Sep 06 00:50:40.483518 ip-10-0-140-57 systemd[1]: Starting Kubernetes Kubelet...
Sep 06 00:50:40.851308 ip-10-0-140-57 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 06 00:50:40.851308 ip-10-0-140-57 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 06 00:50:40.851308 ip-10-0-140-57 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 06 00:50:40.851308 ip-10-0-140-57 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 06 00:50:40.851308 ip-10-0-140-57 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 06 00:50:40.852477 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.852261    2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 06 00:50:40.857506 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857482    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 00:50:40.857506 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857505    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 00:50:40.857506 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857512    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 00:50:40.857671 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857516    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 00:50:40.857671 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857617    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 00:50:40.857671 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857620    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 00:50:40.857671 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857624    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 00:50:40.857671 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857627    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 00:50:40.857671 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857630    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 00:50:40.857671 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857633    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 00:50:40.857671 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857636    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 00:50:40.857671 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857639    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 00:50:40.857671 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857641    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 00:50:40.857671 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857644    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 00:50:40.857671 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857647    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 00:50:40.857671 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857649    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 00:50:40.857671 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857652    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 00:50:40.857671 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857654    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 00:50:40.857671 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857657    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 00:50:40.857671 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857659    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 00:50:40.857671 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857662    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 00:50:40.857671 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857664    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 00:50:40.857671 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857667    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 00:50:40.858152 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857674    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 00:50:40.858152 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857677    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 00:50:40.858152 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857680    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 00:50:40.858152 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857683    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 00:50:40.858152 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857686    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 00:50:40.858152 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857688    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 00:50:40.858152 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857691    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 00:50:40.858152 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857693    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 00:50:40.858152 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857696    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 00:50:40.858152 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857698    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 00:50:40.858152 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857701    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 00:50:40.858152 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857704    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 00:50:40.858152 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857706    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 00:50:40.858152 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857709    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 00:50:40.858152 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857711    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 00:50:40.858152 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857714    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 00:50:40.858152 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857717    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 00:50:40.858152 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857719    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 00:50:40.858152 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857721    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 00:50:40.858152 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857724    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 00:50:40.858648 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857726    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 00:50:40.858648 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857729    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 00:50:40.858648 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857731    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 00:50:40.858648 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857734    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 00:50:40.858648 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857736    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 00:50:40.858648 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857739    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 00:50:40.858648 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857741    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 00:50:40.858648 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857744    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 00:50:40.858648 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857746    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 00:50:40.858648 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857749    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 00:50:40.858648 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857752    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 00:50:40.858648 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857754    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 00:50:40.858648 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857756    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 00:50:40.858648 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857760    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 00:50:40.858648 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857765    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 00:50:40.858648 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857768    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 00:50:40.858648 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857770    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 00:50:40.858648 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857773    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 00:50:40.858648 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857775    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 00:50:40.859143 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857778    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 00:50:40.859143 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857780    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 00:50:40.859143 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857783    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 00:50:40.859143 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857785    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 00:50:40.859143 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857788    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 00:50:40.859143 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857790    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 00:50:40.859143 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857793    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 00:50:40.859143 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857796    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 00:50:40.859143 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857799    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 00:50:40.859143 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857803    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 00:50:40.859143 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857807    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 00:50:40.859143 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857809    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 00:50:40.859143 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857813    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 00:50:40.859143 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857816    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 00:50:40.859143 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857819    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 00:50:40.859143 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857822    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 00:50:40.859143 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857825    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 00:50:40.859143 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857829    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 00:50:40.859143 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857832    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 00:50:40.859613 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857834    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 00:50:40.859613 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857837    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 00:50:40.859613 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857841    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 00:50:40.859613 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857843    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 00:50:40.859613 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857846    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 00:50:40.859613 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857848    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 00:50:40.859613 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857850    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 00:50:40.859613 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857853    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 00:50:40.859613 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857856    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 00:50:40.859613 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857859    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 00:50:40.859613 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857861    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 00:50:40.859613 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857864    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 00:50:40.859613 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857867    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 00:50:40.859613 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857869    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 00:50:40.859613 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857872    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 00:50:40.859613 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857874    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 00:50:40.859613 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857877    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 00:50:40.859613 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.857879    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 00:50:40.859613 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858594    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 00:50:40.860066 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858603    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 00:50:40.860066 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858606    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 00:50:40.860066 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858609    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 00:50:40.860066 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858612    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 00:50:40.860066 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858615    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 00:50:40.860066 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858618    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 00:50:40.860066 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858620    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 00:50:40.860066 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858624    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 00:50:40.860066 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858628    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 00:50:40.860066 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858631    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 00:50:40.860066 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858633    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 00:50:40.860066 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858636    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 00:50:40.860066 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858639    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 00:50:40.860066 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858642    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 00:50:40.860066 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858645    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 00:50:40.860066 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858648    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 00:50:40.860066 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858651    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 00:50:40.860066 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858654    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 00:50:40.860066 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858657    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 00:50:40.860554 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858660    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 00:50:40.860554 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858672    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 00:50:40.860554 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858676    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 00:50:40.860554 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858678    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 00:50:40.860554 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858681    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 00:50:40.860554 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858684    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 00:50:40.860554 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858687    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 00:50:40.860554 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858689    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 00:50:40.860554 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858692    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 00:50:40.860554 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858695    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 00:50:40.860554 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858697    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 00:50:40.860554 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858700    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 00:50:40.860554 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858702    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 00:50:40.860554 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858705    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 00:50:40.860554 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858707    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 00:50:40.860554 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858710    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 00:50:40.860554 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858712    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 00:50:40.860554 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858715    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 00:50:40.860554 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858717    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 00:50:40.861014 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858720    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 00:50:40.861014 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858722    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 00:50:40.861014 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858725    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 00:50:40.861014 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858727    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 00:50:40.861014 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858730    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 00:50:40.861014 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858732    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 00:50:40.861014 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858735    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 00:50:40.861014 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858737    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 00:50:40.861014 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858740    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 00:50:40.861014 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858743    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 00:50:40.861014 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858745    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 00:50:40.861014 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858748    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 00:50:40.861014 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858751    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 00:50:40.861014 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858753    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 00:50:40.861014 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858756    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 00:50:40.861014 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858758    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 00:50:40.861014 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858761    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 00:50:40.861014 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858763    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 00:50:40.861014 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858765    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 00:50:40.861014 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858768    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 00:50:40.861526 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858770    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 00:50:40.861526 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858773    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 00:50:40.861526 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858775    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 00:50:40.861526 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858777    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 00:50:40.861526 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858781    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 00:50:40.861526 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858784    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 00:50:40.861526 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858787    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 00:50:40.861526 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858791    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 00:50:40.861526 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858794    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 00:50:40.861526 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858796    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 00:50:40.861526 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858799    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 00:50:40.861526 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858801    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 00:50:40.861526 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858804    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 00:50:40.861526 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858806    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 00:50:40.861526 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858808    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 00:50:40.861526 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858811    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 00:50:40.861526 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858818    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 00:50:40.861526 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858820    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 00:50:40.861526 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858823    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 00:50:40.861997 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858825    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 00:50:40.861997 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858828    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 00:50:40.861997 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858830    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 00:50:40.861997 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858833    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 00:50:40.861997 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858835    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 00:50:40.861997 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858838    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 00:50:40.861997 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858841    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 00:50:40.861997 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858843    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 00:50:40.861997 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858846    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 00:50:40.861997 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858848    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 00:50:40.861997 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858851    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 00:50:40.861997 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858853    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 00:50:40.861997 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858855    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 00:50:40.861997 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858858    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 00:50:40.861997 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858860    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 00:50:40.861997 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858863    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 00:50:40.861997 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858865    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 00:50:40.861997 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858868    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 00:50:40.861997 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858870    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 00:50:40.861997 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858873    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 00:50:40.862493 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.858875    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 00:50:40.862493 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859219    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 00:50:40.862493 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859225    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 00:50:40.862493 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859229    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 00:50:40.862493 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859232    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 00:50:40.862493 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859235    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 00:50:40.862493 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859237    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 00:50:40.862493 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859260    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 00:50:40.862493 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859263    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 00:50:40.862493 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859267    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 00:50:40.862493 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859270    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 00:50:40.862493 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859272    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 00:50:40.862493 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859275    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 00:50:40.862493 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859278    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 00:50:40.862493 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859280    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 00:50:40.862493 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859282    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 00:50:40.862493 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859285    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 00:50:40.862493 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859288    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 00:50:40.862493 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859291    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 00:50:40.862970 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859294    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 00:50:40.862970 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859297    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 00:50:40.862970 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859299    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 00:50:40.862970 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859302    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 00:50:40.862970 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859305    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 00:50:40.862970 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859307    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 00:50:40.862970 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859310    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 00:50:40.862970 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859312    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 00:50:40.862970 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859314    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 00:50:40.862970 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859317    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 00:50:40.862970 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859320    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 00:50:40.862970 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859322    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 00:50:40.862970 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859324    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 00:50:40.862970 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859327    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 00:50:40.862970 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859329    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 00:50:40.862970 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859331    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 00:50:40.862970 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859334    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 00:50:40.862970 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859337    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 00:50:40.862970 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859339    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 00:50:40.862970 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859342    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 00:50:40.863464 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859344    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 00:50:40.863464 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859347    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 00:50:40.863464 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859350    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 00:50:40.863464 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859353    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 00:50:40.863464 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859355    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 00:50:40.863464 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859357    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 00:50:40.863464 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859360    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 00:50:40.863464 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859362    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 00:50:40.863464 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859365    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 00:50:40.863464 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859367    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 00:50:40.863464 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859370    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 00:50:40.863464 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859373    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 00:50:40.863464 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859375    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 00:50:40.863464 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859378    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 00:50:40.863464 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859380    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 00:50:40.863464 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859383    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 00:50:40.863464 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859385    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 00:50:40.863464 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859387    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 00:50:40.863464 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859390    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 00:50:40.863464 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859392    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 00:50:40.863946 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859395    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 00:50:40.863946 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859397    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 00:50:40.863946 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859400    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 00:50:40.863946 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859403    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 00:50:40.863946 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859405    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 00:50:40.863946 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859408    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 00:50:40.863946 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859410    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 00:50:40.863946 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859412    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 00:50:40.863946 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859415    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 00:50:40.863946 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859418    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 00:50:40.863946 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859420    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 00:50:40.863946 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859423    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 00:50:40.863946 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859425    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 00:50:40.863946 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859428    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 00:50:40.863946 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859431    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 00:50:40.863946 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859434    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 00:50:40.863946 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859437    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 00:50:40.863946 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859440    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 00:50:40.863946 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859443    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 00:50:40.863946 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859446    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 00:50:40.864498 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859448    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 00:50:40.864498 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859451    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 00:50:40.864498 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859453    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 00:50:40.864498 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859456    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 00:50:40.864498 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859459    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 00:50:40.864498 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859461    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 00:50:40.864498 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859463    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 00:50:40.864498 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859466    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 00:50:40.864498 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859469    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 00:50:40.864498 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859472    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 00:50:40.864498 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859474    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 00:50:40.864498 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859476    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 00:50:40.864498 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859479    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 00:50:40.864498 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859481    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 00:50:40.864498 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859483    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 00:50:40.864498 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859486    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 00:50:40.864498 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859488    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 00:50:40.864498 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859491    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 00:50:40.864498 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859493    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 00:50:40.864942 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859495    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 00:50:40.864942 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.859501    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 00:50:40.864942 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859569    2577 flags.go:64] FLAG: --address="0.0.0.0"
Sep 06 00:50:40.864942 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859601    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 06 00:50:40.864942 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859608    2577 flags.go:64] FLAG: --anonymous-auth="true"
Sep 06 00:50:40.864942 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859612    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 06 00:50:40.864942 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859616    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 06 00:50:40.864942 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859620    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 06 00:50:40.864942 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859625    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 06 00:50:40.864942 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859629    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 06 00:50:40.864942 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859632    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 06 00:50:40.864942 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859634    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 06 00:50:40.864942 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859638    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 06 00:50:40.864942 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859641    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 06 00:50:40.864942 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859644    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 06 00:50:40.864942 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859646    2577 flags.go:64] FLAG: --cgroup-root=""
Sep 06 00:50:40.864942 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859649    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 06 00:50:40.864942 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859652    2577 flags.go:64] FLAG: --client-ca-file=""
Sep 06 00:50:40.864942 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859656    2577 flags.go:64] FLAG: --cloud-provider="external"
Sep 06 00:50:40.864942 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859659    2577 flags.go:64] FLAG: --cluster-dns="[]"
Sep 06 00:50:40.864942 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859663    2577 flags.go:64] FLAG: --cluster-domain=""
Sep 06 00:50:40.864942 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859666    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 06 00:50:40.864942 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859669    2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 06 00:50:40.865599 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859672    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 06 00:50:40.865599 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859675    2577 flags.go:64] FLAG: --container-log-max-files="5"
Sep 06 00:50:40.865599 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859679    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 06 00:50:40.865599 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859682    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 06 00:50:40.865599 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859684    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 06 00:50:40.865599 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859687    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 06 00:50:40.865599 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859690    2577 flags.go:64] FLAG: --contention-profiling="false"
Sep 06 00:50:40.865599 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859693    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 06 00:50:40.865599 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859696    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 06 00:50:40.865599 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859699    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 06 00:50:40.865599 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859703    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 06 00:50:40.865599 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859706    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 06 00:50:40.865599 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859709    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 06 00:50:40.865599 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859712    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 06 00:50:40.865599 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859715    2577 flags.go:64] FLAG: --enable-load-reader="false"
Sep 06 00:50:40.865599 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859718    2577 flags.go:64] FLAG: --enable-server="true"
Sep 06 00:50:40.865599 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859722    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 06 00:50:40.865599 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859726    2577 flags.go:64] FLAG: --event-burst="100"
Sep 06 00:50:40.865599 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859729    2577 flags.go:64] FLAG: --event-qps="50"
Sep 06 00:50:40.865599 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859731    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 06 00:50:40.865599 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859734    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 06 00:50:40.865599 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859737    2577 flags.go:64] FLAG: --eviction-hard=""
Sep 06 00:50:40.865599 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859740    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 06 00:50:40.865599 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859743    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 06 00:50:40.866193 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859746    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 06 00:50:40.866193 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859749    2577 flags.go:64] FLAG: --eviction-soft=""
Sep 06 00:50:40.866193 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859752    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 06 00:50:40.866193 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859755    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 06 00:50:40.866193 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859758    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 06 00:50:40.866193 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859761    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 06 00:50:40.866193 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859763    2577 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 06 00:50:40.866193 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859766    2577 flags.go:64] FLAG: --fail-swap-on="true"
Sep 06 00:50:40.866193 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859769    2577 flags.go:64] FLAG: --feature-gates=""
Sep 06 00:50:40.866193 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859772    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 06 00:50:40.866193 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859775    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 06 00:50:40.866193 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859778    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 06 00:50:40.866193 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859781    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 06 00:50:40.866193 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859784    2577 flags.go:64] FLAG: --healthz-port="10248"
Sep 06 00:50:40.866193 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859787    2577 flags.go:64] FLAG: --help="false"
Sep 06 00:50:40.866193 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859790    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-140-57.ec2.internal"
Sep 06 00:50:40.866193 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859792    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 06 00:50:40.866193 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859795    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 06 00:50:40.866193 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859799    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 06 00:50:40.866193 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859803    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 06 00:50:40.866193 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859806    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 06 00:50:40.866193 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859809    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 06 00:50:40.866193 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859811    2577 flags.go:64] FLAG: --image-service-endpoint=""
Sep 06 00:50:40.866900 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859814    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 06 00:50:40.866900 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859818    2577 flags.go:64] FLAG: --kube-api-burst="100"
Sep 06 00:50:40.866900 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859821    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 06 00:50:40.866900 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859824    2577 flags.go:64] FLAG: --kube-api-qps="50"
Sep 06 00:50:40.866900 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859826    2577 flags.go:64] FLAG: --kube-reserved=""
Sep 06 00:50:40.866900 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859829    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 06 00:50:40.866900 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859832    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 06 00:50:40.866900 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859835    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 06 00:50:40.866900 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859837    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 06 00:50:40.866900 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859841    2577 flags.go:64] FLAG: --lock-file=""
Sep 06 00:50:40.866900 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859843    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 06 00:50:40.866900 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859846    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 06 00:50:40.866900 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859849    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 06 00:50:40.866900 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859854    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 06 00:50:40.866900 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859857    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 06 00:50:40.866900 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859859    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 06 00:50:40.866900 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859862    2577 flags.go:64] FLAG: --logging-format="text"
Sep 06 00:50:40.866900 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859865    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 06 00:50:40.866900 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859868    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 06 00:50:40.866900 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859870    2577 flags.go:64] FLAG: --manifest-url=""
Sep 06 00:50:40.866900 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859873    2577 flags.go:64] FLAG: --manifest-url-header=""
Sep 06 00:50:40.866900 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859877    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 06 00:50:40.866900 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859880    2577 flags.go:64] FLAG: --max-open-files="1000000"
Sep 06 00:50:40.866900 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859884    2577 flags.go:64] FLAG: --max-pods="110"
Sep 06 00:50:40.866900 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859886    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 06 00:50:40.867718 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859889    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 06 00:50:40.867718 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859891    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 06 00:50:40.867718 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859896    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 06 00:50:40.867718 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859899    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 06 00:50:40.867718 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859901    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 06 00:50:40.867718 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859904    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 06 00:50:40.867718 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859911    2577 flags.go:64] FLAG: --node-status-max-images="50"
Sep 06 00:50:40.867718 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859914    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 06 00:50:40.867718 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859918    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 06 00:50:40.867718 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859921    2577 flags.go:64] FLAG: --pod-cidr=""
Sep 06 00:50:40.867718 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859923    2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 06 00:50:40.867718 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859928    2577 flags.go:64] FLAG: --pod-manifest-path=""
Sep 06 00:50:40.867718 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859931    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 06 00:50:40.867718 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859934    2577 flags.go:64] FLAG: --pods-per-core="0"
Sep 06 00:50:40.867718 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859937    2577 flags.go:64] FLAG: --port="10250"
Sep 06 00:50:40.867718 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859940    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 06 00:50:40.867718 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859943    2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e55b7aa965e2d619"
Sep 06 00:50:40.867718 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859946    2577 flags.go:64] FLAG: --qos-reserved=""
Sep 06 00:50:40.867718 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859949    2577 flags.go:64] FLAG: --read-only-port="10255"
Sep 06 00:50:40.867718 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859951    2577 flags.go:64] FLAG: --register-node="true"
Sep 06 00:50:40.867718 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859954    2577 flags.go:64] FLAG: --register-with-taints=""
Sep 06 00:50:40.867718 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859958    2577 flags.go:64] FLAG: --registry-burst="10"
Sep 06 00:50:40.867718 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859961    2577 flags.go:64] FLAG: --registry-qps="5"
Sep 06 00:50:40.867718 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859964    2577 flags.go:64] FLAG: --reserved-cpus=""
Sep 06 00:50:40.868759 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859966    2577 flags.go:64] FLAG: --reserved-memory=""
Sep 06 00:50:40.868759 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859969    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 06 00:50:40.868759 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859972    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 06 00:50:40.868759 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859975    2577 flags.go:64] FLAG: --rotate-certificates="false"
Sep 06 00:50:40.868759 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859978    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 06 00:50:40.868759 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859980    2577 flags.go:64] FLAG: --runonce="false"
Sep 06 00:50:40.868759 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859983    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 06 00:50:40.868759 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859986    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 06 00:50:40.868759 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859988    2577 flags.go:64] FLAG: --seccomp-default="false"
Sep 06 00:50:40.868759 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859991    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 06 00:50:40.868759 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859995    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 06 00:50:40.868759 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.859998    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 06 00:50:40.868759 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.860001    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 06 00:50:40.868759 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.860003    2577 flags.go:64] FLAG: --storage-driver-password="root"
Sep 06 00:50:40.868759 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.860006    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 06 00:50:40.868759 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.860009    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 06 00:50:40.868759 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.860012    2577 flags.go:64] FLAG: --storage-driver-user="root"
Sep 06 00:50:40.868759 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.860015    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 06 00:50:40.868759 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.860018    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 06 00:50:40.868759 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.860021    2577 flags.go:64] FLAG: --system-cgroups=""
Sep 06 00:50:40.868759 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.860023    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 06 00:50:40.868759 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.860028    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 06 00:50:40.868759 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.860031    2577 flags.go:64] FLAG: --tls-cert-file=""
Sep 06 00:50:40.868759 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.860034    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 06 00:50:40.868759 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.860038    2577 flags.go:64] FLAG: --tls-min-version=""
Sep 06 00:50:40.869851 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.860041    2577 flags.go:64] FLAG: --tls-private-key-file=""
Sep 06 00:50:40.869851 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.860043    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 06 00:50:40.869851 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.860046    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 06 00:50:40.869851 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.860049    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 06 00:50:40.869851 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.860051    2577 flags.go:64] FLAG: --v="2"
Sep 06 00:50:40.869851 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.860055    2577 flags.go:64] FLAG: --version="false"
Sep 06 00:50:40.869851 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.860059    2577 flags.go:64] FLAG: --vmodule=""
Sep 06 00:50:40.869851 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.860062    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 06 00:50:40.869851 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.860065    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 06 00:50:40.869851 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860199    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 00:50:40.869851 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860203    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 00:50:40.869851 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860206    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 00:50:40.869851 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860208    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 00:50:40.869851 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860211    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 00:50:40.869851 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860214    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 00:50:40.869851 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860217    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 00:50:40.869851 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860220    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 00:50:40.869851 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860224    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 00:50:40.869851 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860227    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 00:50:40.869851 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860229    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 00:50:40.869851 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860232    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 00:50:40.869851 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860235    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 00:50:40.870461 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860237    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 00:50:40.870461 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860257    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 00:50:40.870461 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860260    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 00:50:40.870461 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860263    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 00:50:40.870461 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860266    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 00:50:40.870461 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860268    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 00:50:40.870461 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860271    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 00:50:40.870461 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860273    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 00:50:40.870461 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860276    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 00:50:40.870461 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860278    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 00:50:40.870461 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860282    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 00:50:40.870461 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860285    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 00:50:40.870461 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860288    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 00:50:40.870461 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860291    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 00:50:40.870461 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860294    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 00:50:40.870461 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860296    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 00:50:40.870461 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860298    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 00:50:40.870461 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860302    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 00:50:40.870461 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860304    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 00:50:40.870461 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860307    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 00:50:40.871285 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860309    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 00:50:40.871285 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860311    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 00:50:40.871285 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860314    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 00:50:40.871285 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860317    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 00:50:40.871285 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860319    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 00:50:40.871285 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860321    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 00:50:40.871285 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860325    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 00:50:40.871285 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860330    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 00:50:40.871285 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860333    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 00:50:40.871285 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860336    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 00:50:40.871285 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860340    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 00:50:40.871285 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860342    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 00:50:40.871285 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860345    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 00:50:40.871285 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860348    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 00:50:40.871285 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860350    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 00:50:40.871285 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860353    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 00:50:40.871285 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860355    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 00:50:40.871285 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860358    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 00:50:40.871285 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860361    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 00:50:40.871285 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860363    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 00:50:40.872097 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860366    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 00:50:40.872097 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860368    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 00:50:40.872097 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860371    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 00:50:40.872097 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860373    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 00:50:40.872097 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860376    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 00:50:40.872097 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860378    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 00:50:40.872097 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860380    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 00:50:40.872097 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860383    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 00:50:40.872097 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860385    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 00:50:40.872097 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860388    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 00:50:40.872097 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860390    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 00:50:40.872097 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860393    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 00:50:40.872097 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860396    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 00:50:40.872097 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860398    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 00:50:40.872097 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860400    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 00:50:40.872097 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860403    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 00:50:40.872097 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860405    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 00:50:40.872097 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860408    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 00:50:40.872097 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860410    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 00:50:40.872646 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860414    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 00:50:40.872646 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860416    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 00:50:40.872646 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860419    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 00:50:40.872646 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860421    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 00:50:40.872646 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860424    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 00:50:40.872646 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860426    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 00:50:40.872646 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860429    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 00:50:40.872646 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860431    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 00:50:40.872646 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860434    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 00:50:40.872646 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860436    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 00:50:40.872646 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860438    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 00:50:40.872646 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860441    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 00:50:40.872646 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860443    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 00:50:40.872646 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860446    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 00:50:40.872646 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860448    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 00:50:40.872646 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860450    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 00:50:40.872646 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860453    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 00:50:40.872646 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860455    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 00:50:40.872646 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860457    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 00:50:40.873556 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860460    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 00:50:40.873556 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860462    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 00:50:40.873556 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860464    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 00:50:40.873556 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860467    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 00:50:40.873556 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860469    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 00:50:40.873556 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860473    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 00:50:40.873556 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860475    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 00:50:40.873556 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.860478    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 00:50:40.873556 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.861082    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 06 00:50:40.873556 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.869804    2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 06 00:50:40.873556 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.869839    2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 06 00:50:40.873556 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.870584    2577 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 06 00:50:40.873556 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.870598    2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 06 00:50:40.873556 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870692    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 00:50:40.873556 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870701    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 00:50:40.874133 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870706    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 00:50:40.874133 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870710    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 00:50:40.874133 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870715    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 00:50:40.874133 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870720    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 00:50:40.874133 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870724    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 00:50:40.874133 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870729    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 00:50:40.874133 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870733    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 00:50:40.874133 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870737    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 00:50:40.874133 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870741    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 00:50:40.874133 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870745    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 00:50:40.874133 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870750    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 00:50:40.874133 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870754    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 00:50:40.874133 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870758    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 00:50:40.874133 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870762    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 00:50:40.874133 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870766    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 00:50:40.874133 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870770    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 00:50:40.874133 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870774    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 00:50:40.874133 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870778    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 00:50:40.874133 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870783    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 00:50:40.874133 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870786    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 00:50:40.874793 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870791    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 00:50:40.874793 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870794    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 00:50:40.874793 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870800    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 00:50:40.874793 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870804    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 00:50:40.874793 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870808    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 00:50:40.874793 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870812    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 00:50:40.874793 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870817    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 00:50:40.874793 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870822    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 00:50:40.874793 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870826    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 00:50:40.874793 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870831    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 00:50:40.874793 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870835    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 00:50:40.874793 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870839    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 00:50:40.874793 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870843    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 00:50:40.874793 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870847    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 00:50:40.874793 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870851    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 00:50:40.874793 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870855    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 00:50:40.874793 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870859    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 00:50:40.874793 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870864    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 00:50:40.874793 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870868    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 00:50:40.875310 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870874    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 00:50:40.875310 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870881    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 00:50:40.875310 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870885    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 00:50:40.875310 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870892    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 00:50:40.875310 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870898    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 00:50:40.875310 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870903    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 00:50:40.875310 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870907    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 00:50:40.875310 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870912    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 00:50:40.875310 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870917    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 00:50:40.875310 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870921    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 00:50:40.875310 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870926    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 00:50:40.875310 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870930    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 00:50:40.875310 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870935    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 00:50:40.875310 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870940    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 00:50:40.875310 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870944    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 00:50:40.875310 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870948    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 00:50:40.875310 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870953    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 00:50:40.875310 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870957    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 00:50:40.875801 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870962    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 00:50:40.875801 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870966    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 00:50:40.875801 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870971    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 00:50:40.875801 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870975    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 00:50:40.875801 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870979    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 00:50:40.875801 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870983    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 00:50:40.875801 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870987    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 00:50:40.875801 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870991    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 00:50:40.875801 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870995    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 00:50:40.875801 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.870999    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 00:50:40.875801 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871003    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 00:50:40.875801 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871008    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 00:50:40.875801 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871011    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 00:50:40.875801 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871017    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 00:50:40.875801 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871023    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 00:50:40.875801 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871028    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 00:50:40.875801 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871032    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 00:50:40.875801 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871036    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 00:50:40.875801 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871040    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 00:50:40.875801 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871044    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 00:50:40.876358 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871048    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 00:50:40.876358 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871052    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 00:50:40.876358 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871056    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 00:50:40.876358 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871060    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 00:50:40.876358 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871064    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 00:50:40.876358 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871069    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 00:50:40.876358 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871073    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 00:50:40.876358 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871077    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 00:50:40.876358 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871081    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 00:50:40.876358 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871085    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 00:50:40.876358 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871090    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 00:50:40.876358 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871094    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 00:50:40.876358 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871098    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 00:50:40.876358 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871103    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 00:50:40.876358 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871108    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 00:50:40.876358 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871112    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 00:50:40.876358 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871116    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 00:50:40.876358 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871120    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 00:50:40.876358 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871124    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 00:50:40.876358 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871128    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 00:50:40.876888 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.871136    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 06 00:50:40.876888 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871330    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 00:50:40.876888 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871339    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 00:50:40.876888 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871343    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 00:50:40.876888 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871347    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 00:50:40.876888 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871352    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 00:50:40.876888 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871356    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 00:50:40.876888 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871360    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 00:50:40.876888 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871364    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 00:50:40.876888 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871368    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 00:50:40.876888 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871374    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 00:50:40.876888 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871380    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 00:50:40.876888 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871385    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 00:50:40.876888 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871389    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 00:50:40.877229 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871393    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 00:50:40.877229 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871398    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 00:50:40.877229 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871401    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 00:50:40.877229 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871406    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 00:50:40.877229 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871410    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 00:50:40.877229 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871414    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 00:50:40.877229 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871418    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 00:50:40.877229 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871422    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 00:50:40.877229 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871427    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 00:50:40.877229 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871431    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 00:50:40.877229 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871436    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 00:50:40.877229 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871441    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 00:50:40.877229 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871445    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 00:50:40.877229 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871449    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 00:50:40.877229 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871453    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 00:50:40.877229 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871457    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 00:50:40.877229 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871460    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 00:50:40.877229 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871464    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 00:50:40.877229 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871468    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 00:50:40.877998 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871472    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 00:50:40.877998 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871476    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 00:50:40.877998 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871480    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 00:50:40.877998 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871485    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 00:50:40.877998 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871488    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 00:50:40.877998 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871493    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 00:50:40.877998 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871497    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 00:50:40.877998 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871501    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 00:50:40.877998 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871505    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 00:50:40.877998 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871509    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 00:50:40.877998 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871513    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 00:50:40.877998 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871517    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 00:50:40.877998 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871521    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 00:50:40.877998 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871525    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 00:50:40.877998 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871529    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 00:50:40.877998 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871533    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 00:50:40.877998 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871537    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 00:50:40.877998 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871541    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 00:50:40.877998 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871546    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 00:50:40.878636 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871552    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 00:50:40.878636 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871558    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 00:50:40.878636 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871563    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 00:50:40.878636 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871567    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 00:50:40.878636 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871571    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 00:50:40.878636 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871577    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 00:50:40.878636 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871581    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 00:50:40.878636 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871586    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 00:50:40.878636 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871592    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 00:50:40.878636 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871598    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 00:50:40.878636 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871603    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 00:50:40.878636 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871607    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 00:50:40.878636 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871611    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 00:50:40.878636 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871615    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 00:50:40.878636 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871619    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 00:50:40.878636 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871623    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 00:50:40.878636 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871627    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 00:50:40.878636 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871631    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 00:50:40.878636 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871635    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 00:50:40.879114 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871640    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 00:50:40.879114 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871643    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 00:50:40.879114 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871647    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 00:50:40.879114 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871651    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 00:50:40.879114 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871656    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 00:50:40.879114 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871659    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 00:50:40.879114 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871663    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 00:50:40.879114 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871667    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 00:50:40.879114 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871671    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 00:50:40.879114 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871675    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 00:50:40.879114 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871679    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 00:50:40.879114 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871683    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 00:50:40.879114 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871687    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 00:50:40.879114 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871692    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 00:50:40.879114 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871696    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 00:50:40.879114 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871699    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 00:50:40.879114 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871703    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 00:50:40.879114 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871707    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 00:50:40.879114 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871711    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 00:50:40.879114 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871716    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 00:50:40.879114 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871720    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 00:50:40.879671 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871724    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 00:50:40.879671 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871728    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 00:50:40.879671 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871732    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 00:50:40.879671 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871736    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 00:50:40.879671 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871740    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 00:50:40.879671 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871744    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 00:50:40.879671 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871748    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 00:50:40.879671 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:40.871752    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 00:50:40.879671 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.871759    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 06 00:50:40.879671 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.871903    2577 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 06 00:50:40.879671 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.874493    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 06 00:50:40.879671 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.875365    2577 server.go:1019] "Starting client certificate rotation"
Sep 06 00:50:40.879671 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.875472    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 06 00:50:40.879671 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.875505    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 06 00:50:40.880031 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.877986    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 06 00:50:40.881519 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.881498    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 06 00:50:40.890298 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.890278    2577 log.go:25] "Validated CRI v1 runtime API"
Sep 06 00:50:40.894323 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.894305    2577 log.go:25] "Validated CRI v1 image API"
Sep 06 00:50:40.895836 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.895819    2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 06 00:50:40.898599 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.898582    2577 fs.go:135] Filesystem UUIDs: map[12478a29-b6cc-4ddf-81a6-bbdcdebbffb4:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 e8ebe5ca-3813-4fe9-8290-62e0580eb337:/dev/nvme0n1p3]
Sep 06 00:50:40.898651 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.898600    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 06 00:50:40.903790 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.903677    2577 manager.go:216] Machine: {Timestamp:2026-09-06 00:50:40.902376143 +0000 UTC m=+0.309595629 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099259 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2564b7deb9f8ff6a35a5b7bec47106 SystemUUID:ec2564b7-deb9-f8ff-6a35-a5b7bec47106 BootID:61fe2e8b-76bf-4114-b985-fbf954c69adf Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:98:da:bf:ee:31 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:98:da:bf:ee:31 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:ce:38:b4:55:d3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 06 00:50:40.903790 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.903788    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 06 00:50:40.903897 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.903858    2577 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 06 00:50:40.904426 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.904411    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 06 00:50:40.906897 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.906869    2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 06 00:50:40.907035 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.906900    2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-57.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 06 00:50:40.907616 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.907607    2577 topology_manager.go:138] "Creating topology manager with none policy"
Sep 06 00:50:40.907655 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.907619    2577 container_manager_linux.go:309] "Creating device plugin manager"
Sep 06 00:50:40.907655 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.907626    2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 06 00:50:40.908228 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.908218    2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 06 00:50:40.909470 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.909461    2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 06 00:50:40.913590 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.913578    2577 state_mem.go:36] "Initialized new in-memory state store"
Sep 06 00:50:40.913714 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.913704    2577 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 06 00:50:40.913755 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.913734    2577 kubelet.go:486] "Attempting to sync node with API server"
Sep 06 00:50:40.913755 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.913748    2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 06 00:50:40.913823 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.913762    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 06 00:50:40.913823 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.913776    2577 kubelet.go:398] "Adding apiserver pod source"
Sep 06 00:50:40.913823 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.913788    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 06 00:50:40.914132 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.914119    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 06 00:50:40.914177 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.914144    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 06 00:50:40.916459 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.916443    2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 06 00:50:40.923003 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.918926    2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 06 00:50:40.923003 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.918956    2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 06 00:50:40.923003 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.919129    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 06 00:50:40.923003 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.919142    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 06 00:50:40.923003 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.919149    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 06 00:50:40.923003 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.919154    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 06 00:50:40.923003 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.919162    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 06 00:50:40.923003 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.919167    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 06 00:50:40.923003 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.919483    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 06 00:50:40.923003 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.919490    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 06 00:50:40.923003 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.919497    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 06 00:50:40.923003 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.919502    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 06 00:50:40.923003 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.919511    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 06 00:50:40.923003 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.919519    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 06 00:50:40.923003 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.920813    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 06 00:50:40.923003 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.920820    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 06 00:50:40.924759 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:40.924700    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-57.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 06 00:50:40.924844 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:40.924701    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 06 00:50:40.925559 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.925540    2577 server.go:1268] "Started kubelet"
Sep 06 00:50:40.925691 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.925628    2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 06 00:50:40.925749 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.925681    2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 06 00:50:40.925846 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.925753    2577 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 06 00:50:40.926437 ip-10-0-140-57 systemd[1]: Started Kubernetes Kubelet.
Sep 06 00:50:40.927094 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.927049    2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 06 00:50:40.927648 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.927634    2577 server.go:310] "Adding debug handlers to kubelet server"
Sep 06 00:50:40.928406 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.928388    2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-57.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 06 00:50:40.929648 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:40.929626    2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 06 00:50:40.932137 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.932123    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 06 00:50:40.932729 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.932715    2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 06 00:50:40.932836 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:40.932819    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-57.ec2.internal\" not found"
Sep 06 00:50:40.933397 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.933368    2577 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 06 00:50:40.933397 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.933389    2577 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 06 00:50:40.933397 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.933368    2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 06 00:50:40.933584 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.933448    2577 reconstruct.go:97] "Volume reconstruction finished"
Sep 06 00:50:40.933584 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.933451    2577 factory.go:55] Registering systemd factory
Sep 06 00:50:40.933584 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.933465    2577 factory.go:223] Registration of the systemd container factory successfully
Sep 06 00:50:40.933584 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.933456    2577 reconciler.go:29] "Reconciler: start to sync state"
Sep 06 00:50:40.933749 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.933666    2577 factory.go:153] Registering CRI-O factory
Sep 06 00:50:40.933749 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.933676    2577 factory.go:223] Registration of the crio container factory successfully
Sep 06 00:50:40.933749 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.933718    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 06 00:50:40.933749 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.933736    2577 factory.go:103] Registering Raw factory
Sep 06 00:50:40.933749 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.933748    2577 manager.go:1196] Started watching for new ooms in manager
Sep 06 00:50:40.934058 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.934047    2577 manager.go:349] Starting recovery of all containers
Sep 06 00:50:40.934871 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:40.933776    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-57.ec2.internal.18d29502b7caeaab  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-57.ec2.internal,UID:ip-10-0-140-57.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-57.ec2.internal,},FirstTimestamp:2026-09-06 00:50:40.925510315 +0000 UTC m=+0.332729803,LastTimestamp:2026-09-06 00:50:40.925510315 +0000 UTC m=+0.332729803,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-57.ec2.internal,}"
Sep 06 00:50:40.937275 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.936618    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mbnsn"
Sep 06 00:50:40.937728 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:40.937692    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 06 00:50:40.937822 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:40.937799    2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-57.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 06 00:50:40.944039 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.944009    2577 manager.go:354] Recovery completed
Sep 06 00:50:40.947180 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.947159    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mbnsn"
Sep 06 00:50:40.950352 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.950337    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 00:50:40.952284 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.952269    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 00:50:40.952341 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.952297    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 00:50:40.952341 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.952308    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeHasSufficientPID"
Sep 06 00:50:40.952802 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.952785    2577 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 06 00:50:40.952873 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.952803    2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 06 00:50:40.952873 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.952821    2577 state_mem.go:36] "Initialized new in-memory state store"
Sep 06 00:50:40.952873 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.952834    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 00:50:40.953509 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.953495    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 00:50:40.953574 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.953526    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 00:50:40.953574 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.953542    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeHasSufficientPID"
Sep 06 00:50:40.954268 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:40.954169    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-57.ec2.internal.18d29502b96374c8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-57.ec2.internal,UID:ip-10-0-140-57.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-57.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-57.ec2.internal,},FirstTimestamp:2026-09-06 00:50:40.95228436 +0000 UTC m=+0.359503846,LastTimestamp:2026-09-06 00:50:40.95228436 +0000 UTC m=+0.359503846,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-57.ec2.internal,}"
Sep 06 00:50:40.954721 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.954709    2577 policy_none.go:49] "None policy: Start"
Sep 06 00:50:40.954760 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.954726    2577 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 06 00:50:40.954760 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.954736    2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 06 00:50:40.956583 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.956570    2577 policy_none.go:47] "Start"
Sep 06 00:50:41.016387 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.997623    2577 manager.go:337] "Starting Device Plugin manager"
Sep 06 00:50:41.016387 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:40.997655    2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 06 00:50:41.016387 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.997665    2577 server.go:87] "Starting device plugin registration server"
Sep 06 00:50:41.016387 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.997897    2577 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 06 00:50:41.016387 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.997911    2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 06 00:50:41.016387 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.998060    2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 06 00:50:41.016387 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.998152    2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 06 00:50:41.016387 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:40.998161    2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 06 00:50:41.016387 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:40.998809    2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 06 00:50:41.016387 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:40.998856    2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-57.ec2.internal\" not found"
Sep 06 00:50:41.030003 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.029971    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 06 00:50:41.031299 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.031283    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 06 00:50:41.031382 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.031327    2577 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 06 00:50:41.031382 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.031350    2577 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 06 00:50:41.031458 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:41.031415    2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 06 00:50:41.033052 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.033036    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 00:50:41.098383 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.098365    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 00:50:41.099198 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.099179    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 00:50:41.099318 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.099210    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 00:50:41.099318 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.099224    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeHasSufficientPID"
Sep 06 00:50:41.099318 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.099308    2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-57.ec2.internal"
Sep 06 00:50:41.107221 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.107174    2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-57.ec2.internal"
Sep 06 00:50:41.107221 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:41.107197    2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-57.ec2.internal\": node \"ip-10-0-140-57.ec2.internal\" not found"
Sep 06 00:50:41.123960 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:41.123938    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-57.ec2.internal\" not found"
Sep 06 00:50:41.132479 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.132451    2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-57.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-57.ec2.internal"]
Sep 06 00:50:41.132560 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.132519    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 00:50:41.133343 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.133327    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 00:50:41.133415 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.133355    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 00:50:41.133415 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.133368    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeHasSufficientPID"
Sep 06 00:50:41.134543 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.134526    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e51dd1d48421ec025c1694f8cabaffd2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-57.ec2.internal\" (UID: \"e51dd1d48421ec025c1694f8cabaffd2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-57.ec2.internal"
Sep 06 00:50:41.134626 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.134549    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e51dd1d48421ec025c1694f8cabaffd2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-57.ec2.internal\" (UID: \"e51dd1d48421ec025c1694f8cabaffd2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-57.ec2.internal"
Sep 06 00:50:41.135280 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.135267    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 00:50:41.135338 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.135327    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-57.ec2.internal"
Sep 06 00:50:41.135380 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.135354    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 00:50:41.136002 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.135986    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 00:50:41.136002 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.135997    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 00:50:41.136123 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.136018    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 00:50:41.136123 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.136020    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 00:50:41.136123 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.136029    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeHasSufficientPID"
Sep 06 00:50:41.136123 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.136044    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeHasSufficientPID"
Sep 06 00:50:41.137698 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.137684    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-57.ec2.internal"
Sep 06 00:50:41.137751 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.137709    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 00:50:41.138344 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.138328    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 00:50:41.138418 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.138360    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 00:50:41.138418 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.138375    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeHasSufficientPID"
Sep 06 00:50:41.171794 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:41.171778    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-57.ec2.internal\" not found" node="ip-10-0-140-57.ec2.internal"
Sep 06 00:50:41.176032 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:41.176012    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-57.ec2.internal\" not found" node="ip-10-0-140-57.ec2.internal"
Sep 06 00:50:41.224757 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:41.224731    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-57.ec2.internal\" not found"
Sep 06 00:50:41.234830 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.234811    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6098c4696f62080d6b73924491e58881-config\") pod \"kube-apiserver-proxy-ip-10-0-140-57.ec2.internal\" (UID: \"6098c4696f62080d6b73924491e58881\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-57.ec2.internal"
Sep 06 00:50:41.234912 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.234854    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e51dd1d48421ec025c1694f8cabaffd2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-57.ec2.internal\" (UID: \"e51dd1d48421ec025c1694f8cabaffd2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-57.ec2.internal"
Sep 06 00:50:41.234951 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.234910    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e51dd1d48421ec025c1694f8cabaffd2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-57.ec2.internal\" (UID: \"e51dd1d48421ec025c1694f8cabaffd2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-57.ec2.internal"
Sep 06 00:50:41.234951 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.234943    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e51dd1d48421ec025c1694f8cabaffd2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-57.ec2.internal\" (UID: \"e51dd1d48421ec025c1694f8cabaffd2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-57.ec2.internal"
Sep 06 00:50:41.235021 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.234982    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e51dd1d48421ec025c1694f8cabaffd2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-57.ec2.internal\" (UID: \"e51dd1d48421ec025c1694f8cabaffd2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-57.ec2.internal"
Sep 06 00:50:41.325706 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:41.325678    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-57.ec2.internal\" not found"
Sep 06 00:50:41.335996 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.335975    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6098c4696f62080d6b73924491e58881-config\") pod \"kube-apiserver-proxy-ip-10-0-140-57.ec2.internal\" (UID: \"6098c4696f62080d6b73924491e58881\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-57.ec2.internal"
Sep 06 00:50:41.336068 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.336010    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6098c4696f62080d6b73924491e58881-config\") pod \"kube-apiserver-proxy-ip-10-0-140-57.ec2.internal\" (UID: \"6098c4696f62080d6b73924491e58881\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-57.ec2.internal"
Sep 06 00:50:41.426438 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:41.426373    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-57.ec2.internal\" not found"
Sep 06 00:50:41.474836 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.474812    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-57.ec2.internal"
Sep 06 00:50:41.479817 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.479097    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-57.ec2.internal"
Sep 06 00:50:41.527360 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:41.527218    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-57.ec2.internal\" not found"
Sep 06 00:50:41.627749 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:41.627726    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-57.ec2.internal\" not found"
Sep 06 00:50:41.728239 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:41.728190    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-57.ec2.internal\" not found"
Sep 06 00:50:41.828749 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:41.828724    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-57.ec2.internal\" not found"
Sep 06 00:50:41.875182 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.875156    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 06 00:50:41.875732 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.875340    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 06 00:50:41.928799 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:41.928775    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-57.ec2.internal\" not found"
Sep 06 00:50:41.950009 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.949979    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-05 00:45:42 +0000 UTC" deadline="2028-06-12 00:03:01.79659132 +0000 UTC"
Sep 06 00:50:41.950009 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.950008    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15479h12m19.846587245s"
Sep 06 00:50:41.964585 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:41.964565    2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 00:50:42.029492 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:42.029410    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-57.ec2.internal\" not found"
Sep 06 00:50:42.087632 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:42.087597    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6098c4696f62080d6b73924491e58881.slice/crio-9dbf1f80f32d04128a7ae2c262f4eb28c90657240c15c8bce42bf2c6cb566eb8 WatchSource:0}: Error finding container 9dbf1f80f32d04128a7ae2c262f4eb28c90657240c15c8bce42bf2c6cb566eb8: Status 404 returned error can't find the container with id 9dbf1f80f32d04128a7ae2c262f4eb28c90657240c15c8bce42bf2c6cb566eb8
Sep 06 00:50:42.088299 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:42.088277    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode51dd1d48421ec025c1694f8cabaffd2.slice/crio-a90a455bccffd1bc1689f2e19e9116f69ce78370609e9c63e448f4974a5c9230 WatchSource:0}: Error finding container a90a455bccffd1bc1689f2e19e9116f69ce78370609e9c63e448f4974a5c9230: Status 404 returned error can't find the container with id a90a455bccffd1bc1689f2e19e9116f69ce78370609e9c63e448f4974a5c9230
Sep 06 00:50:42.092088 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:42.092070    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 00:50:42.130297 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:42.130279    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-57.ec2.internal\" not found"
Sep 06 00:50:42.230816 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:42.230794    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-57.ec2.internal\" not found"
Sep 06 00:50:42.249177 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:42.249154    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 00:50:42.331875 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:42.331816    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-57.ec2.internal\" not found"
Sep 06 00:50:42.416698 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:42.416671    2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 00:50:42.433038 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:42.433013    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-57.ec2.internal"
Sep 06 00:50:42.443865 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:42.443849    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 06 00:50:42.444662 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:42.444651    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-57.ec2.internal"
Sep 06 00:50:42.453117 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:42.453096    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 06 00:50:44.286485 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.286456    2577 apiserver.go:52] "Watching apiserver"
Sep 06 00:50:44.298538 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.298511    2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 06 00:50:44.299552 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.299529    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-ww88t","openshift-network-diagnostics/network-check-target-wfwc6","kube-system/global-pull-secret-syncer-tc782","openshift-cluster-node-tuning-operator/tuned-5tp8t","openshift-image-registry/node-ca-gk6l5","openshift-multus/multus-additional-cni-plugins-jv24f","openshift-multus/network-metrics-daemon-d7gvz","openshift-network-operator/iptables-alerter-wvtqk","openshift-ovn-kubernetes/ovnkube-node-j2z66","kube-system/konnectivity-agent-ks4rt","kube-system/kube-apiserver-proxy-ip-10-0-140-57.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78nm","openshift-dns/node-resolver-w9xwb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-57.ec2.internal"]
Sep 06 00:50:44.302013 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.301991    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7gvz"
Sep 06 00:50:44.302119 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:44.302091    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7gvz" podUID="8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528"
Sep 06 00:50:44.303964 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.303947    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 06 00:50:44.304102 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.304078    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w9xwb"
Sep 06 00:50:44.306257 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.306240    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 06 00:50:44.306491 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.306477    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-n7hjk\""
Sep 06 00:50:44.306660 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.306645    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 06 00:50:44.308301 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.308052    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:50:44.308301 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:44.308134    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc782" podUID="7270e6a0-6c6a-410a-b615-5cb276ebf879"
Sep 06 00:50:44.310157 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.310139    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.313412 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.312385    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 06 00:50:44.313412 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.312450    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 06 00:50:44.313412 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.312512    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 06 00:50:44.313412 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.312572    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vgddn\""
Sep 06 00:50:44.313412 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.312671    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gk6l5"
Sep 06 00:50:44.314757 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.314739    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 06 00:50:44.314757 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.314751    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 06 00:50:44.315022 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.315005    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 06 00:50:44.315091 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.315006    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8lbrd\""
Sep 06 00:50:44.315430 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.315413    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jv24f"
Sep 06 00:50:44.317208 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.317185    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx4pl\" (UniqueName: \"kubernetes.io/projected/07e0007b-c474-48f7-9bdc-91218d4e681e-kube-api-access-cx4pl\") pod \"node-resolver-w9xwb\" (UID: \"07e0007b-c474-48f7-9bdc-91218d4e681e\") " pod="openshift-dns/node-resolver-w9xwb"
Sep 06 00:50:44.317289 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.317240    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7270e6a0-6c6a-410a-b615-5cb276ebf879-kubelet-config\") pod \"global-pull-secret-syncer-tc782\" (UID: \"7270e6a0-6c6a-410a-b615-5cb276ebf879\") " pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:50:44.317289 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.317277    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bg5rn\" (UniqueName: \"kubernetes.io/projected/8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528-kube-api-access-bg5rn\") pod \"network-metrics-daemon-d7gvz\" (UID: \"8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528\") " pod="openshift-multus/network-metrics-daemon-d7gvz"
Sep 06 00:50:44.317403 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.317306    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/07e0007b-c474-48f7-9bdc-91218d4e681e-hosts-file\") pod \"node-resolver-w9xwb\" (UID: \"07e0007b-c474-48f7-9bdc-91218d4e681e\") " pod="openshift-dns/node-resolver-w9xwb"
Sep 06 00:50:44.317403 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.317377    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07e0007b-c474-48f7-9bdc-91218d4e681e-tmp-dir\") pod \"node-resolver-w9xwb\" (UID: \"07e0007b-c474-48f7-9bdc-91218d4e681e\") " pod="openshift-dns/node-resolver-w9xwb"
Sep 06 00:50:44.317403 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.317394    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7270e6a0-6c6a-410a-b615-5cb276ebf879-dbus\") pod \"global-pull-secret-syncer-tc782\" (UID: \"7270e6a0-6c6a-410a-b615-5cb276ebf879\") " pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:50:44.317528 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.317428    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7270e6a0-6c6a-410a-b615-5cb276ebf879-original-pull-secret\") pod \"global-pull-secret-syncer-tc782\" (UID: \"7270e6a0-6c6a-410a-b615-5cb276ebf879\") " pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:50:44.317528 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.317449    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528-metrics-certs\") pod \"network-metrics-daemon-d7gvz\" (UID: \"8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528\") " pod="openshift-multus/network-metrics-daemon-d7gvz"
Sep 06 00:50:44.319168 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.318290    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.319168 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.319017    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 06 00:50:44.319168 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.319019    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 06 00:50:44.319569 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.319532    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 06 00:50:44.319671 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.319639    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 06 00:50:44.319671 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.319660    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-p9qps\""
Sep 06 00:50:44.319801 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.319762    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 06 00:50:44.322431 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.321422    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.322431 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.321686    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 06 00:50:44.322431 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.321724    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 06 00:50:44.322431 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.321865    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 06 00:50:44.322431 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.321886    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 06 00:50:44.322431 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.322046    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ggz6l\""
Sep 06 00:50:44.322431 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.322194    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 06 00:50:44.322431 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.322287    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 06 00:50:44.323269 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.323247    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 06 00:50:44.323387 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.323338    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fq8l4\""
Sep 06 00:50:44.325142 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.325124    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfwc6"
Sep 06 00:50:44.325214 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:44.325192    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfwc6" podUID="31067da9-3ebb-40fc-b24e-34ccd0f5f3fd"
Sep 06 00:50:44.327540 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.327415    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ks4rt"
Sep 06 00:50:44.330086 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.329736    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 06 00:50:44.330086 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.329814    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-h8fgp\""
Sep 06 00:50:44.330086 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.329943    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 06 00:50:44.330281 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.330260    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wvtqk"
Sep 06 00:50:44.332389 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.332375    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 06 00:50:44.335661 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.332832    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 06 00:50:44.335661 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.332423    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 06 00:50:44.335661 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.332386    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cj6x7\""
Sep 06 00:50:44.336368 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.336351    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78nm"
Sep 06 00:50:44.338683 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.338306    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 00:50:44.338683 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.338354    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 06 00:50:44.338683 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.338425    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 06 00:50:44.338683 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.338559    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-l6c2f\""
Sep 06 00:50:44.338683 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.338629    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 06 00:50:44.341186 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.341160    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-78xw2"
Sep 06 00:50:44.351288 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.350372    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-78xw2"
Sep 06 00:50:44.405999 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.405976    2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 06 00:50:44.408135 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.408090    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-57.ec2.internal" event={"ID":"e51dd1d48421ec025c1694f8cabaffd2","Type":"ContainerStarted","Data":"a90a455bccffd1bc1689f2e19e9116f69ce78370609e9c63e448f4974a5c9230"}
Sep 06 00:50:44.409669 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.409644    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-57.ec2.internal" event={"ID":"6098c4696f62080d6b73924491e58881","Type":"ContainerStarted","Data":"9dbf1f80f32d04128a7ae2c262f4eb28c90657240c15c8bce42bf2c6cb566eb8"}
Sep 06 00:50:44.418363 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.418339    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/620c23ce-8e99-4b25-88ea-862c99c5dba3-etc-kubernetes\") pod \"tuned-5tp8t\" (UID: \"620c23ce-8e99-4b25-88ea-862c99c5dba3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.418458 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.418377    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/079a153a-9b55-4225-8928-cd8a28906fd3-multus-daemon-config\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.418458 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.418405    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2vkp\" (UniqueName: \"kubernetes.io/projected/31067da9-3ebb-40fc-b24e-34ccd0f5f3fd-kube-api-access-h2vkp\") pod \"network-check-target-wfwc6\" (UID: \"31067da9-3ebb-40fc-b24e-34ccd0f5f3fd\") " pod="openshift-network-diagnostics/network-check-target-wfwc6"
Sep 06 00:50:44.418458 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.418432    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/500d4399-6afb-424e-8cc2-b17de185462c-agent-certs\") pod \"konnectivity-agent-ks4rt\" (UID: \"500d4399-6afb-424e-8cc2-b17de185462c\") " pod="kube-system/konnectivity-agent-ks4rt"
Sep 06 00:50:44.418620 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.418455    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/500d4399-6afb-424e-8cc2-b17de185462c-konnectivity-ca\") pod \"konnectivity-agent-ks4rt\" (UID: \"500d4399-6afb-424e-8cc2-b17de185462c\") " pod="kube-system/konnectivity-agent-ks4rt"
Sep 06 00:50:44.418620 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.418479    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-run-openvswitch\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.418620 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.418502    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-log-socket\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.418620 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.418525    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtcj7\" (UniqueName: \"kubernetes.io/projected/079a153a-9b55-4225-8928-cd8a28906fd3-kube-api-access-qtcj7\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.418620 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.418554    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a199e00-e8e6-4ac4-93c6-cfa4d3701ced-host-slash\") pod \"iptables-alerter-wvtqk\" (UID: \"9a199e00-e8e6-4ac4-93c6-cfa4d3701ced\") " pod="openshift-network-operator/iptables-alerter-wvtqk"
Sep 06 00:50:44.418620 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.418577    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-host-slash\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.418620 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.418601    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/079a153a-9b55-4225-8928-cd8a28906fd3-hostroot\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.418954 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.418625    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2c9e3cd8-83aa-40b9-a844-65a7a157c377-cni-binary-copy\") pod \"multus-additional-cni-plugins-jv24f\" (UID: \"2c9e3cd8-83aa-40b9-a844-65a7a157c377\") " pod="openshift-multus/multus-additional-cni-plugins-jv24f"
Sep 06 00:50:44.418954 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.418648    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c85785bd-cd1f-47c0-bd9f-167af4cc20dc-socket-dir\") pod \"aws-ebs-csi-driver-node-p78nm\" (UID: \"c85785bd-cd1f-47c0-bd9f-167af4cc20dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78nm"
Sep 06 00:50:44.418954 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.418675    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c85785bd-cd1f-47c0-bd9f-167af4cc20dc-registration-dir\") pod \"aws-ebs-csi-driver-node-p78nm\" (UID: \"c85785bd-cd1f-47c0-bd9f-167af4cc20dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78nm"
Sep 06 00:50:44.418954 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.418704    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/620c23ce-8e99-4b25-88ea-862c99c5dba3-sys\") pod \"tuned-5tp8t\" (UID: \"620c23ce-8e99-4b25-88ea-862c99c5dba3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.418954 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.418728    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/079a153a-9b55-4225-8928-cd8a28906fd3-host-var-lib-kubelet\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.418954 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.418750    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-run-ovn\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.418954 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.418773    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-host-cni-netd\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.418954 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.418802    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c85785bd-cd1f-47c0-bd9f-167af4cc20dc-device-dir\") pod \"aws-ebs-csi-driver-node-p78nm\" (UID: \"c85785bd-cd1f-47c0-bd9f-167af4cc20dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78nm"
Sep 06 00:50:44.418954 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.418824    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/620c23ce-8e99-4b25-88ea-862c99c5dba3-host\") pod \"tuned-5tp8t\" (UID: \"620c23ce-8e99-4b25-88ea-862c99c5dba3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.418954 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.418847    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/079a153a-9b55-4225-8928-cd8a28906fd3-host-var-lib-cni-bin\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.418954 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.418869    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/079a153a-9b55-4225-8928-cd8a28906fd3-host-run-multus-certs\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.418954 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.418904    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg5rn\" (UniqueName: \"kubernetes.io/projected/8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528-kube-api-access-bg5rn\") pod \"network-metrics-daemon-d7gvz\" (UID: \"8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528\") " pod="openshift-multus/network-metrics-daemon-d7gvz"
Sep 06 00:50:44.418954 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.418927    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e100e633-d18a-4d68-9c81-0ff379c12d2f-ovn-node-metrics-cert\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.418954 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.418949    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/620c23ce-8e99-4b25-88ea-862c99c5dba3-etc-systemd\") pod \"tuned-5tp8t\" (UID: \"620c23ce-8e99-4b25-88ea-862c99c5dba3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.419637 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.418972    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/620c23ce-8e99-4b25-88ea-862c99c5dba3-etc-tuned\") pod \"tuned-5tp8t\" (UID: \"620c23ce-8e99-4b25-88ea-862c99c5dba3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.419637 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.418996    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/079a153a-9b55-4225-8928-cd8a28906fd3-etc-kubernetes\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.419637 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.419033    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx4pl\" (UniqueName: \"kubernetes.io/projected/07e0007b-c474-48f7-9bdc-91218d4e681e-kube-api-access-cx4pl\") pod \"node-resolver-w9xwb\" (UID: \"07e0007b-c474-48f7-9bdc-91218d4e681e\") " pod="openshift-dns/node-resolver-w9xwb"
Sep 06 00:50:44.419637 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.419059    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm5mx\" (UniqueName: \"kubernetes.io/projected/2c9e3cd8-83aa-40b9-a844-65a7a157c377-kube-api-access-fm5mx\") pod \"multus-additional-cni-plugins-jv24f\" (UID: \"2c9e3cd8-83aa-40b9-a844-65a7a157c377\") " pod="openshift-multus/multus-additional-cni-plugins-jv24f"
Sep 06 00:50:44.419637 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.419087    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/620c23ce-8e99-4b25-88ea-862c99c5dba3-lib-modules\") pod \"tuned-5tp8t\" (UID: \"620c23ce-8e99-4b25-88ea-862c99c5dba3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.419637 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.419109    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/620c23ce-8e99-4b25-88ea-862c99c5dba3-var-lib-kubelet\") pod \"tuned-5tp8t\" (UID: \"620c23ce-8e99-4b25-88ea-862c99c5dba3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.419637 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.419132    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9zvb\" (UniqueName: \"kubernetes.io/projected/bcd87c76-22e5-4905-bb95-d1acd077ceff-kube-api-access-z9zvb\") pod \"node-ca-gk6l5\" (UID: \"bcd87c76-22e5-4905-bb95-d1acd077ceff\") " pod="openshift-image-registry/node-ca-gk6l5"
Sep 06 00:50:44.419637 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.419155    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/079a153a-9b55-4225-8928-cd8a28906fd3-cnibin\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.419637 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.419181    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-var-lib-openvswitch\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.419637 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.419210    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c85785bd-cd1f-47c0-bd9f-167af4cc20dc-etc-selinux\") pod \"aws-ebs-csi-driver-node-p78nm\" (UID: \"c85785bd-cd1f-47c0-bd9f-167af4cc20dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78nm"
Sep 06 00:50:44.419637 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.419232    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/620c23ce-8e99-4b25-88ea-862c99c5dba3-etc-sysctl-d\") pod \"tuned-5tp8t\" (UID: \"620c23ce-8e99-4b25-88ea-862c99c5dba3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.419637 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.419253    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/620c23ce-8e99-4b25-88ea-862c99c5dba3-tmp\") pod \"tuned-5tp8t\" (UID: \"620c23ce-8e99-4b25-88ea-862c99c5dba3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.419637 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.419279    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528-metrics-certs\") pod \"network-metrics-daemon-d7gvz\" (UID: \"8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528\") " pod="openshift-multus/network-metrics-daemon-d7gvz"
Sep 06 00:50:44.419637 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.419303    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9a199e00-e8e6-4ac4-93c6-cfa4d3701ced-iptables-alerter-script\") pod \"iptables-alerter-wvtqk\" (UID: \"9a199e00-e8e6-4ac4-93c6-cfa4d3701ced\") " pod="openshift-network-operator/iptables-alerter-wvtqk"
Sep 06 00:50:44.419637 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.419344    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-host-run-netns\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.419637 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.419368    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e100e633-d18a-4d68-9c81-0ff379c12d2f-env-overrides\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.420473 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.419390    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/620c23ce-8e99-4b25-88ea-862c99c5dba3-etc-sysctl-conf\") pod \"tuned-5tp8t\" (UID: \"620c23ce-8e99-4b25-88ea-862c99c5dba3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.420473 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.419413    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/079a153a-9b55-4225-8928-cd8a28906fd3-multus-conf-dir\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.420473 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.419451    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07e0007b-c474-48f7-9bdc-91218d4e681e-tmp-dir\") pod \"node-resolver-w9xwb\" (UID: \"07e0007b-c474-48f7-9bdc-91218d4e681e\") " pod="openshift-dns/node-resolver-w9xwb"
Sep 06 00:50:44.420473 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.419474    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7270e6a0-6c6a-410a-b615-5cb276ebf879-dbus\") pod \"global-pull-secret-syncer-tc782\" (UID: \"7270e6a0-6c6a-410a-b615-5cb276ebf879\") " pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:50:44.420473 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.419501    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc6b2\" (UniqueName: \"kubernetes.io/projected/9a199e00-e8e6-4ac4-93c6-cfa4d3701ced-kube-api-access-jc6b2\") pod \"iptables-alerter-wvtqk\" (UID: \"9a199e00-e8e6-4ac4-93c6-cfa4d3701ced\") " pod="openshift-network-operator/iptables-alerter-wvtqk"
Sep 06 00:50:44.420473 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.419527    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2c9e3cd8-83aa-40b9-a844-65a7a157c377-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jv24f\" (UID: \"2c9e3cd8-83aa-40b9-a844-65a7a157c377\") " pod="openshift-multus/multus-additional-cni-plugins-jv24f"
Sep 06 00:50:44.420473 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.419552    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2c9e3cd8-83aa-40b9-a844-65a7a157c377-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jv24f\" (UID: \"2c9e3cd8-83aa-40b9-a844-65a7a157c377\") " pod="openshift-multus/multus-additional-cni-plugins-jv24f"
Sep 06 00:50:44.420473 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.419576    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/620c23ce-8e99-4b25-88ea-862c99c5dba3-run\") pod \"tuned-5tp8t\" (UID: \"620c23ce-8e99-4b25-88ea-862c99c5dba3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.420473 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.419599    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjlvh\" (UniqueName: \"kubernetes.io/projected/620c23ce-8e99-4b25-88ea-862c99c5dba3-kube-api-access-cjlvh\") pod \"tuned-5tp8t\" (UID: \"620c23ce-8e99-4b25-88ea-862c99c5dba3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.420473 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.419626    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/079a153a-9b55-4225-8928-cd8a28906fd3-host-run-k8s-cni-cncf-io\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.420473 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.419649    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bcd87c76-22e5-4905-bb95-d1acd077ceff-serviceca\") pod \"node-ca-gk6l5\" (UID: \"bcd87c76-22e5-4905-bb95-d1acd077ceff\") " pod="openshift-image-registry/node-ca-gk6l5"
Sep 06 00:50:44.420473 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.419674    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/079a153a-9b55-4225-8928-cd8a28906fd3-cni-binary-copy\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.420473 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.419698    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/079a153a-9b55-4225-8928-cd8a28906fd3-multus-socket-dir-parent\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.420473 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.419722    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-systemd-units\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.420473 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.419745    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/079a153a-9b55-4225-8928-cd8a28906fd3-system-cni-dir\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.420473 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.419771    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c9e3cd8-83aa-40b9-a844-65a7a157c377-system-cni-dir\") pod \"multus-additional-cni-plugins-jv24f\" (UID: \"2c9e3cd8-83aa-40b9-a844-65a7a157c377\") " pod="openshift-multus/multus-additional-cni-plugins-jv24f"
Sep 06 00:50:44.421104 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.419822    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-etc-openvswitch\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.421104 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.419848    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-node-log\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.421104 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.419873    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c85785bd-cd1f-47c0-bd9f-167af4cc20dc-sys-fs\") pod \"aws-ebs-csi-driver-node-p78nm\" (UID: \"c85785bd-cd1f-47c0-bd9f-167af4cc20dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78nm"
Sep 06 00:50:44.421104 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.419910    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/620c23ce-8e99-4b25-88ea-862c99c5dba3-etc-sysconfig\") pod \"tuned-5tp8t\" (UID: \"620c23ce-8e99-4b25-88ea-862c99c5dba3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.421104 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.419942    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bcd87c76-22e5-4905-bb95-d1acd077ceff-host\") pod \"node-ca-gk6l5\" (UID: \"bcd87c76-22e5-4905-bb95-d1acd077ceff\") " pod="openshift-image-registry/node-ca-gk6l5"
Sep 06 00:50:44.421104 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.420168    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/079a153a-9b55-4225-8928-cd8a28906fd3-multus-cni-dir\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.421104 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.420200    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7270e6a0-6c6a-410a-b615-5cb276ebf879-kubelet-config\") pod \"global-pull-secret-syncer-tc782\" (UID: \"7270e6a0-6c6a-410a-b615-5cb276ebf879\") " pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:50:44.421104 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.420225    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2c9e3cd8-83aa-40b9-a844-65a7a157c377-cnibin\") pod \"multus-additional-cni-plugins-jv24f\" (UID: \"2c9e3cd8-83aa-40b9-a844-65a7a157c377\") " pod="openshift-multus/multus-additional-cni-plugins-jv24f"
Sep 06 00:50:44.421104 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.420251    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-host-kubelet\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.421104 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.420268    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-run-systemd\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.421104 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.420283    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c85785bd-cd1f-47c0-bd9f-167af4cc20dc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p78nm\" (UID: \"c85785bd-cd1f-47c0-bd9f-167af4cc20dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78nm"
Sep 06 00:50:44.421104 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.420302    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck8cc\" (UniqueName: \"kubernetes.io/projected/c85785bd-cd1f-47c0-bd9f-167af4cc20dc-kube-api-access-ck8cc\") pod \"aws-ebs-csi-driver-node-p78nm\" (UID: \"c85785bd-cd1f-47c0-bd9f-167af4cc20dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78nm"
Sep 06 00:50:44.421104 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.420343    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/079a153a-9b55-4225-8928-cd8a28906fd3-host-run-netns\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.421104 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.420364    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/079a153a-9b55-4225-8928-cd8a28906fd3-host-var-lib-cni-multus\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.421104 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.420393    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/07e0007b-c474-48f7-9bdc-91218d4e681e-hosts-file\") pod \"node-resolver-w9xwb\" (UID: \"07e0007b-c474-48f7-9bdc-91218d4e681e\") " pod="openshift-dns/node-resolver-w9xwb"
Sep 06 00:50:44.421104 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.420426    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7270e6a0-6c6a-410a-b615-5cb276ebf879-original-pull-secret\") pod \"global-pull-secret-syncer-tc782\" (UID: \"7270e6a0-6c6a-410a-b615-5cb276ebf879\") " pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:50:44.421754 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.420453    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2c9e3cd8-83aa-40b9-a844-65a7a157c377-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jv24f\" (UID: \"2c9e3cd8-83aa-40b9-a844-65a7a157c377\") " pod="openshift-multus/multus-additional-cni-plugins-jv24f"
Sep 06 00:50:44.421754 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.420478    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-host-run-ovn-kubernetes\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.421754 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.420505    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.421754 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.420532    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e100e633-d18a-4d68-9c81-0ff379c12d2f-ovnkube-config\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.421754 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.420558    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e100e633-d18a-4d68-9c81-0ff379c12d2f-ovnkube-script-lib\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.421754 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.420598    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-host-cni-bin\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.421754 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.420630    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq4zn\" (UniqueName: \"kubernetes.io/projected/e100e633-d18a-4d68-9c81-0ff379c12d2f-kube-api-access-hq4zn\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.421754 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.420662    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/620c23ce-8e99-4b25-88ea-862c99c5dba3-etc-modprobe-d\") pod \"tuned-5tp8t\" (UID: \"620c23ce-8e99-4b25-88ea-862c99c5dba3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.421754 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:44.420763    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 00:50:44.421754 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:44.420837    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528-metrics-certs podName:8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528 nodeName:}" failed. No retries permitted until 2026-09-06 00:50:44.920806338 +0000 UTC m=+2.956949299 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528-metrics-certs") pod "network-metrics-daemon-d7gvz" (UID: "8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 00:50:44.421754 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.421182    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7270e6a0-6c6a-410a-b615-5cb276ebf879-kubelet-config\") pod \"global-pull-secret-syncer-tc782\" (UID: \"7270e6a0-6c6a-410a-b615-5cb276ebf879\") " pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:50:44.421754 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.421218    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07e0007b-c474-48f7-9bdc-91218d4e681e-tmp-dir\") pod \"node-resolver-w9xwb\" (UID: \"07e0007b-c474-48f7-9bdc-91218d4e681e\") " pod="openshift-dns/node-resolver-w9xwb"
Sep 06 00:50:44.421754 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.421272    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/07e0007b-c474-48f7-9bdc-91218d4e681e-hosts-file\") pod \"node-resolver-w9xwb\" (UID: \"07e0007b-c474-48f7-9bdc-91218d4e681e\") " pod="openshift-dns/node-resolver-w9xwb"
Sep 06 00:50:44.421754 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:44.421305    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 00:50:44.421754 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.421312    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7270e6a0-6c6a-410a-b615-5cb276ebf879-dbus\") pod \"global-pull-secret-syncer-tc782\" (UID: \"7270e6a0-6c6a-410a-b615-5cb276ebf879\") " pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:50:44.421754 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:44.421379    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7270e6a0-6c6a-410a-b615-5cb276ebf879-original-pull-secret podName:7270e6a0-6c6a-410a-b615-5cb276ebf879 nodeName:}" failed. No retries permitted until 2026-09-06 00:50:44.921363997 +0000 UTC m=+2.957506937 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7270e6a0-6c6a-410a-b615-5cb276ebf879-original-pull-secret") pod "global-pull-secret-syncer-tc782" (UID: "7270e6a0-6c6a-410a-b615-5cb276ebf879") : object "kube-system"/"original-pull-secret" not registered
Sep 06 00:50:44.427253 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.427230    2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 06 00:50:44.431149 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.431128    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bg5rn\" (UniqueName: \"kubernetes.io/projected/8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528-kube-api-access-bg5rn\") pod \"network-metrics-daemon-d7gvz\" (UID: \"8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528\") " pod="openshift-multus/network-metrics-daemon-d7gvz"
Sep 06 00:50:44.432056 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.432037    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx4pl\" (UniqueName: \"kubernetes.io/projected/07e0007b-c474-48f7-9bdc-91218d4e681e-kube-api-access-cx4pl\") pod \"node-resolver-w9xwb\" (UID: \"07e0007b-c474-48f7-9bdc-91218d4e681e\") " pod="openshift-dns/node-resolver-w9xwb"
Sep 06 00:50:44.521922 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.521840    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc6b2\" (UniqueName: \"kubernetes.io/projected/9a199e00-e8e6-4ac4-93c6-cfa4d3701ced-kube-api-access-jc6b2\") pod \"iptables-alerter-wvtqk\" (UID: \"9a199e00-e8e6-4ac4-93c6-cfa4d3701ced\") " pod="openshift-network-operator/iptables-alerter-wvtqk"
Sep 06 00:50:44.521922 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.521873    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2c9e3cd8-83aa-40b9-a844-65a7a157c377-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jv24f\" (UID: \"2c9e3cd8-83aa-40b9-a844-65a7a157c377\") " pod="openshift-multus/multus-additional-cni-plugins-jv24f"
Sep 06 00:50:44.521922 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.521905    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2c9e3cd8-83aa-40b9-a844-65a7a157c377-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jv24f\" (UID: \"2c9e3cd8-83aa-40b9-a844-65a7a157c377\") " pod="openshift-multus/multus-additional-cni-plugins-jv24f"
Sep 06 00:50:44.522198 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.521928    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/620c23ce-8e99-4b25-88ea-862c99c5dba3-run\") pod \"tuned-5tp8t\" (UID: \"620c23ce-8e99-4b25-88ea-862c99c5dba3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.522198 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.521952    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjlvh\" (UniqueName: \"kubernetes.io/projected/620c23ce-8e99-4b25-88ea-862c99c5dba3-kube-api-access-cjlvh\") pod \"tuned-5tp8t\" (UID: \"620c23ce-8e99-4b25-88ea-862c99c5dba3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.522198 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.521975    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/079a153a-9b55-4225-8928-cd8a28906fd3-host-run-k8s-cni-cncf-io\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.522198 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.521996    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bcd87c76-22e5-4905-bb95-d1acd077ceff-serviceca\") pod \"node-ca-gk6l5\" (UID: \"bcd87c76-22e5-4905-bb95-d1acd077ceff\") " pod="openshift-image-registry/node-ca-gk6l5"
Sep 06 00:50:44.522198 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.522018    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/079a153a-9b55-4225-8928-cd8a28906fd3-cni-binary-copy\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.522198 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.522031    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/620c23ce-8e99-4b25-88ea-862c99c5dba3-run\") pod \"tuned-5tp8t\" (UID: \"620c23ce-8e99-4b25-88ea-862c99c5dba3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.522198 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.522040    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/079a153a-9b55-4225-8928-cd8a28906fd3-multus-socket-dir-parent\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.522198 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.522076    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-systemd-units\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.522198 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.522085    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/079a153a-9b55-4225-8928-cd8a28906fd3-multus-socket-dir-parent\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.522198 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.522103    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/079a153a-9b55-4225-8928-cd8a28906fd3-system-cni-dir\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.522198 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.522160    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-systemd-units\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.522723 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.522209    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/079a153a-9b55-4225-8928-cd8a28906fd3-system-cni-dir\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.522723 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.522513    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2c9e3cd8-83aa-40b9-a844-65a7a157c377-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jv24f\" (UID: \"2c9e3cd8-83aa-40b9-a844-65a7a157c377\") " pod="openshift-multus/multus-additional-cni-plugins-jv24f"
Sep 06 00:50:44.522723 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.522587    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c9e3cd8-83aa-40b9-a844-65a7a157c377-system-cni-dir\") pod \"multus-additional-cni-plugins-jv24f\" (UID: \"2c9e3cd8-83aa-40b9-a844-65a7a157c377\") " pod="openshift-multus/multus-additional-cni-plugins-jv24f"
Sep 06 00:50:44.522723 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.522608    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-etc-openvswitch\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.522723 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.522633    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-node-log\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.522723 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.522652    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c85785bd-cd1f-47c0-bd9f-167af4cc20dc-sys-fs\") pod \"aws-ebs-csi-driver-node-p78nm\" (UID: \"c85785bd-cd1f-47c0-bd9f-167af4cc20dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78nm"
Sep 06 00:50:44.522723 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.522666    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/620c23ce-8e99-4b25-88ea-862c99c5dba3-etc-sysconfig\") pod \"tuned-5tp8t\" (UID: \"620c23ce-8e99-4b25-88ea-862c99c5dba3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.522723 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.522668    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bcd87c76-22e5-4905-bb95-d1acd077ceff-serviceca\") pod \"node-ca-gk6l5\" (UID: \"bcd87c76-22e5-4905-bb95-d1acd077ceff\") " pod="openshift-image-registry/node-ca-gk6l5"
Sep 06 00:50:44.522723 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.522681    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bcd87c76-22e5-4905-bb95-d1acd077ceff-host\") pod \"node-ca-gk6l5\" (UID: \"bcd87c76-22e5-4905-bb95-d1acd077ceff\") " pod="openshift-image-registry/node-ca-gk6l5"
Sep 06 00:50:44.522723 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.522695    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/079a153a-9b55-4225-8928-cd8a28906fd3-multus-cni-dir\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.522723 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.522712    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2c9e3cd8-83aa-40b9-a844-65a7a157c377-cnibin\") pod \"multus-additional-cni-plugins-jv24f\" (UID: \"2c9e3cd8-83aa-40b9-a844-65a7a157c377\") " pod="openshift-multus/multus-additional-cni-plugins-jv24f"
Sep 06 00:50:44.522723 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.522723    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/079a153a-9b55-4225-8928-cd8a28906fd3-host-run-k8s-cni-cncf-io\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.523111 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.522737    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2c9e3cd8-83aa-40b9-a844-65a7a157c377-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jv24f\" (UID: \"2c9e3cd8-83aa-40b9-a844-65a7a157c377\") " pod="openshift-multus/multus-additional-cni-plugins-jv24f"
Sep 06 00:50:44.523111 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.522756    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c9e3cd8-83aa-40b9-a844-65a7a157c377-system-cni-dir\") pod \"multus-additional-cni-plugins-jv24f\" (UID: \"2c9e3cd8-83aa-40b9-a844-65a7a157c377\") " pod="openshift-multus/multus-additional-cni-plugins-jv24f"
Sep 06 00:50:44.523111 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.522726    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-host-kubelet\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.523111 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.522764    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-host-kubelet\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.523111 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.522777    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-run-systemd\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.523111 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.522783    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/079a153a-9b55-4225-8928-cd8a28906fd3-cni-binary-copy\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.523111 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.522792    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c85785bd-cd1f-47c0-bd9f-167af4cc20dc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p78nm\" (UID: \"c85785bd-cd1f-47c0-bd9f-167af4cc20dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78nm"
Sep 06 00:50:44.523111 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.522793    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/620c23ce-8e99-4b25-88ea-862c99c5dba3-etc-sysconfig\") pod \"tuned-5tp8t\" (UID: \"620c23ce-8e99-4b25-88ea-862c99c5dba3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.523111 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.522817    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-node-log\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.523111 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.522820    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2c9e3cd8-83aa-40b9-a844-65a7a157c377-cnibin\") pod \"multus-additional-cni-plugins-jv24f\" (UID: \"2c9e3cd8-83aa-40b9-a844-65a7a157c377\") " pod="openshift-multus/multus-additional-cni-plugins-jv24f"
Sep 06 00:50:44.523111 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.522817    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/079a153a-9b55-4225-8928-cd8a28906fd3-multus-cni-dir\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.523111 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.522825    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-etc-openvswitch\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.523111 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.522877    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bcd87c76-22e5-4905-bb95-d1acd077ceff-host\") pod \"node-ca-gk6l5\" (UID: \"bcd87c76-22e5-4905-bb95-d1acd077ceff\") " pod="openshift-image-registry/node-ca-gk6l5"
Sep 06 00:50:44.523111 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.522936    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck8cc\" (UniqueName: \"kubernetes.io/projected/c85785bd-cd1f-47c0-bd9f-167af4cc20dc-kube-api-access-ck8cc\") pod \"aws-ebs-csi-driver-node-p78nm\" (UID: \"c85785bd-cd1f-47c0-bd9f-167af4cc20dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78nm"
Sep 06 00:50:44.523111 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.522907    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-run-systemd\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.523111 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.522953    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c85785bd-cd1f-47c0-bd9f-167af4cc20dc-sys-fs\") pod \"aws-ebs-csi-driver-node-p78nm\" (UID: \"c85785bd-cd1f-47c0-bd9f-167af4cc20dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78nm"
Sep 06 00:50:44.523111 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.522961    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/079a153a-9b55-4225-8928-cd8a28906fd3-host-run-netns\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.523111 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.522992    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/079a153a-9b55-4225-8928-cd8a28906fd3-host-var-lib-cni-multus\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.523732 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.523009    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/079a153a-9b55-4225-8928-cd8a28906fd3-host-run-netns\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.523732 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.523008    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c85785bd-cd1f-47c0-bd9f-167af4cc20dc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p78nm\" (UID: \"c85785bd-cd1f-47c0-bd9f-167af4cc20dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78nm"
Sep 06 00:50:44.523732 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.523052    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/079a153a-9b55-4225-8928-cd8a28906fd3-host-var-lib-cni-multus\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.523732 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.523095    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2c9e3cd8-83aa-40b9-a844-65a7a157c377-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jv24f\" (UID: \"2c9e3cd8-83aa-40b9-a844-65a7a157c377\") " pod="openshift-multus/multus-additional-cni-plugins-jv24f"
Sep 06 00:50:44.523732 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.523126    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-host-run-ovn-kubernetes\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.523732 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.523150    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.523732 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.523210    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e100e633-d18a-4d68-9c81-0ff379c12d2f-ovnkube-config\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.523732 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.523227    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e100e633-d18a-4d68-9c81-0ff379c12d2f-ovnkube-script-lib\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.523732 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.523246    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-host-cni-bin\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.523732 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.523277    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hq4zn\" (UniqueName: \"kubernetes.io/projected/e100e633-d18a-4d68-9c81-0ff379c12d2f-kube-api-access-hq4zn\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.523732 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.523291    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/620c23ce-8e99-4b25-88ea-862c99c5dba3-etc-modprobe-d\") pod \"tuned-5tp8t\" (UID: \"620c23ce-8e99-4b25-88ea-862c99c5dba3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.523732 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.523313    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/620c23ce-8e99-4b25-88ea-862c99c5dba3-etc-kubernetes\") pod \"tuned-5tp8t\" (UID: \"620c23ce-8e99-4b25-88ea-862c99c5dba3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.523732 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.523337    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-host-run-ovn-kubernetes\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.523732 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.523361    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.523732 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.523444    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/620c23ce-8e99-4b25-88ea-862c99c5dba3-etc-modprobe-d\") pod \"tuned-5tp8t\" (UID: \"620c23ce-8e99-4b25-88ea-862c99c5dba3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.523732 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.523465    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-host-cni-bin\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.524468 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.523759    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e100e633-d18a-4d68-9c81-0ff379c12d2f-ovnkube-config\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.524468 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.523760    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2c9e3cd8-83aa-40b9-a844-65a7a157c377-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jv24f\" (UID: \"2c9e3cd8-83aa-40b9-a844-65a7a157c377\") " pod="openshift-multus/multus-additional-cni-plugins-jv24f"
Sep 06 00:50:44.524468 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.523766    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/079a153a-9b55-4225-8928-cd8a28906fd3-multus-daemon-config\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.524468 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.523799    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/620c23ce-8e99-4b25-88ea-862c99c5dba3-etc-kubernetes\") pod \"tuned-5tp8t\" (UID: \"620c23ce-8e99-4b25-88ea-862c99c5dba3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.524468 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.523805    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2vkp\" (UniqueName: \"kubernetes.io/projected/31067da9-3ebb-40fc-b24e-34ccd0f5f3fd-kube-api-access-h2vkp\") pod \"network-check-target-wfwc6\" (UID: \"31067da9-3ebb-40fc-b24e-34ccd0f5f3fd\") " pod="openshift-network-diagnostics/network-check-target-wfwc6"
Sep 06 00:50:44.524468 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.523832    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/500d4399-6afb-424e-8cc2-b17de185462c-agent-certs\") pod \"konnectivity-agent-ks4rt\" (UID: \"500d4399-6afb-424e-8cc2-b17de185462c\") " pod="kube-system/konnectivity-agent-ks4rt"
Sep 06 00:50:44.524468 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.523855    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/500d4399-6afb-424e-8cc2-b17de185462c-konnectivity-ca\") pod \"konnectivity-agent-ks4rt\" (UID: \"500d4399-6afb-424e-8cc2-b17de185462c\") " pod="kube-system/konnectivity-agent-ks4rt"
Sep 06 00:50:44.524468 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.523876    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-run-openvswitch\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.524468 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.523898    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-log-socket\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.524468 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.523920    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtcj7\" (UniqueName: \"kubernetes.io/projected/079a153a-9b55-4225-8928-cd8a28906fd3-kube-api-access-qtcj7\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.524468 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.523943    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a199e00-e8e6-4ac4-93c6-cfa4d3701ced-host-slash\") pod \"iptables-alerter-wvtqk\" (UID: \"9a199e00-e8e6-4ac4-93c6-cfa4d3701ced\") " pod="openshift-network-operator/iptables-alerter-wvtqk"
Sep 06 00:50:44.524468 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.523966    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-host-slash\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.524468 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.523951    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e100e633-d18a-4d68-9c81-0ff379c12d2f-ovnkube-script-lib\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.524468 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.523980    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-run-openvswitch\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.524468 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524009    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/079a153a-9b55-4225-8928-cd8a28906fd3-hostroot\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.524468 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524033    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-log-socket\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.524468 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524048    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2c9e3cd8-83aa-40b9-a844-65a7a157c377-cni-binary-copy\") pod \"multus-additional-cni-plugins-jv24f\" (UID: \"2c9e3cd8-83aa-40b9-a844-65a7a157c377\") " pod="openshift-multus/multus-additional-cni-plugins-jv24f"
Sep 06 00:50:44.525178 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524069    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-host-slash\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.525178 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524106    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/079a153a-9b55-4225-8928-cd8a28906fd3-hostroot\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.525178 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524115    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a199e00-e8e6-4ac4-93c6-cfa4d3701ced-host-slash\") pod \"iptables-alerter-wvtqk\" (UID: \"9a199e00-e8e6-4ac4-93c6-cfa4d3701ced\") " pod="openshift-network-operator/iptables-alerter-wvtqk"
Sep 06 00:50:44.525178 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524070    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c85785bd-cd1f-47c0-bd9f-167af4cc20dc-socket-dir\") pod \"aws-ebs-csi-driver-node-p78nm\" (UID: \"c85785bd-cd1f-47c0-bd9f-167af4cc20dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78nm"
Sep 06 00:50:44.525178 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524156    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c85785bd-cd1f-47c0-bd9f-167af4cc20dc-registration-dir\") pod \"aws-ebs-csi-driver-node-p78nm\" (UID: \"c85785bd-cd1f-47c0-bd9f-167af4cc20dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78nm"
Sep 06 00:50:44.525178 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524177    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c85785bd-cd1f-47c0-bd9f-167af4cc20dc-socket-dir\") pod \"aws-ebs-csi-driver-node-p78nm\" (UID: \"c85785bd-cd1f-47c0-bd9f-167af4cc20dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78nm"
Sep 06 00:50:44.525178 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524184    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/620c23ce-8e99-4b25-88ea-862c99c5dba3-sys\") pod \"tuned-5tp8t\" (UID: \"620c23ce-8e99-4b25-88ea-862c99c5dba3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.525178 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524188    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/079a153a-9b55-4225-8928-cd8a28906fd3-multus-daemon-config\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.525178 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524207    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/079a153a-9b55-4225-8928-cd8a28906fd3-host-var-lib-kubelet\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.525178 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524226    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c85785bd-cd1f-47c0-bd9f-167af4cc20dc-registration-dir\") pod \"aws-ebs-csi-driver-node-p78nm\" (UID: \"c85785bd-cd1f-47c0-bd9f-167af4cc20dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78nm"
Sep 06 00:50:44.525178 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524233    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-run-ovn\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.525178 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524236    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/620c23ce-8e99-4b25-88ea-862c99c5dba3-sys\") pod \"tuned-5tp8t\" (UID: \"620c23ce-8e99-4b25-88ea-862c99c5dba3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.525178 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524257    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-host-cni-netd\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.525178 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524282    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/079a153a-9b55-4225-8928-cd8a28906fd3-host-var-lib-kubelet\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.525178 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524282    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-run-ovn\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.525178 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524342    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c85785bd-cd1f-47c0-bd9f-167af4cc20dc-device-dir\") pod \"aws-ebs-csi-driver-node-p78nm\" (UID: \"c85785bd-cd1f-47c0-bd9f-167af4cc20dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78nm"
Sep 06 00:50:44.525178 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524390    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-host-cni-netd\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.525178 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524417    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/500d4399-6afb-424e-8cc2-b17de185462c-konnectivity-ca\") pod \"konnectivity-agent-ks4rt\" (UID: \"500d4399-6afb-424e-8cc2-b17de185462c\") " pod="kube-system/konnectivity-agent-ks4rt"
Sep 06 00:50:44.526050 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524431    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/620c23ce-8e99-4b25-88ea-862c99c5dba3-host\") pod \"tuned-5tp8t\" (UID: \"620c23ce-8e99-4b25-88ea-862c99c5dba3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.526050 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524444    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c85785bd-cd1f-47c0-bd9f-167af4cc20dc-device-dir\") pod \"aws-ebs-csi-driver-node-p78nm\" (UID: \"c85785bd-cd1f-47c0-bd9f-167af4cc20dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78nm"
Sep 06 00:50:44.526050 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524471    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/620c23ce-8e99-4b25-88ea-862c99c5dba3-host\") pod \"tuned-5tp8t\" (UID: \"620c23ce-8e99-4b25-88ea-862c99c5dba3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.526050 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524487    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/079a153a-9b55-4225-8928-cd8a28906fd3-host-var-lib-cni-bin\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.526050 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524511    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/079a153a-9b55-4225-8928-cd8a28906fd3-host-run-multus-certs\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.526050 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524557    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/079a153a-9b55-4225-8928-cd8a28906fd3-host-run-multus-certs\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.526050 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524562    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/079a153a-9b55-4225-8928-cd8a28906fd3-host-var-lib-cni-bin\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.526050 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524575    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2c9e3cd8-83aa-40b9-a844-65a7a157c377-cni-binary-copy\") pod \"multus-additional-cni-plugins-jv24f\" (UID: \"2c9e3cd8-83aa-40b9-a844-65a7a157c377\") " pod="openshift-multus/multus-additional-cni-plugins-jv24f"
Sep 06 00:50:44.526050 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524594    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e100e633-d18a-4d68-9c81-0ff379c12d2f-ovn-node-metrics-cert\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.526050 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524620    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/620c23ce-8e99-4b25-88ea-862c99c5dba3-etc-systemd\") pod \"tuned-5tp8t\" (UID: \"620c23ce-8e99-4b25-88ea-862c99c5dba3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.526050 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524643    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/620c23ce-8e99-4b25-88ea-862c99c5dba3-etc-tuned\") pod \"tuned-5tp8t\" (UID: \"620c23ce-8e99-4b25-88ea-862c99c5dba3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.526050 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524666    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/079a153a-9b55-4225-8928-cd8a28906fd3-etc-kubernetes\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.526050 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524692    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm5mx\" (UniqueName: \"kubernetes.io/projected/2c9e3cd8-83aa-40b9-a844-65a7a157c377-kube-api-access-fm5mx\") pod \"multus-additional-cni-plugins-jv24f\" (UID: \"2c9e3cd8-83aa-40b9-a844-65a7a157c377\") " pod="openshift-multus/multus-additional-cni-plugins-jv24f"
Sep 06 00:50:44.526050 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524720    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/620c23ce-8e99-4b25-88ea-862c99c5dba3-lib-modules\") pod \"tuned-5tp8t\" (UID: \"620c23ce-8e99-4b25-88ea-862c99c5dba3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.526050 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524742    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/620c23ce-8e99-4b25-88ea-862c99c5dba3-var-lib-kubelet\") pod \"tuned-5tp8t\" (UID: \"620c23ce-8e99-4b25-88ea-862c99c5dba3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.526050 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524766    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9zvb\" (UniqueName: \"kubernetes.io/projected/bcd87c76-22e5-4905-bb95-d1acd077ceff-kube-api-access-z9zvb\") pod \"node-ca-gk6l5\" (UID: \"bcd87c76-22e5-4905-bb95-d1acd077ceff\") " pod="openshift-image-registry/node-ca-gk6l5"
Sep 06 00:50:44.526050 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524788    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/079a153a-9b55-4225-8928-cd8a28906fd3-cnibin\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.526050 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524812    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-var-lib-openvswitch\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.526829 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524835    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c85785bd-cd1f-47c0-bd9f-167af4cc20dc-etc-selinux\") pod \"aws-ebs-csi-driver-node-p78nm\" (UID: \"c85785bd-cd1f-47c0-bd9f-167af4cc20dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78nm"
Sep 06 00:50:44.526829 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524872    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/620c23ce-8e99-4b25-88ea-862c99c5dba3-etc-sysctl-d\") pod \"tuned-5tp8t\" (UID: \"620c23ce-8e99-4b25-88ea-862c99c5dba3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.526829 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524896    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/620c23ce-8e99-4b25-88ea-862c99c5dba3-tmp\") pod \"tuned-5tp8t\" (UID: \"620c23ce-8e99-4b25-88ea-862c99c5dba3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.526829 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524935    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9a199e00-e8e6-4ac4-93c6-cfa4d3701ced-iptables-alerter-script\") pod \"iptables-alerter-wvtqk\" (UID: \"9a199e00-e8e6-4ac4-93c6-cfa4d3701ced\") " pod="openshift-network-operator/iptables-alerter-wvtqk"
Sep 06 00:50:44.526829 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524958    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-host-run-netns\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.526829 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524966    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/620c23ce-8e99-4b25-88ea-862c99c5dba3-etc-systemd\") pod \"tuned-5tp8t\" (UID: \"620c23ce-8e99-4b25-88ea-862c99c5dba3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.526829 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524978    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e100e633-d18a-4d68-9c81-0ff379c12d2f-env-overrides\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.526829 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.524999    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/620c23ce-8e99-4b25-88ea-862c99c5dba3-etc-sysctl-conf\") pod \"tuned-5tp8t\" (UID: \"620c23ce-8e99-4b25-88ea-862c99c5dba3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.526829 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.525014    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/079a153a-9b55-4225-8928-cd8a28906fd3-etc-kubernetes\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.526829 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.525046    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/079a153a-9b55-4225-8928-cd8a28906fd3-multus-conf-dir\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.526829 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.525118    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/079a153a-9b55-4225-8928-cd8a28906fd3-multus-conf-dir\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.526829 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.525300    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/620c23ce-8e99-4b25-88ea-862c99c5dba3-lib-modules\") pod \"tuned-5tp8t\" (UID: \"620c23ce-8e99-4b25-88ea-862c99c5dba3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.526829 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.525315    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/079a153a-9b55-4225-8928-cd8a28906fd3-cnibin\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.526829 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.525391    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/620c23ce-8e99-4b25-88ea-862c99c5dba3-var-lib-kubelet\") pod \"tuned-5tp8t\" (UID: \"620c23ce-8e99-4b25-88ea-862c99c5dba3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.526829 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.525450    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-var-lib-openvswitch\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.526829 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.525502    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c85785bd-cd1f-47c0-bd9f-167af4cc20dc-etc-selinux\") pod \"aws-ebs-csi-driver-node-p78nm\" (UID: \"c85785bd-cd1f-47c0-bd9f-167af4cc20dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78nm"
Sep 06 00:50:44.526829 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.525597    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/620c23ce-8e99-4b25-88ea-862c99c5dba3-etc-sysctl-d\") pod \"tuned-5tp8t\" (UID: \"620c23ce-8e99-4b25-88ea-862c99c5dba3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.526829 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.525802    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e100e633-d18a-4d68-9c81-0ff379c12d2f-env-overrides\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.527594 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.525865    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e100e633-d18a-4d68-9c81-0ff379c12d2f-host-run-netns\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.527594 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.525846    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9a199e00-e8e6-4ac4-93c6-cfa4d3701ced-iptables-alerter-script\") pod \"iptables-alerter-wvtqk\" (UID: \"9a199e00-e8e6-4ac4-93c6-cfa4d3701ced\") " pod="openshift-network-operator/iptables-alerter-wvtqk"
Sep 06 00:50:44.527594 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.526001    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/620c23ce-8e99-4b25-88ea-862c99c5dba3-etc-sysctl-conf\") pod \"tuned-5tp8t\" (UID: \"620c23ce-8e99-4b25-88ea-862c99c5dba3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.527594 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.527111    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/500d4399-6afb-424e-8cc2-b17de185462c-agent-certs\") pod \"konnectivity-agent-ks4rt\" (UID: \"500d4399-6afb-424e-8cc2-b17de185462c\") " pod="kube-system/konnectivity-agent-ks4rt"
Sep 06 00:50:44.528048 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.528027    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/620c23ce-8e99-4b25-88ea-862c99c5dba3-tmp\") pod \"tuned-5tp8t\" (UID: \"620c23ce-8e99-4b25-88ea-862c99c5dba3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.528245 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.528228    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/620c23ce-8e99-4b25-88ea-862c99c5dba3-etc-tuned\") pod \"tuned-5tp8t\" (UID: \"620c23ce-8e99-4b25-88ea-862c99c5dba3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.529891 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.529874    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e100e633-d18a-4d68-9c81-0ff379c12d2f-ovn-node-metrics-cert\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.532115 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:44.532067    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 00:50:44.532115 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:44.532092    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 00:50:44.532115 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:44.532105    2577 projected.go:196] Error preparing data for projected volume kube-api-access-h2vkp for pod openshift-network-diagnostics/network-check-target-wfwc6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 00:50:44.532299 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:44.532160    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31067da9-3ebb-40fc-b24e-34ccd0f5f3fd-kube-api-access-h2vkp podName:31067da9-3ebb-40fc-b24e-34ccd0f5f3fd nodeName:}" failed. No retries permitted until 2026-09-06 00:50:45.032142903 +0000 UTC m=+3.068285853 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-h2vkp" (UniqueName: "kubernetes.io/projected/31067da9-3ebb-40fc-b24e-34ccd0f5f3fd-kube-api-access-h2vkp") pod "network-check-target-wfwc6" (UID: "31067da9-3ebb-40fc-b24e-34ccd0f5f3fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 00:50:44.532750 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.532617    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc6b2\" (UniqueName: \"kubernetes.io/projected/9a199e00-e8e6-4ac4-93c6-cfa4d3701ced-kube-api-access-jc6b2\") pod \"iptables-alerter-wvtqk\" (UID: \"9a199e00-e8e6-4ac4-93c6-cfa4d3701ced\") " pod="openshift-network-operator/iptables-alerter-wvtqk"
Sep 06 00:50:44.533310 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.533085    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjlvh\" (UniqueName: \"kubernetes.io/projected/620c23ce-8e99-4b25-88ea-862c99c5dba3-kube-api-access-cjlvh\") pod \"tuned-5tp8t\" (UID: \"620c23ce-8e99-4b25-88ea-862c99c5dba3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.533546 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.533527    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck8cc\" (UniqueName: \"kubernetes.io/projected/c85785bd-cd1f-47c0-bd9f-167af4cc20dc-kube-api-access-ck8cc\") pod \"aws-ebs-csi-driver-node-p78nm\" (UID: \"c85785bd-cd1f-47c0-bd9f-167af4cc20dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78nm"
Sep 06 00:50:44.534613 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.534590    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9zvb\" (UniqueName: \"kubernetes.io/projected/bcd87c76-22e5-4905-bb95-d1acd077ceff-kube-api-access-z9zvb\") pod \"node-ca-gk6l5\" (UID: \"bcd87c76-22e5-4905-bb95-d1acd077ceff\") " pod="openshift-image-registry/node-ca-gk6l5"
Sep 06 00:50:44.534751 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.534696    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm5mx\" (UniqueName: \"kubernetes.io/projected/2c9e3cd8-83aa-40b9-a844-65a7a157c377-kube-api-access-fm5mx\") pod \"multus-additional-cni-plugins-jv24f\" (UID: \"2c9e3cd8-83aa-40b9-a844-65a7a157c377\") " pod="openshift-multus/multus-additional-cni-plugins-jv24f"
Sep 06 00:50:44.535557 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.535536    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtcj7\" (UniqueName: \"kubernetes.io/projected/079a153a-9b55-4225-8928-cd8a28906fd3-kube-api-access-qtcj7\") pod \"multus-ww88t\" (UID: \"079a153a-9b55-4225-8928-cd8a28906fd3\") " pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.536979 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.536960    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq4zn\" (UniqueName: \"kubernetes.io/projected/e100e633-d18a-4d68-9c81-0ff379c12d2f-kube-api-access-hq4zn\") pod \"ovnkube-node-j2z66\" (UID: \"e100e633-d18a-4d68-9c81-0ff379c12d2f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.616257 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.616220    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w9xwb"
Sep 06 00:50:44.624423 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.624407    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5tp8t"
Sep 06 00:50:44.633054 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.633037    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gk6l5"
Sep 06 00:50:44.640625 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.640608    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jv24f"
Sep 06 00:50:44.648199 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.648181    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:50:44.657944 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.657925    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ww88t"
Sep 06 00:50:44.665492 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.665472    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ks4rt"
Sep 06 00:50:44.673268 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.673251    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wvtqk"
Sep 06 00:50:44.678828 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.678813    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78nm"
Sep 06 00:50:44.927044 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.926968    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528-metrics-certs\") pod \"network-metrics-daemon-d7gvz\" (UID: \"8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528\") " pod="openshift-multus/network-metrics-daemon-d7gvz"
Sep 06 00:50:44.927044 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:44.927015    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7270e6a0-6c6a-410a-b615-5cb276ebf879-original-pull-secret\") pod \"global-pull-secret-syncer-tc782\" (UID: \"7270e6a0-6c6a-410a-b615-5cb276ebf879\") " pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:50:44.927240 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:44.927106    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 00:50:44.927240 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:44.927165    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528-metrics-certs podName:8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528 nodeName:}" failed. No retries permitted until 2026-09-06 00:50:45.927147772 +0000 UTC m=+3.963290710 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528-metrics-certs") pod "network-metrics-daemon-d7gvz" (UID: "8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 00:50:44.927240 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:44.927106    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 00:50:44.927402 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:44.927265    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7270e6a0-6c6a-410a-b615-5cb276ebf879-original-pull-secret podName:7270e6a0-6c6a-410a-b615-5cb276ebf879 nodeName:}" failed. No retries permitted until 2026-09-06 00:50:45.927244925 +0000 UTC m=+3.963387865 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7270e6a0-6c6a-410a-b615-5cb276ebf879-original-pull-secret") pod "global-pull-secret-syncer-tc782" (UID: "7270e6a0-6c6a-410a-b615-5cb276ebf879") : object "kube-system"/"original-pull-secret" not registered
Sep 06 00:50:45.127754 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:45.127717    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2vkp\" (UniqueName: \"kubernetes.io/projected/31067da9-3ebb-40fc-b24e-34ccd0f5f3fd-kube-api-access-h2vkp\") pod \"network-check-target-wfwc6\" (UID: \"31067da9-3ebb-40fc-b24e-34ccd0f5f3fd\") " pod="openshift-network-diagnostics/network-check-target-wfwc6"
Sep 06 00:50:45.127903 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:45.127856    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 00:50:45.127903 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:45.127874    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 00:50:45.127903 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:45.127883    2577 projected.go:196] Error preparing data for projected volume kube-api-access-h2vkp for pod openshift-network-diagnostics/network-check-target-wfwc6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 00:50:45.128039 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:45.127938    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31067da9-3ebb-40fc-b24e-34ccd0f5f3fd-kube-api-access-h2vkp podName:31067da9-3ebb-40fc-b24e-34ccd0f5f3fd nodeName:}" failed. No retries permitted until 2026-09-06 00:50:46.127919489 +0000 UTC m=+4.164062441 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-h2vkp" (UniqueName: "kubernetes.io/projected/31067da9-3ebb-40fc-b24e-34ccd0f5f3fd-kube-api-access-h2vkp") pod "network-check-target-wfwc6" (UID: "31067da9-3ebb-40fc-b24e-34ccd0f5f3fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 00:50:45.353944 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:45.353816    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-05 00:45:44 +0000 UTC" deadline="2028-04-21 20:48:02.967863485 +0000 UTC"
Sep 06 00:50:45.353944 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:45.353841    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14251h57m17.614026784s"
Sep 06 00:50:45.356696 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:45.356667    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07e0007b_c474_48f7_9bdc_91218d4e681e.slice/crio-2e6999e9bc6174b1dbea0b1eea8fafe16754cb704112ee9256087d8cf01c933f WatchSource:0}: Error finding container 2e6999e9bc6174b1dbea0b1eea8fafe16754cb704112ee9256087d8cf01c933f: Status 404 returned error can't find the container with id 2e6999e9bc6174b1dbea0b1eea8fafe16754cb704112ee9256087d8cf01c933f
Sep 06 00:50:45.357152 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:45.357126    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod500d4399_6afb_424e_8cc2_b17de185462c.slice/crio-053e13eb2a138fb9d39fdb39cb57b45ecaba32b6618282740b8535207490b00e WatchSource:0}: Error finding container 053e13eb2a138fb9d39fdb39cb57b45ecaba32b6618282740b8535207490b00e: Status 404 returned error can't find the container with id 053e13eb2a138fb9d39fdb39cb57b45ecaba32b6618282740b8535207490b00e
Sep 06 00:50:45.358498 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:45.358479    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod620c23ce_8e99_4b25_88ea_862c99c5dba3.slice/crio-c41ca614610b1a187a92d107885d7e9e92030361415b0517896c571eeaf443be WatchSource:0}: Error finding container c41ca614610b1a187a92d107885d7e9e92030361415b0517896c571eeaf443be: Status 404 returned error can't find the container with id c41ca614610b1a187a92d107885d7e9e92030361415b0517896c571eeaf443be
Sep 06 00:50:45.359415 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:45.359395    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode100e633_d18a_4d68_9c81_0ff379c12d2f.slice/crio-b8fcf62417605d0e0bc0c9b2fc35ee7dc5df1747e74de73416f644e89265afdf WatchSource:0}: Error finding container b8fcf62417605d0e0bc0c9b2fc35ee7dc5df1747e74de73416f644e89265afdf: Status 404 returned error can't find the container with id b8fcf62417605d0e0bc0c9b2fc35ee7dc5df1747e74de73416f644e89265afdf
Sep 06 00:50:45.360170 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:45.360057    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcd87c76_22e5_4905_bb95_d1acd077ceff.slice/crio-fd813f4d0bcec88f026e8bff58b0c41794702299920645f2e0f54fd63023ca2f WatchSource:0}: Error finding container fd813f4d0bcec88f026e8bff58b0c41794702299920645f2e0f54fd63023ca2f: Status 404 returned error can't find the container with id fd813f4d0bcec88f026e8bff58b0c41794702299920645f2e0f54fd63023ca2f
Sep 06 00:50:45.363711 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:45.363658    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod079a153a_9b55_4225_8928_cd8a28906fd3.slice/crio-a7b2c7a7660b7aae270771dcf32d590b3245317b9d890404169ad771681ab2bb WatchSource:0}: Error finding container a7b2c7a7660b7aae270771dcf32d590b3245317b9d890404169ad771681ab2bb: Status 404 returned error can't find the container with id a7b2c7a7660b7aae270771dcf32d590b3245317b9d890404169ad771681ab2bb
Sep 06 00:50:45.364526 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:45.364480    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc85785bd_cd1f_47c0_bd9f_167af4cc20dc.slice/crio-f705de0c61fd12afe657337e24507f9aa43dc97055f5cc5d869a8a7fceb2d4e4 WatchSource:0}: Error finding container f705de0c61fd12afe657337e24507f9aa43dc97055f5cc5d869a8a7fceb2d4e4: Status 404 returned error can't find the container with id f705de0c61fd12afe657337e24507f9aa43dc97055f5cc5d869a8a7fceb2d4e4
Sep 06 00:50:45.365368 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:45.365349    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c9e3cd8_83aa_40b9_a844_65a7a157c377.slice/crio-0dd3516bdcad2e1493ef55d59f57269b6d6b6ab7ee9f549b0069805da00528e0 WatchSource:0}: Error finding container 0dd3516bdcad2e1493ef55d59f57269b6d6b6ab7ee9f549b0069805da00528e0: Status 404 returned error can't find the container with id 0dd3516bdcad2e1493ef55d59f57269b6d6b6ab7ee9f549b0069805da00528e0
Sep 06 00:50:45.368790 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:50:45.367878    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a199e00_e8e6_4ac4_93c6_cfa4d3701ced.slice/crio-c21eb06e6251bc5bb6b9b10e1dcf732ebba263fc2a792994f77f5fc85238c6a7 WatchSource:0}: Error finding container c21eb06e6251bc5bb6b9b10e1dcf732ebba263fc2a792994f77f5fc85238c6a7: Status 404 returned error can't find the container with id c21eb06e6251bc5bb6b9b10e1dcf732ebba263fc2a792994f77f5fc85238c6a7
Sep 06 00:50:45.411915 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:45.411892    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78nm" event={"ID":"c85785bd-cd1f-47c0-bd9f-167af4cc20dc","Type":"ContainerStarted","Data":"f705de0c61fd12afe657337e24507f9aa43dc97055f5cc5d869a8a7fceb2d4e4"}
Sep 06 00:50:45.412930 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:45.412911    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ww88t" event={"ID":"079a153a-9b55-4225-8928-cd8a28906fd3","Type":"ContainerStarted","Data":"a7b2c7a7660b7aae270771dcf32d590b3245317b9d890404169ad771681ab2bb"}
Sep 06 00:50:45.413946 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:45.413926    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ks4rt" event={"ID":"500d4399-6afb-424e-8cc2-b17de185462c","Type":"ContainerStarted","Data":"053e13eb2a138fb9d39fdb39cb57b45ecaba32b6618282740b8535207490b00e"}
Sep 06 00:50:45.416956 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:45.416936    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gk6l5" event={"ID":"bcd87c76-22e5-4905-bb95-d1acd077ceff","Type":"ContainerStarted","Data":"fd813f4d0bcec88f026e8bff58b0c41794702299920645f2e0f54fd63023ca2f"}
Sep 06 00:50:45.420017 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:45.419994    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wvtqk" event={"ID":"9a199e00-e8e6-4ac4-93c6-cfa4d3701ced","Type":"ContainerStarted","Data":"c21eb06e6251bc5bb6b9b10e1dcf732ebba263fc2a792994f77f5fc85238c6a7"}
Sep 06 00:50:45.421305 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:45.421281    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j2z66" event={"ID":"e100e633-d18a-4d68-9c81-0ff379c12d2f","Type":"ContainerStarted","Data":"b8fcf62417605d0e0bc0c9b2fc35ee7dc5df1747e74de73416f644e89265afdf"}
Sep 06 00:50:45.423111 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:45.423084    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5tp8t" event={"ID":"620c23ce-8e99-4b25-88ea-862c99c5dba3","Type":"ContainerStarted","Data":"c41ca614610b1a187a92d107885d7e9e92030361415b0517896c571eeaf443be"}
Sep 06 00:50:45.424177 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:45.424159    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w9xwb" event={"ID":"07e0007b-c474-48f7-9bdc-91218d4e681e","Type":"ContainerStarted","Data":"2e6999e9bc6174b1dbea0b1eea8fafe16754cb704112ee9256087d8cf01c933f"}
Sep 06 00:50:45.425642 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:45.425625    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jv24f" event={"ID":"2c9e3cd8-83aa-40b9-a844-65a7a157c377","Type":"ContainerStarted","Data":"0dd3516bdcad2e1493ef55d59f57269b6d6b6ab7ee9f549b0069805da00528e0"}
Sep 06 00:50:45.933565 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:45.933280    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7270e6a0-6c6a-410a-b615-5cb276ebf879-original-pull-secret\") pod \"global-pull-secret-syncer-tc782\" (UID: \"7270e6a0-6c6a-410a-b615-5cb276ebf879\") " pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:50:45.933565 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:45.933515    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 00:50:45.933774 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:45.933577    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7270e6a0-6c6a-410a-b615-5cb276ebf879-original-pull-secret podName:7270e6a0-6c6a-410a-b615-5cb276ebf879 nodeName:}" failed. No retries permitted until 2026-09-06 00:50:47.933559927 +0000 UTC m=+5.969702876 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7270e6a0-6c6a-410a-b615-5cb276ebf879-original-pull-secret") pod "global-pull-secret-syncer-tc782" (UID: "7270e6a0-6c6a-410a-b615-5cb276ebf879") : object "kube-system"/"original-pull-secret" not registered
Sep 06 00:50:45.933774 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:45.933625    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528-metrics-certs\") pod \"network-metrics-daemon-d7gvz\" (UID: \"8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528\") " pod="openshift-multus/network-metrics-daemon-d7gvz"
Sep 06 00:50:45.933774 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:45.933734    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 00:50:45.933930 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:45.933781    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528-metrics-certs podName:8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528 nodeName:}" failed. No retries permitted until 2026-09-06 00:50:47.933767451 +0000 UTC m=+5.969910402 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528-metrics-certs") pod "network-metrics-daemon-d7gvz" (UID: "8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 00:50:46.134520 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:46.134490    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2vkp\" (UniqueName: \"kubernetes.io/projected/31067da9-3ebb-40fc-b24e-34ccd0f5f3fd-kube-api-access-h2vkp\") pod \"network-check-target-wfwc6\" (UID: \"31067da9-3ebb-40fc-b24e-34ccd0f5f3fd\") " pod="openshift-network-diagnostics/network-check-target-wfwc6"
Sep 06 00:50:46.134697 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:46.134628    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 00:50:46.134697 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:46.134647    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 00:50:46.134697 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:46.134658    2577 projected.go:196] Error preparing data for projected volume kube-api-access-h2vkp for pod openshift-network-diagnostics/network-check-target-wfwc6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 00:50:46.134851 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:46.134713    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31067da9-3ebb-40fc-b24e-34ccd0f5f3fd-kube-api-access-h2vkp podName:31067da9-3ebb-40fc-b24e-34ccd0f5f3fd nodeName:}" failed. No retries permitted until 2026-09-06 00:50:48.134695159 +0000 UTC m=+6.170838097 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-h2vkp" (UniqueName: "kubernetes.io/projected/31067da9-3ebb-40fc-b24e-34ccd0f5f3fd-kube-api-access-h2vkp") pod "network-check-target-wfwc6" (UID: "31067da9-3ebb-40fc-b24e-34ccd0f5f3fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 00:50:46.354277 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:46.354163    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-05 00:45:44 +0000 UTC" deadline="2028-02-03 04:19:55.585144052 +0000 UTC"
Sep 06 00:50:46.354277 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:46.354225    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12363h29m9.230922632s"
Sep 06 00:50:46.407003 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:46.405847    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfwc6"
Sep 06 00:50:46.407003 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:46.405961    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfwc6" podUID="31067da9-3ebb-40fc-b24e-34ccd0f5f3fd"
Sep 06 00:50:46.407003 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:46.406412    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:50:46.407003 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:46.406498    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc782" podUID="7270e6a0-6c6a-410a-b615-5cb276ebf879"
Sep 06 00:50:46.407567 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:46.407389    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7gvz"
Sep 06 00:50:46.407567 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:46.407529    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7gvz" podUID="8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528"
Sep 06 00:50:46.449330 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:46.449286    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-57.ec2.internal" event={"ID":"6098c4696f62080d6b73924491e58881","Type":"ContainerStarted","Data":"df5098f5443dd7f968835d2ae2dd7899833c60b64cb918054a856dda4762503c"}
Sep 06 00:50:46.454924 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:46.454899    2577 generic.go:356] "Generic (PLEG): container finished" podID="e51dd1d48421ec025c1694f8cabaffd2" containerID="acc19d2b00c7cad48560d3a4bd4357efd4c5f927a2197ae6d8032ee3f0cd33b7" exitCode=0
Sep 06 00:50:46.455044 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:46.454935    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-57.ec2.internal" event={"ID":"e51dd1d48421ec025c1694f8cabaffd2","Type":"ContainerDied","Data":"acc19d2b00c7cad48560d3a4bd4357efd4c5f927a2197ae6d8032ee3f0cd33b7"}
Sep 06 00:50:46.480289 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:46.480245    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-57.ec2.internal" podStartSLOduration=3.480227172 podStartE2EDuration="3.480227172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 00:50:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:50:46.46647331 +0000 UTC m=+4.502616269" watchObservedRunningTime="2026-09-06 00:50:46.480227172 +0000 UTC m=+4.516370129"
Sep 06 00:50:47.486091 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:47.486060    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-57.ec2.internal" event={"ID":"e51dd1d48421ec025c1694f8cabaffd2","Type":"ContainerStarted","Data":"2dd1ab72e934f38e2004eb8de7829cc2ed7e825fbf4ae9a9177e1ad37e7f451b"}
Sep 06 00:50:47.951501 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:47.951187    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528-metrics-certs\") pod \"network-metrics-daemon-d7gvz\" (UID: \"8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528\") " pod="openshift-multus/network-metrics-daemon-d7gvz"
Sep 06 00:50:47.951501 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:47.951256    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7270e6a0-6c6a-410a-b615-5cb276ebf879-original-pull-secret\") pod \"global-pull-secret-syncer-tc782\" (UID: \"7270e6a0-6c6a-410a-b615-5cb276ebf879\") " pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:50:47.951501 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:47.951400    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 00:50:47.951501 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:47.951461    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7270e6a0-6c6a-410a-b615-5cb276ebf879-original-pull-secret podName:7270e6a0-6c6a-410a-b615-5cb276ebf879 nodeName:}" failed. No retries permitted until 2026-09-06 00:50:51.95144295 +0000 UTC m=+9.987585886 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7270e6a0-6c6a-410a-b615-5cb276ebf879-original-pull-secret") pod "global-pull-secret-syncer-tc782" (UID: "7270e6a0-6c6a-410a-b615-5cb276ebf879") : object "kube-system"/"original-pull-secret" not registered
Sep 06 00:50:47.951921 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:47.951872    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 00:50:47.951988 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:47.951925    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528-metrics-certs podName:8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528 nodeName:}" failed. No retries permitted until 2026-09-06 00:50:51.95190958 +0000 UTC m=+9.988052528 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528-metrics-certs") pod "network-metrics-daemon-d7gvz" (UID: "8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 00:50:48.153950 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:48.153175    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2vkp\" (UniqueName: \"kubernetes.io/projected/31067da9-3ebb-40fc-b24e-34ccd0f5f3fd-kube-api-access-h2vkp\") pod \"network-check-target-wfwc6\" (UID: \"31067da9-3ebb-40fc-b24e-34ccd0f5f3fd\") " pod="openshift-network-diagnostics/network-check-target-wfwc6"
Sep 06 00:50:48.153950 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:48.153414    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 00:50:48.153950 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:48.153439    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 00:50:48.153950 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:48.153466    2577 projected.go:196] Error preparing data for projected volume kube-api-access-h2vkp for pod openshift-network-diagnostics/network-check-target-wfwc6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 00:50:48.153950 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:48.153550    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31067da9-3ebb-40fc-b24e-34ccd0f5f3fd-kube-api-access-h2vkp podName:31067da9-3ebb-40fc-b24e-34ccd0f5f3fd nodeName:}" failed. No retries permitted until 2026-09-06 00:50:52.153531175 +0000 UTC m=+10.189674124 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-h2vkp" (UniqueName: "kubernetes.io/projected/31067da9-3ebb-40fc-b24e-34ccd0f5f3fd-kube-api-access-h2vkp") pod "network-check-target-wfwc6" (UID: "31067da9-3ebb-40fc-b24e-34ccd0f5f3fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 00:50:48.405512 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:48.405441    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfwc6"
Sep 06 00:50:48.405666 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:48.405633    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfwc6" podUID="31067da9-3ebb-40fc-b24e-34ccd0f5f3fd"
Sep 06 00:50:48.405781 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:48.405723    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7gvz"
Sep 06 00:50:48.406042 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:48.405832    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7gvz" podUID="8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528"
Sep 06 00:50:48.406042 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:48.405884    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:50:48.406042 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:48.405952    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc782" podUID="7270e6a0-6c6a-410a-b615-5cb276ebf879"
Sep 06 00:50:50.405187 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:50.405153    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfwc6"
Sep 06 00:50:50.405649 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:50.405288    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfwc6" podUID="31067da9-3ebb-40fc-b24e-34ccd0f5f3fd"
Sep 06 00:50:50.405748 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:50.405727    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7gvz"
Sep 06 00:50:50.405873 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:50.405851    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7gvz" podUID="8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528"
Sep 06 00:50:50.405931 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:50.405921    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:50:50.406021 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:50.405996    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc782" podUID="7270e6a0-6c6a-410a-b615-5cb276ebf879"
Sep 06 00:50:51.985983 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:51.985944    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528-metrics-certs\") pod \"network-metrics-daemon-d7gvz\" (UID: \"8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528\") " pod="openshift-multus/network-metrics-daemon-d7gvz"
Sep 06 00:50:51.986456 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:51.986025    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7270e6a0-6c6a-410a-b615-5cb276ebf879-original-pull-secret\") pod \"global-pull-secret-syncer-tc782\" (UID: \"7270e6a0-6c6a-410a-b615-5cb276ebf879\") " pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:50:51.986456 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:51.986181    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 00:50:51.986456 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:51.986230    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7270e6a0-6c6a-410a-b615-5cb276ebf879-original-pull-secret podName:7270e6a0-6c6a-410a-b615-5cb276ebf879 nodeName:}" failed. No retries permitted until 2026-09-06 00:50:59.986214841 +0000 UTC m=+18.022357785 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7270e6a0-6c6a-410a-b615-5cb276ebf879-original-pull-secret") pod "global-pull-secret-syncer-tc782" (UID: "7270e6a0-6c6a-410a-b615-5cb276ebf879") : object "kube-system"/"original-pull-secret" not registered
Sep 06 00:50:51.986627 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:51.986548    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 00:50:51.986627 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:51.986596    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528-metrics-certs podName:8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528 nodeName:}" failed. No retries permitted until 2026-09-06 00:50:59.986584755 +0000 UTC m=+18.022727690 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528-metrics-certs") pod "network-metrics-daemon-d7gvz" (UID: "8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 00:50:52.187821 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:52.187267    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2vkp\" (UniqueName: \"kubernetes.io/projected/31067da9-3ebb-40fc-b24e-34ccd0f5f3fd-kube-api-access-h2vkp\") pod \"network-check-target-wfwc6\" (UID: \"31067da9-3ebb-40fc-b24e-34ccd0f5f3fd\") " pod="openshift-network-diagnostics/network-check-target-wfwc6"
Sep 06 00:50:52.187821 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:52.187433    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 00:50:52.187821 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:52.187455    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 00:50:52.187821 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:52.187469    2577 projected.go:196] Error preparing data for projected volume kube-api-access-h2vkp for pod openshift-network-diagnostics/network-check-target-wfwc6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 00:50:52.187821 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:52.187534    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31067da9-3ebb-40fc-b24e-34ccd0f5f3fd-kube-api-access-h2vkp podName:31067da9-3ebb-40fc-b24e-34ccd0f5f3fd nodeName:}" failed. No retries permitted until 2026-09-06 00:51:00.187516053 +0000 UTC m=+18.223658992 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-h2vkp" (UniqueName: "kubernetes.io/projected/31067da9-3ebb-40fc-b24e-34ccd0f5f3fd-kube-api-access-h2vkp") pod "network-check-target-wfwc6" (UID: "31067da9-3ebb-40fc-b24e-34ccd0f5f3fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 00:50:52.403876 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:52.403800    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfwc6"
Sep 06 00:50:52.404013 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:52.403909    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfwc6" podUID="31067da9-3ebb-40fc-b24e-34ccd0f5f3fd"
Sep 06 00:50:52.404291 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:52.404270    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7gvz"
Sep 06 00:50:52.404439 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:52.404399    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7gvz" podUID="8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528"
Sep 06 00:50:52.404661 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:52.404618    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:50:52.404745 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:52.404708    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc782" podUID="7270e6a0-6c6a-410a-b615-5cb276ebf879"
Sep 06 00:50:54.405520 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:54.404763    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfwc6"
Sep 06 00:50:54.405520 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:54.404876    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfwc6" podUID="31067da9-3ebb-40fc-b24e-34ccd0f5f3fd"
Sep 06 00:50:54.405520 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:54.404944    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7gvz"
Sep 06 00:50:54.405520 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:54.405022    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7gvz" podUID="8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528"
Sep 06 00:50:54.405520 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:54.405076    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:50:54.405520 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:54.405156    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc782" podUID="7270e6a0-6c6a-410a-b615-5cb276ebf879"
Sep 06 00:50:56.403010 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:56.402980    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7gvz"
Sep 06 00:50:56.403010 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:56.402995    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfwc6"
Sep 06 00:50:56.403485 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:56.402981    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:50:56.403485 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:56.403121    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfwc6" podUID="31067da9-3ebb-40fc-b24e-34ccd0f5f3fd"
Sep 06 00:50:56.403485 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:56.403169    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc782" podUID="7270e6a0-6c6a-410a-b615-5cb276ebf879"
Sep 06 00:50:56.403485 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:56.403218    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7gvz" podUID="8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528"
Sep 06 00:50:58.403647 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:58.403610    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7gvz"
Sep 06 00:50:58.404070 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:58.403610    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:50:58.404070 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:58.403765    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7gvz" podUID="8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528"
Sep 06 00:50:58.404070 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:50:58.403619    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfwc6"
Sep 06 00:50:58.404070 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:58.403820    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc782" podUID="7270e6a0-6c6a-410a-b615-5cb276ebf879"
Sep 06 00:50:58.404070 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:50:58.403879    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfwc6" podUID="31067da9-3ebb-40fc-b24e-34ccd0f5f3fd"
Sep 06 00:51:00.045131 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:00.045091    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7270e6a0-6c6a-410a-b615-5cb276ebf879-original-pull-secret\") pod \"global-pull-secret-syncer-tc782\" (UID: \"7270e6a0-6c6a-410a-b615-5cb276ebf879\") " pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:51:00.045610 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:00.045174    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528-metrics-certs\") pod \"network-metrics-daemon-d7gvz\" (UID: \"8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528\") " pod="openshift-multus/network-metrics-daemon-d7gvz"
Sep 06 00:51:00.045610 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:00.045251    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 00:51:00.045610 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:00.045249    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 00:51:00.045610 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:00.045312    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528-metrics-certs podName:8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528 nodeName:}" failed. No retries permitted until 2026-09-06 00:51:16.045297924 +0000 UTC m=+34.081440860 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528-metrics-certs") pod "network-metrics-daemon-d7gvz" (UID: "8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 00:51:00.045610 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:00.045343    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7270e6a0-6c6a-410a-b615-5cb276ebf879-original-pull-secret podName:7270e6a0-6c6a-410a-b615-5cb276ebf879 nodeName:}" failed. No retries permitted until 2026-09-06 00:51:16.045333327 +0000 UTC m=+34.081476262 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7270e6a0-6c6a-410a-b615-5cb276ebf879-original-pull-secret") pod "global-pull-secret-syncer-tc782" (UID: "7270e6a0-6c6a-410a-b615-5cb276ebf879") : object "kube-system"/"original-pull-secret" not registered
Sep 06 00:51:00.246677 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:00.246587    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2vkp\" (UniqueName: \"kubernetes.io/projected/31067da9-3ebb-40fc-b24e-34ccd0f5f3fd-kube-api-access-h2vkp\") pod \"network-check-target-wfwc6\" (UID: \"31067da9-3ebb-40fc-b24e-34ccd0f5f3fd\") " pod="openshift-network-diagnostics/network-check-target-wfwc6"
Sep 06 00:51:00.246838 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:00.246776    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 00:51:00.246838 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:00.246801    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 00:51:00.246838 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:00.246813    2577 projected.go:196] Error preparing data for projected volume kube-api-access-h2vkp for pod openshift-network-diagnostics/network-check-target-wfwc6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 00:51:00.246988 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:00.246870    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31067da9-3ebb-40fc-b24e-34ccd0f5f3fd-kube-api-access-h2vkp podName:31067da9-3ebb-40fc-b24e-34ccd0f5f3fd nodeName:}" failed. No retries permitted until 2026-09-06 00:51:16.246851911 +0000 UTC m=+34.282994864 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-h2vkp" (UniqueName: "kubernetes.io/projected/31067da9-3ebb-40fc-b24e-34ccd0f5f3fd-kube-api-access-h2vkp") pod "network-check-target-wfwc6" (UID: "31067da9-3ebb-40fc-b24e-34ccd0f5f3fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 00:51:00.402883 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:00.402855    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7gvz"
Sep 06 00:51:00.403070 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:00.402865    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:51:00.403070 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:00.402982    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfwc6"
Sep 06 00:51:00.403070 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:00.402977    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7gvz" podUID="8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528"
Sep 06 00:51:00.403070 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:00.403055    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc782" podUID="7270e6a0-6c6a-410a-b615-5cb276ebf879"
Sep 06 00:51:00.403267 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:00.403118    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfwc6" podUID="31067da9-3ebb-40fc-b24e-34ccd0f5f3fd"
Sep 06 00:51:02.404090 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:02.404063    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7gvz"
Sep 06 00:51:02.404626 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:02.404197    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7gvz" podUID="8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528"
Sep 06 00:51:02.404626 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:02.404273    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:51:02.404626 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:02.404397    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc782" podUID="7270e6a0-6c6a-410a-b615-5cb276ebf879"
Sep 06 00:51:02.404626 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:02.404436    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfwc6"
Sep 06 00:51:02.404626 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:02.404494    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfwc6" podUID="31067da9-3ebb-40fc-b24e-34ccd0f5f3fd"
Sep 06 00:51:04.403834 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:04.403402    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfwc6"
Sep 06 00:51:04.404283 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:04.403427    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7gvz"
Sep 06 00:51:04.404283 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:04.403960    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfwc6" podUID="31067da9-3ebb-40fc-b24e-34ccd0f5f3fd"
Sep 06 00:51:04.404283 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:04.403439    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:51:04.404283 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:04.404001    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7gvz" podUID="8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528"
Sep 06 00:51:04.404283 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:04.404092    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc782" podUID="7270e6a0-6c6a-410a-b615-5cb276ebf879"
Sep 06 00:51:04.523304 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:04.523272    2577 generic.go:356] "Generic (PLEG): container finished" podID="2c9e3cd8-83aa-40b9-a844-65a7a157c377" containerID="321a21f0f1d964e5d3a32ef37b074df001e65bcd61a562d1a685f42ea06d3a4a" exitCode=0
Sep 06 00:51:04.523492 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:04.523362    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jv24f" event={"ID":"2c9e3cd8-83aa-40b9-a844-65a7a157c377","Type":"ContainerDied","Data":"321a21f0f1d964e5d3a32ef37b074df001e65bcd61a562d1a685f42ea06d3a4a"}
Sep 06 00:51:04.524943 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:04.524857    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78nm" event={"ID":"c85785bd-cd1f-47c0-bd9f-167af4cc20dc","Type":"ContainerStarted","Data":"9d152032fee821931b8305b1a7303d7afc2a5d8b5ed857120479cfe1b474b3c0"}
Sep 06 00:51:04.526532 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:04.526351    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ww88t" event={"ID":"079a153a-9b55-4225-8928-cd8a28906fd3","Type":"ContainerStarted","Data":"675346666f9f5d9afb2dedf6591846e844a675fc01757e942eef73f26829bca4"}
Sep 06 00:51:04.527890 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:04.527865    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ks4rt" event={"ID":"500d4399-6afb-424e-8cc2-b17de185462c","Type":"ContainerStarted","Data":"c1d2df4b094952b5a3882e05331b174e2d87a4334d89359d3f20835db4349b14"}
Sep 06 00:51:04.529344 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:04.529306    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gk6l5" event={"ID":"bcd87c76-22e5-4905-bb95-d1acd077ceff","Type":"ContainerStarted","Data":"f70f4f856ef6a56fd13658ad2faa9271e289425c8fb5c6270000c115ac61bba7"}
Sep 06 00:51:04.531997 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:04.531979    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2z66_e100e633-d18a-4d68-9c81-0ff379c12d2f/ovn-acl-logging/0.log"
Sep 06 00:51:04.532281 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:04.532264    2577 generic.go:356] "Generic (PLEG): container finished" podID="e100e633-d18a-4d68-9c81-0ff379c12d2f" containerID="58970649c83ec6834bd3ef3e23ccb515dacdf5abb9edca457097e2c8380c5250" exitCode=1
Sep 06 00:51:04.532390 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:04.532335    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j2z66" event={"ID":"e100e633-d18a-4d68-9c81-0ff379c12d2f","Type":"ContainerStarted","Data":"d77ee3d8a970947d6fbc3f8620603585b1951c0ca27daf22682af6714e56ad09"}
Sep 06 00:51:04.532390 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:04.532387    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j2z66" event={"ID":"e100e633-d18a-4d68-9c81-0ff379c12d2f","Type":"ContainerStarted","Data":"e16716811ae11c2c88337a7c47bdc4775e20536e7722e9de5d43dd9b9c3a6b2d"}
Sep 06 00:51:04.532485 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:04.532433    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j2z66" event={"ID":"e100e633-d18a-4d68-9c81-0ff379c12d2f","Type":"ContainerStarted","Data":"a7601ae59c0bf072cfae82b488573e9929b47adc4f5dd6cec9d1650b5d71ac5b"}
Sep 06 00:51:04.532485 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:04.532465    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j2z66" event={"ID":"e100e633-d18a-4d68-9c81-0ff379c12d2f","Type":"ContainerStarted","Data":"d4bf20547b740f58e0a81975721e4daf5dbf8cc55a32962f759b7cf8a3e4c9f0"}
Sep 06 00:51:04.532555 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:04.532492    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j2z66" event={"ID":"e100e633-d18a-4d68-9c81-0ff379c12d2f","Type":"ContainerDied","Data":"58970649c83ec6834bd3ef3e23ccb515dacdf5abb9edca457097e2c8380c5250"}
Sep 06 00:51:04.532555 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:04.532541    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j2z66" event={"ID":"e100e633-d18a-4d68-9c81-0ff379c12d2f","Type":"ContainerStarted","Data":"3b4043a019437191216bc139c40a0050e654dc72c0e9f4f76166c09e45efa0a1"}
Sep 06 00:51:04.533618 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:04.533601    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5tp8t" event={"ID":"620c23ce-8e99-4b25-88ea-862c99c5dba3","Type":"ContainerStarted","Data":"a1457465f1214b84022d4841438faf161c4b7984292e25bb0e49606dcfc1aa15"}
Sep 06 00:51:04.534843 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:04.534826    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w9xwb" event={"ID":"07e0007b-c474-48f7-9bdc-91218d4e681e","Type":"ContainerStarted","Data":"0fc72891f8899a0e26e9d99a5b88d58b95b9007006f3568b4acf9cabe76a2a62"}
Sep 06 00:51:04.546328 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:04.546282    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-57.ec2.internal" podStartSLOduration=21.546251228 podStartE2EDuration="21.546251228s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 00:50:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:50:47.503606542 +0000 UTC m=+5.539749500" watchObservedRunningTime="2026-09-06 00:51:04.546251228 +0000 UTC m=+22.582394167"
Sep 06 00:51:04.563505 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:04.563422    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-w9xwb" podStartSLOduration=4.181936472 podStartE2EDuration="22.563407732s" totalImagesPullingTime="18.38147126s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 00:50:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:04.563174087 +0000 UTC m=+22.599317043" watchObservedRunningTime="2026-09-06 00:51:04.563407732 +0000 UTC m=+22.599550688"
Sep 06 00:51:04.583019 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:04.582975    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5tp8t" podStartSLOduration=4.201376819 podStartE2EDuration="22.582959663s" totalImagesPullingTime="18.381582844s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 00:50:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:04.582490749 +0000 UTC m=+22.618633703" watchObservedRunningTime="2026-09-06 00:51:04.582959663 +0000 UTC m=+22.619102620"
Sep 06 00:51:04.602154 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:04.602108    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gk6l5" podStartSLOduration=4.223899281 podStartE2EDuration="22.602092718s" totalImagesPullingTime="18.378193437s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 00:50:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:04.60192959 +0000 UTC m=+22.638072546" watchObservedRunningTime="2026-09-06 00:51:04.602092718 +0000 UTC m=+22.638235675"
Sep 06 00:51:04.621804 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:04.621767    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ww88t" podStartSLOduration=3.822604472 podStartE2EDuration="22.621751305s" totalImagesPullingTime="18.799146833s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 00:50:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:04.621579038 +0000 UTC m=+22.657721995" watchObservedRunningTime="2026-09-06 00:51:04.621751305 +0000 UTC m=+22.657894258"
Sep 06 00:51:04.641121 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:04.641076    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ks4rt" podStartSLOduration=8.074923403 podStartE2EDuration="22.641059977s" totalImagesPullingTime="14.566136574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:50:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:04.640586201 +0000 UTC m=+22.676729158" watchObservedRunningTime="2026-09-06 00:51:04.641059977 +0000 UTC m=+22.677202934"
Sep 06 00:51:05.442225 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:05.442195    2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 06 00:51:05.538597 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:05.538565    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wvtqk" event={"ID":"9a199e00-e8e6-4ac4-93c6-cfa4d3701ced","Type":"ContainerStarted","Data":"01e662462bc8a4c293cb103ac645b6716f11aa17032c5b7f8c9031623c47def4"}
Sep 06 00:51:05.540618 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:05.540588    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78nm" event={"ID":"c85785bd-cd1f-47c0-bd9f-167af4cc20dc","Type":"ContainerStarted","Data":"dfd95bd03da135cf9230c055d7d7163d4155f111cfbda27bc72bda3fa2fd0dd2"}
Sep 06 00:51:05.552182 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:05.552133    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wvtqk" podStartSLOduration=5.181137268 podStartE2EDuration="23.552104098s" totalImagesPullingTime="18.37096683s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 00:50:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:05.55180675 +0000 UTC m=+23.587949705" watchObservedRunningTime="2026-09-06 00:51:05.552104098 +0000 UTC m=+23.588247054"
Sep 06 00:51:06.380499 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:06.380388    2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-06T00:51:05.442213202Z","UUID":"659de36d-e7c1-424d-a3a1-24c5875306a0","Handler":null,"Name":"","Endpoint":""}
Sep 06 00:51:06.382008 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:06.381984    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 06 00:51:06.382136 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:06.382022    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 06 00:51:06.405746 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:06.405716    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfwc6"
Sep 06 00:51:06.405886 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:06.405864    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfwc6" podUID="31067da9-3ebb-40fc-b24e-34ccd0f5f3fd"
Sep 06 00:51:06.406252 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:06.406234    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7gvz"
Sep 06 00:51:06.406387 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:06.406356    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7gvz" podUID="8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528"
Sep 06 00:51:06.406493 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:06.406410    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:51:06.406493 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:06.406482    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc782" podUID="7270e6a0-6c6a-410a-b615-5cb276ebf879"
Sep 06 00:51:07.295979 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:07.295944    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ks4rt"
Sep 06 00:51:07.296607 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:07.296591    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ks4rt"
Sep 06 00:51:07.547883 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:07.547801    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78nm" event={"ID":"c85785bd-cd1f-47c0-bd9f-167af4cc20dc","Type":"ContainerStarted","Data":"b15c48247898a32d78467e86c55908762e8f56d1ff5731975a0066af8754a309"}
Sep 06 00:51:07.551564 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:07.551538    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2z66_e100e633-d18a-4d68-9c81-0ff379c12d2f/ovn-acl-logging/0.log"
Sep 06 00:51:07.551931 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:07.551907    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j2z66" event={"ID":"e100e633-d18a-4d68-9c81-0ff379c12d2f","Type":"ContainerStarted","Data":"3892dc70ff7884ce9e1c5a4db44101cb71d7d62d0482e8078c2d399710715124"}
Sep 06 00:51:07.552170 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:07.552125    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ks4rt"
Sep 06 00:51:07.552662 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:07.552642    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ks4rt"
Sep 06 00:51:07.564701 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:07.564655    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78nm" podStartSLOduration=4.627243795 podStartE2EDuration="25.564635667s" totalImagesPullingTime="20.937391872s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 00:50:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:07.564021391 +0000 UTC m=+25.600164379" watchObservedRunningTime="2026-09-06 00:51:07.564635667 +0000 UTC m=+25.600778624"
Sep 06 00:51:08.404481 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:08.404448    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7gvz"
Sep 06 00:51:08.404987 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:08.404447    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:51:08.404987 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:08.404590    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7gvz" podUID="8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528"
Sep 06 00:51:08.404987 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:08.404683    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc782" podUID="7270e6a0-6c6a-410a-b615-5cb276ebf879"
Sep 06 00:51:08.404987 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:08.404731    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfwc6"
Sep 06 00:51:08.404987 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:08.404799    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfwc6" podUID="31067da9-3ebb-40fc-b24e-34ccd0f5f3fd"
Sep 06 00:51:09.558168 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:09.557993    2577 generic.go:356] "Generic (PLEG): container finished" podID="2c9e3cd8-83aa-40b9-a844-65a7a157c377" containerID="550c8c41b4d5d5aa6e0c05b33f3b197e7ac38dc255719209f24637ba61b92c96" exitCode=0
Sep 06 00:51:09.558733 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:09.558078    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jv24f" event={"ID":"2c9e3cd8-83aa-40b9-a844-65a7a157c377","Type":"ContainerDied","Data":"550c8c41b4d5d5aa6e0c05b33f3b197e7ac38dc255719209f24637ba61b92c96"}
Sep 06 00:51:09.561841 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:09.561812    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2z66_e100e633-d18a-4d68-9c81-0ff379c12d2f/ovn-acl-logging/0.log"
Sep 06 00:51:09.562258 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:09.562235    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j2z66" event={"ID":"e100e633-d18a-4d68-9c81-0ff379c12d2f","Type":"ContainerStarted","Data":"259071f6ddffc471273e432b77892d7b278f3ab58a84b848f22ff6818364282a"}
Sep 06 00:51:09.562654 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:09.562637    2577 scope.go:117] "RemoveContainer" containerID="58970649c83ec6834bd3ef3e23ccb515dacdf5abb9edca457097e2c8380c5250"
Sep 06 00:51:10.402889 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:10.402643    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfwc6"
Sep 06 00:51:10.403024 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:10.402994    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfwc6" podUID="31067da9-3ebb-40fc-b24e-34ccd0f5f3fd"
Sep 06 00:51:10.403024 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:10.402696    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7gvz"
Sep 06 00:51:10.403141 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:10.402745    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:51:10.403141 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:10.403116    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7gvz" podUID="8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528"
Sep 06 00:51:10.403245 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:10.403192    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc782" podUID="7270e6a0-6c6a-410a-b615-5cb276ebf879"
Sep 06 00:51:10.491818 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:10.491790    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w9xwb_07e0007b-c474-48f7-9bdc-91218d4e681e/dns-node-resolver/0.log"
Sep 06 00:51:10.567178 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:10.567115    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2z66_e100e633-d18a-4d68-9c81-0ff379c12d2f/ovn-acl-logging/0.log"
Sep 06 00:51:10.567859 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:10.567496    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j2z66" event={"ID":"e100e633-d18a-4d68-9c81-0ff379c12d2f","Type":"ContainerStarted","Data":"cd0964a1d2e750745436135d319a0e54ae397b5241e9a70a65a271098415f21e"}
Sep 06 00:51:10.567859 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:10.567583    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:51:10.567859 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:10.567792    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:51:10.568011 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:10.567942    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:51:10.573148 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:10.572646    2577 generic.go:356] "Generic (PLEG): container finished" podID="2c9e3cd8-83aa-40b9-a844-65a7a157c377" containerID="961c82a085cfb4901fb0e69f9ef59ad7604f7b2b6bccfa61e4ceb9fe87917210" exitCode=0
Sep 06 00:51:10.573148 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:10.572910    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jv24f" event={"ID":"2c9e3cd8-83aa-40b9-a844-65a7a157c377","Type":"ContainerDied","Data":"961c82a085cfb4901fb0e69f9ef59ad7604f7b2b6bccfa61e4ceb9fe87917210"}
Sep 06 00:51:10.585406 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:10.585367    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:51:10.585519 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:10.585503    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:51:10.619168 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:10.619127    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-j2z66" podStartSLOduration=10.202496458 podStartE2EDuration="28.619113969s" totalImagesPullingTime="18.416617511s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 00:50:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:10.598568454 +0000 UTC m=+28.634711411" watchObservedRunningTime="2026-09-06 00:51:10.619113969 +0000 UTC m=+28.655256926"
Sep 06 00:51:10.652739 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:10.652712    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wfwc6"]
Sep 06 00:51:10.652846 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:10.652829    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfwc6"
Sep 06 00:51:10.652959 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:10.652936    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfwc6" podUID="31067da9-3ebb-40fc-b24e-34ccd0f5f3fd"
Sep 06 00:51:10.656074 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:10.656053    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tc782"]
Sep 06 00:51:10.656188 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:10.656152    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:51:10.656271 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:10.656252    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc782" podUID="7270e6a0-6c6a-410a-b615-5cb276ebf879"
Sep 06 00:51:10.656695 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:10.656672    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d7gvz"]
Sep 06 00:51:10.656821 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:10.656763    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7gvz"
Sep 06 00:51:10.656886 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:10.656854    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7gvz" podUID="8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528"
Sep 06 00:51:11.267246 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:11.267219    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gk6l5_bcd87c76-22e5-4905-bb95-d1acd077ceff/node-ca/0.log"
Sep 06 00:51:11.577343 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:11.577295    2577 generic.go:356] "Generic (PLEG): container finished" podID="2c9e3cd8-83aa-40b9-a844-65a7a157c377" containerID="0c5f77c97ab79a1f8bf9a93debf17f0c7d169bae3c7e14d04b8967df0786e197" exitCode=0
Sep 06 00:51:11.577831 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:11.577362    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jv24f" event={"ID":"2c9e3cd8-83aa-40b9-a844-65a7a157c377","Type":"ContainerDied","Data":"0c5f77c97ab79a1f8bf9a93debf17f0c7d169bae3c7e14d04b8967df0786e197"}
Sep 06 00:51:12.412888 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:12.412859    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:51:12.413076 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:12.412912    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfwc6"
Sep 06 00:51:12.413076 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:12.413001    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7gvz"
Sep 06 00:51:12.413076 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:12.413001    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc782" podUID="7270e6a0-6c6a-410a-b615-5cb276ebf879"
Sep 06 00:51:12.413240 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:12.413132    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7gvz" podUID="8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528"
Sep 06 00:51:12.413240 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:12.413207    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfwc6" podUID="31067da9-3ebb-40fc-b24e-34ccd0f5f3fd"
Sep 06 00:51:14.406508 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:14.406289    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:51:14.406938 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:14.406396    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7gvz"
Sep 06 00:51:14.406938 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:14.406404    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfwc6"
Sep 06 00:51:14.406938 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:14.406603    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc782" podUID="7270e6a0-6c6a-410a-b615-5cb276ebf879"
Sep 06 00:51:14.406938 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:14.406672    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7gvz" podUID="8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528"
Sep 06 00:51:14.406938 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:14.406751    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfwc6" podUID="31067da9-3ebb-40fc-b24e-34ccd0f5f3fd"
Sep 06 00:51:16.060408 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:16.060374    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7270e6a0-6c6a-410a-b615-5cb276ebf879-original-pull-secret\") pod \"global-pull-secret-syncer-tc782\" (UID: \"7270e6a0-6c6a-410a-b615-5cb276ebf879\") " pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:51:16.060720 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:16.060435    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528-metrics-certs\") pod \"network-metrics-daemon-d7gvz\" (UID: \"8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528\") " pod="openshift-multus/network-metrics-daemon-d7gvz"
Sep 06 00:51:16.060720 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:16.060511    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 00:51:16.060720 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:16.060525    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 00:51:16.060720 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:16.060573    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7270e6a0-6c6a-410a-b615-5cb276ebf879-original-pull-secret podName:7270e6a0-6c6a-410a-b615-5cb276ebf879 nodeName:}" failed. No retries permitted until 2026-09-06 00:51:48.060557449 +0000 UTC m=+66.096700384 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7270e6a0-6c6a-410a-b615-5cb276ebf879-original-pull-secret") pod "global-pull-secret-syncer-tc782" (UID: "7270e6a0-6c6a-410a-b615-5cb276ebf879") : object "kube-system"/"original-pull-secret" not registered
Sep 06 00:51:16.060720 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:16.060589    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528-metrics-certs podName:8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528 nodeName:}" failed. No retries permitted until 2026-09-06 00:51:48.060580627 +0000 UTC m=+66.096723562 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528-metrics-certs") pod "network-metrics-daemon-d7gvz" (UID: "8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 00:51:16.261548 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:16.261522    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2vkp\" (UniqueName: \"kubernetes.io/projected/31067da9-3ebb-40fc-b24e-34ccd0f5f3fd-kube-api-access-h2vkp\") pod \"network-check-target-wfwc6\" (UID: \"31067da9-3ebb-40fc-b24e-34ccd0f5f3fd\") " pod="openshift-network-diagnostics/network-check-target-wfwc6"
Sep 06 00:51:16.261688 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:16.261653    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 00:51:16.261688 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:16.261670    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 00:51:16.261688 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:16.261682    2577 projected.go:196] Error preparing data for projected volume kube-api-access-h2vkp for pod openshift-network-diagnostics/network-check-target-wfwc6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 00:51:16.261879 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:16.261728    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31067da9-3ebb-40fc-b24e-34ccd0f5f3fd-kube-api-access-h2vkp podName:31067da9-3ebb-40fc-b24e-34ccd0f5f3fd nodeName:}" failed. No retries permitted until 2026-09-06 00:51:48.261715658 +0000 UTC m=+66.297858593 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-h2vkp" (UniqueName: "kubernetes.io/projected/31067da9-3ebb-40fc-b24e-34ccd0f5f3fd-kube-api-access-h2vkp") pod "network-check-target-wfwc6" (UID: "31067da9-3ebb-40fc-b24e-34ccd0f5f3fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 00:51:16.403617 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:16.403585    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:51:16.403617 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:16.403585    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7gvz"
Sep 06 00:51:16.403838 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:16.403703    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfwc6"
Sep 06 00:51:16.403838 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:16.403704    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc782" podUID="7270e6a0-6c6a-410a-b615-5cb276ebf879"
Sep 06 00:51:16.403838 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:16.403815    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7gvz" podUID="8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528"
Sep 06 00:51:16.403976 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:16.403899    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfwc6" podUID="31067da9-3ebb-40fc-b24e-34ccd0f5f3fd"
Sep 06 00:51:16.591785 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:16.591706    2577 generic.go:356] "Generic (PLEG): container finished" podID="2c9e3cd8-83aa-40b9-a844-65a7a157c377" containerID="23c59e3b44dbc7544bd82ec8f4c4f7ab86dbc3c2e7c06e1aa2d7f3c27a83b2f7" exitCode=0
Sep 06 00:51:16.591785 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:16.591742    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jv24f" event={"ID":"2c9e3cd8-83aa-40b9-a844-65a7a157c377","Type":"ContainerDied","Data":"23c59e3b44dbc7544bd82ec8f4c4f7ab86dbc3c2e7c06e1aa2d7f3c27a83b2f7"}
Sep 06 00:51:17.597278 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:17.597235    2577 generic.go:356] "Generic (PLEG): container finished" podID="2c9e3cd8-83aa-40b9-a844-65a7a157c377" containerID="d9e3042a52e7661e179669306cc279a94b29a1bb8c3f8533d1b5c2f7dd990a7b" exitCode=0
Sep 06 00:51:17.597693 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:17.597315    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jv24f" event={"ID":"2c9e3cd8-83aa-40b9-a844-65a7a157c377","Type":"ContainerDied","Data":"d9e3042a52e7661e179669306cc279a94b29a1bb8c3f8533d1b5c2f7dd990a7b"}
Sep 06 00:51:18.403216 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:18.403180    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7gvz"
Sep 06 00:51:18.403392 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:18.403294    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7gvz" podUID="8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528"
Sep 06 00:51:18.403392 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:18.403307    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfwc6"
Sep 06 00:51:18.403484 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:18.403392    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfwc6" podUID="31067da9-3ebb-40fc-b24e-34ccd0f5f3fd"
Sep 06 00:51:18.403484 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:18.403411    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:51:18.403484 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:18.403465    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc782" podUID="7270e6a0-6c6a-410a-b615-5cb276ebf879"
Sep 06 00:51:18.602704 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:18.602666    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jv24f" event={"ID":"2c9e3cd8-83aa-40b9-a844-65a7a157c377","Type":"ContainerStarted","Data":"960062958e8a53d57352fc28807cf3a5a0536e2c6d48efd84cd9bf1119417363"}
Sep 06 00:51:18.625079 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:18.625035    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jv24f" podStartSLOduration=8.331966536 podStartE2EDuration="36.62501735s" totalImagesPullingTime="28.293050814s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 00:50:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:18.624878334 +0000 UTC m=+36.661021290" watchObservedRunningTime="2026-09-06 00:51:18.62501735 +0000 UTC m=+36.661160366"
Sep 06 00:51:20.403583 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:20.403544    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfwc6"
Sep 06 00:51:20.403976 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:20.403549    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7gvz"
Sep 06 00:51:20.403976 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:20.403664    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfwc6" podUID="31067da9-3ebb-40fc-b24e-34ccd0f5f3fd"
Sep 06 00:51:20.403976 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:20.403553    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:51:20.403976 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:20.403742    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7gvz" podUID="8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528"
Sep 06 00:51:20.403976 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:20.403810    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc782" podUID="7270e6a0-6c6a-410a-b615-5cb276ebf879"
Sep 06 00:51:22.403766 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:22.403734    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfwc6"
Sep 06 00:51:22.404132 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:22.403815    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfwc6" podUID="31067da9-3ebb-40fc-b24e-34ccd0f5f3fd"
Sep 06 00:51:22.404132 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:22.403918    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7gvz"
Sep 06 00:51:22.404132 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:22.404033    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7gvz" podUID="8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528"
Sep 06 00:51:22.404132 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:22.404117    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:51:22.404261 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:22.404200    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc782" podUID="7270e6a0-6c6a-410a-b615-5cb276ebf879"
Sep 06 00:51:24.403135 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:24.403103    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7gvz"
Sep 06 00:51:24.403135 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:24.403138    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:51:24.403596 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:24.403103    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfwc6"
Sep 06 00:51:24.403596 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:24.403205    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7gvz" podUID="8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528"
Sep 06 00:51:24.403596 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:24.403294    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfwc6" podUID="31067da9-3ebb-40fc-b24e-34ccd0f5f3fd"
Sep 06 00:51:24.403596 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:24.403378    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc782" podUID="7270e6a0-6c6a-410a-b615-5cb276ebf879"
Sep 06 00:51:26.403334 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:26.403300    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfwc6"
Sep 06 00:51:26.403334 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:26.403315    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:51:26.403895 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:26.403300    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7gvz"
Sep 06 00:51:26.403895 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:26.403428    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfwc6" podUID="31067da9-3ebb-40fc-b24e-34ccd0f5f3fd"
Sep 06 00:51:26.403895 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:26.403495    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7gvz" podUID="8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528"
Sep 06 00:51:26.403895 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:26.403548    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc782" podUID="7270e6a0-6c6a-410a-b615-5cb276ebf879"
Sep 06 00:51:28.403292 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:28.403262    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfwc6"
Sep 06 00:51:28.403292 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:28.403286    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:51:28.403804 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:28.403265    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7gvz"
Sep 06 00:51:28.403804 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:28.403385    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfwc6" podUID="31067da9-3ebb-40fc-b24e-34ccd0f5f3fd"
Sep 06 00:51:28.403804 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:28.403458    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7gvz" podUID="8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528"
Sep 06 00:51:28.403804 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:28.403533    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc782" podUID="7270e6a0-6c6a-410a-b615-5cb276ebf879"
Sep 06 00:51:30.403340 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:30.403281    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7gvz"
Sep 06 00:51:30.403820 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:30.403362    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:51:30.403820 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:30.403379    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfwc6"
Sep 06 00:51:30.403820 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:30.403481    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc782" podUID="7270e6a0-6c6a-410a-b615-5cb276ebf879"
Sep 06 00:51:30.403820 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:30.403528    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfwc6" podUID="31067da9-3ebb-40fc-b24e-34ccd0f5f3fd"
Sep 06 00:51:30.403820 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:30.403603    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7gvz" podUID="8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528"
Sep 06 00:51:32.404262 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:32.404226    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7gvz"
Sep 06 00:51:32.404732 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:32.404352    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7gvz" podUID="8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528"
Sep 06 00:51:32.404732 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:32.404400    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfwc6"
Sep 06 00:51:32.404732 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:32.404476    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfwc6" podUID="31067da9-3ebb-40fc-b24e-34ccd0f5f3fd"
Sep 06 00:51:32.404732 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:32.404484    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:51:32.404732 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:32.404565    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc782" podUID="7270e6a0-6c6a-410a-b615-5cb276ebf879"
Sep 06 00:51:34.403312 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:34.403276    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfwc6"
Sep 06 00:51:34.403312 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:34.403307    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:51:34.403829 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:34.403276    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7gvz"
Sep 06 00:51:34.403829 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:34.403404    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfwc6" podUID="31067da9-3ebb-40fc-b24e-34ccd0f5f3fd"
Sep 06 00:51:34.403829 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:34.403497    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d7gvz" podUID="8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528"
Sep 06 00:51:34.403829 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:34.403586    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc782" podUID="7270e6a0-6c6a-410a-b615-5cb276ebf879"
Sep 06 00:51:35.730077 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.730054    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeReady"
Sep 06 00:51:35.730454 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.730165    2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 06 00:51:35.786144 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.786113    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gcdgv"]
Sep 06 00:51:35.787748 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.787733    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gcdgv"
Sep 06 00:51:35.789422 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.789397    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hfvkl"]
Sep 06 00:51:35.790136 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.790119    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 06 00:51:35.790301 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.790284    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sw7jk\""
Sep 06 00:51:35.790578 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.790563    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 06 00:51:35.791042 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.791026    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hfvkl"
Sep 06 00:51:35.793529 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.793508    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 06 00:51:35.793628 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.793613    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ht4cf\""
Sep 06 00:51:35.793840 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.793822    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 06 00:51:35.794083 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.794065    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 06 00:51:35.800552 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.800533    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8aeab2aa-85be-432a-9cb7-bf89a08bf962-metrics-tls\") pod \"dns-default-gcdgv\" (UID: \"8aeab2aa-85be-432a-9cb7-bf89a08bf962\") " pod="openshift-dns/dns-default-gcdgv"
Sep 06 00:51:35.800639 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.800625    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8aeab2aa-85be-432a-9cb7-bf89a08bf962-config-volume\") pod \"dns-default-gcdgv\" (UID: \"8aeab2aa-85be-432a-9cb7-bf89a08bf962\") " pod="openshift-dns/dns-default-gcdgv"
Sep 06 00:51:35.800704 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.800657    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlds5\" (UniqueName: \"kubernetes.io/projected/8aeab2aa-85be-432a-9cb7-bf89a08bf962-kube-api-access-jlds5\") pod \"dns-default-gcdgv\" (UID: \"8aeab2aa-85be-432a-9cb7-bf89a08bf962\") " pod="openshift-dns/dns-default-gcdgv"
Sep 06 00:51:35.800704 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.800687    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e898d551-a885-4d1c-bf4b-f2632137dcb8-cert\") pod \"ingress-canary-hfvkl\" (UID: \"e898d551-a885-4d1c-bf4b-f2632137dcb8\") " pod="openshift-ingress-canary/ingress-canary-hfvkl"
Sep 06 00:51:35.800898 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.800730    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8aeab2aa-85be-432a-9cb7-bf89a08bf962-tmp-dir\") pod \"dns-default-gcdgv\" (UID: \"8aeab2aa-85be-432a-9cb7-bf89a08bf962\") " pod="openshift-dns/dns-default-gcdgv"
Sep 06 00:51:35.800898 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.800814    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89pt4\" (UniqueName: \"kubernetes.io/projected/e898d551-a885-4d1c-bf4b-f2632137dcb8-kube-api-access-89pt4\") pod \"ingress-canary-hfvkl\" (UID: \"e898d551-a885-4d1c-bf4b-f2632137dcb8\") " pod="openshift-ingress-canary/ingress-canary-hfvkl"
Sep 06 00:51:35.804681 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.804664    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gcdgv"]
Sep 06 00:51:35.815309 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.815287    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7pllw"]
Sep 06 00:51:35.817041 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.817028    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7pllw"
Sep 06 00:51:35.819944 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.819889    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 06 00:51:35.820216 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.820200    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 06 00:51:35.820375 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.820200    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-g58m5\""
Sep 06 00:51:35.820490 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.820472    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 06 00:51:35.820558 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.820518    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 06 00:51:35.821361 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.821311    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hfvkl"]
Sep 06 00:51:35.868613 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.868550    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7pllw"]
Sep 06 00:51:35.901203 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.901179    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8aeab2aa-85be-432a-9cb7-bf89a08bf962-config-volume\") pod \"dns-default-gcdgv\" (UID: \"8aeab2aa-85be-432a-9cb7-bf89a08bf962\") " pod="openshift-dns/dns-default-gcdgv"
Sep 06 00:51:35.901350 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.901209    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2478bdcf-6cca-4dd9-9e4c-9d21405860ed-crio-socket\") pod \"insights-runtime-extractor-7pllw\" (UID: \"2478bdcf-6cca-4dd9-9e4c-9d21405860ed\") " pod="openshift-insights/insights-runtime-extractor-7pllw"
Sep 06 00:51:35.901350 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.901226    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlds5\" (UniqueName: \"kubernetes.io/projected/8aeab2aa-85be-432a-9cb7-bf89a08bf962-kube-api-access-jlds5\") pod \"dns-default-gcdgv\" (UID: \"8aeab2aa-85be-432a-9cb7-bf89a08bf962\") " pod="openshift-dns/dns-default-gcdgv"
Sep 06 00:51:35.901350 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.901245    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e898d551-a885-4d1c-bf4b-f2632137dcb8-cert\") pod \"ingress-canary-hfvkl\" (UID: \"e898d551-a885-4d1c-bf4b-f2632137dcb8\") " pod="openshift-ingress-canary/ingress-canary-hfvkl"
Sep 06 00:51:35.901350 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.901260    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8aeab2aa-85be-432a-9cb7-bf89a08bf962-tmp-dir\") pod \"dns-default-gcdgv\" (UID: \"8aeab2aa-85be-432a-9cb7-bf89a08bf962\") " pod="openshift-dns/dns-default-gcdgv"
Sep 06 00:51:35.901350 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.901284    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89pt4\" (UniqueName: \"kubernetes.io/projected/e898d551-a885-4d1c-bf4b-f2632137dcb8-kube-api-access-89pt4\") pod \"ingress-canary-hfvkl\" (UID: \"e898d551-a885-4d1c-bf4b-f2632137dcb8\") " pod="openshift-ingress-canary/ingress-canary-hfvkl"
Sep 06 00:51:35.901350 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.901306    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2478bdcf-6cca-4dd9-9e4c-9d21405860ed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7pllw\" (UID: \"2478bdcf-6cca-4dd9-9e4c-9d21405860ed\") " pod="openshift-insights/insights-runtime-extractor-7pllw"
Sep 06 00:51:35.901697 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.901359    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbk9r\" (UniqueName: \"kubernetes.io/projected/2478bdcf-6cca-4dd9-9e4c-9d21405860ed-kube-api-access-fbk9r\") pod \"insights-runtime-extractor-7pllw\" (UID: \"2478bdcf-6cca-4dd9-9e4c-9d21405860ed\") " pod="openshift-insights/insights-runtime-extractor-7pllw"
Sep 06 00:51:35.901697 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.901454    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8aeab2aa-85be-432a-9cb7-bf89a08bf962-metrics-tls\") pod \"dns-default-gcdgv\" (UID: \"8aeab2aa-85be-432a-9cb7-bf89a08bf962\") " pod="openshift-dns/dns-default-gcdgv"
Sep 06 00:51:35.901697 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.901491    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2478bdcf-6cca-4dd9-9e4c-9d21405860ed-data-volume\") pod \"insights-runtime-extractor-7pllw\" (UID: \"2478bdcf-6cca-4dd9-9e4c-9d21405860ed\") " pod="openshift-insights/insights-runtime-extractor-7pllw"
Sep 06 00:51:35.901697 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.901609    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2478bdcf-6cca-4dd9-9e4c-9d21405860ed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7pllw\" (UID: \"2478bdcf-6cca-4dd9-9e4c-9d21405860ed\") " pod="openshift-insights/insights-runtime-extractor-7pllw"
Sep 06 00:51:35.901865 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.901696    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8aeab2aa-85be-432a-9cb7-bf89a08bf962-tmp-dir\") pod \"dns-default-gcdgv\" (UID: \"8aeab2aa-85be-432a-9cb7-bf89a08bf962\") " pod="openshift-dns/dns-default-gcdgv"
Sep 06 00:51:35.901865 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.901805    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8aeab2aa-85be-432a-9cb7-bf89a08bf962-config-volume\") pod \"dns-default-gcdgv\" (UID: \"8aeab2aa-85be-432a-9cb7-bf89a08bf962\") " pod="openshift-dns/dns-default-gcdgv"
Sep 06 00:51:35.905263 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.905243    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8aeab2aa-85be-432a-9cb7-bf89a08bf962-metrics-tls\") pod \"dns-default-gcdgv\" (UID: \"8aeab2aa-85be-432a-9cb7-bf89a08bf962\") " pod="openshift-dns/dns-default-gcdgv"
Sep 06 00:51:35.905369 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.905281    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e898d551-a885-4d1c-bf4b-f2632137dcb8-cert\") pod \"ingress-canary-hfvkl\" (UID: \"e898d551-a885-4d1c-bf4b-f2632137dcb8\") " pod="openshift-ingress-canary/ingress-canary-hfvkl"
Sep 06 00:51:35.909896 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.909876    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlds5\" (UniqueName: \"kubernetes.io/projected/8aeab2aa-85be-432a-9cb7-bf89a08bf962-kube-api-access-jlds5\") pod \"dns-default-gcdgv\" (UID: \"8aeab2aa-85be-432a-9cb7-bf89a08bf962\") " pod="openshift-dns/dns-default-gcdgv"
Sep 06 00:51:35.910008 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:35.909992    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89pt4\" (UniqueName: \"kubernetes.io/projected/e898d551-a885-4d1c-bf4b-f2632137dcb8-kube-api-access-89pt4\") pod \"ingress-canary-hfvkl\" (UID: \"e898d551-a885-4d1c-bf4b-f2632137dcb8\") " pod="openshift-ingress-canary/ingress-canary-hfvkl"
Sep 06 00:51:36.002077 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:36.002048    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2478bdcf-6cca-4dd9-9e4c-9d21405860ed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7pllw\" (UID: \"2478bdcf-6cca-4dd9-9e4c-9d21405860ed\") " pod="openshift-insights/insights-runtime-extractor-7pllw"
Sep 06 00:51:36.002193 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:36.002082    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbk9r\" (UniqueName: \"kubernetes.io/projected/2478bdcf-6cca-4dd9-9e4c-9d21405860ed-kube-api-access-fbk9r\") pod \"insights-runtime-extractor-7pllw\" (UID: \"2478bdcf-6cca-4dd9-9e4c-9d21405860ed\") " pod="openshift-insights/insights-runtime-extractor-7pllw"
Sep 06 00:51:36.002193 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:36.002113    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2478bdcf-6cca-4dd9-9e4c-9d21405860ed-data-volume\") pod \"insights-runtime-extractor-7pllw\" (UID: \"2478bdcf-6cca-4dd9-9e4c-9d21405860ed\") " pod="openshift-insights/insights-runtime-extractor-7pllw"
Sep 06 00:51:36.002193 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:36.002137    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2478bdcf-6cca-4dd9-9e4c-9d21405860ed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7pllw\" (UID: \"2478bdcf-6cca-4dd9-9e4c-9d21405860ed\") " pod="openshift-insights/insights-runtime-extractor-7pllw"
Sep 06 00:51:36.002193 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:36.002179    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2478bdcf-6cca-4dd9-9e4c-9d21405860ed-crio-socket\") pod \"insights-runtime-extractor-7pllw\" (UID: \"2478bdcf-6cca-4dd9-9e4c-9d21405860ed\") " pod="openshift-insights/insights-runtime-extractor-7pllw"
Sep 06 00:51:36.002734 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:36.002653    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2478bdcf-6cca-4dd9-9e4c-9d21405860ed-crio-socket\") pod \"insights-runtime-extractor-7pllw\" (UID: \"2478bdcf-6cca-4dd9-9e4c-9d21405860ed\") " pod="openshift-insights/insights-runtime-extractor-7pllw"
Sep 06 00:51:36.002832 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:36.002798    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2478bdcf-6cca-4dd9-9e4c-9d21405860ed-data-volume\") pod \"insights-runtime-extractor-7pllw\" (UID: \"2478bdcf-6cca-4dd9-9e4c-9d21405860ed\") " pod="openshift-insights/insights-runtime-extractor-7pllw"
Sep 06 00:51:36.006193 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:36.006167    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2478bdcf-6cca-4dd9-9e4c-9d21405860ed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7pllw\" (UID: \"2478bdcf-6cca-4dd9-9e4c-9d21405860ed\") " pod="openshift-insights/insights-runtime-extractor-7pllw"
Sep 06 00:51:36.006302 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:36.006244    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2478bdcf-6cca-4dd9-9e4c-9d21405860ed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7pllw\" (UID: \"2478bdcf-6cca-4dd9-9e4c-9d21405860ed\") " pod="openshift-insights/insights-runtime-extractor-7pllw"
Sep 06 00:51:36.016296 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:36.016273    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbk9r\" (UniqueName: \"kubernetes.io/projected/2478bdcf-6cca-4dd9-9e4c-9d21405860ed-kube-api-access-fbk9r\") pod \"insights-runtime-extractor-7pllw\" (UID: \"2478bdcf-6cca-4dd9-9e4c-9d21405860ed\") " pod="openshift-insights/insights-runtime-extractor-7pllw"
Sep 06 00:51:36.098310 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:36.098278    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gcdgv"
Sep 06 00:51:36.102690 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:36.102674    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hfvkl"
Sep 06 00:51:36.125659 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:36.125591    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7pllw"
Sep 06 00:51:36.384887 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:36.384800    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hfvkl"]
Sep 06 00:51:36.385730 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:36.385706    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gcdgv"]
Sep 06 00:51:36.390192 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:51:36.390171    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode898d551_a885_4d1c_bf4b_f2632137dcb8.slice/crio-6837efdae160daa5656ce07f9a81219cc8db203b6fed172386795d02d7bda7fd WatchSource:0}: Error finding container 6837efdae160daa5656ce07f9a81219cc8db203b6fed172386795d02d7bda7fd: Status 404 returned error can't find the container with id 6837efdae160daa5656ce07f9a81219cc8db203b6fed172386795d02d7bda7fd
Sep 06 00:51:36.390405 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:51:36.390382    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8aeab2aa_85be_432a_9cb7_bf89a08bf962.slice/crio-411b2d7b11b7c24f443b1263b090dbb13c5daf398fe8478cbedffe6d25d835fa WatchSource:0}: Error finding container 411b2d7b11b7c24f443b1263b090dbb13c5daf398fe8478cbedffe6d25d835fa: Status 404 returned error can't find the container with id 411b2d7b11b7c24f443b1263b090dbb13c5daf398fe8478cbedffe6d25d835fa
Sep 06 00:51:36.403535 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:36.403508    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:51:36.403635 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:36.403541    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfwc6"
Sep 06 00:51:36.403635 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:36.403508    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7gvz"
Sep 06 00:51:36.406340 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:36.406308    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 06 00:51:36.406440 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:36.406375    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 06 00:51:36.406579 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:36.406558    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7ttx4\""
Sep 06 00:51:36.406716 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:36.406557    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bctds\""
Sep 06 00:51:36.406716 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:36.406715    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 06 00:51:36.407370 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:36.407304    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 06 00:51:36.420514 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:36.420497    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7pllw"]
Sep 06 00:51:36.425354 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:51:36.425308    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2478bdcf_6cca_4dd9_9e4c_9d21405860ed.slice/crio-1b93052b59b1a46e29eab3f404e3e8712e18dc45b1fbb59bcf118249fd85c411 WatchSource:0}: Error finding container 1b93052b59b1a46e29eab3f404e3e8712e18dc45b1fbb59bcf118249fd85c411: Status 404 returned error can't find the container with id 1b93052b59b1a46e29eab3f404e3e8712e18dc45b1fbb59bcf118249fd85c411
Sep 06 00:51:36.643783 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:36.643704    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hfvkl" event={"ID":"e898d551-a885-4d1c-bf4b-f2632137dcb8","Type":"ContainerStarted","Data":"6837efdae160daa5656ce07f9a81219cc8db203b6fed172386795d02d7bda7fd"}
Sep 06 00:51:36.644850 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:36.644825    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gcdgv" event={"ID":"8aeab2aa-85be-432a-9cb7-bf89a08bf962","Type":"ContainerStarted","Data":"411b2d7b11b7c24f443b1263b090dbb13c5daf398fe8478cbedffe6d25d835fa"}
Sep 06 00:51:36.646273 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:36.646252    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7pllw" event={"ID":"2478bdcf-6cca-4dd9-9e4c-9d21405860ed","Type":"ContainerStarted","Data":"3ea32c718e0b50fbc9dd4e821e019a960057bb5f562a5cf670f2c520a1833753"}
Sep 06 00:51:36.646368 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:36.646293    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7pllw" event={"ID":"2478bdcf-6cca-4dd9-9e4c-9d21405860ed","Type":"ContainerStarted","Data":"1b93052b59b1a46e29eab3f404e3e8712e18dc45b1fbb59bcf118249fd85c411"}
Sep 06 00:51:37.652427 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:37.652346    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7pllw" event={"ID":"2478bdcf-6cca-4dd9-9e4c-9d21405860ed","Type":"ContainerStarted","Data":"5e8e49e0e0041b90d72917e349796f695f26f49236d39095e0fccb9cf9ac1502"}
Sep 06 00:51:40.662721 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:40.662681    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7pllw" event={"ID":"2478bdcf-6cca-4dd9-9e4c-9d21405860ed","Type":"ContainerStarted","Data":"b120f4bc43faa2b98e694c76def862b86a212cd2121843232493ca727dbb1524"}
Sep 06 00:51:40.664252 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:40.664227    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hfvkl" event={"ID":"e898d551-a885-4d1c-bf4b-f2632137dcb8","Type":"ContainerStarted","Data":"e3ad936cdcca04dbe8789a3a8fc974432df480a8b2f3472e21f87880700b8d42"}
Sep 06 00:51:40.666037 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:40.666011    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gcdgv" event={"ID":"8aeab2aa-85be-432a-9cb7-bf89a08bf962","Type":"ContainerStarted","Data":"dad934677309f6d53f26732088dfeb70448c8bd02aba801b68ca56ea9e05304e"}
Sep 06 00:51:40.666137 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:40.666054    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gcdgv" event={"ID":"8aeab2aa-85be-432a-9cb7-bf89a08bf962","Type":"ContainerStarted","Data":"7387bf2a09113a02eede906e7ad1a54a9dac7df607ab5919727cf0ffaf926f1e"}
Sep 06 00:51:40.666137 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:40.666122    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gcdgv"
Sep 06 00:51:40.681421 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:40.681377    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7pllw" podStartSLOduration=2.136153923 podStartE2EDuration="5.681363978s" totalImagesPullingTime="3.545210055s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 00:51:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:40.680488012 +0000 UTC m=+58.716630973" watchObservedRunningTime="2026-09-06 00:51:40.681363978 +0000 UTC m=+58.717506929"
Sep 06 00:51:40.695483 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:40.695441    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hfvkl" podStartSLOduration=1.989337093 podStartE2EDuration="5.695426843s" totalImagesPullingTime="3.70608975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:51:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:40.694963171 +0000 UTC m=+58.731106119" watchObservedRunningTime="2026-09-06 00:51:40.695426843 +0000 UTC m=+58.731569799"
Sep 06 00:51:40.720808 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:40.720758    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gcdgv" podStartSLOduration=2.01504844 podStartE2EDuration="5.720746651s" totalImagesPullingTime="3.705698211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:51:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:40.71951378 +0000 UTC m=+58.755656736" watchObservedRunningTime="2026-09-06 00:51:40.720746651 +0000 UTC m=+58.756889607"
Sep 06 00:51:41.039592 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:41.039520    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-wgfxr"]
Sep 06 00:51:41.041356 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:41.041342    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-wgfxr"
Sep 06 00:51:41.043652 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:41.043636    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 06 00:51:41.043782 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:41.043771    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 06 00:51:41.043866 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:41.043845    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-xgqh9\""
Sep 06 00:51:41.043917 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:41.043845    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 06 00:51:41.043917 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:41.043876    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 06 00:51:41.044339 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:41.044304    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 06 00:51:41.051249 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:41.051230    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-wgfxr"]
Sep 06 00:51:41.144714 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:41.144683    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c4b36ccf-e5a3-48ba-8a6d-11f74dad96af-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-wgfxr\" (UID: \"c4b36ccf-e5a3-48ba-8a6d-11f74dad96af\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wgfxr"
Sep 06 00:51:41.144714 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:41.144713    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4b36ccf-e5a3-48ba-8a6d-11f74dad96af-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-wgfxr\" (UID: \"c4b36ccf-e5a3-48ba-8a6d-11f74dad96af\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wgfxr"
Sep 06 00:51:41.144893 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:41.144732    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9c8k\" (UniqueName: \"kubernetes.io/projected/c4b36ccf-e5a3-48ba-8a6d-11f74dad96af-kube-api-access-t9c8k\") pod \"prometheus-operator-6f4946db56-wgfxr\" (UID: \"c4b36ccf-e5a3-48ba-8a6d-11f74dad96af\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wgfxr"
Sep 06 00:51:41.144893 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:41.144816    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c4b36ccf-e5a3-48ba-8a6d-11f74dad96af-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-wgfxr\" (UID: \"c4b36ccf-e5a3-48ba-8a6d-11f74dad96af\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wgfxr"
Sep 06 00:51:41.245375 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:41.245312    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c4b36ccf-e5a3-48ba-8a6d-11f74dad96af-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-wgfxr\" (UID: \"c4b36ccf-e5a3-48ba-8a6d-11f74dad96af\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wgfxr"
Sep 06 00:51:41.245375 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:41.245379    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4b36ccf-e5a3-48ba-8a6d-11f74dad96af-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-wgfxr\" (UID: \"c4b36ccf-e5a3-48ba-8a6d-11f74dad96af\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wgfxr"
Sep 06 00:51:41.245547 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:41.245400    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9c8k\" (UniqueName: \"kubernetes.io/projected/c4b36ccf-e5a3-48ba-8a6d-11f74dad96af-kube-api-access-t9c8k\") pod \"prometheus-operator-6f4946db56-wgfxr\" (UID: \"c4b36ccf-e5a3-48ba-8a6d-11f74dad96af\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wgfxr"
Sep 06 00:51:41.245547 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:41.245436    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c4b36ccf-e5a3-48ba-8a6d-11f74dad96af-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-wgfxr\" (UID: \"c4b36ccf-e5a3-48ba-8a6d-11f74dad96af\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wgfxr"
Sep 06 00:51:41.246041 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:41.246021    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4b36ccf-e5a3-48ba-8a6d-11f74dad96af-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-wgfxr\" (UID: \"c4b36ccf-e5a3-48ba-8a6d-11f74dad96af\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wgfxr"
Sep 06 00:51:41.247823 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:41.247802    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c4b36ccf-e5a3-48ba-8a6d-11f74dad96af-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-wgfxr\" (UID: \"c4b36ccf-e5a3-48ba-8a6d-11f74dad96af\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wgfxr"
Sep 06 00:51:41.247900 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:41.247803    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c4b36ccf-e5a3-48ba-8a6d-11f74dad96af-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-wgfxr\" (UID: \"c4b36ccf-e5a3-48ba-8a6d-11f74dad96af\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wgfxr"
Sep 06 00:51:41.255223 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:41.255203    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9c8k\" (UniqueName: \"kubernetes.io/projected/c4b36ccf-e5a3-48ba-8a6d-11f74dad96af-kube-api-access-t9c8k\") pod \"prometheus-operator-6f4946db56-wgfxr\" (UID: \"c4b36ccf-e5a3-48ba-8a6d-11f74dad96af\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wgfxr"
Sep 06 00:51:41.349958 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:41.349874    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-wgfxr"
Sep 06 00:51:41.617045 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:41.616974    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-wgfxr"]
Sep 06 00:51:41.620443 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:51:41.620421    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4b36ccf_e5a3_48ba_8a6d_11f74dad96af.slice/crio-70c387b2bbdb4742661b6da52b568c8d78eb27f0932d2495768025649e55d25c WatchSource:0}: Error finding container 70c387b2bbdb4742661b6da52b568c8d78eb27f0932d2495768025649e55d25c: Status 404 returned error can't find the container with id 70c387b2bbdb4742661b6da52b568c8d78eb27f0932d2495768025649e55d25c
Sep 06 00:51:41.669778 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:41.669751    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-wgfxr" event={"ID":"c4b36ccf-e5a3-48ba-8a6d-11f74dad96af","Type":"ContainerStarted","Data":"70c387b2bbdb4742661b6da52b568c8d78eb27f0932d2495768025649e55d25c"}
Sep 06 00:51:42.591563 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:42.591535    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j2z66"
Sep 06 00:51:43.680747 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:43.680715    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-wgfxr" event={"ID":"c4b36ccf-e5a3-48ba-8a6d-11f74dad96af","Type":"ContainerStarted","Data":"d2d312ae2e4824ef199b018fa7d3e9dcfc632e6235abb15a3c0cdd0a7172ad1b"}
Sep 06 00:51:43.681140 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:43.680767    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-wgfxr" event={"ID":"c4b36ccf-e5a3-48ba-8a6d-11f74dad96af","Type":"ContainerStarted","Data":"f313375f36bf6aa0cdfddcfeb05e5e28fb32a16470765eef1614350cdaabb9b7"}
Sep 06 00:51:45.395786 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.395733    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-wgfxr" podStartSLOduration=3.345331176 podStartE2EDuration="4.39571275s" totalImagesPullingTime="1.050381574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:51:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:43.711246336 +0000 UTC m=+61.747389295" watchObservedRunningTime="2026-09-06 00:51:45.39571275 +0000 UTC m=+63.431855710"
Sep 06 00:51:45.396179 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.395884    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-jlr5g"]
Sep 06 00:51:45.397762 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.397745    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-jlr5g"
Sep 06 00:51:45.400079 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.400060    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 06 00:51:45.400136 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.400060    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 06 00:51:45.400589 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.400575    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-hwddj\""
Sep 06 00:51:45.405701 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.405681    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-nrpln"]
Sep 06 00:51:45.407349 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.407312    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-nrpln"
Sep 06 00:51:45.410149 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.410133    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 06 00:51:45.410149 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.410142    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 06 00:51:45.410390 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.410377    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-drsg4\""
Sep 06 00:51:45.410445 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.410388    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 06 00:51:45.412334 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.412296    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-jlr5g"]
Sep 06 00:51:45.422738 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.422714    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kg4k7"]
Sep 06 00:51:45.424918 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.424901    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-nrpln"]
Sep 06 00:51:45.425006 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.424995    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kg4k7"
Sep 06 00:51:45.427478 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.427457    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 06 00:51:45.427584 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.427489    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pgq27\""
Sep 06 00:51:45.427584 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.427548    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 06 00:51:45.427700 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.427594    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 06 00:51:45.474090 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.474060    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8cdcead8-4416-4323-971b-20646f62c7a5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-nrpln\" (UID: \"8cdcead8-4416-4323-971b-20646f62c7a5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-nrpln"
Sep 06 00:51:45.474254 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.474093    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d5e48864-f938-4895-aef0-048d525b925a-node-exporter-wtmp\") pod \"node-exporter-kg4k7\" (UID: \"d5e48864-f938-4895-aef0-048d525b925a\") " pod="openshift-monitoring/node-exporter-kg4k7"
Sep 06 00:51:45.474254 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.474165    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8cdcead8-4416-4323-971b-20646f62c7a5-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-nrpln\" (UID: \"8cdcead8-4416-4323-971b-20646f62c7a5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-nrpln"
Sep 06 00:51:45.474254 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.474191    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e81fcce4-a1c4-4769-853f-5d60b65bd6bb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-jlr5g\" (UID: \"e81fcce4-a1c4-4769-853f-5d60b65bd6bb\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-jlr5g"
Sep 06 00:51:45.474254 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.474217    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t445\" (UniqueName: \"kubernetes.io/projected/e81fcce4-a1c4-4769-853f-5d60b65bd6bb-kube-api-access-8t445\") pod \"openshift-state-metrics-657fd6c54-jlr5g\" (UID: \"e81fcce4-a1c4-4769-853f-5d60b65bd6bb\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-jlr5g"
Sep 06 00:51:45.474254 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.474239    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8cdcead8-4416-4323-971b-20646f62c7a5-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-nrpln\" (UID: \"8cdcead8-4416-4323-971b-20646f62c7a5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-nrpln"
Sep 06 00:51:45.474499 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.474268    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d5e48864-f938-4895-aef0-048d525b925a-node-exporter-accelerators-collector-config\") pod \"node-exporter-kg4k7\" (UID: \"d5e48864-f938-4895-aef0-048d525b925a\") " pod="openshift-monitoring/node-exporter-kg4k7"
Sep 06 00:51:45.474499 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.474302    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d5e48864-f938-4895-aef0-048d525b925a-root\") pod \"node-exporter-kg4k7\" (UID: \"d5e48864-f938-4895-aef0-048d525b925a\") " pod="openshift-monitoring/node-exporter-kg4k7"
Sep 06 00:51:45.474499 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.474383    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e81fcce4-a1c4-4769-853f-5d60b65bd6bb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-jlr5g\" (UID: \"e81fcce4-a1c4-4769-853f-5d60b65bd6bb\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-jlr5g"
Sep 06 00:51:45.474499 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.474414    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5e48864-f938-4895-aef0-048d525b925a-metrics-client-ca\") pod \"node-exporter-kg4k7\" (UID: \"d5e48864-f938-4895-aef0-048d525b925a\") " pod="openshift-monitoring/node-exporter-kg4k7"
Sep 06 00:51:45.474499 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.474470    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8cdcead8-4416-4323-971b-20646f62c7a5-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-nrpln\" (UID: \"8cdcead8-4416-4323-971b-20646f62c7a5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-nrpln"
Sep 06 00:51:45.474499 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.474492    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8cdcead8-4416-4323-971b-20646f62c7a5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-nrpln\" (UID: \"8cdcead8-4416-4323-971b-20646f62c7a5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-nrpln"
Sep 06 00:51:45.474739 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.474545    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d5e48864-f938-4895-aef0-048d525b925a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kg4k7\" (UID: \"d5e48864-f938-4895-aef0-048d525b925a\") " pod="openshift-monitoring/node-exporter-kg4k7"
Sep 06 00:51:45.474739 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.474563    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhjgc\" (UniqueName: \"kubernetes.io/projected/8cdcead8-4416-4323-971b-20646f62c7a5-kube-api-access-xhjgc\") pod \"kube-state-metrics-74cb57df7-nrpln\" (UID: \"8cdcead8-4416-4323-971b-20646f62c7a5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-nrpln"
Sep 06 00:51:45.474739 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.474579    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d5e48864-f938-4895-aef0-048d525b925a-node-exporter-textfile\") pod \"node-exporter-kg4k7\" (UID: \"d5e48864-f938-4895-aef0-048d525b925a\") " pod="openshift-monitoring/node-exporter-kg4k7"
Sep 06 00:51:45.474739 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.474605    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d5e48864-f938-4895-aef0-048d525b925a-sys\") pod \"node-exporter-kg4k7\" (UID: \"d5e48864-f938-4895-aef0-048d525b925a\") " pod="openshift-monitoring/node-exporter-kg4k7"
Sep 06 00:51:45.474739 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.474679    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e81fcce4-a1c4-4769-853f-5d60b65bd6bb-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-jlr5g\" (UID: \"e81fcce4-a1c4-4769-853f-5d60b65bd6bb\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-jlr5g"
Sep 06 00:51:45.474739 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.474717    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d5e48864-f938-4895-aef0-048d525b925a-node-exporter-tls\") pod \"node-exporter-kg4k7\" (UID: \"d5e48864-f938-4895-aef0-048d525b925a\") " pod="openshift-monitoring/node-exporter-kg4k7"
Sep 06 00:51:45.474951 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.474744    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pt2n\" (UniqueName: \"kubernetes.io/projected/d5e48864-f938-4895-aef0-048d525b925a-kube-api-access-6pt2n\") pod \"node-exporter-kg4k7\" (UID: \"d5e48864-f938-4895-aef0-048d525b925a\") " pod="openshift-monitoring/node-exporter-kg4k7"
Sep 06 00:51:45.575574 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.575539    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d5e48864-f938-4895-aef0-048d525b925a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kg4k7\" (UID: \"d5e48864-f938-4895-aef0-048d525b925a\") " pod="openshift-monitoring/node-exporter-kg4k7"
Sep 06 00:51:45.575574 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.575570    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhjgc\" (UniqueName: \"kubernetes.io/projected/8cdcead8-4416-4323-971b-20646f62c7a5-kube-api-access-xhjgc\") pod \"kube-state-metrics-74cb57df7-nrpln\" (UID: \"8cdcead8-4416-4323-971b-20646f62c7a5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-nrpln"
Sep 06 00:51:45.575852 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.575588    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d5e48864-f938-4895-aef0-048d525b925a-node-exporter-textfile\") pod \"node-exporter-kg4k7\" (UID: \"d5e48864-f938-4895-aef0-048d525b925a\") " pod="openshift-monitoring/node-exporter-kg4k7"
Sep 06 00:51:45.575852 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.575617    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d5e48864-f938-4895-aef0-048d525b925a-sys\") pod \"node-exporter-kg4k7\" (UID: \"d5e48864-f938-4895-aef0-048d525b925a\") " pod="openshift-monitoring/node-exporter-kg4k7"
Sep 06 00:51:45.575852 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.575760    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d5e48864-f938-4895-aef0-048d525b925a-sys\") pod \"node-exporter-kg4k7\" (UID: \"d5e48864-f938-4895-aef0-048d525b925a\") " pod="openshift-monitoring/node-exporter-kg4k7"
Sep 06 00:51:45.575852 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.575811    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e81fcce4-a1c4-4769-853f-5d60b65bd6bb-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-jlr5g\" (UID: \"e81fcce4-a1c4-4769-853f-5d60b65bd6bb\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-jlr5g"
Sep 06 00:51:45.575852 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.575844    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d5e48864-f938-4895-aef0-048d525b925a-node-exporter-tls\") pod \"node-exporter-kg4k7\" (UID: \"d5e48864-f938-4895-aef0-048d525b925a\") " pod="openshift-monitoring/node-exporter-kg4k7"
Sep 06 00:51:45.576109 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.575873    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pt2n\" (UniqueName: \"kubernetes.io/projected/d5e48864-f938-4895-aef0-048d525b925a-kube-api-access-6pt2n\") pod \"node-exporter-kg4k7\" (UID: \"d5e48864-f938-4895-aef0-048d525b925a\") " pod="openshift-monitoring/node-exporter-kg4k7"
Sep 06 00:51:45.576109 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.575904    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8cdcead8-4416-4323-971b-20646f62c7a5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-nrpln\" (UID: \"8cdcead8-4416-4323-971b-20646f62c7a5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-nrpln"
Sep 06 00:51:45.576109 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.575995    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d5e48864-f938-4895-aef0-048d525b925a-node-exporter-textfile\") pod \"node-exporter-kg4k7\" (UID: \"d5e48864-f938-4895-aef0-048d525b925a\") " pod="openshift-monitoring/node-exporter-kg4k7"
Sep 06 00:51:45.576109 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.576023    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d5e48864-f938-4895-aef0-048d525b925a-node-exporter-wtmp\") pod \"node-exporter-kg4k7\" (UID: \"d5e48864-f938-4895-aef0-048d525b925a\") " pod="openshift-monitoring/node-exporter-kg4k7"
Sep 06 00:51:45.576109 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.576098    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8cdcead8-4416-4323-971b-20646f62c7a5-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-nrpln\" (UID: \"8cdcead8-4416-4323-971b-20646f62c7a5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-nrpln"
Sep 06 00:51:45.576537 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.576130    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e81fcce4-a1c4-4769-853f-5d60b65bd6bb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-jlr5g\" (UID: \"e81fcce4-a1c4-4769-853f-5d60b65bd6bb\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-jlr5g"
Sep 06 00:51:45.576537 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.576158    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t445\" (UniqueName: \"kubernetes.io/projected/e81fcce4-a1c4-4769-853f-5d60b65bd6bb-kube-api-access-8t445\") pod \"openshift-state-metrics-657fd6c54-jlr5g\" (UID: \"e81fcce4-a1c4-4769-853f-5d60b65bd6bb\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-jlr5g"
Sep 06 00:51:45.576537 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.576184    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8cdcead8-4416-4323-971b-20646f62c7a5-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-nrpln\" (UID: \"8cdcead8-4416-4323-971b-20646f62c7a5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-nrpln"
Sep 06 00:51:45.576537 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.576190    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d5e48864-f938-4895-aef0-048d525b925a-node-exporter-wtmp\") pod \"node-exporter-kg4k7\" (UID: \"d5e48864-f938-4895-aef0-048d525b925a\") " pod="openshift-monitoring/node-exporter-kg4k7"
Sep 06 00:51:45.576537 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.576218    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d5e48864-f938-4895-aef0-048d525b925a-node-exporter-accelerators-collector-config\") pod \"node-exporter-kg4k7\" (UID: \"d5e48864-f938-4895-aef0-048d525b925a\") " pod="openshift-monitoring/node-exporter-kg4k7"
Sep 06 00:51:45.576537 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.576244    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d5e48864-f938-4895-aef0-048d525b925a-root\") pod \"node-exporter-kg4k7\" (UID: \"d5e48864-f938-4895-aef0-048d525b925a\") " pod="openshift-monitoring/node-exporter-kg4k7"
Sep 06 00:51:45.576537 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.576296    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e81fcce4-a1c4-4769-853f-5d60b65bd6bb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-jlr5g\" (UID: \"e81fcce4-a1c4-4769-853f-5d60b65bd6bb\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-jlr5g"
Sep 06 00:51:45.576537 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.576352    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5e48864-f938-4895-aef0-048d525b925a-metrics-client-ca\") pod \"node-exporter-kg4k7\" (UID: \"d5e48864-f938-4895-aef0-048d525b925a\") " pod="openshift-monitoring/node-exporter-kg4k7"
Sep 06 00:51:45.576537 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.576399    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8cdcead8-4416-4323-971b-20646f62c7a5-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-nrpln\" (UID: \"8cdcead8-4416-4323-971b-20646f62c7a5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-nrpln"
Sep 06 00:51:45.576537 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.576428    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8cdcead8-4416-4323-971b-20646f62c7a5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-nrpln\" (UID: \"8cdcead8-4416-4323-971b-20646f62c7a5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-nrpln"
Sep 06 00:51:45.577031 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.576773    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e81fcce4-a1c4-4769-853f-5d60b65bd6bb-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-jlr5g\" (UID: \"e81fcce4-a1c4-4769-853f-5d60b65bd6bb\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-jlr5g"
Sep 06 00:51:45.577031 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.576842    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d5e48864-f938-4895-aef0-048d525b925a-root\") pod \"node-exporter-kg4k7\" (UID: \"d5e48864-f938-4895-aef0-048d525b925a\") " pod="openshift-monitoring/node-exporter-kg4k7"
Sep 06 00:51:45.577485 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.577462    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8cdcead8-4416-4323-971b-20646f62c7a5-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-nrpln\" (UID: \"8cdcead8-4416-4323-971b-20646f62c7a5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-nrpln"
Sep 06 00:51:45.577578 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.577508    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5e48864-f938-4895-aef0-048d525b925a-metrics-client-ca\") pod \"node-exporter-kg4k7\" (UID: \"d5e48864-f938-4895-aef0-048d525b925a\") " pod="openshift-monitoring/node-exporter-kg4k7"
Sep 06 00:51:45.577578 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.577534    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8cdcead8-4416-4323-971b-20646f62c7a5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-nrpln\" (UID: \"8cdcead8-4416-4323-971b-20646f62c7a5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-nrpln"
Sep 06 00:51:45.577864 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.577839    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8cdcead8-4416-4323-971b-20646f62c7a5-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-nrpln\" (UID: \"8cdcead8-4416-4323-971b-20646f62c7a5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-nrpln"
Sep 06 00:51:45.577949 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.577924    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d5e48864-f938-4895-aef0-048d525b925a-node-exporter-accelerators-collector-config\") pod \"node-exporter-kg4k7\" (UID: \"d5e48864-f938-4895-aef0-048d525b925a\") " pod="openshift-monitoring/node-exporter-kg4k7"
Sep 06 00:51:45.578572 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.578548    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d5e48864-f938-4895-aef0-048d525b925a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kg4k7\" (UID: \"d5e48864-f938-4895-aef0-048d525b925a\") " pod="openshift-monitoring/node-exporter-kg4k7"
Sep 06 00:51:45.578671 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.578642    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d5e48864-f938-4895-aef0-048d525b925a-node-exporter-tls\") pod \"node-exporter-kg4k7\" (UID: \"d5e48864-f938-4895-aef0-048d525b925a\") " pod="openshift-monitoring/node-exporter-kg4k7"
Sep 06 00:51:45.578818 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.578801    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8cdcead8-4416-4323-971b-20646f62c7a5-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-nrpln\" (UID: \"8cdcead8-4416-4323-971b-20646f62c7a5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-nrpln"
Sep 06 00:51:45.578955 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.578933    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8cdcead8-4416-4323-971b-20646f62c7a5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-nrpln\" (UID: \"8cdcead8-4416-4323-971b-20646f62c7a5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-nrpln"
Sep 06 00:51:45.579934 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.579914    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e81fcce4-a1c4-4769-853f-5d60b65bd6bb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-jlr5g\" (UID: \"e81fcce4-a1c4-4769-853f-5d60b65bd6bb\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-jlr5g"
Sep 06 00:51:45.580000 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.579916    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e81fcce4-a1c4-4769-853f-5d60b65bd6bb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-jlr5g\" (UID: \"e81fcce4-a1c4-4769-853f-5d60b65bd6bb\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-jlr5g"
Sep 06 00:51:45.590634 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.590614    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t445\" (UniqueName: \"kubernetes.io/projected/e81fcce4-a1c4-4769-853f-5d60b65bd6bb-kube-api-access-8t445\") pod \"openshift-state-metrics-657fd6c54-jlr5g\" (UID: \"e81fcce4-a1c4-4769-853f-5d60b65bd6bb\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-jlr5g"
Sep 06 00:51:45.591092 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.591071    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhjgc\" (UniqueName: \"kubernetes.io/projected/8cdcead8-4416-4323-971b-20646f62c7a5-kube-api-access-xhjgc\") pod \"kube-state-metrics-74cb57df7-nrpln\" (UID: \"8cdcead8-4416-4323-971b-20646f62c7a5\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-nrpln"
Sep 06 00:51:45.591201 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.591182    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pt2n\" (UniqueName: \"kubernetes.io/projected/d5e48864-f938-4895-aef0-048d525b925a-kube-api-access-6pt2n\") pod \"node-exporter-kg4k7\" (UID: \"d5e48864-f938-4895-aef0-048d525b925a\") " pod="openshift-monitoring/node-exporter-kg4k7"
Sep 06 00:51:45.706903 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.706875    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-jlr5g"
Sep 06 00:51:45.716182 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.716165    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-nrpln"
Sep 06 00:51:45.733299 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.733274    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kg4k7"
Sep 06 00:51:45.742883 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:51:45.742856    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5e48864_f938_4895_aef0_048d525b925a.slice/crio-659166c645eeb94c9740692737613e836dccd8b64c5695c905a5bea2d7c5fe8e WatchSource:0}: Error finding container 659166c645eeb94c9740692737613e836dccd8b64c5695c905a5bea2d7c5fe8e: Status 404 returned error can't find the container with id 659166c645eeb94c9740692737613e836dccd8b64c5695c905a5bea2d7c5fe8e
Sep 06 00:51:45.982070 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:45.981988    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-jlr5g"]
Sep 06 00:51:45.984844 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:51:45.984820    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode81fcce4_a1c4_4769_853f_5d60b65bd6bb.slice/crio-c437fd35e8ef514b132f98c932065281a321cd5be019d9031eb502c9eeb3c1ec WatchSource:0}: Error finding container c437fd35e8ef514b132f98c932065281a321cd5be019d9031eb502c9eeb3c1ec: Status 404 returned error can't find the container with id c437fd35e8ef514b132f98c932065281a321cd5be019d9031eb502c9eeb3c1ec
Sep 06 00:51:46.001703 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.001663    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-nrpln"]
Sep 06 00:51:46.004959 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:51:46.004937    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cdcead8_4416_4323_971b_20646f62c7a5.slice/crio-579bc75def310aa8a1b07aa97d671f72524a19558dbcbecd5451eacb7bd30491 WatchSource:0}: Error finding container 579bc75def310aa8a1b07aa97d671f72524a19558dbcbecd5451eacb7bd30491: Status 404 returned error can't find the container with id 579bc75def310aa8a1b07aa97d671f72524a19558dbcbecd5451eacb7bd30491
Sep 06 00:51:46.465412 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.465383    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 06 00:51:46.485785 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.485752    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:51:46.488707 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.488659    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 06 00:51:46.489064 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.489038    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 06 00:51:46.489180 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.489078    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2ll9h\""
Sep 06 00:51:46.489180 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.489097    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 06 00:51:46.489180 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.489048    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 06 00:51:46.489426 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.489408    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 06 00:51:46.489603 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.489585    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 06 00:51:46.489698 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.489647    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 06 00:51:46.489868 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.489844    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 06 00:51:46.491088 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.490016    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 06 00:51:46.491088 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.490218    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 06 00:51:46.584576 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.584540    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c747cd59-0363-43d9-a1ae-23060db9fab7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:51:46.584750 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.584619    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c747cd59-0363-43d9-a1ae-23060db9fab7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:51:46.584750 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.584677    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c747cd59-0363-43d9-a1ae-23060db9fab7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:51:46.584750 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.584721    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c747cd59-0363-43d9-a1ae-23060db9fab7-web-config\") pod \"alertmanager-main-0\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:51:46.584911 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.584790    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c747cd59-0363-43d9-a1ae-23060db9fab7-config-out\") pod \"alertmanager-main-0\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:51:46.584911 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.584819    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c747cd59-0363-43d9-a1ae-23060db9fab7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:51:46.584911 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.584850    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rtg6\" (UniqueName: \"kubernetes.io/projected/c747cd59-0363-43d9-a1ae-23060db9fab7-kube-api-access-2rtg6\") pod \"alertmanager-main-0\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:51:46.585055 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.584919    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c747cd59-0363-43d9-a1ae-23060db9fab7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:51:46.585055 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.584994    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c747cd59-0363-43d9-a1ae-23060db9fab7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:51:46.585055 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.585023    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c747cd59-0363-43d9-a1ae-23060db9fab7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:51:46.585170 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.585071    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c747cd59-0363-43d9-a1ae-23060db9fab7-config-volume\") pod \"alertmanager-main-0\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:51:46.585170 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.585099    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c747cd59-0363-43d9-a1ae-23060db9fab7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:51:46.585170 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.585116    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c747cd59-0363-43d9-a1ae-23060db9fab7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:51:46.685815 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.685785    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rtg6\" (UniqueName: \"kubernetes.io/projected/c747cd59-0363-43d9-a1ae-23060db9fab7-kube-api-access-2rtg6\") pod \"alertmanager-main-0\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:51:46.685980 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.685832    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c747cd59-0363-43d9-a1ae-23060db9fab7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:51:46.685980 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.685866    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c747cd59-0363-43d9-a1ae-23060db9fab7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:51:46.685980 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.685893    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c747cd59-0363-43d9-a1ae-23060db9fab7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:51:46.685980 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.685927    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c747cd59-0363-43d9-a1ae-23060db9fab7-config-volume\") pod \"alertmanager-main-0\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:51:46.685980 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.685951    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c747cd59-0363-43d9-a1ae-23060db9fab7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:51:46.685980 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.685973    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c747cd59-0363-43d9-a1ae-23060db9fab7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:51:46.686306 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.686005    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c747cd59-0363-43d9-a1ae-23060db9fab7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:51:46.686306 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:46.686063    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c747cd59-0363-43d9-a1ae-23060db9fab7-alertmanager-trusted-ca-bundle podName:c747cd59-0363-43d9-a1ae-23060db9fab7 nodeName:}" failed. No retries permitted until 2026-09-06 00:51:47.186041598 +0000 UTC m=+65.222184549 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/c747cd59-0363-43d9-a1ae-23060db9fab7-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "c747cd59-0363-43d9-a1ae-23060db9fab7") : configmap references non-existent config key: ca-bundle.crt
Sep 06 00:51:46.686306 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.686129    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c747cd59-0363-43d9-a1ae-23060db9fab7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:51:46.686306 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.686198    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c747cd59-0363-43d9-a1ae-23060db9fab7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:51:46.686306 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.686244    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c747cd59-0363-43d9-a1ae-23060db9fab7-web-config\") pod \"alertmanager-main-0\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:51:46.686890 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.686787    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c747cd59-0363-43d9-a1ae-23060db9fab7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:51:46.686890 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.686886    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c747cd59-0363-43d9-a1ae-23060db9fab7-config-out\") pod \"alertmanager-main-0\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:51:46.686890 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.686925    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c747cd59-0363-43d9-a1ae-23060db9fab7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:51:46.687629 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.687601    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c747cd59-0363-43d9-a1ae-23060db9fab7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:51:46.690117 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.690096    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c747cd59-0363-43d9-a1ae-23060db9fab7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:51:46.690712 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.690695    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c747cd59-0363-43d9-a1ae-23060db9fab7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:51:46.691124 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.691101    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c747cd59-0363-43d9-a1ae-23060db9fab7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:51:46.691678 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.691622    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c747cd59-0363-43d9-a1ae-23060db9fab7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:51:46.691678 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.691634    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c747cd59-0363-43d9-a1ae-23060db9fab7-web-config\") pod \"alertmanager-main-0\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:51:46.691887 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.691861    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c747cd59-0363-43d9-a1ae-23060db9fab7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:51:46.692085 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.692044    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c747cd59-0363-43d9-a1ae-23060db9fab7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:51:46.692786 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.692746    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c747cd59-0363-43d9-a1ae-23060db9fab7-config-volume\") pod \"alertmanager-main-0\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:51:46.696766 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.696744    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c747cd59-0363-43d9-a1ae-23060db9fab7-config-out\") pod \"alertmanager-main-0\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:51:46.697906 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.697880    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kg4k7" event={"ID":"d5e48864-f938-4895-aef0-048d525b925a","Type":"ContainerStarted","Data":"659166c645eeb94c9740692737613e836dccd8b64c5695c905a5bea2d7c5fe8e"}
Sep 06 00:51:46.699733 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.699660    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-nrpln" event={"ID":"8cdcead8-4416-4323-971b-20646f62c7a5","Type":"ContainerStarted","Data":"579bc75def310aa8a1b07aa97d671f72524a19558dbcbecd5451eacb7bd30491"}
Sep 06 00:51:46.702280 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.702257    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-jlr5g" event={"ID":"e81fcce4-a1c4-4769-853f-5d60b65bd6bb","Type":"ContainerStarted","Data":"04778398db7f8765c65bfae61b9211c2487d4c416b5b9c29cf98ec4184ea0283"}
Sep 06 00:51:46.702399 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.702340    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-jlr5g" event={"ID":"e81fcce4-a1c4-4769-853f-5d60b65bd6bb","Type":"ContainerStarted","Data":"b46470e12b9717f790db007c30999d6c4aaa3edaab707408ad682d03ce6613b8"}
Sep 06 00:51:46.702399 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.702376    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-jlr5g" event={"ID":"e81fcce4-a1c4-4769-853f-5d60b65bd6bb","Type":"ContainerStarted","Data":"c437fd35e8ef514b132f98c932065281a321cd5be019d9031eb502c9eeb3c1ec"}
Sep 06 00:51:46.705546 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:46.705526    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rtg6\" (UniqueName: \"kubernetes.io/projected/c747cd59-0363-43d9-a1ae-23060db9fab7-kube-api-access-2rtg6\") pod \"alertmanager-main-0\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:51:47.190307 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:47.190271    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c747cd59-0363-43d9-a1ae-23060db9fab7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:51:47.191182 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:47.191162    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c747cd59-0363-43d9-a1ae-23060db9fab7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:51:47.398754 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:47.398726    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:51:47.710167 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:47.710079    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kg4k7" event={"ID":"d5e48864-f938-4895-aef0-048d525b925a","Type":"ContainerStarted","Data":"95485feb95982cb0ced41aa1c4bdf171e9e6012c44cbe6c8295db8f954bffc6e"}
Sep 06 00:51:47.712073 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:47.712047    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-nrpln" event={"ID":"8cdcead8-4416-4323-971b-20646f62c7a5","Type":"ContainerStarted","Data":"c86b1d53f341e9057b0f9c148725b83d676d3c3765c7bf8803facc2d627cb093"}
Sep 06 00:51:47.845764 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:47.845687    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 06 00:51:47.855010 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:51:47.854985    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc747cd59_0363_43d9_a1ae_23060db9fab7.slice/crio-ac0522badea9ddb16b035f8301a5d8c4a402d10e1cdefc114863b664122e31d0 WatchSource:0}: Error finding container ac0522badea9ddb16b035f8301a5d8c4a402d10e1cdefc114863b664122e31d0: Status 404 returned error can't find the container with id ac0522badea9ddb16b035f8301a5d8c4a402d10e1cdefc114863b664122e31d0
Sep 06 00:51:48.099726 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:48.099629    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7270e6a0-6c6a-410a-b615-5cb276ebf879-original-pull-secret\") pod \"global-pull-secret-syncer-tc782\" (UID: \"7270e6a0-6c6a-410a-b615-5cb276ebf879\") " pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:51:48.099726 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:48.099695    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528-metrics-certs\") pod \"network-metrics-daemon-d7gvz\" (UID: \"8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528\") " pod="openshift-multus/network-metrics-daemon-d7gvz"
Sep 06 00:51:48.102031 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:48.102007    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 06 00:51:48.102153 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:48.102057    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 06 00:51:48.112121 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:48.112090    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7270e6a0-6c6a-410a-b615-5cb276ebf879-original-pull-secret\") pod \"global-pull-secret-syncer-tc782\" (UID: \"7270e6a0-6c6a-410a-b615-5cb276ebf879\") " pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:51:48.112121 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:48.112111    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528-metrics-certs\") pod \"network-metrics-daemon-d7gvz\" (UID: \"8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528\") " pod="openshift-multus/network-metrics-daemon-d7gvz"
Sep 06 00:51:48.114092 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:48.114047    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc782"
Sep 06 00:51:48.122617 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:48.122549    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bctds\""
Sep 06 00:51:48.131112 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:48.131096    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d7gvz"
Sep 06 00:51:48.301995 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:48.301963    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2vkp\" (UniqueName: \"kubernetes.io/projected/31067da9-3ebb-40fc-b24e-34ccd0f5f3fd-kube-api-access-h2vkp\") pod \"network-check-target-wfwc6\" (UID: \"31067da9-3ebb-40fc-b24e-34ccd0f5f3fd\") " pod="openshift-network-diagnostics/network-check-target-wfwc6"
Sep 06 00:51:48.304491 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:48.304473    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 06 00:51:48.315435 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:48.315412    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 06 00:51:48.326825 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:48.326801    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2vkp\" (UniqueName: \"kubernetes.io/projected/31067da9-3ebb-40fc-b24e-34ccd0f5f3fd-kube-api-access-h2vkp\") pod \"network-check-target-wfwc6\" (UID: \"31067da9-3ebb-40fc-b24e-34ccd0f5f3fd\") " pod="openshift-network-diagnostics/network-check-target-wfwc6"
Sep 06 00:51:48.387039 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:48.386962    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tc782"]
Sep 06 00:51:48.390825 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:51:48.390794    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7270e6a0_6c6a_410a_b615_5cb276ebf879.slice/crio-1441303918fd2e44879dfe418a07f971e7ed6b2baedcadc568cc70031a7a0591 WatchSource:0}: Error finding container 1441303918fd2e44879dfe418a07f971e7ed6b2baedcadc568cc70031a7a0591: Status 404 returned error can't find the container with id 1441303918fd2e44879dfe418a07f971e7ed6b2baedcadc568cc70031a7a0591
Sep 06 00:51:48.409933 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:48.409820    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d7gvz"]
Sep 06 00:51:48.412648 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:51:48.412620    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a8cc9a5_3823_40e0_9e61_2ff6ffc1a528.slice/crio-393ca27f7153321416aabad50b72b80a3d9c1633dd74ed5eeb6ccb0572cf7aa6 WatchSource:0}: Error finding container 393ca27f7153321416aabad50b72b80a3d9c1633dd74ed5eeb6ccb0572cf7aa6: Status 404 returned error can't find the container with id 393ca27f7153321416aabad50b72b80a3d9c1633dd74ed5eeb6ccb0572cf7aa6
Sep 06 00:51:48.429870 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:48.429852    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7ttx4\""
Sep 06 00:51:48.437802 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:48.437785    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfwc6"
Sep 06 00:51:48.709784 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:48.709747    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wfwc6"]
Sep 06 00:51:48.732544 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:48.720028    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-jlr5g" event={"ID":"e81fcce4-a1c4-4769-853f-5d60b65bd6bb","Type":"ContainerStarted","Data":"a201ceb46d2c604f40cff9054da6fb06e3ce1506fbded77ada4404a3aa0b82b4"}
Sep 06 00:51:48.734974 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:48.734915    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tc782" event={"ID":"7270e6a0-6c6a-410a-b615-5cb276ebf879","Type":"ContainerStarted","Data":"1441303918fd2e44879dfe418a07f971e7ed6b2baedcadc568cc70031a7a0591"}
Sep 06 00:51:48.736872 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:48.736842    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c747cd59-0363-43d9-a1ae-23060db9fab7","Type":"ContainerStarted","Data":"ac0522badea9ddb16b035f8301a5d8c4a402d10e1cdefc114863b664122e31d0"}
Sep 06 00:51:48.739442 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:48.739418    2577 generic.go:356] "Generic (PLEG): container finished" podID="d5e48864-f938-4895-aef0-048d525b925a" containerID="95485feb95982cb0ced41aa1c4bdf171e9e6012c44cbe6c8295db8f954bffc6e" exitCode=0
Sep 06 00:51:48.739557 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:48.739498    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kg4k7" event={"ID":"d5e48864-f938-4895-aef0-048d525b925a","Type":"ContainerDied","Data":"95485feb95982cb0ced41aa1c4bdf171e9e6012c44cbe6c8295db8f954bffc6e"}
Sep 06 00:51:48.741993 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:48.741968    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-nrpln" event={"ID":"8cdcead8-4416-4323-971b-20646f62c7a5","Type":"ContainerStarted","Data":"ad5ec21a405fcfc1fd0e7bedd71077aee2f7f08e67563ed01fa95282a7d50fae"}
Sep 06 00:51:48.742107 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:48.742023    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-nrpln" event={"ID":"8cdcead8-4416-4323-971b-20646f62c7a5","Type":"ContainerStarted","Data":"942007cb3fe6b9e2d47f43c64ee71e7a1367da4c5791de26b11af9922ac7979f"}
Sep 06 00:51:48.743176 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:48.743155    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d7gvz" event={"ID":"8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528","Type":"ContainerStarted","Data":"393ca27f7153321416aabad50b72b80a3d9c1633dd74ed5eeb6ccb0572cf7aa6"}
Sep 06 00:51:48.748958 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:48.748911    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-jlr5g" podStartSLOduration=2.099654115 podStartE2EDuration="3.748897431s" totalImagesPullingTime="1.649243316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:51:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:48.747544259 +0000 UTC m=+66.783687219" watchObservedRunningTime="2026-09-06 00:51:48.748897431 +0000 UTC m=+66.785040388"
Sep 06 00:51:48.767000 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:48.766941    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-nrpln" podStartSLOduration=2.205120136 podStartE2EDuration="3.766922396s" totalImagesPullingTime="1.56180226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:51:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:48.765540897 +0000 UTC m=+66.801683856" watchObservedRunningTime="2026-09-06 00:51:48.766922396 +0000 UTC m=+66.803065356"
Sep 06 00:51:48.834929 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:51:48.834898    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31067da9_3ebb_40fc_b24e_34ccd0f5f3fd.slice/crio-38b26af50f133ea48f29edcc22ec069432f89c4e476fde41fe8fc0e0bcb03aef WatchSource:0}: Error finding container 38b26af50f133ea48f29edcc22ec069432f89c4e476fde41fe8fc0e0bcb03aef: Status 404 returned error can't find the container with id 38b26af50f133ea48f29edcc22ec069432f89c4e476fde41fe8fc0e0bcb03aef
Sep 06 00:51:49.710050 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:49.709143    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-74d9d6f984-gkc8n"]
Sep 06 00:51:49.712113 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:49.712092    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-74d9d6f984-gkc8n"
Sep 06 00:51:49.714956 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:49.714904    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 06 00:51:49.716453 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:49.715970    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 06 00:51:49.716453 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:49.716223    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-4m8hsiiam87q3\""
Sep 06 00:51:49.716620 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:49.716469    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 06 00:51:49.716691 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:49.716675    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-prfnt\""
Sep 06 00:51:49.716974 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:49.716951    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 06 00:51:49.722559 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:49.722469    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-74d9d6f984-gkc8n"]
Sep 06 00:51:49.756156 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:49.756082    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kg4k7" event={"ID":"d5e48864-f938-4895-aef0-048d525b925a","Type":"ContainerStarted","Data":"0fdd635f20b6411c6f7e2135186469024d081e7b4a0a2810da5de634432c939c"}
Sep 06 00:51:49.756593 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:49.756175    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kg4k7" event={"ID":"d5e48864-f938-4895-aef0-048d525b925a","Type":"ContainerStarted","Data":"876b72ef9244c25c641a8a732f6957f1021c6e84d5c7fff3e2f297a3d874c393"}
Sep 06 00:51:49.759019 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:49.758988    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d7gvz" event={"ID":"8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528","Type":"ContainerStarted","Data":"9e06d4f133026bc9e152b0409ea299c60bffe2b895abe021d3c02fba1546a025"}
Sep 06 00:51:49.759141 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:49.759045    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d7gvz" event={"ID":"8a8cc9a5-3823-40e0-9e61-2ff6ffc1a528","Type":"ContainerStarted","Data":"8f21a4759ef8126b57d52827ad518f3fa9562ac8cb4ab83d4adcefc8f7ce25bc"}
Sep 06 00:51:49.760354 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:49.760309    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wfwc6" event={"ID":"31067da9-3ebb-40fc-b24e-34ccd0f5f3fd","Type":"ContainerStarted","Data":"38b26af50f133ea48f29edcc22ec069432f89c4e476fde41fe8fc0e0bcb03aef"}
Sep 06 00:51:49.761939 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:49.761914    2577 generic.go:356] "Generic (PLEG): container finished" podID="c747cd59-0363-43d9-a1ae-23060db9fab7" containerID="d56039573c58707b6e853bd2678914216909f8ff06c7a7c06b6c72ea2c8c04b3" exitCode=0
Sep 06 00:51:49.762041 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:49.761996    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c747cd59-0363-43d9-a1ae-23060db9fab7","Type":"ContainerDied","Data":"d56039573c58707b6e853bd2678914216909f8ff06c7a7c06b6c72ea2c8c04b3"}
Sep 06 00:51:49.774583 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:49.774539    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kg4k7" podStartSLOduration=2.869289649 podStartE2EDuration="4.774522339s" totalImagesPullingTime="1.823898402s" totalInitContainerRuntime="81.334288ms" isStatefulPod=true podCreationTimestamp="2026-09-06 00:51:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:49.773877685 +0000 UTC m=+67.810020642" watchObservedRunningTime="2026-09-06 00:51:49.774522339 +0000 UTC m=+67.810665297"
Sep 06 00:51:49.813763 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:49.813658    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/84341857-7ef5-4bb7-b5e4-06c6a2da54fc-audit-log\") pod \"metrics-server-74d9d6f984-gkc8n\" (UID: \"84341857-7ef5-4bb7-b5e4-06c6a2da54fc\") " pod="openshift-monitoring/metrics-server-74d9d6f984-gkc8n"
Sep 06 00:51:49.813763 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:49.813731    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/84341857-7ef5-4bb7-b5e4-06c6a2da54fc-secret-metrics-server-client-certs\") pod \"metrics-server-74d9d6f984-gkc8n\" (UID: \"84341857-7ef5-4bb7-b5e4-06c6a2da54fc\") " pod="openshift-monitoring/metrics-server-74d9d6f984-gkc8n"
Sep 06 00:51:49.814374 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:49.813800    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84341857-7ef5-4bb7-b5e4-06c6a2da54fc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-74d9d6f984-gkc8n\" (UID: \"84341857-7ef5-4bb7-b5e4-06c6a2da54fc\") " pod="openshift-monitoring/metrics-server-74d9d6f984-gkc8n"
Sep 06 00:51:49.814374 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:49.813851    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/84341857-7ef5-4bb7-b5e4-06c6a2da54fc-client-ca-bundle\") pod \"metrics-server-74d9d6f984-gkc8n\" (UID: \"84341857-7ef5-4bb7-b5e4-06c6a2da54fc\") " pod="openshift-monitoring/metrics-server-74d9d6f984-gkc8n"
Sep 06 00:51:49.814374 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:49.813899    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/84341857-7ef5-4bb7-b5e4-06c6a2da54fc-metrics-server-audit-profiles\") pod \"metrics-server-74d9d6f984-gkc8n\" (UID: \"84341857-7ef5-4bb7-b5e4-06c6a2da54fc\") " pod="openshift-monitoring/metrics-server-74d9d6f984-gkc8n"
Sep 06 00:51:49.814374 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:49.814071    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/84341857-7ef5-4bb7-b5e4-06c6a2da54fc-secret-metrics-server-tls\") pod \"metrics-server-74d9d6f984-gkc8n\" (UID: \"84341857-7ef5-4bb7-b5e4-06c6a2da54fc\") " pod="openshift-monitoring/metrics-server-74d9d6f984-gkc8n"
Sep 06 00:51:49.814374 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:49.814170    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gczj5\" (UniqueName: \"kubernetes.io/projected/84341857-7ef5-4bb7-b5e4-06c6a2da54fc-kube-api-access-gczj5\") pod \"metrics-server-74d9d6f984-gkc8n\" (UID: \"84341857-7ef5-4bb7-b5e4-06c6a2da54fc\") " pod="openshift-monitoring/metrics-server-74d9d6f984-gkc8n"
Sep 06 00:51:49.814374 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:49.814201    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-d7gvz" podStartSLOduration=66.726497475 podStartE2EDuration="1m7.814185904s" totalImagesPullingTime="1.087688429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:50:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:49.813394115 +0000 UTC m=+67.849537073" watchObservedRunningTime="2026-09-06 00:51:49.814185904 +0000 UTC m=+67.850328861"
Sep 06 00:51:49.915535 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:49.915503    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/84341857-7ef5-4bb7-b5e4-06c6a2da54fc-secret-metrics-server-tls\") pod \"metrics-server-74d9d6f984-gkc8n\" (UID: \"84341857-7ef5-4bb7-b5e4-06c6a2da54fc\") " pod="openshift-monitoring/metrics-server-74d9d6f984-gkc8n"
Sep 06 00:51:49.915701 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:49.915559    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gczj5\" (UniqueName: \"kubernetes.io/projected/84341857-7ef5-4bb7-b5e4-06c6a2da54fc-kube-api-access-gczj5\") pod \"metrics-server-74d9d6f984-gkc8n\" (UID: \"84341857-7ef5-4bb7-b5e4-06c6a2da54fc\") " pod="openshift-monitoring/metrics-server-74d9d6f984-gkc8n"
Sep 06 00:51:49.915701 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:49.915603    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/84341857-7ef5-4bb7-b5e4-06c6a2da54fc-audit-log\") pod \"metrics-server-74d9d6f984-gkc8n\" (UID: \"84341857-7ef5-4bb7-b5e4-06c6a2da54fc\") " pod="openshift-monitoring/metrics-server-74d9d6f984-gkc8n"
Sep 06 00:51:49.915701 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:49.915632    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/84341857-7ef5-4bb7-b5e4-06c6a2da54fc-secret-metrics-server-client-certs\") pod \"metrics-server-74d9d6f984-gkc8n\" (UID: \"84341857-7ef5-4bb7-b5e4-06c6a2da54fc\") " pod="openshift-monitoring/metrics-server-74d9d6f984-gkc8n"
Sep 06 00:51:49.915701 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:49.915674    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84341857-7ef5-4bb7-b5e4-06c6a2da54fc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-74d9d6f984-gkc8n\" (UID: \"84341857-7ef5-4bb7-b5e4-06c6a2da54fc\") " pod="openshift-monitoring/metrics-server-74d9d6f984-gkc8n"
Sep 06 00:51:49.915701 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:49.915699    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/84341857-7ef5-4bb7-b5e4-06c6a2da54fc-client-ca-bundle\") pod \"metrics-server-74d9d6f984-gkc8n\" (UID: \"84341857-7ef5-4bb7-b5e4-06c6a2da54fc\") " pod="openshift-monitoring/metrics-server-74d9d6f984-gkc8n"
Sep 06 00:51:49.915882 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:49.915730    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/84341857-7ef5-4bb7-b5e4-06c6a2da54fc-metrics-server-audit-profiles\") pod \"metrics-server-74d9d6f984-gkc8n\" (UID: \"84341857-7ef5-4bb7-b5e4-06c6a2da54fc\") " pod="openshift-monitoring/metrics-server-74d9d6f984-gkc8n"
Sep 06 00:51:49.916244 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:49.916214    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/84341857-7ef5-4bb7-b5e4-06c6a2da54fc-audit-log\") pod \"metrics-server-74d9d6f984-gkc8n\" (UID: \"84341857-7ef5-4bb7-b5e4-06c6a2da54fc\") " pod="openshift-monitoring/metrics-server-74d9d6f984-gkc8n"
Sep 06 00:51:49.916602 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:49.916575    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84341857-7ef5-4bb7-b5e4-06c6a2da54fc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-74d9d6f984-gkc8n\" (UID: \"84341857-7ef5-4bb7-b5e4-06c6a2da54fc\") " pod="openshift-monitoring/metrics-server-74d9d6f984-gkc8n"
Sep 06 00:51:49.916706 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:49.916675    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/84341857-7ef5-4bb7-b5e4-06c6a2da54fc-metrics-server-audit-profiles\") pod \"metrics-server-74d9d6f984-gkc8n\" (UID: \"84341857-7ef5-4bb7-b5e4-06c6a2da54fc\") " pod="openshift-monitoring/metrics-server-74d9d6f984-gkc8n"
Sep 06 00:51:49.919186 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:49.919151    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/84341857-7ef5-4bb7-b5e4-06c6a2da54fc-secret-metrics-server-client-certs\") pod \"metrics-server-74d9d6f984-gkc8n\" (UID: \"84341857-7ef5-4bb7-b5e4-06c6a2da54fc\") " pod="openshift-monitoring/metrics-server-74d9d6f984-gkc8n"
Sep 06 00:51:49.919421 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:49.919401    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/84341857-7ef5-4bb7-b5e4-06c6a2da54fc-client-ca-bundle\") pod \"metrics-server-74d9d6f984-gkc8n\" (UID: \"84341857-7ef5-4bb7-b5e4-06c6a2da54fc\") " pod="openshift-monitoring/metrics-server-74d9d6f984-gkc8n"
Sep 06 00:51:49.923773 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:49.923749    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/84341857-7ef5-4bb7-b5e4-06c6a2da54fc-secret-metrics-server-tls\") pod \"metrics-server-74d9d6f984-gkc8n\" (UID: \"84341857-7ef5-4bb7-b5e4-06c6a2da54fc\") " pod="openshift-monitoring/metrics-server-74d9d6f984-gkc8n"
Sep 06 00:51:49.925961 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:49.925940    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gczj5\" (UniqueName: \"kubernetes.io/projected/84341857-7ef5-4bb7-b5e4-06c6a2da54fc-kube-api-access-gczj5\") pod \"metrics-server-74d9d6f984-gkc8n\" (UID: \"84341857-7ef5-4bb7-b5e4-06c6a2da54fc\") " pod="openshift-monitoring/metrics-server-74d9d6f984-gkc8n"
Sep 06 00:51:50.024885 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:50.024805    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-74d9d6f984-gkc8n"
Sep 06 00:51:50.174243 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:50.174213    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-8sqks"]
Sep 06 00:51:50.178424 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:50.178401    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8sqks"
Sep 06 00:51:50.181652 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:50.181627    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-4xm69\""
Sep 06 00:51:50.181867 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:50.181849    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 06 00:51:50.185444 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:50.185423    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-8sqks"]
Sep 06 00:51:50.218337 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:50.218220    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e0550f3-3722-412d-be53-7c79eec50332-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-8sqks\" (UID: \"8e0550f3-3722-412d-be53-7c79eec50332\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8sqks"
Sep 06 00:51:50.218665 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:50.218571    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6mzl\" (UniqueName: \"kubernetes.io/projected/8e0550f3-3722-412d-be53-7c79eec50332-kube-api-access-t6mzl\") pod \"monitoring-plugin-85bbbbbf4-8sqks\" (UID: \"8e0550f3-3722-412d-be53-7c79eec50332\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8sqks"
Sep 06 00:51:50.311909 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:50.311784    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-74d9d6f984-gkc8n"]
Sep 06 00:51:50.319065 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:50.319009    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6mzl\" (UniqueName: \"kubernetes.io/projected/8e0550f3-3722-412d-be53-7c79eec50332-kube-api-access-t6mzl\") pod \"monitoring-plugin-85bbbbbf4-8sqks\" (UID: \"8e0550f3-3722-412d-be53-7c79eec50332\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8sqks"
Sep 06 00:51:50.319134 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:50.319094    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e0550f3-3722-412d-be53-7c79eec50332-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-8sqks\" (UID: \"8e0550f3-3722-412d-be53-7c79eec50332\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8sqks"
Sep 06 00:51:50.319300 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:50.319214    2577 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 06 00:51:50.319300 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:51:50.319265    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e0550f3-3722-412d-be53-7c79eec50332-monitoring-plugin-cert podName:8e0550f3-3722-412d-be53-7c79eec50332 nodeName:}" failed. No retries permitted until 2026-09-06 00:51:50.819249435 +0000 UTC m=+68.855392383 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/8e0550f3-3722-412d-be53-7c79eec50332-monitoring-plugin-cert") pod "monitoring-plugin-85bbbbbf4-8sqks" (UID: "8e0550f3-3722-412d-be53-7c79eec50332") : secret "monitoring-plugin-cert" not found
Sep 06 00:51:50.329150 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:50.329126    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6mzl\" (UniqueName: \"kubernetes.io/projected/8e0550f3-3722-412d-be53-7c79eec50332-kube-api-access-t6mzl\") pod \"monitoring-plugin-85bbbbbf4-8sqks\" (UID: \"8e0550f3-3722-412d-be53-7c79eec50332\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8sqks"
Sep 06 00:51:50.672419 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:50.672390    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gcdgv"
Sep 06 00:51:50.773060 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:50.773025    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-74d9d6f984-gkc8n" event={"ID":"84341857-7ef5-4bb7-b5e4-06c6a2da54fc","Type":"ContainerStarted","Data":"54fcfe97415307fe2ad29b1819d7c48f0b63a558917e87c3e023a912617ffdb7"}
Sep 06 00:51:50.828473 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:50.826475    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e0550f3-3722-412d-be53-7c79eec50332-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-8sqks\" (UID: \"8e0550f3-3722-412d-be53-7c79eec50332\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8sqks"
Sep 06 00:51:50.840096 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:50.840066    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e0550f3-3722-412d-be53-7c79eec50332-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-8sqks\" (UID: \"8e0550f3-3722-412d-be53-7c79eec50332\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8sqks"
Sep 06 00:51:51.094073 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.093989    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8sqks"
Sep 06 00:51:51.642011 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.640044    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 06 00:51:51.644220 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.644200    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.648449 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.646416    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 06 00:51:51.648449 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.646695    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 06 00:51:51.648449 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.646896    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-dw828\""
Sep 06 00:51:51.648449 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.647062    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 06 00:51:51.648449 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.647639    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 06 00:51:51.648449 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.647882    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 06 00:51:51.648449 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.648014    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 06 00:51:51.648449 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.648186    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5u49usj1384nr\""
Sep 06 00:51:51.649919 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.649895    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 06 00:51:51.651370 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.650077    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 06 00:51:51.651370 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.650381    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 06 00:51:51.651370 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.650537    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 06 00:51:51.651370 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.650939    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 06 00:51:51.651608 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.651382    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 06 00:51:51.656399 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.652354    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 06 00:51:51.657561 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.657537    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 06 00:51:51.662634 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.662614    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 06 00:51:51.736478 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.736440    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.736670 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.736486    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc7520bd-0bc9-459c-8870-60becfde2a5b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.736670 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.736505    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-web-config\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.736670 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.736525    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.736670 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.736545    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cc7520bd-0bc9-459c-8870-60becfde2a5b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.736670 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.736562    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.736670 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.736583    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc7520bd-0bc9-459c-8870-60becfde2a5b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.736670 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.736601    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cc7520bd-0bc9-459c-8870-60becfde2a5b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.736670 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.736633    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cc7520bd-0bc9-459c-8870-60becfde2a5b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.736670 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.736652    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2swdr\" (UniqueName: \"kubernetes.io/projected/cc7520bd-0bc9-459c-8870-60becfde2a5b-kube-api-access-2swdr\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.736670 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.736677    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.737140 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.736694    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-config\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.737140 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.736712    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.737140 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.736737    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.737140 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.736761    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc7520bd-0bc9-459c-8870-60becfde2a5b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.737140 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.736775    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cc7520bd-0bc9-459c-8870-60becfde2a5b-config-out\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.737140 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.736796    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc7520bd-0bc9-459c-8870-60becfde2a5b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.737140 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.736826    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.737140 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.736855    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cc7520bd-0bc9-459c-8870-60becfde2a5b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.737140 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.736883    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cc7520bd-0bc9-459c-8870-60becfde2a5b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.839188 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.838095    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.839188 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.838149    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc7520bd-0bc9-459c-8870-60becfde2a5b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.839188 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.838175    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cc7520bd-0bc9-459c-8870-60becfde2a5b-config-out\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.839188 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.838198    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc7520bd-0bc9-459c-8870-60becfde2a5b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.839188 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.838229    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.839188 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.838266    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cc7520bd-0bc9-459c-8870-60becfde2a5b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.839188 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.838295    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cc7520bd-0bc9-459c-8870-60becfde2a5b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.839188 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.838333    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.839188 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.838362    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc7520bd-0bc9-459c-8870-60becfde2a5b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.839188 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.838378    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-web-config\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.839188 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.838404    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.839188 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.838430    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cc7520bd-0bc9-459c-8870-60becfde2a5b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.839188 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.838463    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.839188 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.838501    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc7520bd-0bc9-459c-8870-60becfde2a5b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.839188 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.838530    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cc7520bd-0bc9-459c-8870-60becfde2a5b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.839188 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.838564    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cc7520bd-0bc9-459c-8870-60becfde2a5b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.839188 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.838586    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2swdr\" (UniqueName: \"kubernetes.io/projected/cc7520bd-0bc9-459c-8870-60becfde2a5b-kube-api-access-2swdr\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.840381 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.838619    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.840381 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.838648    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-config\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.840381 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.838674    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.841378 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.841340    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc7520bd-0bc9-459c-8870-60becfde2a5b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.841682 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.841655    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc7520bd-0bc9-459c-8870-60becfde2a5b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.843297 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.842086    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-web-config\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.843297 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.842691    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc7520bd-0bc9-459c-8870-60becfde2a5b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.843594 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.843573    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cc7520bd-0bc9-459c-8870-60becfde2a5b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.844282 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.844259    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.845879 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.845615    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cc7520bd-0bc9-459c-8870-60becfde2a5b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.845972 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.845879    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cc7520bd-0bc9-459c-8870-60becfde2a5b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.845972 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.845930    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cc7520bd-0bc9-459c-8870-60becfde2a5b-config-out\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.846200 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.846172    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.846903 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.846858    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.848186 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.847600    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cc7520bd-0bc9-459c-8870-60becfde2a5b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.848186 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.847815    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.848186 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.848148    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cc7520bd-0bc9-459c-8870-60becfde2a5b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.848554 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.848487    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-config\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.848790 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.848769    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc7520bd-0bc9-459c-8870-60becfde2a5b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.848969 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.848947    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.849932 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.849906    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.850087 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.850068    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.853111 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.853011    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2swdr\" (UniqueName: \"kubernetes.io/projected/cc7520bd-0bc9-459c-8870-60becfde2a5b-kube-api-access-2swdr\") pod \"prometheus-k8s-0\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:51.963180 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:51.963134    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:51:54.774686 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:54.774627    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-8sqks"]
Sep 06 00:51:54.777033 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:51:54.777008    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e0550f3_3722_412d_be53_7c79eec50332.slice/crio-cb11651202012f824169862071eb6257349adeb70b53651e3ab34dc6a3c12806 WatchSource:0}: Error finding container cb11651202012f824169862071eb6257349adeb70b53651e3ab34dc6a3c12806: Status 404 returned error can't find the container with id cb11651202012f824169862071eb6257349adeb70b53651e3ab34dc6a3c12806
Sep 06 00:51:54.787905 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:54.787816    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 06 00:51:54.790688 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:54.790660    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wfwc6" event={"ID":"31067da9-3ebb-40fc-b24e-34ccd0f5f3fd","Type":"ContainerStarted","Data":"ce5fc6062027352917709ca2d6cf96255f2996681d8161ef2f1dbaed54d7af3e"}
Sep 06 00:51:54.790979 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:54.790929    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wfwc6"
Sep 06 00:51:54.791650 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:51:54.791613    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc7520bd_0bc9_459c_8870_60becfde2a5b.slice/crio-c341ad1e7110ddbd25969f557655c2c5cad6cc23c06046dbf94e62f8499599bd WatchSource:0}: Error finding container c341ad1e7110ddbd25969f557655c2c5cad6cc23c06046dbf94e62f8499599bd: Status 404 returned error can't find the container with id c341ad1e7110ddbd25969f557655c2c5cad6cc23c06046dbf94e62f8499599bd
Sep 06 00:51:54.793788 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:54.793747    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-74d9d6f984-gkc8n" event={"ID":"84341857-7ef5-4bb7-b5e4-06c6a2da54fc","Type":"ContainerStarted","Data":"a51a1974468e9ce1295c8b36b7cfbe78d13769b162afd3dfaa4fc7e56d655ad7"}
Sep 06 00:51:54.795834 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:54.795816    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8sqks" event={"ID":"8e0550f3-3722-412d-be53-7c79eec50332","Type":"ContainerStarted","Data":"cb11651202012f824169862071eb6257349adeb70b53651e3ab34dc6a3c12806"}
Sep 06 00:51:54.798002 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:54.797966    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tc782" event={"ID":"7270e6a0-6c6a-410a-b615-5cb276ebf879","Type":"ContainerStarted","Data":"4edbc68f45d804055edaae9cb452181b6c8db044f3f4f2c38184277998473d50"}
Sep 06 00:51:54.801168 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:54.801148    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c747cd59-0363-43d9-a1ae-23060db9fab7","Type":"ContainerStarted","Data":"e82e84b45adb1a39d709e70d83754cb5b4dbe18bea64530e9fd42aa59eb7c717"}
Sep 06 00:51:54.801265 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:54.801213    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c747cd59-0363-43d9-a1ae-23060db9fab7","Type":"ContainerStarted","Data":"afea58959c9d8c0d76f7c23fc2588ab65fb75448480ff311b7614d0997f257ee"}
Sep 06 00:51:54.801345 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:54.801280    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c747cd59-0363-43d9-a1ae-23060db9fab7","Type":"ContainerStarted","Data":"6bc34985818432225e16f0062933125cb9575c5cf9d5c5e44107360011681c71"}
Sep 06 00:51:54.808914 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:54.808861    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wfwc6" podStartSLOduration=67.142457251 podStartE2EDuration="1m12.808844381s" totalImagesPullingTime="5.66638713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:50:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:54.808700241 +0000 UTC m=+72.844843199" watchObservedRunningTime="2026-09-06 00:51:54.808844381 +0000 UTC m=+72.844987339"
Sep 06 00:51:54.831513 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:54.830787    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tc782" podStartSLOduration=66.707395864 podStartE2EDuration="1m12.830739473s" totalImagesPullingTime="6.123343609s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 00:50:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:54.830041463 +0000 UTC m=+72.866184430" watchObservedRunningTime="2026-09-06 00:51:54.830739473 +0000 UTC m=+72.866882431"
Sep 06 00:51:54.850269 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:54.850225    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-74d9d6f984-gkc8n" podStartSLOduration=1.672413411 podStartE2EDuration="5.85020833s" totalImagesPullingTime="4.177794919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:51:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:54.849482837 +0000 UTC m=+72.885625795" watchObservedRunningTime="2026-09-06 00:51:54.85020833 +0000 UTC m=+72.886351286"
Sep 06 00:51:55.810581 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:55.810530    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c747cd59-0363-43d9-a1ae-23060db9fab7","Type":"ContainerStarted","Data":"36610f90668caaca8c789c3d3b8b17e07da6943f073d7a30fe238d8721b51761"}
Sep 06 00:51:55.810933 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:55.810649    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c747cd59-0363-43d9-a1ae-23060db9fab7","Type":"ContainerStarted","Data":"80ac4cdb15eb9b64c69b5c9af4a72f0a604509a71685720ef466ce5e27aa3fa9"}
Sep 06 00:51:55.810933 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:55.810683    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c747cd59-0363-43d9-a1ae-23060db9fab7","Type":"ContainerStarted","Data":"88ffdafe572e28aa8f2b6f85ab2a94b43d2ca351988201aa06f6e22f749a8e90"}
Sep 06 00:51:55.812409 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:55.812381    2577 generic.go:356] "Generic (PLEG): container finished" podID="cc7520bd-0bc9-459c-8870-60becfde2a5b" containerID="55ac28475f942b5b3285752fb3055a8099fb5bad2864d9eb5568fc9e047468ca" exitCode=0
Sep 06 00:51:55.812526 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:55.812459    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cc7520bd-0bc9-459c-8870-60becfde2a5b","Type":"ContainerDied","Data":"55ac28475f942b5b3285752fb3055a8099fb5bad2864d9eb5568fc9e047468ca"}
Sep 06 00:51:55.812526 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:55.812524    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cc7520bd-0bc9-459c-8870-60becfde2a5b","Type":"ContainerStarted","Data":"c341ad1e7110ddbd25969f557655c2c5cad6cc23c06046dbf94e62f8499599bd"}
Sep 06 00:51:55.838827 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:55.838552    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.324157551 podStartE2EDuration="9.838530643s" totalImagesPullingTime="6.493424424s" totalInitContainerRuntime="20.948668ms" isStatefulPod=false podCreationTimestamp="2026-09-06 00:51:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:55.836887529 +0000 UTC m=+73.873030516" watchObservedRunningTime="2026-09-06 00:51:55.838530643 +0000 UTC m=+73.874673604"
Sep 06 00:51:56.819066 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:56.819022    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8sqks" event={"ID":"8e0550f3-3722-412d-be53-7c79eec50332","Type":"ContainerStarted","Data":"796f998d43aebc2abb61461d181da619fd2f0626191ea9348e944313053fc480"}
Sep 06 00:51:56.819560 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:56.819095    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8sqks"
Sep 06 00:51:56.824911 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:56.824885    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8sqks"
Sep 06 00:51:56.834382 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:56.833668    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8sqks" podStartSLOduration=5.420479105 podStartE2EDuration="6.833651553s" totalImagesPullingTime="1.413172448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:51:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:51:56.833616714 +0000 UTC m=+74.869759709" watchObservedRunningTime="2026-09-06 00:51:56.833651553 +0000 UTC m=+74.869794511"
Sep 06 00:51:59.836174 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:59.836108    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cc7520bd-0bc9-459c-8870-60becfde2a5b","Type":"ContainerStarted","Data":"1f74babebbb7f9968cae876e3f755e8d1aa4d9846a7c1bbb8927e255b5f85b40"}
Sep 06 00:51:59.836660 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:51:59.836228    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cc7520bd-0bc9-459c-8870-60becfde2a5b","Type":"ContainerStarted","Data":"94b6d7529ae817ff3d2d26e3d0500919fbde1557de215fb669f8d9eee10b3c11"}
Sep 06 00:52:01.847281 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:52:01.847246    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cc7520bd-0bc9-459c-8870-60becfde2a5b","Type":"ContainerStarted","Data":"d1ad633d0c3972b71b1523dbd9e2c5a60271bddda12008eaa787dfd5a8e71df2"}
Sep 06 00:52:01.847674 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:52:01.847346    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cc7520bd-0bc9-459c-8870-60becfde2a5b","Type":"ContainerStarted","Data":"aae6a8a170d225bad34865b59319c064af8f832d981e6f6650e275f59affe82a"}
Sep 06 00:52:01.847674 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:52:01.847391    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cc7520bd-0bc9-459c-8870-60becfde2a5b","Type":"ContainerStarted","Data":"413e0ef5ad37371cc80b679c2e1fed2fd06671d1fec2ff661345653894cf4050"}
Sep 06 00:52:01.847674 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:52:01.847431    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cc7520bd-0bc9-459c-8870-60becfde2a5b","Type":"ContainerStarted","Data":"700442fa098b2aac999662b1e131baf309dcdf053c5189560604036a21930161"}
Sep 06 00:52:01.874880 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:52:01.874818    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=5.684818518 podStartE2EDuration="10.874793329s" totalImagesPullingTime="5.166110785s" totalInitContainerRuntime="23.864026ms" isStatefulPod=false podCreationTimestamp="2026-09-06 00:51:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:52:01.872251603 +0000 UTC m=+79.908394561" watchObservedRunningTime="2026-09-06 00:52:01.874793329 +0000 UTC m=+79.910936361"
Sep 06 00:52:01.963465 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:52:01.963428    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:52:10.025753 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:52:10.025712    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-74d9d6f984-gkc8n"
Sep 06 00:52:10.026240 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:52:10.025822    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-74d9d6f984-gkc8n"
Sep 06 00:52:25.814355 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:52:25.814305    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wfwc6"
Sep 06 00:52:30.030567 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:52:30.030536    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-74d9d6f984-gkc8n"
Sep 06 00:52:30.034430 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:52:30.034414    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-74d9d6f984-gkc8n"
Sep 06 00:52:51.964072 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:52:51.964032    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:52:51.983048 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:52:51.983029    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:52:52.057749 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:52:52.057724    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:05.611246 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:05.611212    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 06 00:53:05.611665 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:05.611515    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c747cd59-0363-43d9-a1ae-23060db9fab7" containerName="alertmanager" containerID="cri-o://6bc34985818432225e16f0062933125cb9575c5cf9d5c5e44107360011681c71" gracePeriod=120
Sep 06 00:53:05.611665 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:05.611601    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c747cd59-0363-43d9-a1ae-23060db9fab7" containerName="kube-rbac-proxy-metric" containerID="cri-o://80ac4cdb15eb9b64c69b5c9af4a72f0a604509a71685720ef466ce5e27aa3fa9" gracePeriod=120
Sep 06 00:53:05.611665 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:05.611625    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c747cd59-0363-43d9-a1ae-23060db9fab7" containerName="prom-label-proxy" containerID="cri-o://36610f90668caaca8c789c3d3b8b17e07da6943f073d7a30fe238d8721b51761" gracePeriod=120
Sep 06 00:53:05.611815 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:05.611655    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c747cd59-0363-43d9-a1ae-23060db9fab7" containerName="config-reloader" containerID="cri-o://afea58959c9d8c0d76f7c23fc2588ab65fb75448480ff311b7614d0997f257ee" gracePeriod=120
Sep 06 00:53:05.611815 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:05.611676    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c747cd59-0363-43d9-a1ae-23060db9fab7" containerName="kube-rbac-proxy" containerID="cri-o://88ffdafe572e28aa8f2b6f85ab2a94b43d2ca351988201aa06f6e22f749a8e90" gracePeriod=120
Sep 06 00:53:05.611815 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:05.611649    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c747cd59-0363-43d9-a1ae-23060db9fab7" containerName="kube-rbac-proxy-web" containerID="cri-o://e82e84b45adb1a39d709e70d83754cb5b4dbe18bea64530e9fd42aa59eb7c717" gracePeriod=120
Sep 06 00:53:06.096799 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:06.096762    2577 generic.go:356] "Generic (PLEG): container finished" podID="c747cd59-0363-43d9-a1ae-23060db9fab7" containerID="36610f90668caaca8c789c3d3b8b17e07da6943f073d7a30fe238d8721b51761" exitCode=0
Sep 06 00:53:06.096799 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:06.096786    2577 generic.go:356] "Generic (PLEG): container finished" podID="c747cd59-0363-43d9-a1ae-23060db9fab7" containerID="80ac4cdb15eb9b64c69b5c9af4a72f0a604509a71685720ef466ce5e27aa3fa9" exitCode=0
Sep 06 00:53:06.096799 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:06.096792    2577 generic.go:356] "Generic (PLEG): container finished" podID="c747cd59-0363-43d9-a1ae-23060db9fab7" containerID="88ffdafe572e28aa8f2b6f85ab2a94b43d2ca351988201aa06f6e22f749a8e90" exitCode=0
Sep 06 00:53:06.096799 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:06.096798    2577 generic.go:356] "Generic (PLEG): container finished" podID="c747cd59-0363-43d9-a1ae-23060db9fab7" containerID="afea58959c9d8c0d76f7c23fc2588ab65fb75448480ff311b7614d0997f257ee" exitCode=0
Sep 06 00:53:06.096799 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:06.096804    2577 generic.go:356] "Generic (PLEG): container finished" podID="c747cd59-0363-43d9-a1ae-23060db9fab7" containerID="6bc34985818432225e16f0062933125cb9575c5cf9d5c5e44107360011681c71" exitCode=0
Sep 06 00:53:06.097074 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:06.096830    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c747cd59-0363-43d9-a1ae-23060db9fab7","Type":"ContainerDied","Data":"36610f90668caaca8c789c3d3b8b17e07da6943f073d7a30fe238d8721b51761"}
Sep 06 00:53:06.097074 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:06.096894    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c747cd59-0363-43d9-a1ae-23060db9fab7","Type":"ContainerDied","Data":"80ac4cdb15eb9b64c69b5c9af4a72f0a604509a71685720ef466ce5e27aa3fa9"}
Sep 06 00:53:06.097074 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:06.096921    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c747cd59-0363-43d9-a1ae-23060db9fab7","Type":"ContainerDied","Data":"88ffdafe572e28aa8f2b6f85ab2a94b43d2ca351988201aa06f6e22f749a8e90"}
Sep 06 00:53:06.097074 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:06.096947    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c747cd59-0363-43d9-a1ae-23060db9fab7","Type":"ContainerDied","Data":"afea58959c9d8c0d76f7c23fc2588ab65fb75448480ff311b7614d0997f257ee"}
Sep 06 00:53:06.097074 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:06.096970    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c747cd59-0363-43d9-a1ae-23060db9fab7","Type":"ContainerDied","Data":"6bc34985818432225e16f0062933125cb9575c5cf9d5c5e44107360011681c71"}
Sep 06 00:53:06.865407 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:06.865384    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:53:06.967514 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:06.967436    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c747cd59-0363-43d9-a1ae-23060db9fab7-config-out\") pod \"c747cd59-0363-43d9-a1ae-23060db9fab7\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") "
Sep 06 00:53:06.967514 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:06.967475    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c747cd59-0363-43d9-a1ae-23060db9fab7-tls-assets\") pod \"c747cd59-0363-43d9-a1ae-23060db9fab7\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") "
Sep 06 00:53:06.967514 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:06.967496    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c747cd59-0363-43d9-a1ae-23060db9fab7-alertmanager-main-db\") pod \"c747cd59-0363-43d9-a1ae-23060db9fab7\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") "
Sep 06 00:53:06.967514 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:06.967515    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rtg6\" (UniqueName: \"kubernetes.io/projected/c747cd59-0363-43d9-a1ae-23060db9fab7-kube-api-access-2rtg6\") pod \"c747cd59-0363-43d9-a1ae-23060db9fab7\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") "
Sep 06 00:53:06.967832 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:06.967554    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c747cd59-0363-43d9-a1ae-23060db9fab7-cluster-tls-config\") pod \"c747cd59-0363-43d9-a1ae-23060db9fab7\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") "
Sep 06 00:53:06.967832 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:06.967584    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c747cd59-0363-43d9-a1ae-23060db9fab7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"c747cd59-0363-43d9-a1ae-23060db9fab7\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") "
Sep 06 00:53:06.967832 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:06.967616    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c747cd59-0363-43d9-a1ae-23060db9fab7-secret-alertmanager-kube-rbac-proxy-web\") pod \"c747cd59-0363-43d9-a1ae-23060db9fab7\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") "
Sep 06 00:53:06.967832 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:06.967642    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c747cd59-0363-43d9-a1ae-23060db9fab7-alertmanager-trusted-ca-bundle\") pod \"c747cd59-0363-43d9-a1ae-23060db9fab7\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") "
Sep 06 00:53:06.967832 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:06.967676    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c747cd59-0363-43d9-a1ae-23060db9fab7-config-volume\") pod \"c747cd59-0363-43d9-a1ae-23060db9fab7\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") "
Sep 06 00:53:06.967832 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:06.967696    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c747cd59-0363-43d9-a1ae-23060db9fab7-web-config\") pod \"c747cd59-0363-43d9-a1ae-23060db9fab7\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") "
Sep 06 00:53:06.967832 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:06.967714    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c747cd59-0363-43d9-a1ae-23060db9fab7-secret-alertmanager-main-tls\") pod \"c747cd59-0363-43d9-a1ae-23060db9fab7\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") "
Sep 06 00:53:06.967832 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:06.967738    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c747cd59-0363-43d9-a1ae-23060db9fab7-metrics-client-ca\") pod \"c747cd59-0363-43d9-a1ae-23060db9fab7\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") "
Sep 06 00:53:06.967832 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:06.967766    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c747cd59-0363-43d9-a1ae-23060db9fab7-secret-alertmanager-kube-rbac-proxy\") pod \"c747cd59-0363-43d9-a1ae-23060db9fab7\" (UID: \"c747cd59-0363-43d9-a1ae-23060db9fab7\") "
Sep 06 00:53:06.968635 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:06.968347    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c747cd59-0363-43d9-a1ae-23060db9fab7-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "c747cd59-0363-43d9-a1ae-23060db9fab7" (UID: "c747cd59-0363-43d9-a1ae-23060db9fab7"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 00:53:06.968635 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:06.968389    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c747cd59-0363-43d9-a1ae-23060db9fab7-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "c747cd59-0363-43d9-a1ae-23060db9fab7" (UID: "c747cd59-0363-43d9-a1ae-23060db9fab7"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 00:53:06.969405 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:06.969367    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c747cd59-0363-43d9-a1ae-23060db9fab7-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "c747cd59-0363-43d9-a1ae-23060db9fab7" (UID: "c747cd59-0363-43d9-a1ae-23060db9fab7"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 00:53:06.971723 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:06.971691    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c747cd59-0363-43d9-a1ae-23060db9fab7-kube-api-access-2rtg6" (OuterVolumeSpecName: "kube-api-access-2rtg6") pod "c747cd59-0363-43d9-a1ae-23060db9fab7" (UID: "c747cd59-0363-43d9-a1ae-23060db9fab7"). InnerVolumeSpecName "kube-api-access-2rtg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 00:53:06.972390 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:06.972369    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c747cd59-0363-43d9-a1ae-23060db9fab7-config-out" (OuterVolumeSpecName: "config-out") pod "c747cd59-0363-43d9-a1ae-23060db9fab7" (UID: "c747cd59-0363-43d9-a1ae-23060db9fab7"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 00:53:06.972875 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:06.972830    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c747cd59-0363-43d9-a1ae-23060db9fab7-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "c747cd59-0363-43d9-a1ae-23060db9fab7" (UID: "c747cd59-0363-43d9-a1ae-23060db9fab7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 00:53:06.972966 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:06.972923    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c747cd59-0363-43d9-a1ae-23060db9fab7-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c747cd59-0363-43d9-a1ae-23060db9fab7" (UID: "c747cd59-0363-43d9-a1ae-23060db9fab7"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 00:53:06.973604 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:06.973571    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c747cd59-0363-43d9-a1ae-23060db9fab7-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "c747cd59-0363-43d9-a1ae-23060db9fab7" (UID: "c747cd59-0363-43d9-a1ae-23060db9fab7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 00:53:06.973689 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:06.973653    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c747cd59-0363-43d9-a1ae-23060db9fab7-config-volume" (OuterVolumeSpecName: "config-volume") pod "c747cd59-0363-43d9-a1ae-23060db9fab7" (UID: "c747cd59-0363-43d9-a1ae-23060db9fab7"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 00:53:06.973749 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:06.973717    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c747cd59-0363-43d9-a1ae-23060db9fab7-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "c747cd59-0363-43d9-a1ae-23060db9fab7" (UID: "c747cd59-0363-43d9-a1ae-23060db9fab7"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 00:53:06.973819 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:06.973804    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c747cd59-0363-43d9-a1ae-23060db9fab7-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "c747cd59-0363-43d9-a1ae-23060db9fab7" (UID: "c747cd59-0363-43d9-a1ae-23060db9fab7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 00:53:06.977172 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:06.977151    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c747cd59-0363-43d9-a1ae-23060db9fab7-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "c747cd59-0363-43d9-a1ae-23060db9fab7" (UID: "c747cd59-0363-43d9-a1ae-23060db9fab7"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 00:53:06.984529 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:06.984510    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c747cd59-0363-43d9-a1ae-23060db9fab7-web-config" (OuterVolumeSpecName: "web-config") pod "c747cd59-0363-43d9-a1ae-23060db9fab7" (UID: "c747cd59-0363-43d9-a1ae-23060db9fab7"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 00:53:07.068237 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.068210    2577 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c747cd59-0363-43d9-a1ae-23060db9fab7-cluster-tls-config\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:53:07.068237 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.068237    2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c747cd59-0363-43d9-a1ae-23060db9fab7-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:53:07.068466 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.068252    2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c747cd59-0363-43d9-a1ae-23060db9fab7-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:53:07.068466 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.068265    2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c747cd59-0363-43d9-a1ae-23060db9fab7-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:53:07.068466 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.068276    2577 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c747cd59-0363-43d9-a1ae-23060db9fab7-config-volume\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:53:07.068466 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.068312    2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c747cd59-0363-43d9-a1ae-23060db9fab7-web-config\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:53:07.068466 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.068352    2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c747cd59-0363-43d9-a1ae-23060db9fab7-secret-alertmanager-main-tls\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:53:07.068466 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.068365    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c747cd59-0363-43d9-a1ae-23060db9fab7-metrics-client-ca\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:53:07.068466 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.068377    2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c747cd59-0363-43d9-a1ae-23060db9fab7-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:53:07.068466 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.068389    2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c747cd59-0363-43d9-a1ae-23060db9fab7-config-out\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:53:07.068466 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.068400    2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c747cd59-0363-43d9-a1ae-23060db9fab7-tls-assets\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:53:07.068466 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.068414    2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c747cd59-0363-43d9-a1ae-23060db9fab7-alertmanager-main-db\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:53:07.068466 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.068426    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rtg6\" (UniqueName: \"kubernetes.io/projected/c747cd59-0363-43d9-a1ae-23060db9fab7-kube-api-access-2rtg6\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:53:07.103357 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.103306    2577 generic.go:356] "Generic (PLEG): container finished" podID="c747cd59-0363-43d9-a1ae-23060db9fab7" containerID="e82e84b45adb1a39d709e70d83754cb5b4dbe18bea64530e9fd42aa59eb7c717" exitCode=0
Sep 06 00:53:07.103493 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.103395    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c747cd59-0363-43d9-a1ae-23060db9fab7","Type":"ContainerDied","Data":"e82e84b45adb1a39d709e70d83754cb5b4dbe18bea64530e9fd42aa59eb7c717"}
Sep 06 00:53:07.103493 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.103416    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:53:07.103493 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.103464    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c747cd59-0363-43d9-a1ae-23060db9fab7","Type":"ContainerDied","Data":"ac0522badea9ddb16b035f8301a5d8c4a402d10e1cdefc114863b664122e31d0"}
Sep 06 00:53:07.103653 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.103502    2577 scope.go:117] "RemoveContainer" containerID="36610f90668caaca8c789c3d3b8b17e07da6943f073d7a30fe238d8721b51761"
Sep 06 00:53:07.116755 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.116738    2577 scope.go:117] "RemoveContainer" containerID="80ac4cdb15eb9b64c69b5c9af4a72f0a604509a71685720ef466ce5e27aa3fa9"
Sep 06 00:53:07.123351 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.123314    2577 scope.go:117] "RemoveContainer" containerID="88ffdafe572e28aa8f2b6f85ab2a94b43d2ca351988201aa06f6e22f749a8e90"
Sep 06 00:53:07.130127 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.130103    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 06 00:53:07.130773 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.130758    2577 scope.go:117] "RemoveContainer" containerID="e82e84b45adb1a39d709e70d83754cb5b4dbe18bea64530e9fd42aa59eb7c717"
Sep 06 00:53:07.134509 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.134483    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 06 00:53:07.137999 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.137986    2577 scope.go:117] "RemoveContainer" containerID="afea58959c9d8c0d76f7c23fc2588ab65fb75448480ff311b7614d0997f257ee"
Sep 06 00:53:07.144517 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.144501    2577 scope.go:117] "RemoveContainer" containerID="6bc34985818432225e16f0062933125cb9575c5cf9d5c5e44107360011681c71"
Sep 06 00:53:07.151153 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.151137    2577 scope.go:117] "RemoveContainer" containerID="d56039573c58707b6e853bd2678914216909f8ff06c7a7c06b6c72ea2c8c04b3"
Sep 06 00:53:07.157977 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.157961    2577 scope.go:117] "RemoveContainer" containerID="36610f90668caaca8c789c3d3b8b17e07da6943f073d7a30fe238d8721b51761"
Sep 06 00:53:07.158250 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:53:07.158226    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36610f90668caaca8c789c3d3b8b17e07da6943f073d7a30fe238d8721b51761\": container with ID starting with 36610f90668caaca8c789c3d3b8b17e07da6943f073d7a30fe238d8721b51761 not found: ID does not exist" containerID="36610f90668caaca8c789c3d3b8b17e07da6943f073d7a30fe238d8721b51761"
Sep 06 00:53:07.158311 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.158257    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36610f90668caaca8c789c3d3b8b17e07da6943f073d7a30fe238d8721b51761"} err="failed to get container status \"36610f90668caaca8c789c3d3b8b17e07da6943f073d7a30fe238d8721b51761\": rpc error: code = NotFound desc = could not find container \"36610f90668caaca8c789c3d3b8b17e07da6943f073d7a30fe238d8721b51761\": container with ID starting with 36610f90668caaca8c789c3d3b8b17e07da6943f073d7a30fe238d8721b51761 not found: ID does not exist"
Sep 06 00:53:07.158311 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.158286    2577 scope.go:117] "RemoveContainer" containerID="80ac4cdb15eb9b64c69b5c9af4a72f0a604509a71685720ef466ce5e27aa3fa9"
Sep 06 00:53:07.158549 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:53:07.158530    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80ac4cdb15eb9b64c69b5c9af4a72f0a604509a71685720ef466ce5e27aa3fa9\": container with ID starting with 80ac4cdb15eb9b64c69b5c9af4a72f0a604509a71685720ef466ce5e27aa3fa9 not found: ID does not exist" containerID="80ac4cdb15eb9b64c69b5c9af4a72f0a604509a71685720ef466ce5e27aa3fa9"
Sep 06 00:53:07.158584 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.158556    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80ac4cdb15eb9b64c69b5c9af4a72f0a604509a71685720ef466ce5e27aa3fa9"} err="failed to get container status \"80ac4cdb15eb9b64c69b5c9af4a72f0a604509a71685720ef466ce5e27aa3fa9\": rpc error: code = NotFound desc = could not find container \"80ac4cdb15eb9b64c69b5c9af4a72f0a604509a71685720ef466ce5e27aa3fa9\": container with ID starting with 80ac4cdb15eb9b64c69b5c9af4a72f0a604509a71685720ef466ce5e27aa3fa9 not found: ID does not exist"
Sep 06 00:53:07.158584 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.158573    2577 scope.go:117] "RemoveContainer" containerID="88ffdafe572e28aa8f2b6f85ab2a94b43d2ca351988201aa06f6e22f749a8e90"
Sep 06 00:53:07.158830 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:53:07.158814    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88ffdafe572e28aa8f2b6f85ab2a94b43d2ca351988201aa06f6e22f749a8e90\": container with ID starting with 88ffdafe572e28aa8f2b6f85ab2a94b43d2ca351988201aa06f6e22f749a8e90 not found: ID does not exist" containerID="88ffdafe572e28aa8f2b6f85ab2a94b43d2ca351988201aa06f6e22f749a8e90"
Sep 06 00:53:07.158877 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.158835    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88ffdafe572e28aa8f2b6f85ab2a94b43d2ca351988201aa06f6e22f749a8e90"} err="failed to get container status \"88ffdafe572e28aa8f2b6f85ab2a94b43d2ca351988201aa06f6e22f749a8e90\": rpc error: code = NotFound desc = could not find container \"88ffdafe572e28aa8f2b6f85ab2a94b43d2ca351988201aa06f6e22f749a8e90\": container with ID starting with 88ffdafe572e28aa8f2b6f85ab2a94b43d2ca351988201aa06f6e22f749a8e90 not found: ID does not exist"
Sep 06 00:53:07.158877 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.158849    2577 scope.go:117] "RemoveContainer" containerID="e82e84b45adb1a39d709e70d83754cb5b4dbe18bea64530e9fd42aa59eb7c717"
Sep 06 00:53:07.159079 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:53:07.159065    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e82e84b45adb1a39d709e70d83754cb5b4dbe18bea64530e9fd42aa59eb7c717\": container with ID starting with e82e84b45adb1a39d709e70d83754cb5b4dbe18bea64530e9fd42aa59eb7c717 not found: ID does not exist" containerID="e82e84b45adb1a39d709e70d83754cb5b4dbe18bea64530e9fd42aa59eb7c717"
Sep 06 00:53:07.159113 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.159084    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e82e84b45adb1a39d709e70d83754cb5b4dbe18bea64530e9fd42aa59eb7c717"} err="failed to get container status \"e82e84b45adb1a39d709e70d83754cb5b4dbe18bea64530e9fd42aa59eb7c717\": rpc error: code = NotFound desc = could not find container \"e82e84b45adb1a39d709e70d83754cb5b4dbe18bea64530e9fd42aa59eb7c717\": container with ID starting with e82e84b45adb1a39d709e70d83754cb5b4dbe18bea64530e9fd42aa59eb7c717 not found: ID does not exist"
Sep 06 00:53:07.159113 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.159095    2577 scope.go:117] "RemoveContainer" containerID="afea58959c9d8c0d76f7c23fc2588ab65fb75448480ff311b7614d0997f257ee"
Sep 06 00:53:07.159363 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:53:07.159343    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afea58959c9d8c0d76f7c23fc2588ab65fb75448480ff311b7614d0997f257ee\": container with ID starting with afea58959c9d8c0d76f7c23fc2588ab65fb75448480ff311b7614d0997f257ee not found: ID does not exist" containerID="afea58959c9d8c0d76f7c23fc2588ab65fb75448480ff311b7614d0997f257ee"
Sep 06 00:53:07.159426 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.159371    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afea58959c9d8c0d76f7c23fc2588ab65fb75448480ff311b7614d0997f257ee"} err="failed to get container status \"afea58959c9d8c0d76f7c23fc2588ab65fb75448480ff311b7614d0997f257ee\": rpc error: code = NotFound desc = could not find container \"afea58959c9d8c0d76f7c23fc2588ab65fb75448480ff311b7614d0997f257ee\": container with ID starting with afea58959c9d8c0d76f7c23fc2588ab65fb75448480ff311b7614d0997f257ee not found: ID does not exist"
Sep 06 00:53:07.159426 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.159392    2577 scope.go:117] "RemoveContainer" containerID="6bc34985818432225e16f0062933125cb9575c5cf9d5c5e44107360011681c71"
Sep 06 00:53:07.159638 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:53:07.159623    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bc34985818432225e16f0062933125cb9575c5cf9d5c5e44107360011681c71\": container with ID starting with 6bc34985818432225e16f0062933125cb9575c5cf9d5c5e44107360011681c71 not found: ID does not exist" containerID="6bc34985818432225e16f0062933125cb9575c5cf9d5c5e44107360011681c71"
Sep 06 00:53:07.159675 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.159642    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bc34985818432225e16f0062933125cb9575c5cf9d5c5e44107360011681c71"} err="failed to get container status \"6bc34985818432225e16f0062933125cb9575c5cf9d5c5e44107360011681c71\": rpc error: code = NotFound desc = could not find container \"6bc34985818432225e16f0062933125cb9575c5cf9d5c5e44107360011681c71\": container with ID starting with 6bc34985818432225e16f0062933125cb9575c5cf9d5c5e44107360011681c71 not found: ID does not exist"
Sep 06 00:53:07.159675 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.159654    2577 scope.go:117] "RemoveContainer" containerID="d56039573c58707b6e853bd2678914216909f8ff06c7a7c06b6c72ea2c8c04b3"
Sep 06 00:53:07.159865 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:53:07.159849    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d56039573c58707b6e853bd2678914216909f8ff06c7a7c06b6c72ea2c8c04b3\": container with ID starting with d56039573c58707b6e853bd2678914216909f8ff06c7a7c06b6c72ea2c8c04b3 not found: ID does not exist" containerID="d56039573c58707b6e853bd2678914216909f8ff06c7a7c06b6c72ea2c8c04b3"
Sep 06 00:53:07.159915 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.159872    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d56039573c58707b6e853bd2678914216909f8ff06c7a7c06b6c72ea2c8c04b3"} err="failed to get container status \"d56039573c58707b6e853bd2678914216909f8ff06c7a7c06b6c72ea2c8c04b3\": rpc error: code = NotFound desc = could not find container \"d56039573c58707b6e853bd2678914216909f8ff06c7a7c06b6c72ea2c8c04b3\": container with ID starting with d56039573c58707b6e853bd2678914216909f8ff06c7a7c06b6c72ea2c8c04b3 not found: ID does not exist"
Sep 06 00:53:07.174737 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.174716    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 06 00:53:07.175026 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.175011    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c747cd59-0363-43d9-a1ae-23060db9fab7" containerName="kube-rbac-proxy-web"
Sep 06 00:53:07.175091 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.175029    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c747cd59-0363-43d9-a1ae-23060db9fab7" containerName="kube-rbac-proxy-web"
Sep 06 00:53:07.175091 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.175045    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c747cd59-0363-43d9-a1ae-23060db9fab7" containerName="kube-rbac-proxy-metric"
Sep 06 00:53:07.175091 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.175054    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c747cd59-0363-43d9-a1ae-23060db9fab7" containerName="kube-rbac-proxy-metric"
Sep 06 00:53:07.175091 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.175064    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c747cd59-0363-43d9-a1ae-23060db9fab7" containerName="prom-label-proxy"
Sep 06 00:53:07.175091 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.175072    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c747cd59-0363-43d9-a1ae-23060db9fab7" containerName="prom-label-proxy"
Sep 06 00:53:07.175091 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.175083    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c747cd59-0363-43d9-a1ae-23060db9fab7" containerName="kube-rbac-proxy"
Sep 06 00:53:07.175091 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.175091    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c747cd59-0363-43d9-a1ae-23060db9fab7" containerName="kube-rbac-proxy"
Sep 06 00:53:07.175453 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.175104    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c747cd59-0363-43d9-a1ae-23060db9fab7" containerName="config-reloader"
Sep 06 00:53:07.175453 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.175114    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c747cd59-0363-43d9-a1ae-23060db9fab7" containerName="config-reloader"
Sep 06 00:53:07.175453 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.175130    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c747cd59-0363-43d9-a1ae-23060db9fab7" containerName="alertmanager"
Sep 06 00:53:07.175453 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.175138    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c747cd59-0363-43d9-a1ae-23060db9fab7" containerName="alertmanager"
Sep 06 00:53:07.175453 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.175155    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c747cd59-0363-43d9-a1ae-23060db9fab7" containerName="init-config-reloader"
Sep 06 00:53:07.175453 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.175162    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c747cd59-0363-43d9-a1ae-23060db9fab7" containerName="init-config-reloader"
Sep 06 00:53:07.175453 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.175230    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c747cd59-0363-43d9-a1ae-23060db9fab7" containerName="alertmanager"
Sep 06 00:53:07.175453 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.175241    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c747cd59-0363-43d9-a1ae-23060db9fab7" containerName="config-reloader"
Sep 06 00:53:07.175453 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.175251    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c747cd59-0363-43d9-a1ae-23060db9fab7" containerName="kube-rbac-proxy"
Sep 06 00:53:07.175453 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.175261    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c747cd59-0363-43d9-a1ae-23060db9fab7" containerName="kube-rbac-proxy-web"
Sep 06 00:53:07.175453 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.175269    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c747cd59-0363-43d9-a1ae-23060db9fab7" containerName="kube-rbac-proxy-metric"
Sep 06 00:53:07.175453 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.175277    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c747cd59-0363-43d9-a1ae-23060db9fab7" containerName="prom-label-proxy"
Sep 06 00:53:07.180900 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.180881    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:53:07.183394 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.183380    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 06 00:53:07.183605 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.183589    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 06 00:53:07.183707 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.183669    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 06 00:53:07.183785 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.183724    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2ll9h\""
Sep 06 00:53:07.183785 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.183750    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 06 00:53:07.183927 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.183834    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 06 00:53:07.184036 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.184022    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 06 00:53:07.184182 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.184163    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 06 00:53:07.184872 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.184852    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 06 00:53:07.188743 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.188728    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 06 00:53:07.195680 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.195662    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 06 00:53:07.270946 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.270877    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fdc32a23-fc37-42f2-96cc-519b50ea8dae-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fdc32a23-fc37-42f2-96cc-519b50ea8dae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:53:07.270946 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.270909    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fdc32a23-fc37-42f2-96cc-519b50ea8dae-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fdc32a23-fc37-42f2-96cc-519b50ea8dae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:53:07.270946 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.270926    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fdc32a23-fc37-42f2-96cc-519b50ea8dae-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fdc32a23-fc37-42f2-96cc-519b50ea8dae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:53:07.270946 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.270944    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fdc32a23-fc37-42f2-96cc-519b50ea8dae-config-volume\") pod \"alertmanager-main-0\" (UID: \"fdc32a23-fc37-42f2-96cc-519b50ea8dae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:53:07.271154 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.271028    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fdc32a23-fc37-42f2-96cc-519b50ea8dae-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fdc32a23-fc37-42f2-96cc-519b50ea8dae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:53:07.271154 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.271059    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fdc32a23-fc37-42f2-96cc-519b50ea8dae-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fdc32a23-fc37-42f2-96cc-519b50ea8dae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:53:07.271154 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.271078    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fdc32a23-fc37-42f2-96cc-519b50ea8dae-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fdc32a23-fc37-42f2-96cc-519b50ea8dae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:53:07.271154 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.271098    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fdc32a23-fc37-42f2-96cc-519b50ea8dae-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fdc32a23-fc37-42f2-96cc-519b50ea8dae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:53:07.271154 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.271117    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdc32a23-fc37-42f2-96cc-519b50ea8dae-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fdc32a23-fc37-42f2-96cc-519b50ea8dae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:53:07.271154 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.271136    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t59t\" (UniqueName: \"kubernetes.io/projected/fdc32a23-fc37-42f2-96cc-519b50ea8dae-kube-api-access-5t59t\") pod \"alertmanager-main-0\" (UID: \"fdc32a23-fc37-42f2-96cc-519b50ea8dae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:53:07.271343 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.271162    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fdc32a23-fc37-42f2-96cc-519b50ea8dae-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fdc32a23-fc37-42f2-96cc-519b50ea8dae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:53:07.271343 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.271198    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fdc32a23-fc37-42f2-96cc-519b50ea8dae-config-out\") pod \"alertmanager-main-0\" (UID: \"fdc32a23-fc37-42f2-96cc-519b50ea8dae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:53:07.271343 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.271216    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fdc32a23-fc37-42f2-96cc-519b50ea8dae-web-config\") pod \"alertmanager-main-0\" (UID: \"fdc32a23-fc37-42f2-96cc-519b50ea8dae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:53:07.371539 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.371495    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fdc32a23-fc37-42f2-96cc-519b50ea8dae-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fdc32a23-fc37-42f2-96cc-519b50ea8dae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:53:07.371539 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.371543    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fdc32a23-fc37-42f2-96cc-519b50ea8dae-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fdc32a23-fc37-42f2-96cc-519b50ea8dae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:53:07.371712 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.371656    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fdc32a23-fc37-42f2-96cc-519b50ea8dae-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fdc32a23-fc37-42f2-96cc-519b50ea8dae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:53:07.371712 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.371699    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fdc32a23-fc37-42f2-96cc-519b50ea8dae-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fdc32a23-fc37-42f2-96cc-519b50ea8dae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:53:07.371799 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.371721    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdc32a23-fc37-42f2-96cc-519b50ea8dae-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fdc32a23-fc37-42f2-96cc-519b50ea8dae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:53:07.371799 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.371745    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t59t\" (UniqueName: \"kubernetes.io/projected/fdc32a23-fc37-42f2-96cc-519b50ea8dae-kube-api-access-5t59t\") pod \"alertmanager-main-0\" (UID: \"fdc32a23-fc37-42f2-96cc-519b50ea8dae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:53:07.371799 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.371774    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fdc32a23-fc37-42f2-96cc-519b50ea8dae-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fdc32a23-fc37-42f2-96cc-519b50ea8dae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:53:07.371956 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.371804    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fdc32a23-fc37-42f2-96cc-519b50ea8dae-config-out\") pod \"alertmanager-main-0\" (UID: \"fdc32a23-fc37-42f2-96cc-519b50ea8dae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:53:07.371956 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.371837    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fdc32a23-fc37-42f2-96cc-519b50ea8dae-web-config\") pod \"alertmanager-main-0\" (UID: \"fdc32a23-fc37-42f2-96cc-519b50ea8dae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:53:07.371956 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.371861    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fdc32a23-fc37-42f2-96cc-519b50ea8dae-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fdc32a23-fc37-42f2-96cc-519b50ea8dae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:53:07.371956 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.371897    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fdc32a23-fc37-42f2-96cc-519b50ea8dae-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fdc32a23-fc37-42f2-96cc-519b50ea8dae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:53:07.371956 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.371920    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fdc32a23-fc37-42f2-96cc-519b50ea8dae-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fdc32a23-fc37-42f2-96cc-519b50ea8dae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:53:07.372197 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.371957    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fdc32a23-fc37-42f2-96cc-519b50ea8dae-config-volume\") pod \"alertmanager-main-0\" (UID: \"fdc32a23-fc37-42f2-96cc-519b50ea8dae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:53:07.372852 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.372826    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdc32a23-fc37-42f2-96cc-519b50ea8dae-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fdc32a23-fc37-42f2-96cc-519b50ea8dae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:53:07.374694 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.374667    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fdc32a23-fc37-42f2-96cc-519b50ea8dae-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fdc32a23-fc37-42f2-96cc-519b50ea8dae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:53:07.374854 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.374667    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fdc32a23-fc37-42f2-96cc-519b50ea8dae-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fdc32a23-fc37-42f2-96cc-519b50ea8dae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:53:07.374915 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.374852    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fdc32a23-fc37-42f2-96cc-519b50ea8dae-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fdc32a23-fc37-42f2-96cc-519b50ea8dae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:53:07.374996 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.374972    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fdc32a23-fc37-42f2-96cc-519b50ea8dae-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fdc32a23-fc37-42f2-96cc-519b50ea8dae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:53:07.375053 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.374992    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fdc32a23-fc37-42f2-96cc-519b50ea8dae-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fdc32a23-fc37-42f2-96cc-519b50ea8dae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:53:07.375115 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.375092    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fdc32a23-fc37-42f2-96cc-519b50ea8dae-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fdc32a23-fc37-42f2-96cc-519b50ea8dae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:53:07.375115 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.375109    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fdc32a23-fc37-42f2-96cc-519b50ea8dae-web-config\") pod \"alertmanager-main-0\" (UID: \"fdc32a23-fc37-42f2-96cc-519b50ea8dae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:53:07.375242 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.375223    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fdc32a23-fc37-42f2-96cc-519b50ea8dae-config-out\") pod \"alertmanager-main-0\" (UID: \"fdc32a23-fc37-42f2-96cc-519b50ea8dae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:53:07.375414 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.375399    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fdc32a23-fc37-42f2-96cc-519b50ea8dae-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fdc32a23-fc37-42f2-96cc-519b50ea8dae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:53:07.375542 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.375528    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fdc32a23-fc37-42f2-96cc-519b50ea8dae-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fdc32a23-fc37-42f2-96cc-519b50ea8dae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:53:07.376615 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.376599    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fdc32a23-fc37-42f2-96cc-519b50ea8dae-config-volume\") pod \"alertmanager-main-0\" (UID: \"fdc32a23-fc37-42f2-96cc-519b50ea8dae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:53:07.380647 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.380630    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t59t\" (UniqueName: \"kubernetes.io/projected/fdc32a23-fc37-42f2-96cc-519b50ea8dae-kube-api-access-5t59t\") pod \"alertmanager-main-0\" (UID: \"fdc32a23-fc37-42f2-96cc-519b50ea8dae\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:53:07.490286 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.490244    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 06 00:53:07.768824 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:07.768793    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 06 00:53:07.771999 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:53:07.771969    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdc32a23_fc37_42f2_96cc_519b50ea8dae.slice/crio-26f29098f0bc54bfb3d99bf163a609aa33aab11c69ec2c6d67d1a55a86986dd3 WatchSource:0}: Error finding container 26f29098f0bc54bfb3d99bf163a609aa33aab11c69ec2c6d67d1a55a86986dd3: Status 404 returned error can't find the container with id 26f29098f0bc54bfb3d99bf163a609aa33aab11c69ec2c6d67d1a55a86986dd3
Sep 06 00:53:08.108464 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:08.108377    2577 generic.go:356] "Generic (PLEG): container finished" podID="fdc32a23-fc37-42f2-96cc-519b50ea8dae" containerID="bfd6aa4a3ee6ccc3d21513711f52c0a34678b1671793e49b9a3dd11eb8935e00" exitCode=0
Sep 06 00:53:08.108885 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:08.108470    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fdc32a23-fc37-42f2-96cc-519b50ea8dae","Type":"ContainerDied","Data":"bfd6aa4a3ee6ccc3d21513711f52c0a34678b1671793e49b9a3dd11eb8935e00"}
Sep 06 00:53:08.108885 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:08.108560    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fdc32a23-fc37-42f2-96cc-519b50ea8dae","Type":"ContainerStarted","Data":"26f29098f0bc54bfb3d99bf163a609aa33aab11c69ec2c6d67d1a55a86986dd3"}
Sep 06 00:53:08.408788 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:08.408765    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c747cd59-0363-43d9-a1ae-23060db9fab7" path="/var/lib/kubelet/pods/c747cd59-0363-43d9-a1ae-23060db9fab7/volumes"
Sep 06 00:53:09.118104 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:09.118002    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fdc32a23-fc37-42f2-96cc-519b50ea8dae","Type":"ContainerStarted","Data":"193faa7025d7b0208c7ad5113f47334e5059299be9ccd78f20eed691121df9ca"}
Sep 06 00:53:09.118549 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:09.118110    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fdc32a23-fc37-42f2-96cc-519b50ea8dae","Type":"ContainerStarted","Data":"a129f3ecec48915b7a0132f5f1da002ad160892bd219c87858fda12c7081af02"}
Sep 06 00:53:09.118549 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:09.118151    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fdc32a23-fc37-42f2-96cc-519b50ea8dae","Type":"ContainerStarted","Data":"1235d2d41430eed6ba3504b3d326c0be6a834a2cf043e0ce292b2165614d2584"}
Sep 06 00:53:09.118549 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:09.118190    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fdc32a23-fc37-42f2-96cc-519b50ea8dae","Type":"ContainerStarted","Data":"ba95e82cea55e322f19ff41bafa1d6dd0d3c18fb3e7c3f2c1af65f5e1d84282c"}
Sep 06 00:53:09.118549 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:09.118226    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fdc32a23-fc37-42f2-96cc-519b50ea8dae","Type":"ContainerStarted","Data":"75886612735a8a1c21fd2d30284ea370e520038dee9c29e948a2568056a6c28a"}
Sep 06 00:53:09.118549 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:09.118253    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fdc32a23-fc37-42f2-96cc-519b50ea8dae","Type":"ContainerStarted","Data":"be4e975e6f68dbf927f718d8a1e351939cca5d9fe08474e887ac65797067f0f5"}
Sep 06 00:53:09.146086 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:09.146024    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.130807818 podStartE2EDuration="2.146003167s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.195349ms" isStatefulPod=false podCreationTimestamp="2026-09-06 00:53:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:53:09.144049001 +0000 UTC m=+147.180191997" watchObservedRunningTime="2026-09-06 00:53:09.146003167 +0000 UTC m=+147.182146124"
Sep 06 00:53:09.973562 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:09.973524    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 06 00:53:09.973859 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:09.973827    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="cc7520bd-0bc9-459c-8870-60becfde2a5b" containerName="prometheus" containerID="cri-o://94b6d7529ae817ff3d2d26e3d0500919fbde1557de215fb669f8d9eee10b3c11" gracePeriod=600
Sep 06 00:53:09.974011 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:09.973867    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="cc7520bd-0bc9-459c-8870-60becfde2a5b" containerName="kube-rbac-proxy" containerID="cri-o://aae6a8a170d225bad34865b59319c064af8f832d981e6f6650e275f59affe82a" gracePeriod=600
Sep 06 00:53:09.974011 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:09.973895    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="cc7520bd-0bc9-459c-8870-60becfde2a5b" containerName="kube-rbac-proxy-thanos" containerID="cri-o://d1ad633d0c3972b71b1523dbd9e2c5a60271bddda12008eaa787dfd5a8e71df2" gracePeriod=600
Sep 06 00:53:09.974011 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:09.973929    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="cc7520bd-0bc9-459c-8870-60becfde2a5b" containerName="kube-rbac-proxy-web" containerID="cri-o://413e0ef5ad37371cc80b679c2e1fed2fd06671d1fec2ff661345653894cf4050" gracePeriod=600
Sep 06 00:53:09.974011 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:09.973935    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="cc7520bd-0bc9-459c-8870-60becfde2a5b" containerName="config-reloader" containerID="cri-o://1f74babebbb7f9968cae876e3f755e8d1aa4d9846a7c1bbb8927e255b5f85b40" gracePeriod=600
Sep 06 00:53:09.974011 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:09.973906    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="cc7520bd-0bc9-459c-8870-60becfde2a5b" containerName="thanos-sidecar" containerID="cri-o://700442fa098b2aac999662b1e131baf309dcdf053c5189560604036a21930161" gracePeriod=600
Sep 06 00:53:10.126536 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.126505    2577 generic.go:356] "Generic (PLEG): container finished" podID="cc7520bd-0bc9-459c-8870-60becfde2a5b" containerID="d1ad633d0c3972b71b1523dbd9e2c5a60271bddda12008eaa787dfd5a8e71df2" exitCode=0
Sep 06 00:53:10.126536 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.126530    2577 generic.go:356] "Generic (PLEG): container finished" podID="cc7520bd-0bc9-459c-8870-60becfde2a5b" containerID="aae6a8a170d225bad34865b59319c064af8f832d981e6f6650e275f59affe82a" exitCode=0
Sep 06 00:53:10.126536 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.126536    2577 generic.go:356] "Generic (PLEG): container finished" podID="cc7520bd-0bc9-459c-8870-60becfde2a5b" containerID="413e0ef5ad37371cc80b679c2e1fed2fd06671d1fec2ff661345653894cf4050" exitCode=0
Sep 06 00:53:10.126536 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.126542    2577 generic.go:356] "Generic (PLEG): container finished" podID="cc7520bd-0bc9-459c-8870-60becfde2a5b" containerID="700442fa098b2aac999662b1e131baf309dcdf053c5189560604036a21930161" exitCode=0
Sep 06 00:53:10.126984 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.126549    2577 generic.go:356] "Generic (PLEG): container finished" podID="cc7520bd-0bc9-459c-8870-60becfde2a5b" containerID="1f74babebbb7f9968cae876e3f755e8d1aa4d9846a7c1bbb8927e255b5f85b40" exitCode=0
Sep 06 00:53:10.126984 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.126557    2577 generic.go:356] "Generic (PLEG): container finished" podID="cc7520bd-0bc9-459c-8870-60becfde2a5b" containerID="94b6d7529ae817ff3d2d26e3d0500919fbde1557de215fb669f8d9eee10b3c11" exitCode=0
Sep 06 00:53:10.126984 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.126573    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cc7520bd-0bc9-459c-8870-60becfde2a5b","Type":"ContainerDied","Data":"d1ad633d0c3972b71b1523dbd9e2c5a60271bddda12008eaa787dfd5a8e71df2"}
Sep 06 00:53:10.126984 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.126654    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cc7520bd-0bc9-459c-8870-60becfde2a5b","Type":"ContainerDied","Data":"aae6a8a170d225bad34865b59319c064af8f832d981e6f6650e275f59affe82a"}
Sep 06 00:53:10.126984 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.126694    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cc7520bd-0bc9-459c-8870-60becfde2a5b","Type":"ContainerDied","Data":"413e0ef5ad37371cc80b679c2e1fed2fd06671d1fec2ff661345653894cf4050"}
Sep 06 00:53:10.126984 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.126731    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cc7520bd-0bc9-459c-8870-60becfde2a5b","Type":"ContainerDied","Data":"700442fa098b2aac999662b1e131baf309dcdf053c5189560604036a21930161"}
Sep 06 00:53:10.126984 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.126768    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cc7520bd-0bc9-459c-8870-60becfde2a5b","Type":"ContainerDied","Data":"1f74babebbb7f9968cae876e3f755e8d1aa4d9846a7c1bbb8927e255b5f85b40"}
Sep 06 00:53:10.126984 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.126805    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cc7520bd-0bc9-459c-8870-60becfde2a5b","Type":"ContainerDied","Data":"94b6d7529ae817ff3d2d26e3d0500919fbde1557de215fb669f8d9eee10b3c11"}
Sep 06 00:53:10.235009 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.234940    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:10.294297 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.294260    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"cc7520bd-0bc9-459c-8870-60becfde2a5b\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") "
Sep 06 00:53:10.294511 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.294314    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-thanos-prometheus-http-client-file\") pod \"cc7520bd-0bc9-459c-8870-60becfde2a5b\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") "
Sep 06 00:53:10.294511 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.294379    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-secret-metrics-client-certs\") pod \"cc7520bd-0bc9-459c-8870-60becfde2a5b\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") "
Sep 06 00:53:10.294640 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.294511    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cc7520bd-0bc9-459c-8870-60becfde2a5b-prometheus-k8s-rulefiles-0\") pod \"cc7520bd-0bc9-459c-8870-60becfde2a5b\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") "
Sep 06 00:53:10.294640 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.294559    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc7520bd-0bc9-459c-8870-60becfde2a5b-configmap-metrics-client-ca\") pod \"cc7520bd-0bc9-459c-8870-60becfde2a5b\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") "
Sep 06 00:53:10.294640 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.294589    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-web-config\") pod \"cc7520bd-0bc9-459c-8870-60becfde2a5b\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") "
Sep 06 00:53:10.294640 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.294630    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-secret-grpc-tls\") pod \"cc7520bd-0bc9-459c-8870-60becfde2a5b\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") "
Sep 06 00:53:10.294836 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.294653    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-config\") pod \"cc7520bd-0bc9-459c-8870-60becfde2a5b\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") "
Sep 06 00:53:10.294836 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.294677    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cc7520bd-0bc9-459c-8870-60becfde2a5b-prometheus-k8s-rulefiles-1\") pod \"cc7520bd-0bc9-459c-8870-60becfde2a5b\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") "
Sep 06 00:53:10.294836 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.294723    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"cc7520bd-0bc9-459c-8870-60becfde2a5b\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") "
Sep 06 00:53:10.294836 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.294749    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cc7520bd-0bc9-459c-8870-60becfde2a5b-prometheus-k8s-db\") pod \"cc7520bd-0bc9-459c-8870-60becfde2a5b\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") "
Sep 06 00:53:10.294836 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.294779    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cc7520bd-0bc9-459c-8870-60becfde2a5b-tls-assets\") pod \"cc7520bd-0bc9-459c-8870-60becfde2a5b\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") "
Sep 06 00:53:10.294836 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.294819    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc7520bd-0bc9-459c-8870-60becfde2a5b-prometheus-trusted-ca-bundle\") pod \"cc7520bd-0bc9-459c-8870-60becfde2a5b\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") "
Sep 06 00:53:10.295106 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.294853    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cc7520bd-0bc9-459c-8870-60becfde2a5b-prometheus-k8s-rulefiles-2\") pod \"cc7520bd-0bc9-459c-8870-60becfde2a5b\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") "
Sep 06 00:53:10.295106 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.294887    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc7520bd-0bc9-459c-8870-60becfde2a5b-configmap-kubelet-serving-ca-bundle\") pod \"cc7520bd-0bc9-459c-8870-60becfde2a5b\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") "
Sep 06 00:53:10.295106 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.294935    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2swdr\" (UniqueName: \"kubernetes.io/projected/cc7520bd-0bc9-459c-8870-60becfde2a5b-kube-api-access-2swdr\") pod \"cc7520bd-0bc9-459c-8870-60becfde2a5b\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") "
Sep 06 00:53:10.295106 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.294975    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc7520bd-0bc9-459c-8870-60becfde2a5b-configmap-serving-certs-ca-bundle\") pod \"cc7520bd-0bc9-459c-8870-60becfde2a5b\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") "
Sep 06 00:53:10.295106 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.295013    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-secret-prometheus-k8s-tls\") pod \"cc7520bd-0bc9-459c-8870-60becfde2a5b\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") "
Sep 06 00:53:10.295106 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.295037    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cc7520bd-0bc9-459c-8870-60becfde2a5b-config-out\") pod \"cc7520bd-0bc9-459c-8870-60becfde2a5b\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") "
Sep 06 00:53:10.295106 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.295074    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-secret-kube-rbac-proxy\") pod \"cc7520bd-0bc9-459c-8870-60becfde2a5b\" (UID: \"cc7520bd-0bc9-459c-8870-60becfde2a5b\") "
Sep 06 00:53:10.295924 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.295893    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc7520bd-0bc9-459c-8870-60becfde2a5b-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "cc7520bd-0bc9-459c-8870-60becfde2a5b" (UID: "cc7520bd-0bc9-459c-8870-60becfde2a5b"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 00:53:10.297569 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.297336    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc7520bd-0bc9-459c-8870-60becfde2a5b-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "cc7520bd-0bc9-459c-8870-60becfde2a5b" (UID: "cc7520bd-0bc9-459c-8870-60becfde2a5b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 00:53:10.297569 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.297463    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc7520bd-0bc9-459c-8870-60becfde2a5b-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "cc7520bd-0bc9-459c-8870-60becfde2a5b" (UID: "cc7520bd-0bc9-459c-8870-60becfde2a5b"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 00:53:10.298101 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.297835    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc7520bd-0bc9-459c-8870-60becfde2a5b-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "cc7520bd-0bc9-459c-8870-60becfde2a5b" (UID: "cc7520bd-0bc9-459c-8870-60becfde2a5b"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 00:53:10.298210 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.298121    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc7520bd-0bc9-459c-8870-60becfde2a5b-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "cc7520bd-0bc9-459c-8870-60becfde2a5b" (UID: "cc7520bd-0bc9-459c-8870-60becfde2a5b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 00:53:10.298399 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.298214    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "cc7520bd-0bc9-459c-8870-60becfde2a5b" (UID: "cc7520bd-0bc9-459c-8870-60becfde2a5b"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 00:53:10.298624 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.298598    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc7520bd-0bc9-459c-8870-60becfde2a5b-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "cc7520bd-0bc9-459c-8870-60becfde2a5b" (UID: "cc7520bd-0bc9-459c-8870-60becfde2a5b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 00:53:10.299032 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.298775    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc7520bd-0bc9-459c-8870-60becfde2a5b-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "cc7520bd-0bc9-459c-8870-60becfde2a5b" (UID: "cc7520bd-0bc9-459c-8870-60becfde2a5b"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 00:53:10.299385 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.299352    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc7520bd-0bc9-459c-8870-60becfde2a5b-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "cc7520bd-0bc9-459c-8870-60becfde2a5b" (UID: "cc7520bd-0bc9-459c-8870-60becfde2a5b"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 00:53:10.299829 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.299791    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc7520bd-0bc9-459c-8870-60becfde2a5b-kube-api-access-2swdr" (OuterVolumeSpecName: "kube-api-access-2swdr") pod "cc7520bd-0bc9-459c-8870-60becfde2a5b" (UID: "cc7520bd-0bc9-459c-8870-60becfde2a5b"). InnerVolumeSpecName "kube-api-access-2swdr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 00:53:10.300052 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.300019    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "cc7520bd-0bc9-459c-8870-60becfde2a5b" (UID: "cc7520bd-0bc9-459c-8870-60becfde2a5b"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 00:53:10.300186 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.300135    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "cc7520bd-0bc9-459c-8870-60becfde2a5b" (UID: "cc7520bd-0bc9-459c-8870-60becfde2a5b"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 00:53:10.300436 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.300407    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "cc7520bd-0bc9-459c-8870-60becfde2a5b" (UID: "cc7520bd-0bc9-459c-8870-60becfde2a5b"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 00:53:10.301375 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.300740    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-config" (OuterVolumeSpecName: "config") pod "cc7520bd-0bc9-459c-8870-60becfde2a5b" (UID: "cc7520bd-0bc9-459c-8870-60becfde2a5b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 00:53:10.301459 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.301378    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "cc7520bd-0bc9-459c-8870-60becfde2a5b" (UID: "cc7520bd-0bc9-459c-8870-60becfde2a5b"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 00:53:10.301909 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.301883    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc7520bd-0bc9-459c-8870-60becfde2a5b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "cc7520bd-0bc9-459c-8870-60becfde2a5b" (UID: "cc7520bd-0bc9-459c-8870-60becfde2a5b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 00:53:10.302015 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.301932    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "cc7520bd-0bc9-459c-8870-60becfde2a5b" (UID: "cc7520bd-0bc9-459c-8870-60becfde2a5b"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 00:53:10.302178 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.302153    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "cc7520bd-0bc9-459c-8870-60becfde2a5b" (UID: "cc7520bd-0bc9-459c-8870-60becfde2a5b"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 00:53:10.302355 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.302309    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc7520bd-0bc9-459c-8870-60becfde2a5b-config-out" (OuterVolumeSpecName: "config-out") pod "cc7520bd-0bc9-459c-8870-60becfde2a5b" (UID: "cc7520bd-0bc9-459c-8870-60becfde2a5b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 00:53:10.309967 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.309942    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-web-config" (OuterVolumeSpecName: "web-config") pod "cc7520bd-0bc9-459c-8870-60becfde2a5b" (UID: "cc7520bd-0bc9-459c-8870-60becfde2a5b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 00:53:10.396143 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.396107    2577 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc7520bd-0bc9-459c-8870-60becfde2a5b-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:53:10.396143 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.396137    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2swdr\" (UniqueName: \"kubernetes.io/projected/cc7520bd-0bc9-459c-8870-60becfde2a5b-kube-api-access-2swdr\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:53:10.396143 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.396148    2577 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc7520bd-0bc9-459c-8870-60becfde2a5b-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:53:10.396396 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.396157    2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-secret-prometheus-k8s-tls\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:53:10.396396 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.396169    2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cc7520bd-0bc9-459c-8870-60becfde2a5b-config-out\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:53:10.396396 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.396177    2577 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-secret-kube-rbac-proxy\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:53:10.396396 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.396186    2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:53:10.396396 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.396196    2577 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-thanos-prometheus-http-client-file\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:53:10.396396 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.396204    2577 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-secret-metrics-client-certs\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:53:10.396396 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.396213    2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cc7520bd-0bc9-459c-8870-60becfde2a5b-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:53:10.396396 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.396221    2577 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc7520bd-0bc9-459c-8870-60becfde2a5b-configmap-metrics-client-ca\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:53:10.396396 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.396229    2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-web-config\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:53:10.396396 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.396237    2577 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-secret-grpc-tls\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:53:10.396396 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.396244    2577 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-config\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:53:10.396396 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.396251    2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cc7520bd-0bc9-459c-8870-60becfde2a5b-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:53:10.396396 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.396259    2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cc7520bd-0bc9-459c-8870-60becfde2a5b-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:53:10.396396 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.396267    2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cc7520bd-0bc9-459c-8870-60becfde2a5b-prometheus-k8s-db\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:53:10.396396 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.396275    2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cc7520bd-0bc9-459c-8870-60becfde2a5b-tls-assets\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:53:10.396396 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.396283    2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc7520bd-0bc9-459c-8870-60becfde2a5b-prometheus-trusted-ca-bundle\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:53:10.396396 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:10.396291    2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cc7520bd-0bc9-459c-8870-60becfde2a5b-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:53:11.133899 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.133855    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cc7520bd-0bc9-459c-8870-60becfde2a5b","Type":"ContainerDied","Data":"c341ad1e7110ddbd25969f557655c2c5cad6cc23c06046dbf94e62f8499599bd"}
Sep 06 00:53:11.134374 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.133932    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.134374 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.133958    2577 scope.go:117] "RemoveContainer" containerID="d1ad633d0c3972b71b1523dbd9e2c5a60271bddda12008eaa787dfd5a8e71df2"
Sep 06 00:53:11.142013 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.141993    2577 scope.go:117] "RemoveContainer" containerID="aae6a8a170d225bad34865b59319c064af8f832d981e6f6650e275f59affe82a"
Sep 06 00:53:11.149414 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.149398    2577 scope.go:117] "RemoveContainer" containerID="413e0ef5ad37371cc80b679c2e1fed2fd06671d1fec2ff661345653894cf4050"
Sep 06 00:53:11.156107 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.156091    2577 scope.go:117] "RemoveContainer" containerID="700442fa098b2aac999662b1e131baf309dcdf053c5189560604036a21930161"
Sep 06 00:53:11.159833 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.159810    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 06 00:53:11.166486 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.166467    2577 scope.go:117] "RemoveContainer" containerID="1f74babebbb7f9968cae876e3f755e8d1aa4d9846a7c1bbb8927e255b5f85b40"
Sep 06 00:53:11.166711 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.166693    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 06 00:53:11.173417 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.173400    2577 scope.go:117] "RemoveContainer" containerID="94b6d7529ae817ff3d2d26e3d0500919fbde1557de215fb669f8d9eee10b3c11"
Sep 06 00:53:11.180622 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.180602    2577 scope.go:117] "RemoveContainer" containerID="55ac28475f942b5b3285752fb3055a8099fb5bad2864d9eb5568fc9e047468ca"
Sep 06 00:53:11.196532 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.196512    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 06 00:53:11.196793 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.196780    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc7520bd-0bc9-459c-8870-60becfde2a5b" containerName="kube-rbac-proxy-web"
Sep 06 00:53:11.196793 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.196794    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc7520bd-0bc9-459c-8870-60becfde2a5b" containerName="kube-rbac-proxy-web"
Sep 06 00:53:11.196869 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.196802    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc7520bd-0bc9-459c-8870-60becfde2a5b" containerName="thanos-sidecar"
Sep 06 00:53:11.196869 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.196807    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc7520bd-0bc9-459c-8870-60becfde2a5b" containerName="thanos-sidecar"
Sep 06 00:53:11.196869 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.196815    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc7520bd-0bc9-459c-8870-60becfde2a5b" containerName="init-config-reloader"
Sep 06 00:53:11.196869 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.196820    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc7520bd-0bc9-459c-8870-60becfde2a5b" containerName="init-config-reloader"
Sep 06 00:53:11.196869 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.196827    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc7520bd-0bc9-459c-8870-60becfde2a5b" containerName="prometheus"
Sep 06 00:53:11.196869 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.196832    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc7520bd-0bc9-459c-8870-60becfde2a5b" containerName="prometheus"
Sep 06 00:53:11.196869 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.196840    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc7520bd-0bc9-459c-8870-60becfde2a5b" containerName="config-reloader"
Sep 06 00:53:11.196869 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.196845    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc7520bd-0bc9-459c-8870-60becfde2a5b" containerName="config-reloader"
Sep 06 00:53:11.196869 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.196851    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc7520bd-0bc9-459c-8870-60becfde2a5b" containerName="kube-rbac-proxy"
Sep 06 00:53:11.196869 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.196856    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc7520bd-0bc9-459c-8870-60becfde2a5b" containerName="kube-rbac-proxy"
Sep 06 00:53:11.196869 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.196864    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc7520bd-0bc9-459c-8870-60becfde2a5b" containerName="kube-rbac-proxy-thanos"
Sep 06 00:53:11.196869 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.196869    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc7520bd-0bc9-459c-8870-60becfde2a5b" containerName="kube-rbac-proxy-thanos"
Sep 06 00:53:11.197217 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.196911    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc7520bd-0bc9-459c-8870-60becfde2a5b" containerName="kube-rbac-proxy-web"
Sep 06 00:53:11.197217 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.196919    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc7520bd-0bc9-459c-8870-60becfde2a5b" containerName="prometheus"
Sep 06 00:53:11.197217 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.196926    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc7520bd-0bc9-459c-8870-60becfde2a5b" containerName="kube-rbac-proxy-thanos"
Sep 06 00:53:11.197217 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.196931    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc7520bd-0bc9-459c-8870-60becfde2a5b" containerName="thanos-sidecar"
Sep 06 00:53:11.197217 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.196938    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc7520bd-0bc9-459c-8870-60becfde2a5b" containerName="config-reloader"
Sep 06 00:53:11.197217 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.196942    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc7520bd-0bc9-459c-8870-60becfde2a5b" containerName="kube-rbac-proxy"
Sep 06 00:53:11.202097 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.202079    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.205009 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.204991    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 06 00:53:11.205465 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.205420    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 06 00:53:11.205818 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.205803    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 06 00:53:11.206523 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.206481    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-dw828\""
Sep 06 00:53:11.206661 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.206593    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 06 00:53:11.206725 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.206600    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 06 00:53:11.206935 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.206918    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 06 00:53:11.207040 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.206933    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 06 00:53:11.207103 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.207088    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 06 00:53:11.207690 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.207377    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 06 00:53:11.207690 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.207382    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 06 00:53:11.207690 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.207411    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5u49usj1384nr\""
Sep 06 00:53:11.207690 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.207419    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 06 00:53:11.207690 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.207426    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 06 00:53:11.208392 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.208374    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 06 00:53:11.211993 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.211978    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 06 00:53:11.219345 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.219306    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 06 00:53:11.302819 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.302730    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-config-out\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.302819 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.302769    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.302819 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.302784    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.302819 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.302811    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.303077 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.302848    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv995\" (UniqueName: \"kubernetes.io/projected/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-kube-api-access-qv995\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.303077 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.302870    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.303077 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.302887    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.303077 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.302916    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.303077 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.302931    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.303077 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.302945    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.303077 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.302978    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.303077 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.303012    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.303077 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.303027    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-web-config\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.303077 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.303055    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.303077 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.303073    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.303512 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.303099    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.303512 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.303140    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.303512 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.303162    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.303512 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.303183    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.303512 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.303203    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-config\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.404195 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.404147    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.404195 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.404200    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.404392 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.404230    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.404392 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.404248    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.404392 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.404266    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-config\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.404392 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.404297    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-config-out\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.404392 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.404349    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.404392 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.404390    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.404651 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.404418    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.404651 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.404443    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv995\" (UniqueName: \"kubernetes.io/projected/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-kube-api-access-qv995\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.404651 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.404470    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.404651 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.404492    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.404651 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.404532    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.404651 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.404558    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.404651 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.404580    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.404651 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.404603    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.404651 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.404628    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.404651 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.404647    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-web-config\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.405103 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.404670    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.405103 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.404697    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.405103 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.404858    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.405261 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.405119    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.405426 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.405400    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.405668 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.405553    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.407691 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.407398    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.407691 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.407431    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-config\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.407691 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.407648    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.408568 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.408061    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.408568 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.408139    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.409449 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.408849    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.409449 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.409357    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.409449 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.409390    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.409449 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.409416    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.409722 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.409489    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.409796 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.409773    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-config-out\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.410091 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.410069    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.410638 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.410617    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-web-config\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.410756 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.410741    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.411457 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.411437    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.414640 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.414622    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv995\" (UniqueName: \"kubernetes.io/projected/8bbf6f0d-4885-45bd-9522-c6ce6b97028b-kube-api-access-qv995\") pod \"prometheus-k8s-0\" (UID: \"8bbf6f0d-4885-45bd-9522-c6ce6b97028b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.514152 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.514111    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:53:11.804690 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:11.804665    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 06 00:53:11.807048 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:53:11.807021    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bbf6f0d_4885_45bd_9522_c6ce6b97028b.slice/crio-3f5a27165e20fc27bee4f86c59cdc77a69b86fbd56dedbae1c4c8e4582a1c969 WatchSource:0}: Error finding container 3f5a27165e20fc27bee4f86c59cdc77a69b86fbd56dedbae1c4c8e4582a1c969: Status 404 returned error can't find the container with id 3f5a27165e20fc27bee4f86c59cdc77a69b86fbd56dedbae1c4c8e4582a1c969
Sep 06 00:53:12.139984 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:12.139893    2577 generic.go:356] "Generic (PLEG): container finished" podID="8bbf6f0d-4885-45bd-9522-c6ce6b97028b" containerID="4d56d8b6dc0ccdee9af1a3cf3a31e90abed23e9b6c1f3095180e0f6e324deaa7" exitCode=0
Sep 06 00:53:12.139984 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:12.139931    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bbf6f0d-4885-45bd-9522-c6ce6b97028b","Type":"ContainerDied","Data":"4d56d8b6dc0ccdee9af1a3cf3a31e90abed23e9b6c1f3095180e0f6e324deaa7"}
Sep 06 00:53:12.139984 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:12.139979    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bbf6f0d-4885-45bd-9522-c6ce6b97028b","Type":"ContainerStarted","Data":"3f5a27165e20fc27bee4f86c59cdc77a69b86fbd56dedbae1c4c8e4582a1c969"}
Sep 06 00:53:12.414254 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:12.414215    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc7520bd-0bc9-459c-8870-60becfde2a5b" path="/var/lib/kubelet/pods/cc7520bd-0bc9-459c-8870-60becfde2a5b/volumes"
Sep 06 00:53:13.147952 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:13.147914    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bbf6f0d-4885-45bd-9522-c6ce6b97028b","Type":"ContainerStarted","Data":"1711700e74b0535e73e928efcbfcc76bfcd08a78824cdf3e36f7714f224e7358"}
Sep 06 00:53:13.148307 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:13.147977    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bbf6f0d-4885-45bd-9522-c6ce6b97028b","Type":"ContainerStarted","Data":"011ea5571f140a1486e4bc413085c094cad0118ee10de45b922ca320db536598"}
Sep 06 00:53:13.148307 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:13.148002    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bbf6f0d-4885-45bd-9522-c6ce6b97028b","Type":"ContainerStarted","Data":"1eac634ae097517a52ec7a7609e1a5807d4239399818c674e9fbf41e59e85fcf"}
Sep 06 00:53:13.148307 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:13.148030    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bbf6f0d-4885-45bd-9522-c6ce6b97028b","Type":"ContainerStarted","Data":"4c3491171b6cfe5a427fd4391575530203dce65fdee1b5da47d35536f2c2e2bc"}
Sep 06 00:53:13.148307 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:13.148054    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bbf6f0d-4885-45bd-9522-c6ce6b97028b","Type":"ContainerStarted","Data":"0355f5492658363c6f8de5cda4e4e86c5d3d0feb331533457099ee13f046e11e"}
Sep 06 00:53:13.148307 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:13.148076    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bbf6f0d-4885-45bd-9522-c6ce6b97028b","Type":"ContainerStarted","Data":"d2d4da628dcc81584a3c0996959a4e7a30a94e65f04f416cf2f6148c149c8e03"}
Sep 06 00:53:13.183170 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:13.182776    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.164039268 podStartE2EDuration="2.182754769s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.715501ms" isStatefulPod=false podCreationTimestamp="2026-09-06 00:53:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:53:13.180938174 +0000 UTC m=+151.217081170" watchObservedRunningTime="2026-09-06 00:53:13.182754769 +0000 UTC m=+151.218897727"
Sep 06 00:53:16.514550 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:53:16.514499    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:54:11.515083 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:54:11.515041    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:54:11.531086 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:54:11.531051    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:54:12.381414 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:54:12.381380    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 00:55:42.328701 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:55:42.328666    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2z66_e100e633-d18a-4d68-9c81-0ff379c12d2f/ovn-acl-logging/0.log"
Sep 06 00:55:42.330514 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:55:42.330496    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2z66_e100e633-d18a-4d68-9c81-0ff379c12d2f/ovn-acl-logging/0.log"
Sep 06 00:55:42.332011 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:55:42.331986    2577 kubelet.go:1648] "Image garbage collection succeeded"
Sep 06 00:56:19.160390 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:19.160355    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-mmtm6"]
Sep 06 00:56:19.163532 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:19.163508    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mmtm6"
Sep 06 00:56:19.165850 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:19.165830    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-vdp4s\""
Sep 06 00:56:19.166553 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:19.166534    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 06 00:56:19.166630 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:19.166534    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 06 00:56:19.170674 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:19.170652    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-mmtm6"]
Sep 06 00:56:19.230224 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:19.230192    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn6qh\" (UniqueName: \"kubernetes.io/projected/20266e1c-6104-44a5-b840-fe0ec2390d20-kube-api-access-dn6qh\") pod \"cert-manager-cainjector-559cdd8c87-mmtm6\" (UID: \"20266e1c-6104-44a5-b840-fe0ec2390d20\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mmtm6"
Sep 06 00:56:19.230439 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:19.230291    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20266e1c-6104-44a5-b840-fe0ec2390d20-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-mmtm6\" (UID: \"20266e1c-6104-44a5-b840-fe0ec2390d20\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mmtm6"
Sep 06 00:56:19.331272 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:19.331237    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20266e1c-6104-44a5-b840-fe0ec2390d20-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-mmtm6\" (UID: \"20266e1c-6104-44a5-b840-fe0ec2390d20\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mmtm6"
Sep 06 00:56:19.331272 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:19.331279    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn6qh\" (UniqueName: \"kubernetes.io/projected/20266e1c-6104-44a5-b840-fe0ec2390d20-kube-api-access-dn6qh\") pod \"cert-manager-cainjector-559cdd8c87-mmtm6\" (UID: \"20266e1c-6104-44a5-b840-fe0ec2390d20\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mmtm6"
Sep 06 00:56:19.339303 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:19.339272    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20266e1c-6104-44a5-b840-fe0ec2390d20-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-mmtm6\" (UID: \"20266e1c-6104-44a5-b840-fe0ec2390d20\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mmtm6"
Sep 06 00:56:19.339459 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:19.339390    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn6qh\" (UniqueName: \"kubernetes.io/projected/20266e1c-6104-44a5-b840-fe0ec2390d20-kube-api-access-dn6qh\") pod \"cert-manager-cainjector-559cdd8c87-mmtm6\" (UID: \"20266e1c-6104-44a5-b840-fe0ec2390d20\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mmtm6"
Sep 06 00:56:19.483293 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:19.483215    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mmtm6"
Sep 06 00:56:19.754068 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:19.753984    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-mmtm6"]
Sep 06 00:56:19.757425 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:56:19.757399    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod20266e1c_6104_44a5_b840_fe0ec2390d20.slice/crio-4d213cc5107840c65d4a113b17f6f14653144060afc41c90413e7a92cb95b202 WatchSource:0}: Error finding container 4d213cc5107840c65d4a113b17f6f14653144060afc41c90413e7a92cb95b202: Status 404 returned error can't find the container with id 4d213cc5107840c65d4a113b17f6f14653144060afc41c90413e7a92cb95b202
Sep 06 00:56:19.759447 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:19.759430    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 00:56:19.820681 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:19.820650    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mmtm6" event={"ID":"20266e1c-6104-44a5-b840-fe0ec2390d20","Type":"ContainerStarted","Data":"4d213cc5107840c65d4a113b17f6f14653144060afc41c90413e7a92cb95b202"}
Sep 06 00:56:22.835820 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:22.835790    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mmtm6" event={"ID":"20266e1c-6104-44a5-b840-fe0ec2390d20","Type":"ContainerStarted","Data":"4a5da179544bd775c05b9664c55ce87449db323e67eae3582d4cbc8c2ba666ef"}
Sep 06 00:56:22.851803 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:22.851746    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mmtm6" podStartSLOduration=0.880367644 podStartE2EDuration="3.851725241s" totalImagesPullingTime="2.971357597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:56:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:56:22.851211316 +0000 UTC m=+340.887354274" watchObservedRunningTime="2026-09-06 00:56:22.851725241 +0000 UTC m=+340.887868193"
Sep 06 00:56:45.230834 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:45.230747    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-g2fhq"]
Sep 06 00:56:45.234073 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:45.234051    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-g2fhq"
Sep 06 00:56:45.237378 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:45.237354    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 06 00:56:45.237550 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:45.237358    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 06 00:56:45.237550 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:45.237490    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 06 00:56:45.237696 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:45.237679    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 06 00:56:45.238490 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:45.238471    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-fcj4z\""
Sep 06 00:56:45.257421 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:45.257390    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-g2fhq"]
Sep 06 00:56:45.350257 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:45.350227    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f66hn\" (UniqueName: \"kubernetes.io/projected/bed80868-695e-4962-ae19-9497a12168e0-kube-api-access-f66hn\") pod \"opendatahub-operator-controller-manager-79dff7ddb6-g2fhq\" (UID: \"bed80868-695e-4962-ae19-9497a12168e0\") " pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-g2fhq"
Sep 06 00:56:45.350430 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:45.350269    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bed80868-695e-4962-ae19-9497a12168e0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79dff7ddb6-g2fhq\" (UID: \"bed80868-695e-4962-ae19-9497a12168e0\") " pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-g2fhq"
Sep 06 00:56:45.350430 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:45.350289    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bed80868-695e-4962-ae19-9497a12168e0-manifests\") pod \"opendatahub-operator-controller-manager-79dff7ddb6-g2fhq\" (UID: \"bed80868-695e-4962-ae19-9497a12168e0\") " pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-g2fhq"
Sep 06 00:56:45.350430 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:45.350353    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bed80868-695e-4962-ae19-9497a12168e0-tmp\") pod \"opendatahub-operator-controller-manager-79dff7ddb6-g2fhq\" (UID: \"bed80868-695e-4962-ae19-9497a12168e0\") " pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-g2fhq"
Sep 06 00:56:45.350430 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:45.350380    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bed80868-695e-4962-ae19-9497a12168e0-webhook-cert\") pod \"opendatahub-operator-controller-manager-79dff7ddb6-g2fhq\" (UID: \"bed80868-695e-4962-ae19-9497a12168e0\") " pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-g2fhq"
Sep 06 00:56:45.451349 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:45.451269    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f66hn\" (UniqueName: \"kubernetes.io/projected/bed80868-695e-4962-ae19-9497a12168e0-kube-api-access-f66hn\") pod \"opendatahub-operator-controller-manager-79dff7ddb6-g2fhq\" (UID: \"bed80868-695e-4962-ae19-9497a12168e0\") " pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-g2fhq"
Sep 06 00:56:45.451517 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:45.451365    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bed80868-695e-4962-ae19-9497a12168e0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79dff7ddb6-g2fhq\" (UID: \"bed80868-695e-4962-ae19-9497a12168e0\") " pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-g2fhq"
Sep 06 00:56:45.451517 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:45.451418    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bed80868-695e-4962-ae19-9497a12168e0-manifests\") pod \"opendatahub-operator-controller-manager-79dff7ddb6-g2fhq\" (UID: \"bed80868-695e-4962-ae19-9497a12168e0\") " pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-g2fhq"
Sep 06 00:56:45.451586 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:45.451534    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bed80868-695e-4962-ae19-9497a12168e0-tmp\") pod \"opendatahub-operator-controller-manager-79dff7ddb6-g2fhq\" (UID: \"bed80868-695e-4962-ae19-9497a12168e0\") " pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-g2fhq"
Sep 06 00:56:45.451586 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:45.451565    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bed80868-695e-4962-ae19-9497a12168e0-webhook-cert\") pod \"opendatahub-operator-controller-manager-79dff7ddb6-g2fhq\" (UID: \"bed80868-695e-4962-ae19-9497a12168e0\") " pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-g2fhq"
Sep 06 00:56:45.451806 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:45.451788    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bed80868-695e-4962-ae19-9497a12168e0-manifests\") pod \"opendatahub-operator-controller-manager-79dff7ddb6-g2fhq\" (UID: \"bed80868-695e-4962-ae19-9497a12168e0\") " pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-g2fhq"
Sep 06 00:56:45.453932 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:45.453904    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bed80868-695e-4962-ae19-9497a12168e0-tmp\") pod \"opendatahub-operator-controller-manager-79dff7ddb6-g2fhq\" (UID: \"bed80868-695e-4962-ae19-9497a12168e0\") " pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-g2fhq"
Sep 06 00:56:45.454033 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:45.454012    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bed80868-695e-4962-ae19-9497a12168e0-webhook-cert\") pod \"opendatahub-operator-controller-manager-79dff7ddb6-g2fhq\" (UID: \"bed80868-695e-4962-ae19-9497a12168e0\") " pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-g2fhq"
Sep 06 00:56:45.454121 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:45.454105    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bed80868-695e-4962-ae19-9497a12168e0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79dff7ddb6-g2fhq\" (UID: \"bed80868-695e-4962-ae19-9497a12168e0\") " pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-g2fhq"
Sep 06 00:56:45.462706 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:45.462684    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f66hn\" (UniqueName: \"kubernetes.io/projected/bed80868-695e-4962-ae19-9497a12168e0-kube-api-access-f66hn\") pod \"opendatahub-operator-controller-manager-79dff7ddb6-g2fhq\" (UID: \"bed80868-695e-4962-ae19-9497a12168e0\") " pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-g2fhq"
Sep 06 00:56:45.544785 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:45.544697    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-g2fhq"
Sep 06 00:56:45.819144 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:45.819120    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-g2fhq"]
Sep 06 00:56:45.821525 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:56:45.821497    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbed80868_695e_4962_ae19_9497a12168e0.slice/crio-c077ff9243a2cd164fa48b3037019bf18c2336df08a1b0276071488a944ba19d WatchSource:0}: Error finding container c077ff9243a2cd164fa48b3037019bf18c2336df08a1b0276071488a944ba19d: Status 404 returned error can't find the container with id c077ff9243a2cd164fa48b3037019bf18c2336df08a1b0276071488a944ba19d
Sep 06 00:56:45.925385 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:45.925348    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-g2fhq" event={"ID":"bed80868-695e-4962-ae19-9497a12168e0","Type":"ContainerStarted","Data":"c077ff9243a2cd164fa48b3037019bf18c2336df08a1b0276071488a944ba19d"}
Sep 06 00:56:48.940078 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:48.940042    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-g2fhq" event={"ID":"bed80868-695e-4962-ae19-9497a12168e0","Type":"ContainerStarted","Data":"e773981ead8364616da809fe3f19d6df5b8d0f022a6ca9f11c24dc0f3c0eb144"}
Sep 06 00:56:49.945442 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:49.945403    2577 generic.go:356] "Generic (PLEG): container finished" podID="bed80868-695e-4962-ae19-9497a12168e0" containerID="e773981ead8364616da809fe3f19d6df5b8d0f022a6ca9f11c24dc0f3c0eb144" exitCode=0
Sep 06 00:56:49.945792 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:49.945453    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-g2fhq" event={"ID":"bed80868-695e-4962-ae19-9497a12168e0","Type":"ContainerDied","Data":"e773981ead8364616da809fe3f19d6df5b8d0f022a6ca9f11c24dc0f3c0eb144"}
Sep 06 00:56:50.952124 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:50.952090    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-g2fhq" event={"ID":"bed80868-695e-4962-ae19-9497a12168e0","Type":"ContainerStarted","Data":"714058b833aa44d524db25a9ee91f89008820443705c930dc92dbb574a3a1250"}
Sep 06 00:56:50.952601 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:50.952230    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-g2fhq"
Sep 06 00:56:50.979340 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:56:50.979278    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-g2fhq" podStartSLOduration=1.721776843 podStartE2EDuration="5.979262657s" totalImagesPullingTime="3.254107185s" totalInitContainerRuntime="1.003378629s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:56:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:56:50.977842247 +0000 UTC m=+369.013985228" watchObservedRunningTime="2026-09-06 00:56:50.979262657 +0000 UTC m=+369.015405613"
Sep 06 00:57:01.957876 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:01.957842    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-79dff7ddb6-g2fhq"
Sep 06 00:57:10.265238 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:10.265204    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5cb67ffb98-nq844"]
Sep 06 00:57:10.268160 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:10.268136    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5cb67ffb98-nq844"
Sep 06 00:57:10.270337 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:10.270304    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 06 00:57:10.270478 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:10.270365    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 06 00:57:10.271084 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:10.271066    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-hvxhq\""
Sep 06 00:57:10.271084 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:10.271081    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 06 00:57:10.271230 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:10.271151    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 06 00:57:10.278125 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:10.278103    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5cb67ffb98-nq844"]
Sep 06 00:57:10.370583 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:10.370546    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0795e942-befb-4b46-bece-2cf28ea1566e-tls-certs\") pod \"kube-auth-proxy-5cb67ffb98-nq844\" (UID: \"0795e942-befb-4b46-bece-2cf28ea1566e\") " pod="openshift-ingress/kube-auth-proxy-5cb67ffb98-nq844"
Sep 06 00:57:10.370778 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:10.370641    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0795e942-befb-4b46-bece-2cf28ea1566e-tmp\") pod \"kube-auth-proxy-5cb67ffb98-nq844\" (UID: \"0795e942-befb-4b46-bece-2cf28ea1566e\") " pod="openshift-ingress/kube-auth-proxy-5cb67ffb98-nq844"
Sep 06 00:57:10.370778 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:10.370684    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glpw6\" (UniqueName: \"kubernetes.io/projected/0795e942-befb-4b46-bece-2cf28ea1566e-kube-api-access-glpw6\") pod \"kube-auth-proxy-5cb67ffb98-nq844\" (UID: \"0795e942-befb-4b46-bece-2cf28ea1566e\") " pod="openshift-ingress/kube-auth-proxy-5cb67ffb98-nq844"
Sep 06 00:57:10.471864 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:10.471825    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0795e942-befb-4b46-bece-2cf28ea1566e-tmp\") pod \"kube-auth-proxy-5cb67ffb98-nq844\" (UID: \"0795e942-befb-4b46-bece-2cf28ea1566e\") " pod="openshift-ingress/kube-auth-proxy-5cb67ffb98-nq844"
Sep 06 00:57:10.472053 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:10.471876    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glpw6\" (UniqueName: \"kubernetes.io/projected/0795e942-befb-4b46-bece-2cf28ea1566e-kube-api-access-glpw6\") pod \"kube-auth-proxy-5cb67ffb98-nq844\" (UID: \"0795e942-befb-4b46-bece-2cf28ea1566e\") " pod="openshift-ingress/kube-auth-proxy-5cb67ffb98-nq844"
Sep 06 00:57:10.472053 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:10.471899    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0795e942-befb-4b46-bece-2cf28ea1566e-tls-certs\") pod \"kube-auth-proxy-5cb67ffb98-nq844\" (UID: \"0795e942-befb-4b46-bece-2cf28ea1566e\") " pod="openshift-ingress/kube-auth-proxy-5cb67ffb98-nq844"
Sep 06 00:57:10.472053 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:57:10.472032    2577 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 06 00:57:10.472224 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:57:10.472100    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0795e942-befb-4b46-bece-2cf28ea1566e-tls-certs podName:0795e942-befb-4b46-bece-2cf28ea1566e nodeName:}" failed. No retries permitted until 2026-09-06 00:57:10.972082969 +0000 UTC m=+389.008225921 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/0795e942-befb-4b46-bece-2cf28ea1566e-tls-certs") pod "kube-auth-proxy-5cb67ffb98-nq844" (UID: "0795e942-befb-4b46-bece-2cf28ea1566e") : secret "kube-auth-proxy-tls" not found
Sep 06 00:57:10.474244 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:10.474220    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0795e942-befb-4b46-bece-2cf28ea1566e-tmp\") pod \"kube-auth-proxy-5cb67ffb98-nq844\" (UID: \"0795e942-befb-4b46-bece-2cf28ea1566e\") " pod="openshift-ingress/kube-auth-proxy-5cb67ffb98-nq844"
Sep 06 00:57:10.481364 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:10.481341    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glpw6\" (UniqueName: \"kubernetes.io/projected/0795e942-befb-4b46-bece-2cf28ea1566e-kube-api-access-glpw6\") pod \"kube-auth-proxy-5cb67ffb98-nq844\" (UID: \"0795e942-befb-4b46-bece-2cf28ea1566e\") " pod="openshift-ingress/kube-auth-proxy-5cb67ffb98-nq844"
Sep 06 00:57:10.976680 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:10.976636    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0795e942-befb-4b46-bece-2cf28ea1566e-tls-certs\") pod \"kube-auth-proxy-5cb67ffb98-nq844\" (UID: \"0795e942-befb-4b46-bece-2cf28ea1566e\") " pod="openshift-ingress/kube-auth-proxy-5cb67ffb98-nq844"
Sep 06 00:57:10.979093 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:10.979067    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0795e942-befb-4b46-bece-2cf28ea1566e-tls-certs\") pod \"kube-auth-proxy-5cb67ffb98-nq844\" (UID: \"0795e942-befb-4b46-bece-2cf28ea1566e\") " pod="openshift-ingress/kube-auth-proxy-5cb67ffb98-nq844"
Sep 06 00:57:11.179707 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:11.179673    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5cb67ffb98-nq844"
Sep 06 00:57:11.459252 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:11.459205    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5cb67ffb98-nq844"]
Sep 06 00:57:11.461976 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:57:11.461951    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0795e942_befb_4b46_bece_2cf28ea1566e.slice/crio-2d01b015075222ac05009bd07540ccadbe50f9695036b410b108ce88fd812751 WatchSource:0}: Error finding container 2d01b015075222ac05009bd07540ccadbe50f9695036b410b108ce88fd812751: Status 404 returned error can't find the container with id 2d01b015075222ac05009bd07540ccadbe50f9695036b410b108ce88fd812751
Sep 06 00:57:11.536027 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:11.535959    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mbkmp"]
Sep 06 00:57:11.540228 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:11.540214    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mbkmp"
Sep 06 00:57:11.542611 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:11.542590    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 06 00:57:11.542872 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:11.542850    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 06 00:57:11.542978 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:11.542905    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 06 00:57:11.542978 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:11.542927    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 06 00:57:11.543085 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:11.543039    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-bx6vm\""
Sep 06 00:57:11.554347 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:11.554307    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mbkmp"]
Sep 06 00:57:11.581349 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:11.581300    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e0a3846f-efc4-48bf-9841-bc73831bf970-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-mbkmp\" (UID: \"e0a3846f-efc4-48bf-9841-bc73831bf970\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mbkmp"
Sep 06 00:57:11.581482 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:11.581349    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e0a3846f-efc4-48bf-9841-bc73831bf970-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-mbkmp\" (UID: \"e0a3846f-efc4-48bf-9841-bc73831bf970\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mbkmp"
Sep 06 00:57:11.581482 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:11.581431    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0a3846f-efc4-48bf-9841-bc73831bf970-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-mbkmp\" (UID: \"e0a3846f-efc4-48bf-9841-bc73831bf970\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mbkmp"
Sep 06 00:57:11.581482 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:11.581460    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e0a3846f-efc4-48bf-9841-bc73831bf970-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-mbkmp\" (UID: \"e0a3846f-efc4-48bf-9841-bc73831bf970\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mbkmp"
Sep 06 00:57:11.581648 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:11.581507    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e0a3846f-efc4-48bf-9841-bc73831bf970-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-mbkmp\" (UID: \"e0a3846f-efc4-48bf-9841-bc73831bf970\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mbkmp"
Sep 06 00:57:11.581648 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:11.581576    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhhv6\" (UniqueName: \"kubernetes.io/projected/e0a3846f-efc4-48bf-9841-bc73831bf970-kube-api-access-hhhv6\") pod \"istiod-openshift-gateway-7b7995d5cd-mbkmp\" (UID: \"e0a3846f-efc4-48bf-9841-bc73831bf970\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mbkmp"
Sep 06 00:57:11.581648 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:11.581623    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0a3846f-efc4-48bf-9841-bc73831bf970-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-mbkmp\" (UID: \"e0a3846f-efc4-48bf-9841-bc73831bf970\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mbkmp"
Sep 06 00:57:11.682400 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:11.682367    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e0a3846f-efc4-48bf-9841-bc73831bf970-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-mbkmp\" (UID: \"e0a3846f-efc4-48bf-9841-bc73831bf970\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mbkmp"
Sep 06 00:57:11.682400 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:11.682400    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e0a3846f-efc4-48bf-9841-bc73831bf970-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-mbkmp\" (UID: \"e0a3846f-efc4-48bf-9841-bc73831bf970\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mbkmp"
Sep 06 00:57:11.682595 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:11.682435    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0a3846f-efc4-48bf-9841-bc73831bf970-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-mbkmp\" (UID: \"e0a3846f-efc4-48bf-9841-bc73831bf970\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mbkmp"
Sep 06 00:57:11.682595 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:11.682466    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e0a3846f-efc4-48bf-9841-bc73831bf970-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-mbkmp\" (UID: \"e0a3846f-efc4-48bf-9841-bc73831bf970\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mbkmp"
Sep 06 00:57:11.682595 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:11.682493    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e0a3846f-efc4-48bf-9841-bc73831bf970-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-mbkmp\" (UID: \"e0a3846f-efc4-48bf-9841-bc73831bf970\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mbkmp"
Sep 06 00:57:11.682595 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:11.682538    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhhv6\" (UniqueName: \"kubernetes.io/projected/e0a3846f-efc4-48bf-9841-bc73831bf970-kube-api-access-hhhv6\") pod \"istiod-openshift-gateway-7b7995d5cd-mbkmp\" (UID: \"e0a3846f-efc4-48bf-9841-bc73831bf970\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mbkmp"
Sep 06 00:57:11.682784 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:11.682669    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0a3846f-efc4-48bf-9841-bc73831bf970-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-mbkmp\" (UID: \"e0a3846f-efc4-48bf-9841-bc73831bf970\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mbkmp"
Sep 06 00:57:11.683071 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:11.683042    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e0a3846f-efc4-48bf-9841-bc73831bf970-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-mbkmp\" (UID: \"e0a3846f-efc4-48bf-9841-bc73831bf970\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mbkmp"
Sep 06 00:57:11.685021 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:11.684992    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e0a3846f-efc4-48bf-9841-bc73831bf970-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-mbkmp\" (UID: \"e0a3846f-efc4-48bf-9841-bc73831bf970\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mbkmp"
Sep 06 00:57:11.685021 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:11.685005    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e0a3846f-efc4-48bf-9841-bc73831bf970-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-mbkmp\" (UID: \"e0a3846f-efc4-48bf-9841-bc73831bf970\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mbkmp"
Sep 06 00:57:11.685302 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:11.685284    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0a3846f-efc4-48bf-9841-bc73831bf970-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-mbkmp\" (UID: \"e0a3846f-efc4-48bf-9841-bc73831bf970\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mbkmp"
Sep 06 00:57:11.685407 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:11.685312    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e0a3846f-efc4-48bf-9841-bc73831bf970-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-mbkmp\" (UID: \"e0a3846f-efc4-48bf-9841-bc73831bf970\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mbkmp"
Sep 06 00:57:11.690829 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:11.690802    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0a3846f-efc4-48bf-9841-bc73831bf970-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-mbkmp\" (UID: \"e0a3846f-efc4-48bf-9841-bc73831bf970\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mbkmp"
Sep 06 00:57:11.690955 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:11.690937    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhhv6\" (UniqueName: \"kubernetes.io/projected/e0a3846f-efc4-48bf-9841-bc73831bf970-kube-api-access-hhhv6\") pod \"istiod-openshift-gateway-7b7995d5cd-mbkmp\" (UID: \"e0a3846f-efc4-48bf-9841-bc73831bf970\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mbkmp"
Sep 06 00:57:11.850351 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:11.850251    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mbkmp"
Sep 06 00:57:12.033586 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:12.033552    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5cb67ffb98-nq844" event={"ID":"0795e942-befb-4b46-bece-2cf28ea1566e","Type":"ContainerStarted","Data":"2d01b015075222ac05009bd07540ccadbe50f9695036b410b108ce88fd812751"}
Sep 06 00:57:12.128987 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:12.128895    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mbkmp"]
Sep 06 00:57:12.132618 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:57:12.132580    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0a3846f_efc4_48bf_9841_bc73831bf970.slice/crio-be4dc4614758626337839e472cdcfe3f07cc6ef22c1bacd7b0c2df7041cff36a WatchSource:0}: Error finding container be4dc4614758626337839e472cdcfe3f07cc6ef22c1bacd7b0c2df7041cff36a: Status 404 returned error can't find the container with id be4dc4614758626337839e472cdcfe3f07cc6ef22c1bacd7b0c2df7041cff36a
Sep 06 00:57:13.041836 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:13.041789    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mbkmp" event={"ID":"e0a3846f-efc4-48bf-9841-bc73831bf970","Type":"ContainerStarted","Data":"be4dc4614758626337839e472cdcfe3f07cc6ef22c1bacd7b0c2df7041cff36a"}
Sep 06 00:57:15.378272 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:15.378237    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 00:57:15.378637 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:15.378302    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 00:57:16.060473 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:16.059689    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5cb67ffb98-nq844" event={"ID":"0795e942-befb-4b46-bece-2cf28ea1566e","Type":"ContainerStarted","Data":"85528e9a911cf67e152b750e582b797a335227e8786b23a2f719a25aec2868de"}
Sep 06 00:57:16.062483 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:16.062452    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mbkmp" event={"ID":"e0a3846f-efc4-48bf-9841-bc73831bf970","Type":"ContainerStarted","Data":"37f88cec9e03ca2075622e5fb6c58fe5c4d6d60199cd54dfc03332a7e61d7d5f"}
Sep 06 00:57:16.062689 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:16.062669    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mbkmp"
Sep 06 00:57:16.071893 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:16.071523    2577 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-mbkmp container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 06 00:57:16.071893 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:16.071580    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mbkmp" podUID="e0a3846f-efc4-48bf-9841-bc73831bf970" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 06 00:57:16.086044 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:16.085942    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5cb67ffb98-nq844" podStartSLOduration=2.170061386 podStartE2EDuration="6.085920984s" totalImagesPullingTime="3.915859598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:57:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:57:16.084352429 +0000 UTC m=+394.120495384" watchObservedRunningTime="2026-09-06 00:57:16.085920984 +0000 UTC m=+394.122063943"
Sep 06 00:57:17.067745 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:17.067720    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mbkmp"
Sep 06 00:57:17.089446 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:17.089389    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mbkmp" podStartSLOduration=2.846630159 podStartE2EDuration="6.089360253s" totalImagesPullingTime="3.242730094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:57:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:57:16.109163758 +0000 UTC m=+394.145306716" watchObservedRunningTime="2026-09-06 00:57:17.089360253 +0000 UTC m=+395.125503211"
Sep 06 00:57:25.700392 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:25.700363    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-w9sjm"]
Sep 06 00:57:25.708230 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:25.708209    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w9sjm"
Sep 06 00:57:25.710673 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:25.710654    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-fn9kh\""
Sep 06 00:57:25.710776 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:25.710674    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 06 00:57:25.720847 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:25.720823    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-75x5s"]
Sep 06 00:57:25.723587 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:25.723566    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-w9sjm"]
Sep 06 00:57:25.723688 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:25.723645    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-75x5s"
Sep 06 00:57:25.726217 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:25.726197    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-9wlkj\""
Sep 06 00:57:25.729808 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:25.729791    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 06 00:57:25.741693 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:25.741671    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-75x5s"]
Sep 06 00:57:25.806256 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:25.806219    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/111f4bc9-8160-459c-b8c5-c1edbecfda2c-cert\") pod \"kserve-controller-manager-d6f4b65b8-w9sjm\" (UID: \"111f4bc9-8160-459c-b8c5-c1edbecfda2c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w9sjm"
Sep 06 00:57:25.806517 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:25.806302    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj9zf\" (UniqueName: \"kubernetes.io/projected/111f4bc9-8160-459c-b8c5-c1edbecfda2c-kube-api-access-mj9zf\") pod \"kserve-controller-manager-d6f4b65b8-w9sjm\" (UID: \"111f4bc9-8160-459c-b8c5-c1edbecfda2c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w9sjm"
Sep 06 00:57:25.806517 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:25.806356    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc52dd8b-6f2f-4ad2-b172-b8494ede1e61-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-75x5s\" (UID: \"cc52dd8b-6f2f-4ad2-b172-b8494ede1e61\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-75x5s"
Sep 06 00:57:25.806517 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:25.806418    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csrm8\" (UniqueName: \"kubernetes.io/projected/cc52dd8b-6f2f-4ad2-b172-b8494ede1e61-kube-api-access-csrm8\") pod \"llmisvc-controller-manager-777c6bd7d5-75x5s\" (UID: \"cc52dd8b-6f2f-4ad2-b172-b8494ede1e61\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-75x5s"
Sep 06 00:57:25.907603 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:25.907570    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj9zf\" (UniqueName: \"kubernetes.io/projected/111f4bc9-8160-459c-b8c5-c1edbecfda2c-kube-api-access-mj9zf\") pod \"kserve-controller-manager-d6f4b65b8-w9sjm\" (UID: \"111f4bc9-8160-459c-b8c5-c1edbecfda2c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w9sjm"
Sep 06 00:57:25.907603 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:25.907605    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc52dd8b-6f2f-4ad2-b172-b8494ede1e61-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-75x5s\" (UID: \"cc52dd8b-6f2f-4ad2-b172-b8494ede1e61\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-75x5s"
Sep 06 00:57:25.907791 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:57:25.907710    2577 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 06 00:57:25.907791 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:57:25.907756    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc52dd8b-6f2f-4ad2-b172-b8494ede1e61-cert podName:cc52dd8b-6f2f-4ad2-b172-b8494ede1e61 nodeName:}" failed. No retries permitted until 2026-09-06 00:57:26.407741581 +0000 UTC m=+404.443884517 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cc52dd8b-6f2f-4ad2-b172-b8494ede1e61-cert") pod "llmisvc-controller-manager-777c6bd7d5-75x5s" (UID: "cc52dd8b-6f2f-4ad2-b172-b8494ede1e61") : secret "llmisvc-webhook-server-cert" not found
Sep 06 00:57:25.907871 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:25.907792    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csrm8\" (UniqueName: \"kubernetes.io/projected/cc52dd8b-6f2f-4ad2-b172-b8494ede1e61-kube-api-access-csrm8\") pod \"llmisvc-controller-manager-777c6bd7d5-75x5s\" (UID: \"cc52dd8b-6f2f-4ad2-b172-b8494ede1e61\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-75x5s"
Sep 06 00:57:25.907871 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:25.907840    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/111f4bc9-8160-459c-b8c5-c1edbecfda2c-cert\") pod \"kserve-controller-manager-d6f4b65b8-w9sjm\" (UID: \"111f4bc9-8160-459c-b8c5-c1edbecfda2c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w9sjm"
Sep 06 00:57:25.910499 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:25.910479    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/111f4bc9-8160-459c-b8c5-c1edbecfda2c-cert\") pod \"kserve-controller-manager-d6f4b65b8-w9sjm\" (UID: \"111f4bc9-8160-459c-b8c5-c1edbecfda2c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w9sjm"
Sep 06 00:57:25.918964 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:25.918940    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj9zf\" (UniqueName: \"kubernetes.io/projected/111f4bc9-8160-459c-b8c5-c1edbecfda2c-kube-api-access-mj9zf\") pod \"kserve-controller-manager-d6f4b65b8-w9sjm\" (UID: \"111f4bc9-8160-459c-b8c5-c1edbecfda2c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w9sjm"
Sep 06 00:57:25.930083 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:25.930055    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csrm8\" (UniqueName: \"kubernetes.io/projected/cc52dd8b-6f2f-4ad2-b172-b8494ede1e61-kube-api-access-csrm8\") pod \"llmisvc-controller-manager-777c6bd7d5-75x5s\" (UID: \"cc52dd8b-6f2f-4ad2-b172-b8494ede1e61\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-75x5s"
Sep 06 00:57:26.017970 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:26.017889    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w9sjm"
Sep 06 00:57:26.298431 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:26.298374    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-w9sjm"]
Sep 06 00:57:26.300881 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:57:26.300850    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod111f4bc9_8160_459c_b8c5_c1edbecfda2c.slice/crio-c8b17aa0454b1f5b27a0c906439d7ce7f6ad3db0e62bae871c2b1f9dc400ef31 WatchSource:0}: Error finding container c8b17aa0454b1f5b27a0c906439d7ce7f6ad3db0e62bae871c2b1f9dc400ef31: Status 404 returned error can't find the container with id c8b17aa0454b1f5b27a0c906439d7ce7f6ad3db0e62bae871c2b1f9dc400ef31
Sep 06 00:57:26.410808 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:26.410778    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc52dd8b-6f2f-4ad2-b172-b8494ede1e61-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-75x5s\" (UID: \"cc52dd8b-6f2f-4ad2-b172-b8494ede1e61\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-75x5s"
Sep 06 00:57:26.413177 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:26.413160    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc52dd8b-6f2f-4ad2-b172-b8494ede1e61-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-75x5s\" (UID: \"cc52dd8b-6f2f-4ad2-b172-b8494ede1e61\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-75x5s"
Sep 06 00:57:26.632985 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:26.632902    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-75x5s"
Sep 06 00:57:26.915703 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:26.915660    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mbkmp"]
Sep 06 00:57:26.916491 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:26.916043    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mbkmp" podUID="e0a3846f-efc4-48bf-9841-bc73831bf970" containerName="discovery" containerID="cri-o://37f88cec9e03ca2075622e5fb6c58fe5c4d6d60199cd54dfc03332a7e61d7d5f" gracePeriod=30
Sep 06 00:57:26.926539 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:26.921892    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-75x5s"]
Sep 06 00:57:27.115780 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:27.115615    2577 generic.go:356] "Generic (PLEG): container finished" podID="e0a3846f-efc4-48bf-9841-bc73831bf970" containerID="37f88cec9e03ca2075622e5fb6c58fe5c4d6d60199cd54dfc03332a7e61d7d5f" exitCode=0
Sep 06 00:57:27.115780 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:27.115718    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mbkmp" event={"ID":"e0a3846f-efc4-48bf-9841-bc73831bf970","Type":"ContainerDied","Data":"37f88cec9e03ca2075622e5fb6c58fe5c4d6d60199cd54dfc03332a7e61d7d5f"}
Sep 06 00:57:27.117893 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:27.117865    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-75x5s" event={"ID":"cc52dd8b-6f2f-4ad2-b172-b8494ede1e61","Type":"ContainerStarted","Data":"37f5d4f39d34590167e8357dc089925cd2f1b9784c072d4030e59bed0bbebb61"}
Sep 06 00:57:27.119769 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:27.119706    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w9sjm" event={"ID":"111f4bc9-8160-459c-b8c5-c1edbecfda2c","Type":"ContainerStarted","Data":"c8b17aa0454b1f5b27a0c906439d7ce7f6ad3db0e62bae871c2b1f9dc400ef31"}
Sep 06 00:57:27.188786 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:27.188765    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mbkmp"
Sep 06 00:57:27.325118 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:27.325087    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0a3846f-efc4-48bf-9841-bc73831bf970-local-certs\") pod \"e0a3846f-efc4-48bf-9841-bc73831bf970\" (UID: \"e0a3846f-efc4-48bf-9841-bc73831bf970\") "
Sep 06 00:57:27.325118 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:27.325134    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e0a3846f-efc4-48bf-9841-bc73831bf970-istio-kubeconfig\") pod \"e0a3846f-efc4-48bf-9841-bc73831bf970\" (UID: \"e0a3846f-efc4-48bf-9841-bc73831bf970\") "
Sep 06 00:57:27.325421 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:27.325153    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e0a3846f-efc4-48bf-9841-bc73831bf970-istio-csr-dns-cert\") pod \"e0a3846f-efc4-48bf-9841-bc73831bf970\" (UID: \"e0a3846f-efc4-48bf-9841-bc73831bf970\") "
Sep 06 00:57:27.325421 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:27.325173    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e0a3846f-efc4-48bf-9841-bc73831bf970-istio-csr-ca-configmap\") pod \"e0a3846f-efc4-48bf-9841-bc73831bf970\" (UID: \"e0a3846f-efc4-48bf-9841-bc73831bf970\") "
Sep 06 00:57:27.325421 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:27.325199    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhhv6\" (UniqueName: \"kubernetes.io/projected/e0a3846f-efc4-48bf-9841-bc73831bf970-kube-api-access-hhhv6\") pod \"e0a3846f-efc4-48bf-9841-bc73831bf970\" (UID: \"e0a3846f-efc4-48bf-9841-bc73831bf970\") "
Sep 06 00:57:27.325421 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:27.325249    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e0a3846f-efc4-48bf-9841-bc73831bf970-cacerts\") pod \"e0a3846f-efc4-48bf-9841-bc73831bf970\" (UID: \"e0a3846f-efc4-48bf-9841-bc73831bf970\") "
Sep 06 00:57:27.325421 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:27.325349    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0a3846f-efc4-48bf-9841-bc73831bf970-istio-token\") pod \"e0a3846f-efc4-48bf-9841-bc73831bf970\" (UID: \"e0a3846f-efc4-48bf-9841-bc73831bf970\") "
Sep 06 00:57:27.325940 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:27.325891    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0a3846f-efc4-48bf-9841-bc73831bf970-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "e0a3846f-efc4-48bf-9841-bc73831bf970" (UID: "e0a3846f-efc4-48bf-9841-bc73831bf970"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 00:57:27.327834 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:27.327775    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0a3846f-efc4-48bf-9841-bc73831bf970-kube-api-access-hhhv6" (OuterVolumeSpecName: "kube-api-access-hhhv6") pod "e0a3846f-efc4-48bf-9841-bc73831bf970" (UID: "e0a3846f-efc4-48bf-9841-bc73831bf970"). InnerVolumeSpecName "kube-api-access-hhhv6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 00:57:27.327834 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:27.327802    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0a3846f-efc4-48bf-9841-bc73831bf970-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "e0a3846f-efc4-48bf-9841-bc73831bf970" (UID: "e0a3846f-efc4-48bf-9841-bc73831bf970"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 00:57:27.327966 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:27.327934    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0a3846f-efc4-48bf-9841-bc73831bf970-local-certs" (OuterVolumeSpecName: "local-certs") pod "e0a3846f-efc4-48bf-9841-bc73831bf970" (UID: "e0a3846f-efc4-48bf-9841-bc73831bf970"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 00:57:27.328003 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:27.327992    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0a3846f-efc4-48bf-9841-bc73831bf970-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "e0a3846f-efc4-48bf-9841-bc73831bf970" (UID: "e0a3846f-efc4-48bf-9841-bc73831bf970"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 00:57:27.328095 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:27.328079    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0a3846f-efc4-48bf-9841-bc73831bf970-cacerts" (OuterVolumeSpecName: "cacerts") pod "e0a3846f-efc4-48bf-9841-bc73831bf970" (UID: "e0a3846f-efc4-48bf-9841-bc73831bf970"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 00:57:27.328166 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:27.328154    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0a3846f-efc4-48bf-9841-bc73831bf970-istio-token" (OuterVolumeSpecName: "istio-token") pod "e0a3846f-efc4-48bf-9841-bc73831bf970" (UID: "e0a3846f-efc4-48bf-9841-bc73831bf970"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 00:57:27.426808 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:27.426724    2577 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e0a3846f-efc4-48bf-9841-bc73831bf970-istio-kubeconfig\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:57:27.426808 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:27.426760    2577 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e0a3846f-efc4-48bf-9841-bc73831bf970-istio-csr-dns-cert\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:57:27.426808 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:27.426771    2577 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e0a3846f-efc4-48bf-9841-bc73831bf970-istio-csr-ca-configmap\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:57:27.426808 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:27.426782    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhhv6\" (UniqueName: \"kubernetes.io/projected/e0a3846f-efc4-48bf-9841-bc73831bf970-kube-api-access-hhhv6\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:57:27.426808 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:27.426797    2577 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e0a3846f-efc4-48bf-9841-bc73831bf970-cacerts\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:57:27.426808 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:27.426812    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0a3846f-efc4-48bf-9841-bc73831bf970-istio-token\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:57:27.427108 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:27.426824    2577 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0a3846f-efc4-48bf-9841-bc73831bf970-local-certs\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:57:28.126687 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:28.126658    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mbkmp"
Sep 06 00:57:28.127123 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:28.126657    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mbkmp" event={"ID":"e0a3846f-efc4-48bf-9841-bc73831bf970","Type":"ContainerDied","Data":"be4dc4614758626337839e472cdcfe3f07cc6ef22c1bacd7b0c2df7041cff36a"}
Sep 06 00:57:28.127123 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:28.126829    2577 scope.go:117] "RemoveContainer" containerID="37f88cec9e03ca2075622e5fb6c58fe5c4d6d60199cd54dfc03332a7e61d7d5f"
Sep 06 00:57:28.164765 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:28.164732    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mbkmp"]
Sep 06 00:57:28.180167 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:28.180091    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mbkmp"]
Sep 06 00:57:28.408762 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:28.408731    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0a3846f-efc4-48bf-9841-bc73831bf970" path="/var/lib/kubelet/pods/e0a3846f-efc4-48bf-9841-bc73831bf970/volumes"
Sep 06 00:57:29.133868 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:29.133790    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w9sjm" event={"ID":"111f4bc9-8160-459c-b8c5-c1edbecfda2c","Type":"ContainerStarted","Data":"ae66fa4fb1b6957f2d9e5bf9a70b9bfc54273a740ef35d1aa4381fa2f55e1337"}
Sep 06 00:57:29.134228 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:29.133920    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w9sjm"
Sep 06 00:57:29.154292 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:29.154240    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w9sjm" podStartSLOduration=1.8539385149999998 podStartE2EDuration="4.154224747s" totalImagesPullingTime="2.300286232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:57:29.153963214 +0000 UTC m=+407.190106171" watchObservedRunningTime="2026-09-06 00:57:29.154224747 +0000 UTC m=+407.190367704"
Sep 06 00:57:31.144695 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:31.144659    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-75x5s" event={"ID":"cc52dd8b-6f2f-4ad2-b172-b8494ede1e61","Type":"ContainerStarted","Data":"e6a7351477f8ee3a8b9de6a02db40311607d9a1378ee4e4810566b2e55b15b0d"}
Sep 06 00:57:31.145105 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:31.144801    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-75x5s"
Sep 06 00:57:31.162986 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:57:31.162938    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-75x5s" podStartSLOduration=2.9985945750000003 podStartE2EDuration="6.162923306s" totalImagesPullingTime="3.164328731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:57:31.161157757 +0000 UTC m=+409.197300705" watchObservedRunningTime="2026-09-06 00:57:31.162923306 +0000 UTC m=+409.199066263"
Sep 06 00:58:00.144300 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:00.144270    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w9sjm"
Sep 06 00:58:02.151633 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:02.151605    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-75x5s"
Sep 06 00:58:32.720015 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:32.719967    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-ktbqp"]
Sep 06 00:58:32.721237 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:32.721204    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0a3846f-efc4-48bf-9841-bc73831bf970" containerName="discovery"
Sep 06 00:58:32.721237 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:32.721232    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0a3846f-efc4-48bf-9841-bc73831bf970" containerName="discovery"
Sep 06 00:58:32.721473 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:32.721346    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0a3846f-efc4-48bf-9841-bc73831bf970" containerName="discovery"
Sep 06 00:58:32.725192 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:32.725172    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-ktbqp"
Sep 06 00:58:32.730571 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:32.729819    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 06 00:58:32.730571 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:32.730074    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-7xp2c\""
Sep 06 00:58:32.730571 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:32.730234    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 06 00:58:32.730571 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:32.730423    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 06 00:58:32.741724 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:32.741704    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-ktbqp"]
Sep 06 00:58:32.780735 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:32.780697    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkpkw\" (UniqueName: \"kubernetes.io/projected/a8e69bfe-bb43-4293-899b-72fcf6fa1cea-kube-api-access-tkpkw\") pod \"dns-operator-controller-manager-5985564776-ktbqp\" (UID: \"a8e69bfe-bb43-4293-899b-72fcf6fa1cea\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-ktbqp"
Sep 06 00:58:32.882150 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:32.882118    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkpkw\" (UniqueName: \"kubernetes.io/projected/a8e69bfe-bb43-4293-899b-72fcf6fa1cea-kube-api-access-tkpkw\") pod \"dns-operator-controller-manager-5985564776-ktbqp\" (UID: \"a8e69bfe-bb43-4293-899b-72fcf6fa1cea\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-ktbqp"
Sep 06 00:58:32.891438 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:32.891404    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkpkw\" (UniqueName: \"kubernetes.io/projected/a8e69bfe-bb43-4293-899b-72fcf6fa1cea-kube-api-access-tkpkw\") pod \"dns-operator-controller-manager-5985564776-ktbqp\" (UID: \"a8e69bfe-bb43-4293-899b-72fcf6fa1cea\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-ktbqp"
Sep 06 00:58:33.044008 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:33.043925    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-ktbqp"
Sep 06 00:58:33.321256 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:33.321230    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-ktbqp"]
Sep 06 00:58:33.323974 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:58:33.323940    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8e69bfe_bb43_4293_899b_72fcf6fa1cea.slice/crio-5b0508973d4947c5f0b6eb6c47b193524fccf03db68524a0f616614fc9c06e4d WatchSource:0}: Error finding container 5b0508973d4947c5f0b6eb6c47b193524fccf03db68524a0f616614fc9c06e4d: Status 404 returned error can't find the container with id 5b0508973d4947c5f0b6eb6c47b193524fccf03db68524a0f616614fc9c06e4d
Sep 06 00:58:33.409871 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:33.409736    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-ktbqp" event={"ID":"a8e69bfe-bb43-4293-899b-72fcf6fa1cea","Type":"ContainerStarted","Data":"5b0508973d4947c5f0b6eb6c47b193524fccf03db68524a0f616614fc9c06e4d"}
Sep 06 00:58:34.825991 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:34.825945    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-6c8hq"]
Sep 06 00:58:34.829615 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:34.829578    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-6c8hq"
Sep 06 00:58:34.832219 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:34.832198    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-f7vc4\""
Sep 06 00:58:34.842760 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:34.842702    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-6c8hq"]
Sep 06 00:58:34.896741 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:34.896704    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxvcl\" (UniqueName: \"kubernetes.io/projected/2c0fbc7c-c2c8-4858-96af-811ad08706d6-kube-api-access-nxvcl\") pod \"limitador-operator-controller-manager-6c549b6d85-6c8hq\" (UID: \"2c0fbc7c-c2c8-4858-96af-811ad08706d6\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-6c8hq"
Sep 06 00:58:34.997709 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:34.997670    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxvcl\" (UniqueName: \"kubernetes.io/projected/2c0fbc7c-c2c8-4858-96af-811ad08706d6-kube-api-access-nxvcl\") pod \"limitador-operator-controller-manager-6c549b6d85-6c8hq\" (UID: \"2c0fbc7c-c2c8-4858-96af-811ad08706d6\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-6c8hq"
Sep 06 00:58:35.012971 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:35.012914    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxvcl\" (UniqueName: \"kubernetes.io/projected/2c0fbc7c-c2c8-4858-96af-811ad08706d6-kube-api-access-nxvcl\") pod \"limitador-operator-controller-manager-6c549b6d85-6c8hq\" (UID: \"2c0fbc7c-c2c8-4858-96af-811ad08706d6\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-6c8hq"
Sep 06 00:58:35.144261 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:35.144183    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-6c8hq"
Sep 06 00:58:35.430358 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:35.430308    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-6c8hq"]
Sep 06 00:58:36.512256 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:58:36.512223    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c0fbc7c_c2c8_4858_96af_811ad08706d6.slice/crio-64e053aa443ad84af9df173debe4f34185c980501861b5137d59e00e3cdd84ef WatchSource:0}: Error finding container 64e053aa443ad84af9df173debe4f34185c980501861b5137d59e00e3cdd84ef: Status 404 returned error can't find the container with id 64e053aa443ad84af9df173debe4f34185c980501861b5137d59e00e3cdd84ef
Sep 06 00:58:37.431611 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:37.431577    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-6c8hq" event={"ID":"2c0fbc7c-c2c8-4858-96af-811ad08706d6","Type":"ContainerStarted","Data":"64e053aa443ad84af9df173debe4f34185c980501861b5137d59e00e3cdd84ef"}
Sep 06 00:58:37.433138 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:37.433103    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-ktbqp" event={"ID":"a8e69bfe-bb43-4293-899b-72fcf6fa1cea","Type":"ContainerStarted","Data":"169c6dfe90c069feea1af04191975d72630c0b3f6807cbea35da4626daa52a7c"}
Sep 06 00:58:37.433264 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:37.433233    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-ktbqp"
Sep 06 00:58:37.452466 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:37.452424    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-5985564776-ktbqp" podStartSLOduration=2.1940201249999998 podStartE2EDuration="5.452410525s" totalImagesPullingTime="3.2583904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:58:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:58:37.452346453 +0000 UTC m=+475.488489409" watchObservedRunningTime="2026-09-06 00:58:37.452410525 +0000 UTC m=+475.488553482"
Sep 06 00:58:38.439345 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:38.439296    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-6c8hq" event={"ID":"2c0fbc7c-c2c8-4858-96af-811ad08706d6","Type":"ContainerStarted","Data":"112fbfe5d4f193e885963807e22069e0ec0606f0c20e0c6a74c7ec826d60f1bb"}
Sep 06 00:58:38.439740 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:38.439457    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-6c8hq"
Sep 06 00:58:38.458141 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:38.458099    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-6c8hq" podStartSLOduration=2.7160977920000002 podStartE2EDuration="4.458084315s" totalImagesPullingTime="1.741986523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:58:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:58:38.456666565 +0000 UTC m=+476.492809522" watchObservedRunningTime="2026-09-06 00:58:38.458084315 +0000 UTC m=+476.494227276"
Sep 06 00:58:39.511551 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:39.511515    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94jwq"]
Sep 06 00:58:39.514815 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:39.514800    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94jwq"
Sep 06 00:58:39.518073 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:39.518049    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wk55k\""
Sep 06 00:58:39.530917 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:39.530894    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94jwq"]
Sep 06 00:58:39.536643 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:39.536615    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/615da01e-3e91-47b6-a7dc-9154ef65a1c9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-94jwq\" (UID: \"615da01e-3e91-47b6-a7dc-9154ef65a1c9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94jwq"
Sep 06 00:58:39.536734 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:39.536670    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d85kl\" (UniqueName: \"kubernetes.io/projected/615da01e-3e91-47b6-a7dc-9154ef65a1c9-kube-api-access-d85kl\") pod \"kuadrant-operator-controller-manager-58fc56757c-94jwq\" (UID: \"615da01e-3e91-47b6-a7dc-9154ef65a1c9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94jwq"
Sep 06 00:58:39.637295 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:39.637258    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/615da01e-3e91-47b6-a7dc-9154ef65a1c9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-94jwq\" (UID: \"615da01e-3e91-47b6-a7dc-9154ef65a1c9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94jwq"
Sep 06 00:58:39.637489 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:39.637310    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d85kl\" (UniqueName: \"kubernetes.io/projected/615da01e-3e91-47b6-a7dc-9154ef65a1c9-kube-api-access-d85kl\") pod \"kuadrant-operator-controller-manager-58fc56757c-94jwq\" (UID: \"615da01e-3e91-47b6-a7dc-9154ef65a1c9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94jwq"
Sep 06 00:58:39.637664 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:39.637644    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/615da01e-3e91-47b6-a7dc-9154ef65a1c9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-94jwq\" (UID: \"615da01e-3e91-47b6-a7dc-9154ef65a1c9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94jwq"
Sep 06 00:58:39.662931 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:39.662899    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d85kl\" (UniqueName: \"kubernetes.io/projected/615da01e-3e91-47b6-a7dc-9154ef65a1c9-kube-api-access-d85kl\") pod \"kuadrant-operator-controller-manager-58fc56757c-94jwq\" (UID: \"615da01e-3e91-47b6-a7dc-9154ef65a1c9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94jwq"
Sep 06 00:58:39.824541 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:39.824458    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94jwq"
Sep 06 00:58:40.109145 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:40.109117    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94jwq"]
Sep 06 00:58:40.111561 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:58:40.111524    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod615da01e_3e91_47b6_a7dc_9154ef65a1c9.slice/crio-322f6ee7095d6b159a057ac798641b8a9c467e8639ec8549b8594caa152aacf8 WatchSource:0}: Error finding container 322f6ee7095d6b159a057ac798641b8a9c467e8639ec8549b8594caa152aacf8: Status 404 returned error can't find the container with id 322f6ee7095d6b159a057ac798641b8a9c467e8639ec8549b8594caa152aacf8
Sep 06 00:58:40.450663 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:40.450625    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94jwq" event={"ID":"615da01e-3e91-47b6-a7dc-9154ef65a1c9","Type":"ContainerStarted","Data":"322f6ee7095d6b159a057ac798641b8a9c467e8639ec8549b8594caa152aacf8"}
Sep 06 00:58:42.182214 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:42.182178    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-7prsb"]
Sep 06 00:58:42.186790 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:42.186073    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-7prsb"
Sep 06 00:58:42.191286 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:42.190894    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-pj7rf\""
Sep 06 00:58:42.198705 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:42.198681    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-7prsb"]
Sep 06 00:58:42.260425 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:42.260389    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbh7l\" (UniqueName: \"kubernetes.io/projected/a5ee4e84-8409-4762-aa12-f9a241bd75c0-kube-api-access-hbh7l\") pod \"authorino-operator-68d88948d8-7prsb\" (UID: \"a5ee4e84-8409-4762-aa12-f9a241bd75c0\") " pod="kuadrant-system/authorino-operator-68d88948d8-7prsb"
Sep 06 00:58:42.361583 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:42.361544    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbh7l\" (UniqueName: \"kubernetes.io/projected/a5ee4e84-8409-4762-aa12-f9a241bd75c0-kube-api-access-hbh7l\") pod \"authorino-operator-68d88948d8-7prsb\" (UID: \"a5ee4e84-8409-4762-aa12-f9a241bd75c0\") " pod="kuadrant-system/authorino-operator-68d88948d8-7prsb"
Sep 06 00:58:42.371161 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:42.371134    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbh7l\" (UniqueName: \"kubernetes.io/projected/a5ee4e84-8409-4762-aa12-f9a241bd75c0-kube-api-access-hbh7l\") pod \"authorino-operator-68d88948d8-7prsb\" (UID: \"a5ee4e84-8409-4762-aa12-f9a241bd75c0\") " pod="kuadrant-system/authorino-operator-68d88948d8-7prsb"
Sep 06 00:58:42.502901 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:42.502824    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-pj7rf\""
Sep 06 00:58:42.510625 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:42.510585    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-7prsb"
Sep 06 00:58:42.796942 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:42.796921    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-7prsb"]
Sep 06 00:58:42.799540 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:58:42.799505    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5ee4e84_8409_4762_aa12_f9a241bd75c0.slice/crio-6dca1fba03c04ba907ad6f5080519bd9962bf26729f1c462ab50a5eb22fb031c WatchSource:0}: Error finding container 6dca1fba03c04ba907ad6f5080519bd9962bf26729f1c462ab50a5eb22fb031c: Status 404 returned error can't find the container with id 6dca1fba03c04ba907ad6f5080519bd9962bf26729f1c462ab50a5eb22fb031c
Sep 06 00:58:43.467970 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:43.467936    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-7prsb" event={"ID":"a5ee4e84-8409-4762-aa12-f9a241bd75c0","Type":"ContainerStarted","Data":"6dca1fba03c04ba907ad6f5080519bd9962bf26729f1c462ab50a5eb22fb031c"}
Sep 06 00:58:44.475289 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:44.475251    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94jwq" event={"ID":"615da01e-3e91-47b6-a7dc-9154ef65a1c9","Type":"ContainerStarted","Data":"efbab1b168c8bc01cce3714632b4b301a6d12a93e56785c2497c44cb9319ccda"}
Sep 06 00:58:44.475688 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:44.475339    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94jwq"
Sep 06 00:58:45.481633 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:45.481581    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-7prsb" event={"ID":"a5ee4e84-8409-4762-aa12-f9a241bd75c0","Type":"ContainerStarted","Data":"af71b2f36bd743ed42bf9c11072bd82bb1f178d4075e52ffc16387a234459ea3"}
Sep 06 00:58:45.482235 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:45.481752    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d88948d8-7prsb"
Sep 06 00:58:45.500116 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:45.500065    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94jwq" podStartSLOduration=2.478229638 podStartE2EDuration="6.5000467s" totalImagesPullingTime="4.021817062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:58:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:58:44.500516333 +0000 UTC m=+482.536659288" watchObservedRunningTime="2026-09-06 00:58:45.5000467 +0000 UTC m=+483.536189666"
Sep 06 00:58:45.500286 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:45.500266    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d88948d8-7prsb" podStartSLOduration=1.281909677 podStartE2EDuration="3.500260484s" totalImagesPullingTime="2.218350807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:58:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:58:45.499730584 +0000 UTC m=+483.535873546" watchObservedRunningTime="2026-09-06 00:58:45.500260484 +0000 UTC m=+483.536403440"
Sep 06 00:58:46.820605 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:46.820569    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-pcpxx"]
Sep 06 00:58:46.823897 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:46.823880    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-pcpxx"
Sep 06 00:58:46.827024 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:46.826998    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tc65j\""
Sep 06 00:58:46.827135 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:46.827047    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 06 00:58:46.828874 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:46.828857    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 06 00:58:46.839611 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:46.839589    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-pcpxx"]
Sep 06 00:58:46.901343 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:46.901288    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7krgv\" (UniqueName: \"kubernetes.io/projected/1c71d770-85cc-4826-bb1c-959ff63842a1-kube-api-access-7krgv\") pod \"kuadrant-console-plugin-598f86468b-pcpxx\" (UID: \"1c71d770-85cc-4826-bb1c-959ff63842a1\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-pcpxx"
Sep 06 00:58:46.901510 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:46.901356    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c71d770-85cc-4826-bb1c-959ff63842a1-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-pcpxx\" (UID: \"1c71d770-85cc-4826-bb1c-959ff63842a1\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-pcpxx"
Sep 06 00:58:46.901510 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:46.901378    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1c71d770-85cc-4826-bb1c-959ff63842a1-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-pcpxx\" (UID: \"1c71d770-85cc-4826-bb1c-959ff63842a1\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-pcpxx"
Sep 06 00:58:47.002386 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:47.002350    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7krgv\" (UniqueName: \"kubernetes.io/projected/1c71d770-85cc-4826-bb1c-959ff63842a1-kube-api-access-7krgv\") pod \"kuadrant-console-plugin-598f86468b-pcpxx\" (UID: \"1c71d770-85cc-4826-bb1c-959ff63842a1\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-pcpxx"
Sep 06 00:58:47.002525 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:47.002398    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c71d770-85cc-4826-bb1c-959ff63842a1-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-pcpxx\" (UID: \"1c71d770-85cc-4826-bb1c-959ff63842a1\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-pcpxx"
Sep 06 00:58:47.002525 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:58:47.002488    2577 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Sep 06 00:58:47.002612 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:58:47.002542    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c71d770-85cc-4826-bb1c-959ff63842a1-plugin-serving-cert podName:1c71d770-85cc-4826-bb1c-959ff63842a1 nodeName:}" failed. No retries permitted until 2026-09-06 00:58:47.502521927 +0000 UTC m=+485.538664874 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/1c71d770-85cc-4826-bb1c-959ff63842a1-plugin-serving-cert") pod "kuadrant-console-plugin-598f86468b-pcpxx" (UID: "1c71d770-85cc-4826-bb1c-959ff63842a1") : secret "plugin-serving-cert" not found
Sep 06 00:58:47.002612 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:47.002565    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1c71d770-85cc-4826-bb1c-959ff63842a1-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-pcpxx\" (UID: \"1c71d770-85cc-4826-bb1c-959ff63842a1\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-pcpxx"
Sep 06 00:58:47.003174 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:47.003156    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1c71d770-85cc-4826-bb1c-959ff63842a1-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-pcpxx\" (UID: \"1c71d770-85cc-4826-bb1c-959ff63842a1\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-pcpxx"
Sep 06 00:58:47.012027 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:47.012005    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7krgv\" (UniqueName: \"kubernetes.io/projected/1c71d770-85cc-4826-bb1c-959ff63842a1-kube-api-access-7krgv\") pod \"kuadrant-console-plugin-598f86468b-pcpxx\" (UID: \"1c71d770-85cc-4826-bb1c-959ff63842a1\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-pcpxx"
Sep 06 00:58:47.506706 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:47.506668    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c71d770-85cc-4826-bb1c-959ff63842a1-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-pcpxx\" (UID: \"1c71d770-85cc-4826-bb1c-959ff63842a1\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-pcpxx"
Sep 06 00:58:47.509202 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:47.509177    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c71d770-85cc-4826-bb1c-959ff63842a1-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-pcpxx\" (UID: \"1c71d770-85cc-4826-bb1c-959ff63842a1\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-pcpxx"
Sep 06 00:58:47.732780 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:47.732747    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-pcpxx"
Sep 06 00:58:48.002580 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:48.002553    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-pcpxx"]
Sep 06 00:58:48.004256 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:58:48.004218    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1c71d770_85cc_4826_bb1c_959ff63842a1.slice/crio-16979a743f1e8b994b420205d699d54a605e05c412aeb9214ea5721c3464a38c WatchSource:0}: Error finding container 16979a743f1e8b994b420205d699d54a605e05c412aeb9214ea5721c3464a38c: Status 404 returned error can't find the container with id 16979a743f1e8b994b420205d699d54a605e05c412aeb9214ea5721c3464a38c
Sep 06 00:58:48.441882 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:48.441849    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-ktbqp"
Sep 06 00:58:48.497095 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:48.497062    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-pcpxx" event={"ID":"1c71d770-85cc-4826-bb1c-959ff63842a1","Type":"ContainerStarted","Data":"16979a743f1e8b994b420205d699d54a605e05c412aeb9214ea5721c3464a38c"}
Sep 06 00:58:49.448057 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:49.448026    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-6c8hq"
Sep 06 00:58:53.523457 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:53.523423    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-pcpxx" event={"ID":"1c71d770-85cc-4826-bb1c-959ff63842a1","Type":"ContainerStarted","Data":"d07ce654008afeca55f2fe9302d562945302229eadbb45436000e189142cca18"}
Sep 06 00:58:53.538961 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:53.538915    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-pcpxx" podStartSLOduration=3.003628958 podStartE2EDuration="7.538898798s" totalImagesPullingTime="4.53526984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:58:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:58:53.538235813 +0000 UTC m=+491.574378781" watchObservedRunningTime="2026-09-06 00:58:53.538898798 +0000 UTC m=+491.575041755"
Sep 06 00:58:55.484455 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:55.484417    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94jwq"
Sep 06 00:58:56.488066 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:56.488031    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d88948d8-7prsb"
Sep 06 00:58:56.632521 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:56.632494    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-947k8"]
Sep 06 00:58:56.637000 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:56.636980    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-947k8"
Sep 06 00:58:56.661450 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:56.661423    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-947k8"]
Sep 06 00:58:56.686276 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:56.686245    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9xcs\" (UniqueName: \"kubernetes.io/projected/79be535d-529d-4c29-aecc-1acc5f2c3524-kube-api-access-r9xcs\") pod \"kuadrant-operator-controller-manager-96db98c47-947k8\" (UID: \"79be535d-529d-4c29-aecc-1acc5f2c3524\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-947k8"
Sep 06 00:58:56.686412 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:56.686296    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79be535d-529d-4c29-aecc-1acc5f2c3524-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-947k8\" (UID: \"79be535d-529d-4c29-aecc-1acc5f2c3524\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-947k8"
Sep 06 00:58:56.787645 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:56.787550    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79be535d-529d-4c29-aecc-1acc5f2c3524-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-947k8\" (UID: \"79be535d-529d-4c29-aecc-1acc5f2c3524\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-947k8"
Sep 06 00:58:56.787813 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:56.787660    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9xcs\" (UniqueName: \"kubernetes.io/projected/79be535d-529d-4c29-aecc-1acc5f2c3524-kube-api-access-r9xcs\") pod \"kuadrant-operator-controller-manager-96db98c47-947k8\" (UID: \"79be535d-529d-4c29-aecc-1acc5f2c3524\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-947k8"
Sep 06 00:58:56.787942 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:56.787920    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79be535d-529d-4c29-aecc-1acc5f2c3524-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-947k8\" (UID: \"79be535d-529d-4c29-aecc-1acc5f2c3524\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-947k8"
Sep 06 00:58:56.815147 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:56.815115    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9xcs\" (UniqueName: \"kubernetes.io/projected/79be535d-529d-4c29-aecc-1acc5f2c3524-kube-api-access-r9xcs\") pod \"kuadrant-operator-controller-manager-96db98c47-947k8\" (UID: \"79be535d-529d-4c29-aecc-1acc5f2c3524\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-947k8"
Sep 06 00:58:56.883563 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:56.883532    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-947k8"]
Sep 06 00:58:56.883820 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:56.883808    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-947k8"
Sep 06 00:58:56.952718 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:56.952680    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dmnxg"]
Sep 06 00:58:56.958131 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:56.958106    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dmnxg"
Sep 06 00:58:56.976006 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:56.975982    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dmnxg"]
Sep 06 00:58:57.090504 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.090417    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vp7p\" (UniqueName: \"kubernetes.io/projected/68571273-da38-49b6-a7a9-51fb81c4fb83-kube-api-access-4vp7p\") pod \"kuadrant-operator-controller-manager-6bd956ccf-dmnxg\" (UID: \"68571273-da38-49b6-a7a9-51fb81c4fb83\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dmnxg"
Sep 06 00:58:57.090504 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.090466    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/68571273-da38-49b6-a7a9-51fb81c4fb83-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-dmnxg\" (UID: \"68571273-da38-49b6-a7a9-51fb81c4fb83\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dmnxg"
Sep 06 00:58:57.167656 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.167530    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-947k8"]
Sep 06 00:58:57.170243 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:58:57.170218    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79be535d_529d_4c29_aecc_1acc5f2c3524.slice/crio-fb414b0514003243184bcc8e1aaba90c29720279312caa505b7fb3b4cdb40a2e WatchSource:0}: Error finding container fb414b0514003243184bcc8e1aaba90c29720279312caa505b7fb3b4cdb40a2e: Status 404 returned error can't find the container with id fb414b0514003243184bcc8e1aaba90c29720279312caa505b7fb3b4cdb40a2e
Sep 06 00:58:57.191190 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.191166    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/68571273-da38-49b6-a7a9-51fb81c4fb83-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-dmnxg\" (UID: \"68571273-da38-49b6-a7a9-51fb81c4fb83\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dmnxg"
Sep 06 00:58:57.191293 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.191223    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vp7p\" (UniqueName: \"kubernetes.io/projected/68571273-da38-49b6-a7a9-51fb81c4fb83-kube-api-access-4vp7p\") pod \"kuadrant-operator-controller-manager-6bd956ccf-dmnxg\" (UID: \"68571273-da38-49b6-a7a9-51fb81c4fb83\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dmnxg"
Sep 06 00:58:57.191528 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.191510    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/68571273-da38-49b6-a7a9-51fb81c4fb83-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-dmnxg\" (UID: \"68571273-da38-49b6-a7a9-51fb81c4fb83\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dmnxg"
Sep 06 00:58:57.206206 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.206184    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vp7p\" (UniqueName: \"kubernetes.io/projected/68571273-da38-49b6-a7a9-51fb81c4fb83-kube-api-access-4vp7p\") pod \"kuadrant-operator-controller-manager-6bd956ccf-dmnxg\" (UID: \"68571273-da38-49b6-a7a9-51fb81c4fb83\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dmnxg"
Sep 06 00:58:57.269174 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.269150    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dmnxg"
Sep 06 00:58:57.543294 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.543264    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-947k8" event={"ID":"79be535d-529d-4c29-aecc-1acc5f2c3524","Type":"ContainerStarted","Data":"da0fa2b9f1a54adf1b38a5bdea92dd720640999293f87adb311979ec63d41c2e"}
Sep 06 00:58:57.543701 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.543313    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-947k8" event={"ID":"79be535d-529d-4c29-aecc-1acc5f2c3524","Type":"ContainerStarted","Data":"fb414b0514003243184bcc8e1aaba90c29720279312caa505b7fb3b4cdb40a2e"}
Sep 06 00:58:57.543701 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.543368    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-947k8"
Sep 06 00:58:57.543701 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.543375    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-947k8" podUID="79be535d-529d-4c29-aecc-1acc5f2c3524" containerName="manager" containerID="cri-o://da0fa2b9f1a54adf1b38a5bdea92dd720640999293f87adb311979ec63d41c2e" gracePeriod=10
Sep 06 00:58:57.554823 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.553469    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dmnxg"]
Sep 06 00:58:57.556868 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:58:57.556843    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68571273_da38_49b6_a7a9_51fb81c4fb83.slice/crio-14d26d21b8da533f61909b585d2bd4b5266b94170550b7ee47edce090875bdfd WatchSource:0}: Error finding container 14d26d21b8da533f61909b585d2bd4b5266b94170550b7ee47edce090875bdfd: Status 404 returned error can't find the container with id 14d26d21b8da533f61909b585d2bd4b5266b94170550b7ee47edce090875bdfd
Sep 06 00:58:57.567012 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.566967    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-947k8" podStartSLOduration=1.5669482860000001 podStartE2EDuration="1.566948286s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:58:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:58:57.565967933 +0000 UTC m=+495.602110924" watchObservedRunningTime="2026-09-06 00:58:57.566948286 +0000 UTC m=+495.603091243"
Sep 06 00:58:57.709847 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.709811    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94jwq"]
Sep 06 00:58:57.710151 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.710089    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94jwq" podUID="615da01e-3e91-47b6-a7dc-9154ef65a1c9" containerName="manager" containerID="cri-o://efbab1b168c8bc01cce3714632b4b301a6d12a93e56785c2497c44cb9319ccda" gracePeriod=2
Sep 06 00:58:57.712128 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:58:57.712093    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-94jwq\" is forbidden: User \"system:node:ip-10-0-140-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-57.ec2.internal' and this object" podUID="615da01e-3e91-47b6-a7dc-9154ef65a1c9" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94jwq"
Sep 06 00:58:57.712247 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.712225    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94jwq"]
Sep 06 00:58:57.724165 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.724140    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dmnxg"]
Sep 06 00:58:57.730978 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.730959    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dmnxg"]
Sep 06 00:58:57.745990 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.745876    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfdld"]
Sep 06 00:58:57.746505 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.746486    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="615da01e-3e91-47b6-a7dc-9154ef65a1c9" containerName="manager"
Sep 06 00:58:57.746505 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.746506    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="615da01e-3e91-47b6-a7dc-9154ef65a1c9" containerName="manager"
Sep 06 00:58:57.746626 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.746520    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68571273-da38-49b6-a7a9-51fb81c4fb83" containerName="manager"
Sep 06 00:58:57.746626 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.746529    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="68571273-da38-49b6-a7a9-51fb81c4fb83" containerName="manager"
Sep 06 00:58:57.746626 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.746605    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="615da01e-3e91-47b6-a7dc-9154ef65a1c9" containerName="manager"
Sep 06 00:58:57.746626 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.746622    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="68571273-da38-49b6-a7a9-51fb81c4fb83" containerName="manager"
Sep 06 00:58:57.749771 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.749753    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-947k8"]
Sep 06 00:58:57.749847 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.749837    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfdld"
Sep 06 00:58:57.769435 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.768382    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-fhx5x"]
Sep 06 00:58:57.773953 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.773932    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-947k8"]
Sep 06 00:58:57.773953 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.773963    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfdld"]
Sep 06 00:58:57.774099 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.774048    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-fhx5x"
Sep 06 00:58:57.779629 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.779606    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-6c8hq"]
Sep 06 00:58:57.779805 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.779770    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-6c8hq" podUID="2c0fbc7c-c2c8-4858-96af-811ad08706d6" containerName="manager" containerID="cri-o://112fbfe5d4f193e885963807e22069e0ec0606f0c20e0c6a74c7ec826d60f1bb" gracePeriod=2
Sep 06 00:58:57.793122 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.792834    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-fhx5x"]
Sep 06 00:58:57.794772 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.794717    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-6c8hq"]
Sep 06 00:58:57.797126 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.797103    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tshdx\" (UniqueName: \"kubernetes.io/projected/728a09ce-dce9-40d0-a5d8-1d50526fbe74-kube-api-access-tshdx\") pod \"kuadrant-operator-controller-manager-58fc56757c-vfdld\" (UID: \"728a09ce-dce9-40d0-a5d8-1d50526fbe74\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfdld"
Sep 06 00:58:57.797231 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.797186    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/728a09ce-dce9-40d0-a5d8-1d50526fbe74-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-vfdld\" (UID: \"728a09ce-dce9-40d0-a5d8-1d50526fbe74\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfdld"
Sep 06 00:58:57.798347 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:58:57.798309    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-94jwq\" is forbidden: User \"system:node:ip-10-0-140-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-57.ec2.internal' and this object" podUID="615da01e-3e91-47b6-a7dc-9154ef65a1c9" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94jwq"
Sep 06 00:58:57.801195 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:58:57.801170    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-6c8hq\" is forbidden: User \"system:node:ip-10-0-140-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-57.ec2.internal' and this object" podUID="2c0fbc7c-c2c8-4858-96af-811ad08706d6" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-6c8hq"
Sep 06 00:58:57.802996 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:58:57.802964    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-94jwq\" is forbidden: User \"system:node:ip-10-0-140-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-57.ec2.internal' and this object" podUID="615da01e-3e91-47b6-a7dc-9154ef65a1c9" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94jwq"
Sep 06 00:58:57.816111 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.816087    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5wph6"]
Sep 06 00:58:57.816507 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.816490    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c0fbc7c-c2c8-4858-96af-811ad08706d6" containerName="manager"
Sep 06 00:58:57.816507 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.816508    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c0fbc7c-c2c8-4858-96af-811ad08706d6" containerName="manager"
Sep 06 00:58:57.816653 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.816516    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79be535d-529d-4c29-aecc-1acc5f2c3524" containerName="manager"
Sep 06 00:58:57.816653 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.816521    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="79be535d-529d-4c29-aecc-1acc5f2c3524" containerName="manager"
Sep 06 00:58:57.816653 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.816573    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="79be535d-529d-4c29-aecc-1acc5f2c3524" containerName="manager"
Sep 06 00:58:57.816653 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.816584    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c0fbc7c-c2c8-4858-96af-811ad08706d6" containerName="manager"
Sep 06 00:58:57.819577 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.819558    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5wph6"
Sep 06 00:58:57.835860 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:58:57.835828    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-6c8hq\" is forbidden: User \"system:node:ip-10-0-140-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-57.ec2.internal' and this object" podUID="2c0fbc7c-c2c8-4858-96af-811ad08706d6" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-6c8hq"
Sep 06 00:58:57.839551 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:58:57.839491    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-94jwq\" is forbidden: User \"system:node:ip-10-0-140-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-57.ec2.internal' and this object" podUID="615da01e-3e91-47b6-a7dc-9154ef65a1c9" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94jwq"
Sep 06 00:58:57.842193 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.842168    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5wph6"]
Sep 06 00:58:57.898540 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.898517    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqzt4\" (UniqueName: \"kubernetes.io/projected/91b7bfee-2147-41dd-967a-3758ab796e8b-kube-api-access-lqzt4\") pod \"limitador-operator-controller-manager-6c549b6d85-5wph6\" (UID: \"91b7bfee-2147-41dd-967a-3758ab796e8b\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5wph6"
Sep 06 00:58:57.898626 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.898556    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tshdx\" (UniqueName: \"kubernetes.io/projected/728a09ce-dce9-40d0-a5d8-1d50526fbe74-kube-api-access-tshdx\") pod \"kuadrant-operator-controller-manager-58fc56757c-vfdld\" (UID: \"728a09ce-dce9-40d0-a5d8-1d50526fbe74\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfdld"
Sep 06 00:58:57.898626 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.898596    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b6b4fe4-f936-401a-a082-3bd565f170f7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-fhx5x\" (UID: \"3b6b4fe4-f936-401a-a082-3bd565f170f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-fhx5x"
Sep 06 00:58:57.898720 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.898629    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmp2v\" (UniqueName: \"kubernetes.io/projected/3b6b4fe4-f936-401a-a082-3bd565f170f7-kube-api-access-rmp2v\") pod \"kuadrant-operator-controller-manager-6bd956ccf-fhx5x\" (UID: \"3b6b4fe4-f936-401a-a082-3bd565f170f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-fhx5x"
Sep 06 00:58:57.898720 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.898679    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/728a09ce-dce9-40d0-a5d8-1d50526fbe74-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-vfdld\" (UID: \"728a09ce-dce9-40d0-a5d8-1d50526fbe74\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfdld"
Sep 06 00:58:57.899139 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.899113    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/728a09ce-dce9-40d0-a5d8-1d50526fbe74-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-vfdld\" (UID: \"728a09ce-dce9-40d0-a5d8-1d50526fbe74\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfdld"
Sep 06 00:58:57.907595 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.907573    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tshdx\" (UniqueName: \"kubernetes.io/projected/728a09ce-dce9-40d0-a5d8-1d50526fbe74-kube-api-access-tshdx\") pod \"kuadrant-operator-controller-manager-58fc56757c-vfdld\" (UID: \"728a09ce-dce9-40d0-a5d8-1d50526fbe74\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfdld"
Sep 06 00:58:58.000640 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.999848    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b6b4fe4-f936-401a-a082-3bd565f170f7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-fhx5x\" (UID: \"3b6b4fe4-f936-401a-a082-3bd565f170f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-fhx5x"
Sep 06 00:58:58.000640 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.999890    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmp2v\" (UniqueName: \"kubernetes.io/projected/3b6b4fe4-f936-401a-a082-3bd565f170f7-kube-api-access-rmp2v\") pod \"kuadrant-operator-controller-manager-6bd956ccf-fhx5x\" (UID: \"3b6b4fe4-f936-401a-a082-3bd565f170f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-fhx5x"
Sep 06 00:58:58.000640 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:57.999949    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqzt4\" (UniqueName: \"kubernetes.io/projected/91b7bfee-2147-41dd-967a-3758ab796e8b-kube-api-access-lqzt4\") pod \"limitador-operator-controller-manager-6c549b6d85-5wph6\" (UID: \"91b7bfee-2147-41dd-967a-3758ab796e8b\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5wph6"
Sep 06 00:58:58.000640 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.000548    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b6b4fe4-f936-401a-a082-3bd565f170f7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-fhx5x\" (UID: \"3b6b4fe4-f936-401a-a082-3bd565f170f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-fhx5x"
Sep 06 00:58:58.016853 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.016830    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqzt4\" (UniqueName: \"kubernetes.io/projected/91b7bfee-2147-41dd-967a-3758ab796e8b-kube-api-access-lqzt4\") pod \"limitador-operator-controller-manager-6c549b6d85-5wph6\" (UID: \"91b7bfee-2147-41dd-967a-3758ab796e8b\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5wph6"
Sep 06 00:58:58.019715 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.019693    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmp2v\" (UniqueName: \"kubernetes.io/projected/3b6b4fe4-f936-401a-a082-3bd565f170f7-kube-api-access-rmp2v\") pod \"kuadrant-operator-controller-manager-6bd956ccf-fhx5x\" (UID: \"3b6b4fe4-f936-401a-a082-3bd565f170f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-fhx5x"
Sep 06 00:58:58.025064 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.025042    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94jwq"
Sep 06 00:58:58.030192 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:58:58.030115    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-94jwq\" is forbidden: User \"system:node:ip-10-0-140-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-57.ec2.internal' and this object" podUID="615da01e-3e91-47b6-a7dc-9154ef65a1c9" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94jwq"
Sep 06 00:58:58.030872 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.030631    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-6c8hq"
Sep 06 00:58:58.033910 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:58:58.033881    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-6c8hq\" is forbidden: User \"system:node:ip-10-0-140-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-57.ec2.internal' and this object" podUID="2c0fbc7c-c2c8-4858-96af-811ad08706d6" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-6c8hq"
Sep 06 00:58:58.035837 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:58:58.035812    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-6c8hq\" is forbidden: User \"system:node:ip-10-0-140-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-57.ec2.internal' and this object" podUID="2c0fbc7c-c2c8-4858-96af-811ad08706d6" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-6c8hq"
Sep 06 00:58:58.037950 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:58:58.037928    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-94jwq\" is forbidden: User \"system:node:ip-10-0-140-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-57.ec2.internal' and this object" podUID="615da01e-3e91-47b6-a7dc-9154ef65a1c9" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94jwq"
Sep 06 00:58:58.094308 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.094287    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-947k8"
Sep 06 00:58:58.096592 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:58:58.096570    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-947k8\" is forbidden: User \"system:node:ip-10-0-140-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-57.ec2.internal' and this object" podUID="79be535d-529d-4c29-aecc-1acc5f2c3524" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-947k8"
Sep 06 00:58:58.098191 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:58:58.098169    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-6c8hq\" is forbidden: User \"system:node:ip-10-0-140-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-57.ec2.internal' and this object" podUID="2c0fbc7c-c2c8-4858-96af-811ad08706d6" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-6c8hq"
Sep 06 00:58:58.099934 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:58:58.099916    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-94jwq\" is forbidden: User \"system:node:ip-10-0-140-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-57.ec2.internal' and this object" podUID="615da01e-3e91-47b6-a7dc-9154ef65a1c9" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94jwq"
Sep 06 00:58:58.101236 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.101216    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/615da01e-3e91-47b6-a7dc-9154ef65a1c9-extensions-socket-volume\") pod \"615da01e-3e91-47b6-a7dc-9154ef65a1c9\" (UID: \"615da01e-3e91-47b6-a7dc-9154ef65a1c9\") "
Sep 06 00:58:58.101294 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.101277    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nxvcl\" (UniqueName: \"kubernetes.io/projected/2c0fbc7c-c2c8-4858-96af-811ad08706d6-kube-api-access-nxvcl\") pod \"2c0fbc7c-c2c8-4858-96af-811ad08706d6\" (UID: \"2c0fbc7c-c2c8-4858-96af-811ad08706d6\") "
Sep 06 00:58:58.101354 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.101307    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d85kl\" (UniqueName: \"kubernetes.io/projected/615da01e-3e91-47b6-a7dc-9154ef65a1c9-kube-api-access-d85kl\") pod \"615da01e-3e91-47b6-a7dc-9154ef65a1c9\" (UID: \"615da01e-3e91-47b6-a7dc-9154ef65a1c9\") "
Sep 06 00:58:58.101744 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.101722    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/615da01e-3e91-47b6-a7dc-9154ef65a1c9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "615da01e-3e91-47b6-a7dc-9154ef65a1c9" (UID: "615da01e-3e91-47b6-a7dc-9154ef65a1c9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 00:58:58.103499 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.103479    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c0fbc7c-c2c8-4858-96af-811ad08706d6-kube-api-access-nxvcl" (OuterVolumeSpecName: "kube-api-access-nxvcl") pod "2c0fbc7c-c2c8-4858-96af-811ad08706d6" (UID: "2c0fbc7c-c2c8-4858-96af-811ad08706d6"). InnerVolumeSpecName "kube-api-access-nxvcl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 00:58:58.103499 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.103489    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/615da01e-3e91-47b6-a7dc-9154ef65a1c9-kube-api-access-d85kl" (OuterVolumeSpecName: "kube-api-access-d85kl") pod "615da01e-3e91-47b6-a7dc-9154ef65a1c9" (UID: "615da01e-3e91-47b6-a7dc-9154ef65a1c9"). InnerVolumeSpecName "kube-api-access-d85kl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 00:58:58.157292 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.157253    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfdld"
Sep 06 00:58:58.163245 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.163222    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-fhx5x"
Sep 06 00:58:58.169212 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.169190    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5wph6"
Sep 06 00:58:58.203235 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.202528    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79be535d-529d-4c29-aecc-1acc5f2c3524-extensions-socket-volume\") pod \"79be535d-529d-4c29-aecc-1acc5f2c3524\" (UID: \"79be535d-529d-4c29-aecc-1acc5f2c3524\") "
Sep 06 00:58:58.203235 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.202610    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9xcs\" (UniqueName: \"kubernetes.io/projected/79be535d-529d-4c29-aecc-1acc5f2c3524-kube-api-access-r9xcs\") pod \"79be535d-529d-4c29-aecc-1acc5f2c3524\" (UID: \"79be535d-529d-4c29-aecc-1acc5f2c3524\") "
Sep 06 00:58:58.203235 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.203008    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79be535d-529d-4c29-aecc-1acc5f2c3524-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "79be535d-529d-4c29-aecc-1acc5f2c3524" (UID: "79be535d-529d-4c29-aecc-1acc5f2c3524"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 00:58:58.203235 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.203144    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nxvcl\" (UniqueName: \"kubernetes.io/projected/2c0fbc7c-c2c8-4858-96af-811ad08706d6-kube-api-access-nxvcl\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:58:58.203235 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.203164    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d85kl\" (UniqueName: \"kubernetes.io/projected/615da01e-3e91-47b6-a7dc-9154ef65a1c9-kube-api-access-d85kl\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:58:58.203235 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.203180    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79be535d-529d-4c29-aecc-1acc5f2c3524-extensions-socket-volume\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:58:58.203235 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.203194    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/615da01e-3e91-47b6-a7dc-9154ef65a1c9-extensions-socket-volume\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:58:58.206449 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.205488    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79be535d-529d-4c29-aecc-1acc5f2c3524-kube-api-access-r9xcs" (OuterVolumeSpecName: "kube-api-access-r9xcs") pod "79be535d-529d-4c29-aecc-1acc5f2c3524" (UID: "79be535d-529d-4c29-aecc-1acc5f2c3524"). InnerVolumeSpecName "kube-api-access-r9xcs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 00:58:58.304080 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.304045    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9xcs\" (UniqueName: \"kubernetes.io/projected/79be535d-529d-4c29-aecc-1acc5f2c3524-kube-api-access-r9xcs\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:58:58.408867 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.408838    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c0fbc7c-c2c8-4858-96af-811ad08706d6" path="/var/lib/kubelet/pods/2c0fbc7c-c2c8-4858-96af-811ad08706d6/volumes"
Sep 06 00:58:58.409189 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.409177    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="615da01e-3e91-47b6-a7dc-9154ef65a1c9" path="/var/lib/kubelet/pods/615da01e-3e91-47b6-a7dc-9154ef65a1c9/volumes"
Sep 06 00:58:58.409523 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.409511    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79be535d-529d-4c29-aecc-1acc5f2c3524" path="/var/lib/kubelet/pods/79be535d-529d-4c29-aecc-1acc5f2c3524/volumes"
Sep 06 00:58:58.451343 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.451299    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-fhx5x"]
Sep 06 00:58:58.453180 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:58:58.453158    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b6b4fe4_f936_401a_a082_3bd565f170f7.slice/crio-840afe685949e54c282cdff6ae82def9da97a1bd52cf8cd5e253bd0da60b026c WatchSource:0}: Error finding container 840afe685949e54c282cdff6ae82def9da97a1bd52cf8cd5e253bd0da60b026c: Status 404 returned error can't find the container with id 840afe685949e54c282cdff6ae82def9da97a1bd52cf8cd5e253bd0da60b026c
Sep 06 00:58:58.467543 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.467522    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfdld"]
Sep 06 00:58:58.470165 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:58:58.470142    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod728a09ce_dce9_40d0_a5d8_1d50526fbe74.slice/crio-429b2158688b000be7eb6cf7f10742d91e3ad50e97a546ec622ab9075cb894cd WatchSource:0}: Error finding container 429b2158688b000be7eb6cf7f10742d91e3ad50e97a546ec622ab9075cb894cd: Status 404 returned error can't find the container with id 429b2158688b000be7eb6cf7f10742d91e3ad50e97a546ec622ab9075cb894cd
Sep 06 00:58:58.483291 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.483267    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5wph6"]
Sep 06 00:58:58.486896 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:58:58.486872    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91b7bfee_2147_41dd_967a_3758ab796e8b.slice/crio-a6322106f25e99e14f11b792be4f68959eb5ed7192e691305fa3bde63156b0c2 WatchSource:0}: Error finding container a6322106f25e99e14f11b792be4f68959eb5ed7192e691305fa3bde63156b0c2: Status 404 returned error can't find the container with id a6322106f25e99e14f11b792be4f68959eb5ed7192e691305fa3bde63156b0c2
Sep 06 00:58:58.549781 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.549752    2577 generic.go:356] "Generic (PLEG): container finished" podID="615da01e-3e91-47b6-a7dc-9154ef65a1c9" containerID="efbab1b168c8bc01cce3714632b4b301a6d12a93e56785c2497c44cb9319ccda" exitCode=0
Sep 06 00:58:58.550185 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.549800    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-94jwq"
Sep 06 00:58:58.550185 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.549851    2577 scope.go:117] "RemoveContainer" containerID="efbab1b168c8bc01cce3714632b4b301a6d12a93e56785c2497c44cb9319ccda"
Sep 06 00:58:58.551428 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.551407    2577 generic.go:356] "Generic (PLEG): container finished" podID="79be535d-529d-4c29-aecc-1acc5f2c3524" containerID="da0fa2b9f1a54adf1b38a5bdea92dd720640999293f87adb311979ec63d41c2e" exitCode=0
Sep 06 00:58:58.551532 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.551480    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-947k8"
Sep 06 00:58:58.553474 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.553433    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5wph6" event={"ID":"91b7bfee-2147-41dd-967a-3758ab796e8b","Type":"ContainerStarted","Data":"517630033eb1baac12c68881535761a0895f0c6fefd4da4e3920c3615125c328"}
Sep 06 00:58:58.553562 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.553515    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5wph6" event={"ID":"91b7bfee-2147-41dd-967a-3758ab796e8b","Type":"ContainerStarted","Data":"a6322106f25e99e14f11b792be4f68959eb5ed7192e691305fa3bde63156b0c2"}
Sep 06 00:58:58.553811 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.553794    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5wph6"
Sep 06 00:58:58.555820 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.555795    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-fhx5x" event={"ID":"3b6b4fe4-f936-401a-a082-3bd565f170f7","Type":"ContainerStarted","Data":"be0bb218d142a087e56324df37cc6b9f293113e07b06c61cb068d576c57c610e"}
Sep 06 00:58:58.555915 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.555841    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-fhx5x" event={"ID":"3b6b4fe4-f936-401a-a082-3bd565f170f7","Type":"ContainerStarted","Data":"840afe685949e54c282cdff6ae82def9da97a1bd52cf8cd5e253bd0da60b026c"}
Sep 06 00:58:58.555915 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.555866    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-fhx5x"
Sep 06 00:58:58.560299 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.560281    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfdld" event={"ID":"728a09ce-dce9-40d0-a5d8-1d50526fbe74","Type":"ContainerStarted","Data":"0a7805d04f403b5d29eb7f5e704d1619046e3e215f3ec5148d34081ac3a2123d"}
Sep 06 00:58:58.560411 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.560331    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfdld" event={"ID":"728a09ce-dce9-40d0-a5d8-1d50526fbe74","Type":"ContainerStarted","Data":"429b2158688b000be7eb6cf7f10742d91e3ad50e97a546ec622ab9075cb894cd"}
Sep 06 00:58:58.560411 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.560363    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfdld"
Sep 06 00:58:58.561279 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.561266    2577 scope.go:117] "RemoveContainer" containerID="efbab1b168c8bc01cce3714632b4b301a6d12a93e56785c2497c44cb9319ccda"
Sep 06 00:58:58.561552 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:58:58.561531    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efbab1b168c8bc01cce3714632b4b301a6d12a93e56785c2497c44cb9319ccda\": container with ID starting with efbab1b168c8bc01cce3714632b4b301a6d12a93e56785c2497c44cb9319ccda not found: ID does not exist" containerID="efbab1b168c8bc01cce3714632b4b301a6d12a93e56785c2497c44cb9319ccda"
Sep 06 00:58:58.561612 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.561563    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efbab1b168c8bc01cce3714632b4b301a6d12a93e56785c2497c44cb9319ccda"} err="failed to get container status \"efbab1b168c8bc01cce3714632b4b301a6d12a93e56785c2497c44cb9319ccda\": rpc error: code = NotFound desc = could not find container \"efbab1b168c8bc01cce3714632b4b301a6d12a93e56785c2497c44cb9319ccda\": container with ID starting with efbab1b168c8bc01cce3714632b4b301a6d12a93e56785c2497c44cb9319ccda not found: ID does not exist"
Sep 06 00:58:58.561612 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.561583    2577 scope.go:117] "RemoveContainer" containerID="da0fa2b9f1a54adf1b38a5bdea92dd720640999293f87adb311979ec63d41c2e"
Sep 06 00:58:58.561737 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.561718    2577 generic.go:356] "Generic (PLEG): container finished" podID="2c0fbc7c-c2c8-4858-96af-811ad08706d6" containerID="112fbfe5d4f193e885963807e22069e0ec0606f0c20e0c6a74c7ec826d60f1bb" exitCode=0
Sep 06 00:58:58.561781 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.561742    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-6c8hq"
Sep 06 00:58:58.564177 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:58:58.564161    2577 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dmnxg" container="manager"
Sep 06 00:58:58.571393 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.571376    2577 scope.go:117] "RemoveContainer" containerID="da0fa2b9f1a54adf1b38a5bdea92dd720640999293f87adb311979ec63d41c2e"
Sep 06 00:58:58.571682 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:58:58.571667    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da0fa2b9f1a54adf1b38a5bdea92dd720640999293f87adb311979ec63d41c2e\": container with ID starting with da0fa2b9f1a54adf1b38a5bdea92dd720640999293f87adb311979ec63d41c2e not found: ID does not exist" containerID="da0fa2b9f1a54adf1b38a5bdea92dd720640999293f87adb311979ec63d41c2e"
Sep 06 00:58:58.571735 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.571690    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da0fa2b9f1a54adf1b38a5bdea92dd720640999293f87adb311979ec63d41c2e"} err="failed to get container status \"da0fa2b9f1a54adf1b38a5bdea92dd720640999293f87adb311979ec63d41c2e\": rpc error: code = NotFound desc = could not find container \"da0fa2b9f1a54adf1b38a5bdea92dd720640999293f87adb311979ec63d41c2e\": container with ID starting with da0fa2b9f1a54adf1b38a5bdea92dd720640999293f87adb311979ec63d41c2e not found: ID does not exist"
Sep 06 00:58:58.571735 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.571710    2577 scope.go:117] "RemoveContainer" containerID="112fbfe5d4f193e885963807e22069e0ec0606f0c20e0c6a74c7ec826d60f1bb"
Sep 06 00:58:58.579678 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.579636    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5wph6" podStartSLOduration=1.5796216360000002 podStartE2EDuration="1.579621636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:58:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:58:58.578156073 +0000 UTC m=+496.614299041" watchObservedRunningTime="2026-09-06 00:58:58.579621636 +0000 UTC m=+496.615764593"
Sep 06 00:58:58.580491 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.580470    2577 scope.go:117] "RemoveContainer" containerID="112fbfe5d4f193e885963807e22069e0ec0606f0c20e0c6a74c7ec826d60f1bb"
Sep 06 00:58:58.580789 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:58:58.580768    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"112fbfe5d4f193e885963807e22069e0ec0606f0c20e0c6a74c7ec826d60f1bb\": container with ID starting with 112fbfe5d4f193e885963807e22069e0ec0606f0c20e0c6a74c7ec826d60f1bb not found: ID does not exist" containerID="112fbfe5d4f193e885963807e22069e0ec0606f0c20e0c6a74c7ec826d60f1bb"
Sep 06 00:58:58.580849 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.580795    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"112fbfe5d4f193e885963807e22069e0ec0606f0c20e0c6a74c7ec826d60f1bb"} err="failed to get container status \"112fbfe5d4f193e885963807e22069e0ec0606f0c20e0c6a74c7ec826d60f1bb\": rpc error: code = NotFound desc = could not find container \"112fbfe5d4f193e885963807e22069e0ec0606f0c20e0c6a74c7ec826d60f1bb\": container with ID starting with 112fbfe5d4f193e885963807e22069e0ec0606f0c20e0c6a74c7ec826d60f1bb not found: ID does not exist"
Sep 06 00:58:58.600127 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.600080    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfdld" podStartSLOduration=1.6000649839999999 podStartE2EDuration="1.600064984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:58:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:58:58.598776169 +0000 UTC m=+496.634919126" watchObservedRunningTime="2026-09-06 00:58:58.600064984 +0000 UTC m=+496.636207941"
Sep 06 00:58:58.626992 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:58.626937    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-fhx5x" podStartSLOduration=1.6269217679999999 podStartE2EDuration="1.626921768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:58:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:58:58.625576522 +0000 UTC m=+496.661719481" watchObservedRunningTime="2026-09-06 00:58:58.626921768 +0000 UTC m=+496.663064725"
Sep 06 00:58:59.573526 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:59.573493    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dmnxg" podUID="68571273-da38-49b6-a7a9-51fb81c4fb83" containerName="manager" containerID="cri-o://1703d2ed6674a6b05af5046f4c73e838ea0123d496f99b22d2149a545dea4fbf" gracePeriod=2
Sep 06 00:58:59.576379 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:58:59.576352    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-dmnxg\" is forbidden: User \"system:node:ip-10-0-140-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-57.ec2.internal' and this object" podUID="68571273-da38-49b6-a7a9-51fb81c4fb83" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dmnxg"
Sep 06 00:58:59.817603 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:59.817580    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dmnxg"
Sep 06 00:58:59.819642 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:58:59.819613    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-dmnxg\" is forbidden: User \"system:node:ip-10-0-140-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-57.ec2.internal' and this object" podUID="68571273-da38-49b6-a7a9-51fb81c4fb83" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dmnxg"
Sep 06 00:58:59.919174 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:59.919145    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/68571273-da38-49b6-a7a9-51fb81c4fb83-extensions-socket-volume\") pod \"68571273-da38-49b6-a7a9-51fb81c4fb83\" (UID: \"68571273-da38-49b6-a7a9-51fb81c4fb83\") "
Sep 06 00:58:59.919359 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:59.919204    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vp7p\" (UniqueName: \"kubernetes.io/projected/68571273-da38-49b6-a7a9-51fb81c4fb83-kube-api-access-4vp7p\") pod \"68571273-da38-49b6-a7a9-51fb81c4fb83\" (UID: \"68571273-da38-49b6-a7a9-51fb81c4fb83\") "
Sep 06 00:58:59.919514 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:59.919487    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68571273-da38-49b6-a7a9-51fb81c4fb83-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "68571273-da38-49b6-a7a9-51fb81c4fb83" (UID: "68571273-da38-49b6-a7a9-51fb81c4fb83"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 00:58:59.921440 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:58:59.921418    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68571273-da38-49b6-a7a9-51fb81c4fb83-kube-api-access-4vp7p" (OuterVolumeSpecName: "kube-api-access-4vp7p") pod "68571273-da38-49b6-a7a9-51fb81c4fb83" (UID: "68571273-da38-49b6-a7a9-51fb81c4fb83"). InnerVolumeSpecName "kube-api-access-4vp7p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 00:59:00.020646 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:00.020609    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vp7p\" (UniqueName: \"kubernetes.io/projected/68571273-da38-49b6-a7a9-51fb81c4fb83-kube-api-access-4vp7p\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:59:00.020646 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:00.020640    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/68571273-da38-49b6-a7a9-51fb81c4fb83-extensions-socket-volume\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:59:00.413768 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:00.413735    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68571273-da38-49b6-a7a9-51fb81c4fb83" path="/var/lib/kubelet/pods/68571273-da38-49b6-a7a9-51fb81c4fb83/volumes"
Sep 06 00:59:00.582638 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:00.582602    2577 generic.go:356] "Generic (PLEG): container finished" podID="68571273-da38-49b6-a7a9-51fb81c4fb83" containerID="1703d2ed6674a6b05af5046f4c73e838ea0123d496f99b22d2149a545dea4fbf" exitCode=2
Sep 06 00:59:00.583057 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:00.582651    2577 scope.go:117] "RemoveContainer" containerID="1703d2ed6674a6b05af5046f4c73e838ea0123d496f99b22d2149a545dea4fbf"
Sep 06 00:59:00.583057 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:00.582666    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dmnxg"
Sep 06 00:59:00.587138 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:59:00.587108    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-dmnxg\" is forbidden: User \"system:node:ip-10-0-140-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-57.ec2.internal' and this object" podUID="68571273-da38-49b6-a7a9-51fb81c4fb83" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dmnxg"
Sep 06 00:59:00.591032 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:00.591004    2577 scope.go:117] "RemoveContainer" containerID="1703d2ed6674a6b05af5046f4c73e838ea0123d496f99b22d2149a545dea4fbf"
Sep 06 00:59:00.591348 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:59:00.591304    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1703d2ed6674a6b05af5046f4c73e838ea0123d496f99b22d2149a545dea4fbf\": container with ID starting with 1703d2ed6674a6b05af5046f4c73e838ea0123d496f99b22d2149a545dea4fbf not found: ID does not exist" containerID="1703d2ed6674a6b05af5046f4c73e838ea0123d496f99b22d2149a545dea4fbf"
Sep 06 00:59:00.591420 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:00.591361    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1703d2ed6674a6b05af5046f4c73e838ea0123d496f99b22d2149a545dea4fbf"} err="failed to get container status \"1703d2ed6674a6b05af5046f4c73e838ea0123d496f99b22d2149a545dea4fbf\": rpc error: code = NotFound desc = could not find container \"1703d2ed6674a6b05af5046f4c73e838ea0123d496f99b22d2149a545dea4fbf\": container with ID starting with 1703d2ed6674a6b05af5046f4c73e838ea0123d496f99b22d2149a545dea4fbf not found: ID does not exist"
Sep 06 00:59:02.407288 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:59:02.407248    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-dmnxg\" is forbidden: User \"system:node:ip-10-0-140-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-57.ec2.internal' and this object" podUID="68571273-da38-49b6-a7a9-51fb81c4fb83" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-dmnxg"
Sep 06 00:59:09.575574 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:09.575538    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5wph6"
Sep 06 00:59:09.576093 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:09.575615    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfdld"
Sep 06 00:59:09.576093 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:09.575649    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-fhx5x"
Sep 06 00:59:09.685487 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:09.685457    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfdld"]
Sep 06 00:59:09.685716 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:09.685692    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfdld" podUID="728a09ce-dce9-40d0-a5d8-1d50526fbe74" containerName="manager" containerID="cri-o://0a7805d04f403b5d29eb7f5e704d1619046e3e215f3ec5148d34081ac3a2123d" gracePeriod=10
Sep 06 00:59:09.950176 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:09.950151    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfdld"
Sep 06 00:59:10.012555 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:10.012527    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-4gwsp"]
Sep 06 00:59:10.012902 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:10.012891    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="728a09ce-dce9-40d0-a5d8-1d50526fbe74" containerName="manager"
Sep 06 00:59:10.012955 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:10.012904    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="728a09ce-dce9-40d0-a5d8-1d50526fbe74" containerName="manager"
Sep 06 00:59:10.012955 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:10.012953    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="728a09ce-dce9-40d0-a5d8-1d50526fbe74" containerName="manager"
Sep 06 00:59:10.015614 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:10.015568    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-4gwsp"
Sep 06 00:59:10.036857 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:10.036831    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-4gwsp"]
Sep 06 00:59:10.106099 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:10.106066    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/728a09ce-dce9-40d0-a5d8-1d50526fbe74-extensions-socket-volume\") pod \"728a09ce-dce9-40d0-a5d8-1d50526fbe74\" (UID: \"728a09ce-dce9-40d0-a5d8-1d50526fbe74\") "
Sep 06 00:59:10.106275 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:10.106161    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tshdx\" (UniqueName: \"kubernetes.io/projected/728a09ce-dce9-40d0-a5d8-1d50526fbe74-kube-api-access-tshdx\") pod \"728a09ce-dce9-40d0-a5d8-1d50526fbe74\" (UID: \"728a09ce-dce9-40d0-a5d8-1d50526fbe74\") "
Sep 06 00:59:10.106275 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:10.106264    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31f405f6-e24b-4de0-93b0-8984e3c931dc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-4gwsp\" (UID: \"31f405f6-e24b-4de0-93b0-8984e3c931dc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-4gwsp"
Sep 06 00:59:10.106432 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:10.106355    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zz28\" (UniqueName: \"kubernetes.io/projected/31f405f6-e24b-4de0-93b0-8984e3c931dc-kube-api-access-7zz28\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-4gwsp\" (UID: \"31f405f6-e24b-4de0-93b0-8984e3c931dc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-4gwsp"
Sep 06 00:59:10.106495 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:10.106460    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/728a09ce-dce9-40d0-a5d8-1d50526fbe74-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "728a09ce-dce9-40d0-a5d8-1d50526fbe74" (UID: "728a09ce-dce9-40d0-a5d8-1d50526fbe74"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 00:59:10.108449 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:10.108428    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/728a09ce-dce9-40d0-a5d8-1d50526fbe74-kube-api-access-tshdx" (OuterVolumeSpecName: "kube-api-access-tshdx") pod "728a09ce-dce9-40d0-a5d8-1d50526fbe74" (UID: "728a09ce-dce9-40d0-a5d8-1d50526fbe74"). InnerVolumeSpecName "kube-api-access-tshdx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 00:59:10.207768 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:10.207735    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zz28\" (UniqueName: \"kubernetes.io/projected/31f405f6-e24b-4de0-93b0-8984e3c931dc-kube-api-access-7zz28\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-4gwsp\" (UID: \"31f405f6-e24b-4de0-93b0-8984e3c931dc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-4gwsp"
Sep 06 00:59:10.207918 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:10.207807    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31f405f6-e24b-4de0-93b0-8984e3c931dc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-4gwsp\" (UID: \"31f405f6-e24b-4de0-93b0-8984e3c931dc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-4gwsp"
Sep 06 00:59:10.207918 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:10.207872    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tshdx\" (UniqueName: \"kubernetes.io/projected/728a09ce-dce9-40d0-a5d8-1d50526fbe74-kube-api-access-tshdx\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:59:10.207918 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:10.207887    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/728a09ce-dce9-40d0-a5d8-1d50526fbe74-extensions-socket-volume\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:59:10.208120 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:10.208101    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31f405f6-e24b-4de0-93b0-8984e3c931dc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-4gwsp\" (UID: \"31f405f6-e24b-4de0-93b0-8984e3c931dc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-4gwsp"
Sep 06 00:59:10.219526 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:10.219499    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zz28\" (UniqueName: \"kubernetes.io/projected/31f405f6-e24b-4de0-93b0-8984e3c931dc-kube-api-access-7zz28\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-4gwsp\" (UID: \"31f405f6-e24b-4de0-93b0-8984e3c931dc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-4gwsp"
Sep 06 00:59:10.325293 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:10.325264    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-4gwsp"
Sep 06 00:59:10.603012 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:10.602985    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-4gwsp"]
Sep 06 00:59:10.604170 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:59:10.604139    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31f405f6_e24b_4de0_93b0_8984e3c931dc.slice/crio-9b543cc279d0f7013866a1bd0784580ce033c3f179c877af9c8f4d4dfbdd8898 WatchSource:0}: Error finding container 9b543cc279d0f7013866a1bd0784580ce033c3f179c877af9c8f4d4dfbdd8898: Status 404 returned error can't find the container with id 9b543cc279d0f7013866a1bd0784580ce033c3f179c877af9c8f4d4dfbdd8898
Sep 06 00:59:10.641454 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:10.641418    2577 generic.go:356] "Generic (PLEG): container finished" podID="728a09ce-dce9-40d0-a5d8-1d50526fbe74" containerID="0a7805d04f403b5d29eb7f5e704d1619046e3e215f3ec5148d34081ac3a2123d" exitCode=0
Sep 06 00:59:10.641572 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:10.641507    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfdld"
Sep 06 00:59:10.641572 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:10.641516    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfdld" event={"ID":"728a09ce-dce9-40d0-a5d8-1d50526fbe74","Type":"ContainerDied","Data":"0a7805d04f403b5d29eb7f5e704d1619046e3e215f3ec5148d34081ac3a2123d"}
Sep 06 00:59:10.641572 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:10.641566    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfdld" event={"ID":"728a09ce-dce9-40d0-a5d8-1d50526fbe74","Type":"ContainerDied","Data":"429b2158688b000be7eb6cf7f10742d91e3ad50e97a546ec622ab9075cb894cd"}
Sep 06 00:59:10.641725 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:10.641589    2577 scope.go:117] "RemoveContainer" containerID="0a7805d04f403b5d29eb7f5e704d1619046e3e215f3ec5148d34081ac3a2123d"
Sep 06 00:59:10.643162 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:10.643140    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-4gwsp" event={"ID":"31f405f6-e24b-4de0-93b0-8984e3c931dc","Type":"ContainerStarted","Data":"9b543cc279d0f7013866a1bd0784580ce033c3f179c877af9c8f4d4dfbdd8898"}
Sep 06 00:59:10.657257 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:10.657240    2577 scope.go:117] "RemoveContainer" containerID="0a7805d04f403b5d29eb7f5e704d1619046e3e215f3ec5148d34081ac3a2123d"
Sep 06 00:59:10.657600 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:59:10.657583    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a7805d04f403b5d29eb7f5e704d1619046e3e215f3ec5148d34081ac3a2123d\": container with ID starting with 0a7805d04f403b5d29eb7f5e704d1619046e3e215f3ec5148d34081ac3a2123d not found: ID does not exist" containerID="0a7805d04f403b5d29eb7f5e704d1619046e3e215f3ec5148d34081ac3a2123d"
Sep 06 00:59:10.657721 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:10.657609    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a7805d04f403b5d29eb7f5e704d1619046e3e215f3ec5148d34081ac3a2123d"} err="failed to get container status \"0a7805d04f403b5d29eb7f5e704d1619046e3e215f3ec5148d34081ac3a2123d\": rpc error: code = NotFound desc = could not find container \"0a7805d04f403b5d29eb7f5e704d1619046e3e215f3ec5148d34081ac3a2123d\": container with ID starting with 0a7805d04f403b5d29eb7f5e704d1619046e3e215f3ec5148d34081ac3a2123d not found: ID does not exist"
Sep 06 00:59:10.671065 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:10.671043    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfdld"]
Sep 06 00:59:10.681068 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:10.681047    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfdld"]
Sep 06 00:59:11.650412 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:11.650378    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-4gwsp" event={"ID":"31f405f6-e24b-4de0-93b0-8984e3c931dc","Type":"ContainerStarted","Data":"2cd370be517fc09dc68768ef4354fdcaf067b787581ceedf52f449e23726a03f"}
Sep 06 00:59:11.650789 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:11.650501    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-4gwsp"
Sep 06 00:59:11.672549 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:11.672506    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-4gwsp" podStartSLOduration=2.672490277 podStartE2EDuration="2.672490277s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:59:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:59:11.670605607 +0000 UTC m=+509.706748564" watchObservedRunningTime="2026-09-06 00:59:11.672490277 +0000 UTC m=+509.708633234"
Sep 06 00:59:12.409179 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:12.409145    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="728a09ce-dce9-40d0-a5d8-1d50526fbe74" path="/var/lib/kubelet/pods/728a09ce-dce9-40d0-a5d8-1d50526fbe74/volumes"
Sep 06 00:59:22.657935 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:22.657904    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-4gwsp"
Sep 06 00:59:22.719035 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:22.719004    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-fhx5x"]
Sep 06 00:59:22.719263 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:22.719229    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-fhx5x" podUID="3b6b4fe4-f936-401a-a082-3bd565f170f7" containerName="manager" containerID="cri-o://be0bb218d142a087e56324df37cc6b9f293113e07b06c61cb068d576c57c610e" gracePeriod=10
Sep 06 00:59:23.010721 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:23.010690    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-fhx5x"
Sep 06 00:59:23.123295 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:23.123264    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rmp2v\" (UniqueName: \"kubernetes.io/projected/3b6b4fe4-f936-401a-a082-3bd565f170f7-kube-api-access-rmp2v\") pod \"3b6b4fe4-f936-401a-a082-3bd565f170f7\" (UID: \"3b6b4fe4-f936-401a-a082-3bd565f170f7\") "
Sep 06 00:59:23.123485 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:23.123354    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b6b4fe4-f936-401a-a082-3bd565f170f7-extensions-socket-volume\") pod \"3b6b4fe4-f936-401a-a082-3bd565f170f7\" (UID: \"3b6b4fe4-f936-401a-a082-3bd565f170f7\") "
Sep 06 00:59:23.123791 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:23.123767    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b6b4fe4-f936-401a-a082-3bd565f170f7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3b6b4fe4-f936-401a-a082-3bd565f170f7" (UID: "3b6b4fe4-f936-401a-a082-3bd565f170f7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 00:59:23.125603 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:23.125578    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b6b4fe4-f936-401a-a082-3bd565f170f7-kube-api-access-rmp2v" (OuterVolumeSpecName: "kube-api-access-rmp2v") pod "3b6b4fe4-f936-401a-a082-3bd565f170f7" (UID: "3b6b4fe4-f936-401a-a082-3bd565f170f7"). InnerVolumeSpecName "kube-api-access-rmp2v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 00:59:23.224779 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:23.224703    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rmp2v\" (UniqueName: \"kubernetes.io/projected/3b6b4fe4-f936-401a-a082-3bd565f170f7-kube-api-access-rmp2v\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:59:23.224779 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:23.224729    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b6b4fe4-f936-401a-a082-3bd565f170f7-extensions-socket-volume\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:59:23.717663 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:23.717623    2577 generic.go:356] "Generic (PLEG): container finished" podID="3b6b4fe4-f936-401a-a082-3bd565f170f7" containerID="be0bb218d142a087e56324df37cc6b9f293113e07b06c61cb068d576c57c610e" exitCode=0
Sep 06 00:59:23.718046 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:23.717672    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-fhx5x"
Sep 06 00:59:23.718046 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:23.717702    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-fhx5x" event={"ID":"3b6b4fe4-f936-401a-a082-3bd565f170f7","Type":"ContainerDied","Data":"be0bb218d142a087e56324df37cc6b9f293113e07b06c61cb068d576c57c610e"}
Sep 06 00:59:23.718046 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:23.717753    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-fhx5x" event={"ID":"3b6b4fe4-f936-401a-a082-3bd565f170f7","Type":"ContainerDied","Data":"840afe685949e54c282cdff6ae82def9da97a1bd52cf8cd5e253bd0da60b026c"}
Sep 06 00:59:23.718046 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:23.717775    2577 scope.go:117] "RemoveContainer" containerID="be0bb218d142a087e56324df37cc6b9f293113e07b06c61cb068d576c57c610e"
Sep 06 00:59:23.726897 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:23.726747    2577 scope.go:117] "RemoveContainer" containerID="be0bb218d142a087e56324df37cc6b9f293113e07b06c61cb068d576c57c610e"
Sep 06 00:59:23.727036 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:59:23.727015    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be0bb218d142a087e56324df37cc6b9f293113e07b06c61cb068d576c57c610e\": container with ID starting with be0bb218d142a087e56324df37cc6b9f293113e07b06c61cb068d576c57c610e not found: ID does not exist" containerID="be0bb218d142a087e56324df37cc6b9f293113e07b06c61cb068d576c57c610e"
Sep 06 00:59:23.727097 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:23.727050    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be0bb218d142a087e56324df37cc6b9f293113e07b06c61cb068d576c57c610e"} err="failed to get container status \"be0bb218d142a087e56324df37cc6b9f293113e07b06c61cb068d576c57c610e\": rpc error: code = NotFound desc = could not find container \"be0bb218d142a087e56324df37cc6b9f293113e07b06c61cb068d576c57c610e\": container with ID starting with be0bb218d142a087e56324df37cc6b9f293113e07b06c61cb068d576c57c610e not found: ID does not exist"
Sep 06 00:59:23.748595 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:23.748568    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-fhx5x"]
Sep 06 00:59:23.752372 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:23.752351    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-fhx5x"]
Sep 06 00:59:24.408199 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:24.408168    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b6b4fe4-f936-401a-a082-3bd565f170f7" path="/var/lib/kubelet/pods/3b6b4fe4-f936-401a-a082-3bd565f170f7/volumes"
Sep 06 00:59:26.138175 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:26.138139    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9"]
Sep 06 00:59:26.138734 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:26.138722    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b6b4fe4-f936-401a-a082-3bd565f170f7" containerName="manager"
Sep 06 00:59:26.138805 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:26.138742    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b6b4fe4-f936-401a-a082-3bd565f170f7" containerName="manager"
Sep 06 00:59:26.138931 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:26.138914    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b6b4fe4-f936-401a-a082-3bd565f170f7" containerName="manager"
Sep 06 00:59:26.149610 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:26.149590    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9"
Sep 06 00:59:26.151921 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:26.151891    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9"]
Sep 06 00:59:26.152114 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:26.152092    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 06 00:59:26.152608 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:26.152587    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-wt4x5\""
Sep 06 00:59:26.253755 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:26.253720    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/008a77a0-2765-4ab1-ac54-70ba224c7ad2-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4gqt9\" (UID: \"008a77a0-2765-4ab1-ac54-70ba224c7ad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9"
Sep 06 00:59:26.253755 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:26.253762    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/008a77a0-2765-4ab1-ac54-70ba224c7ad2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4gqt9\" (UID: \"008a77a0-2765-4ab1-ac54-70ba224c7ad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9"
Sep 06 00:59:26.253982 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:26.253824    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/008a77a0-2765-4ab1-ac54-70ba224c7ad2-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4gqt9\" (UID: \"008a77a0-2765-4ab1-ac54-70ba224c7ad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9"
Sep 06 00:59:26.253982 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:26.253865    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/008a77a0-2765-4ab1-ac54-70ba224c7ad2-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4gqt9\" (UID: \"008a77a0-2765-4ab1-ac54-70ba224c7ad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9"
Sep 06 00:59:26.253982 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:26.253902    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/008a77a0-2765-4ab1-ac54-70ba224c7ad2-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4gqt9\" (UID: \"008a77a0-2765-4ab1-ac54-70ba224c7ad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9"
Sep 06 00:59:26.253982 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:26.253930    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psrdk\" (UniqueName: \"kubernetes.io/projected/008a77a0-2765-4ab1-ac54-70ba224c7ad2-kube-api-access-psrdk\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4gqt9\" (UID: \"008a77a0-2765-4ab1-ac54-70ba224c7ad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9"
Sep 06 00:59:26.253982 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:26.253967    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/008a77a0-2765-4ab1-ac54-70ba224c7ad2-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4gqt9\" (UID: \"008a77a0-2765-4ab1-ac54-70ba224c7ad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9"
Sep 06 00:59:26.254160 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:26.253991    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/008a77a0-2765-4ab1-ac54-70ba224c7ad2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4gqt9\" (UID: \"008a77a0-2765-4ab1-ac54-70ba224c7ad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9"
Sep 06 00:59:26.254160 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:26.254017    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/008a77a0-2765-4ab1-ac54-70ba224c7ad2-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4gqt9\" (UID: \"008a77a0-2765-4ab1-ac54-70ba224c7ad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9"
Sep 06 00:59:26.355173 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:26.355135    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/008a77a0-2765-4ab1-ac54-70ba224c7ad2-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4gqt9\" (UID: \"008a77a0-2765-4ab1-ac54-70ba224c7ad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9"
Sep 06 00:59:26.355173 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:26.355173    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/008a77a0-2765-4ab1-ac54-70ba224c7ad2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4gqt9\" (UID: \"008a77a0-2765-4ab1-ac54-70ba224c7ad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9"
Sep 06 00:59:26.355456 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:26.355200    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/008a77a0-2765-4ab1-ac54-70ba224c7ad2-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4gqt9\" (UID: \"008a77a0-2765-4ab1-ac54-70ba224c7ad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9"
Sep 06 00:59:26.355456 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:26.355225    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/008a77a0-2765-4ab1-ac54-70ba224c7ad2-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4gqt9\" (UID: \"008a77a0-2765-4ab1-ac54-70ba224c7ad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9"
Sep 06 00:59:26.355456 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:26.355266    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/008a77a0-2765-4ab1-ac54-70ba224c7ad2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4gqt9\" (UID: \"008a77a0-2765-4ab1-ac54-70ba224c7ad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9"
Sep 06 00:59:26.355456 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:26.355312    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/008a77a0-2765-4ab1-ac54-70ba224c7ad2-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4gqt9\" (UID: \"008a77a0-2765-4ab1-ac54-70ba224c7ad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9"
Sep 06 00:59:26.355456 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:26.355371    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/008a77a0-2765-4ab1-ac54-70ba224c7ad2-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4gqt9\" (UID: \"008a77a0-2765-4ab1-ac54-70ba224c7ad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9"
Sep 06 00:59:26.355456 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:26.355416    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/008a77a0-2765-4ab1-ac54-70ba224c7ad2-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4gqt9\" (UID: \"008a77a0-2765-4ab1-ac54-70ba224c7ad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9"
Sep 06 00:59:26.355456 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:26.355444    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psrdk\" (UniqueName: \"kubernetes.io/projected/008a77a0-2765-4ab1-ac54-70ba224c7ad2-kube-api-access-psrdk\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4gqt9\" (UID: \"008a77a0-2765-4ab1-ac54-70ba224c7ad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9"
Sep 06 00:59:26.355821 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:26.355615    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/008a77a0-2765-4ab1-ac54-70ba224c7ad2-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4gqt9\" (UID: \"008a77a0-2765-4ab1-ac54-70ba224c7ad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9"
Sep 06 00:59:26.355821 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:26.355764    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/008a77a0-2765-4ab1-ac54-70ba224c7ad2-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4gqt9\" (UID: \"008a77a0-2765-4ab1-ac54-70ba224c7ad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9"
Sep 06 00:59:26.355896 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:26.355877    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/008a77a0-2765-4ab1-ac54-70ba224c7ad2-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4gqt9\" (UID: \"008a77a0-2765-4ab1-ac54-70ba224c7ad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9"
Sep 06 00:59:26.355929 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:26.355903    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/008a77a0-2765-4ab1-ac54-70ba224c7ad2-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4gqt9\" (UID: \"008a77a0-2765-4ab1-ac54-70ba224c7ad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9"
Sep 06 00:59:26.355994 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:26.355975    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/008a77a0-2765-4ab1-ac54-70ba224c7ad2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4gqt9\" (UID: \"008a77a0-2765-4ab1-ac54-70ba224c7ad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9"
Sep 06 00:59:26.357757 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:26.357730    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/008a77a0-2765-4ab1-ac54-70ba224c7ad2-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4gqt9\" (UID: \"008a77a0-2765-4ab1-ac54-70ba224c7ad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9"
Sep 06 00:59:26.357857 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:26.357844    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/008a77a0-2765-4ab1-ac54-70ba224c7ad2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4gqt9\" (UID: \"008a77a0-2765-4ab1-ac54-70ba224c7ad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9"
Sep 06 00:59:26.363393 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:26.363375    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psrdk\" (UniqueName: \"kubernetes.io/projected/008a77a0-2765-4ab1-ac54-70ba224c7ad2-kube-api-access-psrdk\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4gqt9\" (UID: \"008a77a0-2765-4ab1-ac54-70ba224c7ad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9"
Sep 06 00:59:26.363485 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:26.363446    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/008a77a0-2765-4ab1-ac54-70ba224c7ad2-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4gqt9\" (UID: \"008a77a0-2765-4ab1-ac54-70ba224c7ad2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9"
Sep 06 00:59:26.461653 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:26.461628    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9"
Sep 06 00:59:26.737078 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:26.737054    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9"]
Sep 06 00:59:26.739122 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:59:26.739090    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod008a77a0_2765_4ab1_ac54_70ba224c7ad2.slice/crio-60ccb9ee25eeeda6436db34865e190cda9de7fb496e72c97e6c7b2facd4317fd WatchSource:0}: Error finding container 60ccb9ee25eeeda6436db34865e190cda9de7fb496e72c97e6c7b2facd4317fd: Status 404 returned error can't find the container with id 60ccb9ee25eeeda6436db34865e190cda9de7fb496e72c97e6c7b2facd4317fd
Sep 06 00:59:27.739219 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:27.739183    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9" event={"ID":"008a77a0-2765-4ab1-ac54-70ba224c7ad2","Type":"ContainerStarted","Data":"60ccb9ee25eeeda6436db34865e190cda9de7fb496e72c97e6c7b2facd4317fd"}
Sep 06 00:59:30.448507 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:30.448473    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 00:59:30.448751 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:30.448552    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 00:59:30.448751 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:30.448582    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 00:59:30.759504 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:30.759422    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9" event={"ID":"008a77a0-2765-4ab1-ac54-70ba224c7ad2","Type":"ContainerStarted","Data":"88afabf366076ef7d30f42ef74896fcc8f5f06b66782a28387efa5644cdf5f5d"}
Sep 06 00:59:30.781396 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:30.781312    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9" podStartSLOduration=1.074060085 podStartE2EDuration="4.781294933s" totalImagesPullingTime="3.707234848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:59:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:59:30.779714852 +0000 UTC m=+528.815857821" watchObservedRunningTime="2026-09-06 00:59:30.781294933 +0000 UTC m=+528.817437890"
Sep 06 00:59:31.462268 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:31.462225    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9"
Sep 06 00:59:31.466884 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:31.466855    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9"
Sep 06 00:59:31.767559 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:31.767483    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9"
Sep 06 00:59:31.768555 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:31.768533    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9"
Sep 06 00:59:37.962571 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:37.962492    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-qn5w5"]
Sep 06 00:59:37.966105 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:37.966084    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-qn5w5"
Sep 06 00:59:37.968217 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:37.968200    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 06 00:59:37.974973 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:37.974950    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-qn5w5"]
Sep 06 00:59:38.061587 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:38.061548    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ae4935ea-6e36-421e-997a-f39afc374a5c-config-file\") pod \"limitador-limitador-859c4d96d6-qn5w5\" (UID: \"ae4935ea-6e36-421e-997a-f39afc374a5c\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-qn5w5"
Sep 06 00:59:38.061752 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:38.061677    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbkmf\" (UniqueName: \"kubernetes.io/projected/ae4935ea-6e36-421e-997a-f39afc374a5c-kube-api-access-wbkmf\") pod \"limitador-limitador-859c4d96d6-qn5w5\" (UID: \"ae4935ea-6e36-421e-997a-f39afc374a5c\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-qn5w5"
Sep 06 00:59:38.062408 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:38.062388    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-qn5w5"]
Sep 06 00:59:38.162514 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:38.162471    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ae4935ea-6e36-421e-997a-f39afc374a5c-config-file\") pod \"limitador-limitador-859c4d96d6-qn5w5\" (UID: \"ae4935ea-6e36-421e-997a-f39afc374a5c\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-qn5w5"
Sep 06 00:59:38.162720 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:38.162551    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbkmf\" (UniqueName: \"kubernetes.io/projected/ae4935ea-6e36-421e-997a-f39afc374a5c-kube-api-access-wbkmf\") pod \"limitador-limitador-859c4d96d6-qn5w5\" (UID: \"ae4935ea-6e36-421e-997a-f39afc374a5c\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-qn5w5"
Sep 06 00:59:38.163131 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:38.163104    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ae4935ea-6e36-421e-997a-f39afc374a5c-config-file\") pod \"limitador-limitador-859c4d96d6-qn5w5\" (UID: \"ae4935ea-6e36-421e-997a-f39afc374a5c\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-qn5w5"
Sep 06 00:59:38.171315 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:38.171284    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbkmf\" (UniqueName: \"kubernetes.io/projected/ae4935ea-6e36-421e-997a-f39afc374a5c-kube-api-access-wbkmf\") pod \"limitador-limitador-859c4d96d6-qn5w5\" (UID: \"ae4935ea-6e36-421e-997a-f39afc374a5c\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-qn5w5"
Sep 06 00:59:38.276766 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:38.276678    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-qn5w5"
Sep 06 00:59:38.378015 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:38.377983    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 00:59:38.381620 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:38.381595    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"
Sep 06 00:59:38.389765 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:38.389737    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 00:59:38.419767 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:38.419738    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 00:59:38.465116 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:38.465083    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chbkg\" (UniqueName: \"kubernetes.io/projected/9fc17157-d507-49de-af37-6b54f834e58d-kube-api-access-chbkg\") pod \"limitador-limitador-85d9db4d5d-pq2zk\" (UID: \"9fc17157-d507-49de-af37-6b54f834e58d\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"
Sep 06 00:59:38.465282 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:38.465165    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9fc17157-d507-49de-af37-6b54f834e58d-config-file\") pod \"limitador-limitador-85d9db4d5d-pq2zk\" (UID: \"9fc17157-d507-49de-af37-6b54f834e58d\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"
Sep 06 00:59:38.545824 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:38.545779    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-qn5w5"]
Sep 06 00:59:38.548809 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:59:38.548785    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae4935ea_6e36_421e_997a_f39afc374a5c.slice/crio-0fac632c589d7b72454685d274ecadd8683533be5fdc6934aed6d19fc25a8b8c WatchSource:0}: Error finding container 0fac632c589d7b72454685d274ecadd8683533be5fdc6934aed6d19fc25a8b8c: Status 404 returned error can't find the container with id 0fac632c589d7b72454685d274ecadd8683533be5fdc6934aed6d19fc25a8b8c
Sep 06 00:59:38.566466 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:38.566440    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9fc17157-d507-49de-af37-6b54f834e58d-config-file\") pod \"limitador-limitador-85d9db4d5d-pq2zk\" (UID: \"9fc17157-d507-49de-af37-6b54f834e58d\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"
Sep 06 00:59:38.566566 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:38.566496    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chbkg\" (UniqueName: \"kubernetes.io/projected/9fc17157-d507-49de-af37-6b54f834e58d-kube-api-access-chbkg\") pod \"limitador-limitador-85d9db4d5d-pq2zk\" (UID: \"9fc17157-d507-49de-af37-6b54f834e58d\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"
Sep 06 00:59:38.567080 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:38.567061    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9fc17157-d507-49de-af37-6b54f834e58d-config-file\") pod \"limitador-limitador-85d9db4d5d-pq2zk\" (UID: \"9fc17157-d507-49de-af37-6b54f834e58d\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"
Sep 06 00:59:38.574888 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:38.574868    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chbkg\" (UniqueName: \"kubernetes.io/projected/9fc17157-d507-49de-af37-6b54f834e58d-kube-api-access-chbkg\") pod \"limitador-limitador-85d9db4d5d-pq2zk\" (UID: \"9fc17157-d507-49de-af37-6b54f834e58d\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"
Sep 06 00:59:38.694163 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:38.694130    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"
Sep 06 00:59:38.803676 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:38.803597    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-qn5w5" event={"ID":"ae4935ea-6e36-421e-997a-f39afc374a5c","Type":"ContainerStarted","Data":"0fac632c589d7b72454685d274ecadd8683533be5fdc6934aed6d19fc25a8b8c"}
Sep 06 00:59:38.961457 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:38.961424    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 00:59:38.963469 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:59:38.963445    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fc17157_d507_49de_af37_6b54f834e58d.slice/crio-bfa5b9cabf4f5e3f143e8262b6964fda5ac41854d4d5a3a453212f686d975816 WatchSource:0}: Error finding container bfa5b9cabf4f5e3f143e8262b6964fda5ac41854d4d5a3a453212f686d975816: Status 404 returned error can't find the container with id bfa5b9cabf4f5e3f143e8262b6964fda5ac41854d4d5a3a453212f686d975816
Sep 06 00:59:39.809545 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:39.809513    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk" event={"ID":"9fc17157-d507-49de-af37-6b54f834e58d","Type":"ContainerStarted","Data":"bfa5b9cabf4f5e3f143e8262b6964fda5ac41854d4d5a3a453212f686d975816"}
Sep 06 00:59:40.816413 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:40.816376    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk" event={"ID":"9fc17157-d507-49de-af37-6b54f834e58d","Type":"ContainerStarted","Data":"410d0fdc564b4f4cd043c584112b31254d9f2f5a189dcb1cbaa746f2987a1d4a"}
Sep 06 00:59:40.816836 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:40.816442    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"
Sep 06 00:59:40.817919 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:40.817894    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-qn5w5" event={"ID":"ae4935ea-6e36-421e-997a-f39afc374a5c","Type":"ContainerStarted","Data":"2050618a167a263f8484ec3a95474ac159e25c22805107224d478c478169fe88"}
Sep 06 00:59:40.818033 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:40.818015    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-qn5w5"
Sep 06 00:59:40.833706 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:40.833665    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk" podStartSLOduration=1.7416330279999999 podStartE2EDuration="2.833650644s" totalImagesPullingTime="1.092017616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:59:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:59:40.83195054 +0000 UTC m=+538.868093498" watchObservedRunningTime="2026-09-06 00:59:40.833650644 +0000 UTC m=+538.869793600"
Sep 06 00:59:40.847285 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:40.847237    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-859c4d96d6-qn5w5" podStartSLOduration=2.550594269 podStartE2EDuration="3.847222888s" totalImagesPullingTime="1.296628619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:59:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:59:40.846646169 +0000 UTC m=+538.882789127" watchObservedRunningTime="2026-09-06 00:59:40.847222888 +0000 UTC m=+538.883365846"
Sep 06 00:59:51.825050 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:51.825015    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"
Sep 06 00:59:51.825494 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:51.825094    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-qn5w5"
Sep 06 00:59:51.883379 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:51.883339    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-qn5w5"]
Sep 06 00:59:51.883594 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:51.883551    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-859c4d96d6-qn5w5" podUID="ae4935ea-6e36-421e-997a-f39afc374a5c" containerName="limitador" containerID="cri-o://2050618a167a263f8484ec3a95474ac159e25c22805107224d478c478169fe88" gracePeriod=30
Sep 06 00:59:52.825691 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:52.825664    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-qn5w5"
Sep 06 00:59:52.875460 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:52.875418    2577 generic.go:356] "Generic (PLEG): container finished" podID="ae4935ea-6e36-421e-997a-f39afc374a5c" containerID="2050618a167a263f8484ec3a95474ac159e25c22805107224d478c478169fe88" exitCode=0
Sep 06 00:59:52.875614 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:52.875468    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-qn5w5"
Sep 06 00:59:52.875614 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:52.875488    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-qn5w5" event={"ID":"ae4935ea-6e36-421e-997a-f39afc374a5c","Type":"ContainerDied","Data":"2050618a167a263f8484ec3a95474ac159e25c22805107224d478c478169fe88"}
Sep 06 00:59:52.875614 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:52.875540    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-qn5w5" event={"ID":"ae4935ea-6e36-421e-997a-f39afc374a5c","Type":"ContainerDied","Data":"0fac632c589d7b72454685d274ecadd8683533be5fdc6934aed6d19fc25a8b8c"}
Sep 06 00:59:52.875614 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:52.875569    2577 scope.go:117] "RemoveContainer" containerID="2050618a167a263f8484ec3a95474ac159e25c22805107224d478c478169fe88"
Sep 06 00:59:52.884016 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:52.883999    2577 scope.go:117] "RemoveContainer" containerID="2050618a167a263f8484ec3a95474ac159e25c22805107224d478c478169fe88"
Sep 06 00:59:52.884304 ip-10-0-140-57 kubenswrapper[2577]: E0906 00:59:52.884285    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2050618a167a263f8484ec3a95474ac159e25c22805107224d478c478169fe88\": container with ID starting with 2050618a167a263f8484ec3a95474ac159e25c22805107224d478c478169fe88 not found: ID does not exist" containerID="2050618a167a263f8484ec3a95474ac159e25c22805107224d478c478169fe88"
Sep 06 00:59:52.884404 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:52.884352    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2050618a167a263f8484ec3a95474ac159e25c22805107224d478c478169fe88"} err="failed to get container status \"2050618a167a263f8484ec3a95474ac159e25c22805107224d478c478169fe88\": rpc error: code = NotFound desc = could not find container \"2050618a167a263f8484ec3a95474ac159e25c22805107224d478c478169fe88\": container with ID starting with 2050618a167a263f8484ec3a95474ac159e25c22805107224d478c478169fe88 not found: ID does not exist"
Sep 06 00:59:52.995555 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:52.995469    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ae4935ea-6e36-421e-997a-f39afc374a5c-config-file\") pod \"ae4935ea-6e36-421e-997a-f39afc374a5c\" (UID: \"ae4935ea-6e36-421e-997a-f39afc374a5c\") "
Sep 06 00:59:52.995555 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:52.995513    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbkmf\" (UniqueName: \"kubernetes.io/projected/ae4935ea-6e36-421e-997a-f39afc374a5c-kube-api-access-wbkmf\") pod \"ae4935ea-6e36-421e-997a-f39afc374a5c\" (UID: \"ae4935ea-6e36-421e-997a-f39afc374a5c\") "
Sep 06 00:59:52.995822 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:52.995802    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae4935ea-6e36-421e-997a-f39afc374a5c-config-file" (OuterVolumeSpecName: "config-file") pod "ae4935ea-6e36-421e-997a-f39afc374a5c" (UID: "ae4935ea-6e36-421e-997a-f39afc374a5c"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 00:59:52.997754 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:52.997734    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae4935ea-6e36-421e-997a-f39afc374a5c-kube-api-access-wbkmf" (OuterVolumeSpecName: "kube-api-access-wbkmf") pod "ae4935ea-6e36-421e-997a-f39afc374a5c" (UID: "ae4935ea-6e36-421e-997a-f39afc374a5c"). InnerVolumeSpecName "kube-api-access-wbkmf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 00:59:53.096619 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:53.096583    2577 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ae4935ea-6e36-421e-997a-f39afc374a5c-config-file\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:59:53.096619 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:53.096611    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbkmf\" (UniqueName: \"kubernetes.io/projected/ae4935ea-6e36-421e-997a-f39afc374a5c-kube-api-access-wbkmf\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 00:59:53.217303 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:53.217270    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-qn5w5"]
Sep 06 00:59:53.222281 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:53.222256    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-qn5w5"]
Sep 06 00:59:53.672060 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:53.672033    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-mrtrr"]
Sep 06 00:59:53.672503 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:53.672485    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae4935ea-6e36-421e-997a-f39afc374a5c" containerName="limitador"
Sep 06 00:59:53.672503 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:53.672502    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae4935ea-6e36-421e-997a-f39afc374a5c" containerName="limitador"
Sep 06 00:59:53.672657 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:53.672583    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae4935ea-6e36-421e-997a-f39afc374a5c" containerName="limitador"
Sep 06 00:59:53.676889 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:53.676869    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mrtrr"
Sep 06 00:59:53.679315 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:53.679292    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 06 00:59:53.679315 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:53.679303    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 06 00:59:53.679484 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:53.679341    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-hzllx\""
Sep 06 00:59:53.680037 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:53.680018    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 06 00:59:53.682828 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:53.682808    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-mrtrr"]
Sep 06 00:59:53.802946 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:53.802902    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3698e84d-ad0a-4e99-a0df-6c87f8c47f93-data\") pod \"postgres-69fb4594cf-mrtrr\" (UID: \"3698e84d-ad0a-4e99-a0df-6c87f8c47f93\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mrtrr"
Sep 06 00:59:53.802946 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:53.802954    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl8kt\" (UniqueName: \"kubernetes.io/projected/3698e84d-ad0a-4e99-a0df-6c87f8c47f93-kube-api-access-cl8kt\") pod \"postgres-69fb4594cf-mrtrr\" (UID: \"3698e84d-ad0a-4e99-a0df-6c87f8c47f93\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mrtrr"
Sep 06 00:59:53.904201 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:53.904155    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3698e84d-ad0a-4e99-a0df-6c87f8c47f93-data\") pod \"postgres-69fb4594cf-mrtrr\" (UID: \"3698e84d-ad0a-4e99-a0df-6c87f8c47f93\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mrtrr"
Sep 06 00:59:53.904614 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:53.904222    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl8kt\" (UniqueName: \"kubernetes.io/projected/3698e84d-ad0a-4e99-a0df-6c87f8c47f93-kube-api-access-cl8kt\") pod \"postgres-69fb4594cf-mrtrr\" (UID: \"3698e84d-ad0a-4e99-a0df-6c87f8c47f93\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mrtrr"
Sep 06 00:59:53.904614 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:53.904562    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3698e84d-ad0a-4e99-a0df-6c87f8c47f93-data\") pod \"postgres-69fb4594cf-mrtrr\" (UID: \"3698e84d-ad0a-4e99-a0df-6c87f8c47f93\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mrtrr"
Sep 06 00:59:53.912537 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:53.912517    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl8kt\" (UniqueName: \"kubernetes.io/projected/3698e84d-ad0a-4e99-a0df-6c87f8c47f93-kube-api-access-cl8kt\") pod \"postgres-69fb4594cf-mrtrr\" (UID: \"3698e84d-ad0a-4e99-a0df-6c87f8c47f93\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mrtrr"
Sep 06 00:59:53.989594 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:53.989508    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mrtrr"
Sep 06 00:59:54.258778 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:54.258701    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-mrtrr"]
Sep 06 00:59:54.262428 ip-10-0-140-57 kubenswrapper[2577]: W0906 00:59:54.262393    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3698e84d_ad0a_4e99_a0df_6c87f8c47f93.slice/crio-9b1f482d620b1d48e7505cd1c65b15a5f7e5cc9c525d7fce16f3a67a0104d6b9 WatchSource:0}: Error finding container 9b1f482d620b1d48e7505cd1c65b15a5f7e5cc9c525d7fce16f3a67a0104d6b9: Status 404 returned error can't find the container with id 9b1f482d620b1d48e7505cd1c65b15a5f7e5cc9c525d7fce16f3a67a0104d6b9
Sep 06 00:59:54.410152 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:54.410122    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae4935ea-6e36-421e-997a-f39afc374a5c" path="/var/lib/kubelet/pods/ae4935ea-6e36-421e-997a-f39afc374a5c/volumes"
Sep 06 00:59:54.890006 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:54.889969    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mrtrr" event={"ID":"3698e84d-ad0a-4e99-a0df-6c87f8c47f93","Type":"ContainerStarted","Data":"9b1f482d620b1d48e7505cd1c65b15a5f7e5cc9c525d7fce16f3a67a0104d6b9"}
Sep 06 00:59:59.923380 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:59.923345    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mrtrr" event={"ID":"3698e84d-ad0a-4e99-a0df-6c87f8c47f93","Type":"ContainerStarted","Data":"a9d22a2d9b603b1fabc3f44df4ca65b0ed0d201ecbcbcc948f5c56aab94c51bf"}
Sep 06 00:59:59.923775 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:59.923526    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mrtrr"
Sep 06 00:59:59.941065 ip-10-0-140-57 kubenswrapper[2577]: I0906 00:59:59.940988    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mrtrr" podStartSLOduration=2.278490867 podStartE2EDuration="6.940973582s" totalImagesPullingTime="4.662482715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 00:59:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 00:59:59.939554324 +0000 UTC m=+557.975697283" watchObservedRunningTime="2026-09-06 00:59:59.940973582 +0000 UTC m=+557.977116593"
Sep 06 01:00:05.957836 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:05.957806    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mrtrr"
Sep 06 01:00:06.513463 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:06.513433    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-h6nv8"]
Sep 06 01:00:06.516972 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:06.516949    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-h6nv8"
Sep 06 01:00:06.519104 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:06.519081    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-pq2qr\""
Sep 06 01:00:06.521624 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:06.521502    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnrw4\" (UniqueName: \"kubernetes.io/projected/6996bb72-e08d-424e-8a33-7049a478844b-kube-api-access-gnrw4\") pod \"authorino-5dc7ccb5f-h6nv8\" (UID: \"6996bb72-e08d-424e-8a33-7049a478844b\") " pod="kuadrant-system/authorino-5dc7ccb5f-h6nv8"
Sep 06 01:00:06.524440 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:06.524305    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-h6nv8"]
Sep 06 01:00:06.622224 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:06.622188    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnrw4\" (UniqueName: \"kubernetes.io/projected/6996bb72-e08d-424e-8a33-7049a478844b-kube-api-access-gnrw4\") pod \"authorino-5dc7ccb5f-h6nv8\" (UID: \"6996bb72-e08d-424e-8a33-7049a478844b\") " pod="kuadrant-system/authorino-5dc7ccb5f-h6nv8"
Sep 06 01:00:06.631011 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:06.630982    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnrw4\" (UniqueName: \"kubernetes.io/projected/6996bb72-e08d-424e-8a33-7049a478844b-kube-api-access-gnrw4\") pod \"authorino-5dc7ccb5f-h6nv8\" (UID: \"6996bb72-e08d-424e-8a33-7049a478844b\") " pod="kuadrant-system/authorino-5dc7ccb5f-h6nv8"
Sep 06 01:00:06.751845 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:06.751811    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-h6nv8"]
Sep 06 01:00:06.752084 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:06.752072    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-h6nv8"
Sep 06 01:00:06.891493 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:06.891458    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-66855f56bd-w8pbj"]
Sep 06 01:00:06.895191 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:06.895160    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66855f56bd-w8pbj"
Sep 06 01:00:06.897617 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:06.897593    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 06 01:00:06.903041 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:06.903015    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66855f56bd-w8pbj"]
Sep 06 01:00:06.925090 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:06.925055    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3882567c-3a8d-4a81-bb65-08a58c10edaf-tls-cert\") pod \"authorino-66855f56bd-w8pbj\" (UID: \"3882567c-3a8d-4a81-bb65-08a58c10edaf\") " pod="kuadrant-system/authorino-66855f56bd-w8pbj"
Sep 06 01:00:06.925265 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:06.925163    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcxdj\" (UniqueName: \"kubernetes.io/projected/3882567c-3a8d-4a81-bb65-08a58c10edaf-kube-api-access-dcxdj\") pod \"authorino-66855f56bd-w8pbj\" (UID: \"3882567c-3a8d-4a81-bb65-08a58c10edaf\") " pod="kuadrant-system/authorino-66855f56bd-w8pbj"
Sep 06 01:00:07.025187 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:07.025158    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-h6nv8"]
Sep 06 01:00:07.025614 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:07.025590    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3882567c-3a8d-4a81-bb65-08a58c10edaf-tls-cert\") pod \"authorino-66855f56bd-w8pbj\" (UID: \"3882567c-3a8d-4a81-bb65-08a58c10edaf\") " pod="kuadrant-system/authorino-66855f56bd-w8pbj"
Sep 06 01:00:07.025662 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:07.025654    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcxdj\" (UniqueName: \"kubernetes.io/projected/3882567c-3a8d-4a81-bb65-08a58c10edaf-kube-api-access-dcxdj\") pod \"authorino-66855f56bd-w8pbj\" (UID: \"3882567c-3a8d-4a81-bb65-08a58c10edaf\") " pod="kuadrant-system/authorino-66855f56bd-w8pbj"
Sep 06 01:00:07.028197 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:07.028172    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3882567c-3a8d-4a81-bb65-08a58c10edaf-tls-cert\") pod \"authorino-66855f56bd-w8pbj\" (UID: \"3882567c-3a8d-4a81-bb65-08a58c10edaf\") " pod="kuadrant-system/authorino-66855f56bd-w8pbj"
Sep 06 01:00:07.028347 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:00:07.028216    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6996bb72_e08d_424e_8a33_7049a478844b.slice/crio-f31c2dd8e208e6ad0eb223f7c7890bf627fac43ed79ff8322def2a0a0f105b7f WatchSource:0}: Error finding container f31c2dd8e208e6ad0eb223f7c7890bf627fac43ed79ff8322def2a0a0f105b7f: Status 404 returned error can't find the container with id f31c2dd8e208e6ad0eb223f7c7890bf627fac43ed79ff8322def2a0a0f105b7f
Sep 06 01:00:07.033796 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:07.033774    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcxdj\" (UniqueName: \"kubernetes.io/projected/3882567c-3a8d-4a81-bb65-08a58c10edaf-kube-api-access-dcxdj\") pod \"authorino-66855f56bd-w8pbj\" (UID: \"3882567c-3a8d-4a81-bb65-08a58c10edaf\") " pod="kuadrant-system/authorino-66855f56bd-w8pbj"
Sep 06 01:00:07.206951 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:07.206907    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66855f56bd-w8pbj"
Sep 06 01:00:07.479664 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:07.479641    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66855f56bd-w8pbj"]
Sep 06 01:00:07.481789 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:00:07.481759    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3882567c_3a8d_4a81_bb65_08a58c10edaf.slice/crio-a83c81f0e94915dec24bb4698b41cd6fd622dae74da324ea98f94dccc49f6fc7 WatchSource:0}: Error finding container a83c81f0e94915dec24bb4698b41cd6fd622dae74da324ea98f94dccc49f6fc7: Status 404 returned error can't find the container with id a83c81f0e94915dec24bb4698b41cd6fd622dae74da324ea98f94dccc49f6fc7
Sep 06 01:00:07.966428 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:07.966362    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-h6nv8" event={"ID":"6996bb72-e08d-424e-8a33-7049a478844b","Type":"ContainerStarted","Data":"f31c2dd8e208e6ad0eb223f7c7890bf627fac43ed79ff8322def2a0a0f105b7f"}
Sep 06 01:00:07.968131 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:07.968102    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66855f56bd-w8pbj" event={"ID":"3882567c-3a8d-4a81-bb65-08a58c10edaf","Type":"ContainerStarted","Data":"a83c81f0e94915dec24bb4698b41cd6fd622dae74da324ea98f94dccc49f6fc7"}
Sep 06 01:00:09.981307 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:09.981269    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-h6nv8" event={"ID":"6996bb72-e08d-424e-8a33-7049a478844b","Type":"ContainerStarted","Data":"cf3588950336a1454fdcbe05d2f82d468ce5150072ca3019e193e50246a3683f"}
Sep 06 01:00:09.981829 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:09.981315    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5dc7ccb5f-h6nv8" podUID="6996bb72-e08d-424e-8a33-7049a478844b" containerName="authorino" containerID="cri-o://cf3588950336a1454fdcbe05d2f82d468ce5150072ca3019e193e50246a3683f" gracePeriod=30
Sep 06 01:00:09.982951 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:09.982926    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66855f56bd-w8pbj" event={"ID":"3882567c-3a8d-4a81-bb65-08a58c10edaf","Type":"ContainerStarted","Data":"e68526b95d05362bf90f3ecf6dec0f8814dc2f467d66a3b37241510fe5f5b78c"}
Sep 06 01:00:09.998037 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:09.997994    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5dc7ccb5f-h6nv8" podStartSLOduration=1.766881421 podStartE2EDuration="3.99797976s" totalImagesPullingTime="2.231098339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:00:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:00:09.995928757 +0000 UTC m=+568.032071715" watchObservedRunningTime="2026-09-06 01:00:09.99797976 +0000 UTC m=+568.034122718"
Sep 06 01:00:10.010229 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:10.010187    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-66855f56bd-w8pbj" podStartSLOduration=2.2215479240000002 podStartE2EDuration="4.010172033s" totalImagesPullingTime="1.788624109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:00:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:00:10.009619298 +0000 UTC m=+568.045762259" watchObservedRunningTime="2026-09-06 01:00:10.010172033 +0000 UTC m=+568.046314990"
Sep 06 01:00:10.223433 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:10.223411    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-h6nv8"
Sep 06 01:00:10.255628 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:10.255548    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gnrw4\" (UniqueName: \"kubernetes.io/projected/6996bb72-e08d-424e-8a33-7049a478844b-kube-api-access-gnrw4\") pod \"6996bb72-e08d-424e-8a33-7049a478844b\" (UID: \"6996bb72-e08d-424e-8a33-7049a478844b\") "
Sep 06 01:00:10.257685 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:10.257661    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6996bb72-e08d-424e-8a33-7049a478844b-kube-api-access-gnrw4" (OuterVolumeSpecName: "kube-api-access-gnrw4") pod "6996bb72-e08d-424e-8a33-7049a478844b" (UID: "6996bb72-e08d-424e-8a33-7049a478844b"). InnerVolumeSpecName "kube-api-access-gnrw4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:00:10.357097 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:10.357049    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gnrw4\" (UniqueName: \"kubernetes.io/projected/6996bb72-e08d-424e-8a33-7049a478844b-kube-api-access-gnrw4\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:00:10.989586 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:10.989550    2577 generic.go:356] "Generic (PLEG): container finished" podID="6996bb72-e08d-424e-8a33-7049a478844b" containerID="cf3588950336a1454fdcbe05d2f82d468ce5150072ca3019e193e50246a3683f" exitCode=0
Sep 06 01:00:10.990031 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:10.989598    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-h6nv8"
Sep 06 01:00:10.990031 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:10.989639    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-h6nv8" event={"ID":"6996bb72-e08d-424e-8a33-7049a478844b","Type":"ContainerDied","Data":"cf3588950336a1454fdcbe05d2f82d468ce5150072ca3019e193e50246a3683f"}
Sep 06 01:00:10.990031 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:10.989692    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-h6nv8" event={"ID":"6996bb72-e08d-424e-8a33-7049a478844b","Type":"ContainerDied","Data":"f31c2dd8e208e6ad0eb223f7c7890bf627fac43ed79ff8322def2a0a0f105b7f"}
Sep 06 01:00:10.990031 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:10.989716    2577 scope.go:117] "RemoveContainer" containerID="cf3588950336a1454fdcbe05d2f82d468ce5150072ca3019e193e50246a3683f"
Sep 06 01:00:10.998705 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:10.998683    2577 scope.go:117] "RemoveContainer" containerID="cf3588950336a1454fdcbe05d2f82d468ce5150072ca3019e193e50246a3683f"
Sep 06 01:00:10.998972 ip-10-0-140-57 kubenswrapper[2577]: E0906 01:00:10.998953    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf3588950336a1454fdcbe05d2f82d468ce5150072ca3019e193e50246a3683f\": container with ID starting with cf3588950336a1454fdcbe05d2f82d468ce5150072ca3019e193e50246a3683f not found: ID does not exist" containerID="cf3588950336a1454fdcbe05d2f82d468ce5150072ca3019e193e50246a3683f"
Sep 06 01:00:10.999033 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:10.998980    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf3588950336a1454fdcbe05d2f82d468ce5150072ca3019e193e50246a3683f"} err="failed to get container status \"cf3588950336a1454fdcbe05d2f82d468ce5150072ca3019e193e50246a3683f\": rpc error: code = NotFound desc = could not find container \"cf3588950336a1454fdcbe05d2f82d468ce5150072ca3019e193e50246a3683f\": container with ID starting with cf3588950336a1454fdcbe05d2f82d468ce5150072ca3019e193e50246a3683f not found: ID does not exist"
Sep 06 01:00:11.004464 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:11.004443    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-h6nv8"]
Sep 06 01:00:11.010451 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:11.010432    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-h6nv8"]
Sep 06 01:00:12.410227 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:12.410191    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6996bb72-e08d-424e-8a33-7049a478844b" path="/var/lib/kubelet/pods/6996bb72-e08d-424e-8a33-7049a478844b/volumes"
Sep 06 01:00:42.363265 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:42.363239    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2z66_e100e633-d18a-4d68-9c81-0ff379c12d2f/ovn-acl-logging/0.log"
Sep 06 01:00:42.363856 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:42.363678    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2z66_e100e633-d18a-4d68-9c81-0ff379c12d2f/ovn-acl-logging/0.log"
Sep 06 01:00:50.799751 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:50.799715    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-zt47h"]
Sep 06 01:00:50.800142 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:50.800128    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6996bb72-e08d-424e-8a33-7049a478844b" containerName="authorino"
Sep 06 01:00:50.800185 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:50.800144    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6996bb72-e08d-424e-8a33-7049a478844b" containerName="authorino"
Sep 06 01:00:50.800228 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:50.800219    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6996bb72-e08d-424e-8a33-7049a478844b" containerName="authorino"
Sep 06 01:00:50.806801 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:50.806769    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zt47h"
Sep 06 01:00:50.811487 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:50.811462    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 06 01:00:50.817175 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:50.817121    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-zt47h"]
Sep 06 01:00:50.826081 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:50.826045    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:00:50.827557 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:50.827527    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fcnb\" (UniqueName: \"kubernetes.io/projected/b04e7bbd-93f4-4e03-a4c4-734ae28721c4-kube-api-access-7fcnb\") pod \"payload-pre-processing-59fbc47bf8-zt47h\" (UID: \"b04e7bbd-93f4-4e03-a4c4-734ae28721c4\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zt47h"
Sep 06 01:00:50.827671 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:50.827650    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b04e7bbd-93f4-4e03-a4c4-734ae28721c4-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-zt47h\" (UID: \"b04e7bbd-93f4-4e03-a4c4-734ae28721c4\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zt47h"
Sep 06 01:00:50.928274 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:50.928233    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b04e7bbd-93f4-4e03-a4c4-734ae28721c4-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-zt47h\" (UID: \"b04e7bbd-93f4-4e03-a4c4-734ae28721c4\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zt47h"
Sep 06 01:00:50.928480 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:50.928364    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fcnb\" (UniqueName: \"kubernetes.io/projected/b04e7bbd-93f4-4e03-a4c4-734ae28721c4-kube-api-access-7fcnb\") pod \"payload-pre-processing-59fbc47bf8-zt47h\" (UID: \"b04e7bbd-93f4-4e03-a4c4-734ae28721c4\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zt47h"
Sep 06 01:00:50.929110 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:50.929080    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b04e7bbd-93f4-4e03-a4c4-734ae28721c4-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-zt47h\" (UID: \"b04e7bbd-93f4-4e03-a4c4-734ae28721c4\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zt47h"
Sep 06 01:00:50.940785 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:50.940730    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fcnb\" (UniqueName: \"kubernetes.io/projected/b04e7bbd-93f4-4e03-a4c4-734ae28721c4-kube-api-access-7fcnb\") pod \"payload-pre-processing-59fbc47bf8-zt47h\" (UID: \"b04e7bbd-93f4-4e03-a4c4-734ae28721c4\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zt47h"
Sep 06 01:00:51.121387 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:51.121024    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zt47h"
Sep 06 01:00:51.394365 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:51.394286    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-zt47h"]
Sep 06 01:00:51.396718 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:00:51.396695    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb04e7bbd_93f4_4e03_a4c4_734ae28721c4.slice/crio-59bf3ab741c07e624321acd7a7ff4f353cdf0f14204bc6980a931114b5d1fe9c WatchSource:0}: Error finding container 59bf3ab741c07e624321acd7a7ff4f353cdf0f14204bc6980a931114b5d1fe9c: Status 404 returned error can't find the container with id 59bf3ab741c07e624321acd7a7ff4f353cdf0f14204bc6980a931114b5d1fe9c
Sep 06 01:00:52.194759 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:52.194681    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zt47h" event={"ID":"b04e7bbd-93f4-4e03-a4c4-734ae28721c4","Type":"ContainerStarted","Data":"59bf3ab741c07e624321acd7a7ff4f353cdf0f14204bc6980a931114b5d1fe9c"}
Sep 06 01:00:54.207592 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:54.207552    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zt47h" event={"ID":"b04e7bbd-93f4-4e03-a4c4-734ae28721c4","Type":"ContainerStarted","Data":"52350aa2207d8ccf72e2b2b739ca65193d67007a65016006606607710c63f920"}
Sep 06 01:00:54.208060 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:54.207721    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zt47h"
Sep 06 01:00:54.226131 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:00:54.226060    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zt47h" podStartSLOduration=2.128448624 podStartE2EDuration="4.226039182s" totalImagesPullingTime="2.097590558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:00:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:00:54.224024734 +0000 UTC m=+612.260167693" watchObservedRunningTime="2026-09-06 01:00:54.226039182 +0000 UTC m=+612.262182138"
Sep 06 01:01:00.245958 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:00.245929    2577 generic.go:356] "Generic (PLEG): container finished" podID="008a77a0-2765-4ab1-ac54-70ba224c7ad2" containerID="88afabf366076ef7d30f42ef74896fcc8f5f06b66782a28387efa5644cdf5f5d" exitCode=0
Sep 06 01:01:00.246296 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:00.245997    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9" event={"ID":"008a77a0-2765-4ab1-ac54-70ba224c7ad2","Type":"ContainerDied","Data":"88afabf366076ef7d30f42ef74896fcc8f5f06b66782a28387efa5644cdf5f5d"}
Sep 06 01:01:00.246367 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:00.246360    2577 scope.go:117] "RemoveContainer" containerID="88afabf366076ef7d30f42ef74896fcc8f5f06b66782a28387efa5644cdf5f5d"
Sep 06 01:01:00.247394 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:00.247367    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:01:00.247497 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:00.247450    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:01:00.247557 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:00.247502    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:01:01.252387 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:01.252353    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9" event={"ID":"008a77a0-2765-4ab1-ac54-70ba224c7ad2","Type":"ContainerStarted","Data":"6503d5e535b26aa8717551c1e5055f2474ce36ff0b17958d356a3cfd1fee9993"}
Sep 06 01:01:01.462689 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:01.462648    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9"
Sep 06 01:01:01.463799 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:01.463771    2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-4gqt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 06 01:01:01.463930 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:01.463841    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9" podUID="008a77a0-2765-4ab1-ac54-70ba224c7ad2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 06 01:01:01.767630 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:01.767592    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9"
Sep 06 01:01:02.463031 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:02.462993    2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-4gqt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 06 01:01:02.463455 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:02.463050    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9" podUID="008a77a0-2765-4ab1-ac54-70ba224c7ad2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 06 01:01:03.462667 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:03.462631    2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-4gqt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 06 01:01:03.462844 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:03.462691    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9" podUID="008a77a0-2765-4ab1-ac54-70ba224c7ad2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 06 01:01:04.462287 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:04.462246    2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-4gqt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 06 01:01:04.462803 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:04.462301    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9" podUID="008a77a0-2765-4ab1-ac54-70ba224c7ad2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 06 01:01:05.218536 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:05.218496    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-zt47h"
Sep 06 01:01:05.462176 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:05.462141    2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-4gqt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 06 01:01:05.462358 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:05.462198    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9" podUID="008a77a0-2765-4ab1-ac54-70ba224c7ad2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 06 01:01:06.462101 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:06.462055    2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-4gqt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 06 01:01:06.462296 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:06.462117    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9" podUID="008a77a0-2765-4ab1-ac54-70ba224c7ad2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 06 01:01:07.466133 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:07.466108    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9"
Sep 06 01:01:07.467081 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:07.467065    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4gqt9"
Sep 06 01:01:10.881588 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:10.881552    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:01:16.853564 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:16.853523    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-54mtt"]
Sep 06 01:01:16.857957 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:16.857934    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-54mtt"
Sep 06 01:01:16.861120 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:16.861094    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 06 01:01:16.861257 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:16.861181    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-pg77g\""
Sep 06 01:01:16.861257 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:16.861143    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 06 01:01:16.861409 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:16.861101    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 06 01:01:16.868936 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:16.868911    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-54mtt"]
Sep 06 01:01:16.973375 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:16.973310    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fl9pm\" (UniqueName: \"kubernetes.io/projected/f9ae5185-76f3-433b-9a1e-d3916d71d025-kube-api-access-fl9pm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-54mtt\" (UID: \"f9ae5185-76f3-433b-9a1e-d3916d71d025\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-54mtt"
Sep 06 01:01:16.973570 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:16.973397    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9ae5185-76f3-433b-9a1e-d3916d71d025-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-54mtt\" (UID: \"f9ae5185-76f3-433b-9a1e-d3916d71d025\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-54mtt"
Sep 06 01:01:16.973570 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:16.973437    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9ae5185-76f3-433b-9a1e-d3916d71d025-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-54mtt\" (UID: \"f9ae5185-76f3-433b-9a1e-d3916d71d025\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-54mtt"
Sep 06 01:01:16.973570 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:16.973464    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9ae5185-76f3-433b-9a1e-d3916d71d025-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-54mtt\" (UID: \"f9ae5185-76f3-433b-9a1e-d3916d71d025\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-54mtt"
Sep 06 01:01:16.973570 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:16.973524    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9ae5185-76f3-433b-9a1e-d3916d71d025-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-54mtt\" (UID: \"f9ae5185-76f3-433b-9a1e-d3916d71d025\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-54mtt"
Sep 06 01:01:16.973729 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:16.973573    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9ae5185-76f3-433b-9a1e-d3916d71d025-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-54mtt\" (UID: \"f9ae5185-76f3-433b-9a1e-d3916d71d025\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-54mtt"
Sep 06 01:01:17.074262 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:17.074229    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl9pm\" (UniqueName: \"kubernetes.io/projected/f9ae5185-76f3-433b-9a1e-d3916d71d025-kube-api-access-fl9pm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-54mtt\" (UID: \"f9ae5185-76f3-433b-9a1e-d3916d71d025\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-54mtt"
Sep 06 01:01:17.074457 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:17.074279    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9ae5185-76f3-433b-9a1e-d3916d71d025-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-54mtt\" (UID: \"f9ae5185-76f3-433b-9a1e-d3916d71d025\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-54mtt"
Sep 06 01:01:17.074457 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:17.074376    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9ae5185-76f3-433b-9a1e-d3916d71d025-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-54mtt\" (UID: \"f9ae5185-76f3-433b-9a1e-d3916d71d025\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-54mtt"
Sep 06 01:01:17.074457 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:17.074424    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9ae5185-76f3-433b-9a1e-d3916d71d025-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-54mtt\" (UID: \"f9ae5185-76f3-433b-9a1e-d3916d71d025\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-54mtt"
Sep 06 01:01:17.074566 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:17.074471    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9ae5185-76f3-433b-9a1e-d3916d71d025-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-54mtt\" (UID: \"f9ae5185-76f3-433b-9a1e-d3916d71d025\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-54mtt"
Sep 06 01:01:17.074646 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:17.074626    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9ae5185-76f3-433b-9a1e-d3916d71d025-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-54mtt\" (UID: \"f9ae5185-76f3-433b-9a1e-d3916d71d025\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-54mtt"
Sep 06 01:01:17.074709 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:17.074692    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9ae5185-76f3-433b-9a1e-d3916d71d025-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-54mtt\" (UID: \"f9ae5185-76f3-433b-9a1e-d3916d71d025\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-54mtt"
Sep 06 01:01:17.074862 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:17.074839    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9ae5185-76f3-433b-9a1e-d3916d71d025-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-54mtt\" (UID: \"f9ae5185-76f3-433b-9a1e-d3916d71d025\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-54mtt"
Sep 06 01:01:17.074939 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:17.074877    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9ae5185-76f3-433b-9a1e-d3916d71d025-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-54mtt\" (UID: \"f9ae5185-76f3-433b-9a1e-d3916d71d025\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-54mtt"
Sep 06 01:01:17.076767 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:17.076746    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9ae5185-76f3-433b-9a1e-d3916d71d025-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-54mtt\" (UID: \"f9ae5185-76f3-433b-9a1e-d3916d71d025\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-54mtt"
Sep 06 01:01:17.077035 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:17.077016    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9ae5185-76f3-433b-9a1e-d3916d71d025-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-54mtt\" (UID: \"f9ae5185-76f3-433b-9a1e-d3916d71d025\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-54mtt"
Sep 06 01:01:17.083543 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:17.083524    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl9pm\" (UniqueName: \"kubernetes.io/projected/f9ae5185-76f3-433b-9a1e-d3916d71d025-kube-api-access-fl9pm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-54mtt\" (UID: \"f9ae5185-76f3-433b-9a1e-d3916d71d025\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-54mtt"
Sep 06 01:01:17.171706 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:17.171677    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-54mtt"
Sep 06 01:01:17.443531 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:17.443450    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-54mtt"]
Sep 06 01:01:17.448308 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:01:17.448282    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9ae5185_76f3_433b_9a1e_d3916d71d025.slice/crio-980452db2a571ac463a35f4d33710b17aec54ac4b710210931386558d3accfc4 WatchSource:0}: Error finding container 980452db2a571ac463a35f4d33710b17aec54ac4b710210931386558d3accfc4: Status 404 returned error can't find the container with id 980452db2a571ac463a35f4d33710b17aec54ac4b710210931386558d3accfc4
Sep 06 01:01:17.613535 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:17.613487    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:01:18.343363 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:18.343291    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-54mtt" event={"ID":"f9ae5185-76f3-433b-9a1e-d3916d71d025","Type":"ContainerStarted","Data":"980452db2a571ac463a35f4d33710b17aec54ac4b710210931386558d3accfc4"}
Sep 06 01:01:19.350338 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:19.350299    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-54mtt" event={"ID":"f9ae5185-76f3-433b-9a1e-d3916d71d025","Type":"ContainerStarted","Data":"803079ead1e9e373a14ddbe83fb5ab825fd0bceef13dfe7d46d81545ad5c67eb"}
Sep 06 01:01:19.369484 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:19.369420    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-54mtt" podStartSLOduration=2.2770494279999998 podStartE2EDuration="3.369402911s" totalImagesPullingTime="1.092353483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:01:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:01:19.367011578 +0000 UTC m=+637.403154536" watchObservedRunningTime="2026-09-06 01:01:19.369402911 +0000 UTC m=+637.405545868"
Sep 06 01:01:27.172234 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:27.172199    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-54mtt"
Sep 06 01:01:27.172631 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:27.172267    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-54mtt"
Sep 06 01:01:27.184456 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:27.184436    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-54mtt"
Sep 06 01:01:27.401163 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:27.401133    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-54mtt"
Sep 06 01:01:42.562965 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:42.562921    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:01:53.765565 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:01:53.765529    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:02:00.961847 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:00.961817    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2"]
Sep 06 01:02:00.965163 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:00.965144    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2"
Sep 06 01:02:00.967551 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:00.967533    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 06 01:02:00.975610 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:00.975589    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2"]
Sep 06 01:02:01.074752 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:01.074712    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9hbv\" (UniqueName: \"kubernetes.io/projected/c2b63864-a518-4d3f-9936-8d815c876ff2-kube-api-access-m9hbv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2\" (UID: \"c2b63864-a518-4d3f-9936-8d815c876ff2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2"
Sep 06 01:02:01.074752 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:01.074753    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2b63864-a518-4d3f-9936-8d815c876ff2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2\" (UID: \"c2b63864-a518-4d3f-9936-8d815c876ff2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2"
Sep 06 01:02:01.074988 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:01.074836    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2b63864-a518-4d3f-9936-8d815c876ff2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2\" (UID: \"c2b63864-a518-4d3f-9936-8d815c876ff2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2"
Sep 06 01:02:01.074988 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:01.074884    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2b63864-a518-4d3f-9936-8d815c876ff2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2\" (UID: \"c2b63864-a518-4d3f-9936-8d815c876ff2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2"
Sep 06 01:02:01.074988 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:01.074903    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2b63864-a518-4d3f-9936-8d815c876ff2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2\" (UID: \"c2b63864-a518-4d3f-9936-8d815c876ff2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2"
Sep 06 01:02:01.074988 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:01.074930    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2b63864-a518-4d3f-9936-8d815c876ff2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2\" (UID: \"c2b63864-a518-4d3f-9936-8d815c876ff2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2"
Sep 06 01:02:01.175710 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:01.175674    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2b63864-a518-4d3f-9936-8d815c876ff2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2\" (UID: \"c2b63864-a518-4d3f-9936-8d815c876ff2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2"
Sep 06 01:02:01.175710 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:01.175712    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2b63864-a518-4d3f-9936-8d815c876ff2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2\" (UID: \"c2b63864-a518-4d3f-9936-8d815c876ff2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2"
Sep 06 01:02:01.175921 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:01.175748    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2b63864-a518-4d3f-9936-8d815c876ff2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2\" (UID: \"c2b63864-a518-4d3f-9936-8d815c876ff2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2"
Sep 06 01:02:01.175921 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:01.175821    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9hbv\" (UniqueName: \"kubernetes.io/projected/c2b63864-a518-4d3f-9936-8d815c876ff2-kube-api-access-m9hbv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2\" (UID: \"c2b63864-a518-4d3f-9936-8d815c876ff2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2"
Sep 06 01:02:01.175921 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:01.175851    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2b63864-a518-4d3f-9936-8d815c876ff2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2\" (UID: \"c2b63864-a518-4d3f-9936-8d815c876ff2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2"
Sep 06 01:02:01.175921 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:01.175907    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2b63864-a518-4d3f-9936-8d815c876ff2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2\" (UID: \"c2b63864-a518-4d3f-9936-8d815c876ff2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2"
Sep 06 01:02:01.176236 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:01.176211    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2b63864-a518-4d3f-9936-8d815c876ff2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2\" (UID: \"c2b63864-a518-4d3f-9936-8d815c876ff2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2"
Sep 06 01:02:01.176295 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:01.176239    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2b63864-a518-4d3f-9936-8d815c876ff2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2\" (UID: \"c2b63864-a518-4d3f-9936-8d815c876ff2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2"
Sep 06 01:02:01.176295 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:01.176276    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2b63864-a518-4d3f-9936-8d815c876ff2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2\" (UID: \"c2b63864-a518-4d3f-9936-8d815c876ff2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2"
Sep 06 01:02:01.178056 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:01.178036    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2b63864-a518-4d3f-9936-8d815c876ff2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2\" (UID: \"c2b63864-a518-4d3f-9936-8d815c876ff2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2"
Sep 06 01:02:01.178308 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:01.178290    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2b63864-a518-4d3f-9936-8d815c876ff2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2\" (UID: \"c2b63864-a518-4d3f-9936-8d815c876ff2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2"
Sep 06 01:02:01.184211 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:01.184189    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9hbv\" (UniqueName: \"kubernetes.io/projected/c2b63864-a518-4d3f-9936-8d815c876ff2-kube-api-access-m9hbv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2\" (UID: \"c2b63864-a518-4d3f-9936-8d815c876ff2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2"
Sep 06 01:02:01.276597 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:01.276510    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2"
Sep 06 01:02:01.546376 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:01.546352    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2"]
Sep 06 01:02:01.548826 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:02:01.548795    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2b63864_a518_4d3f_9936_8d815c876ff2.slice/crio-ec267027ba50b75b847de28df44927e8d0457359540619ddb9b5f5ff638724c0 WatchSource:0}: Error finding container ec267027ba50b75b847de28df44927e8d0457359540619ddb9b5f5ff638724c0: Status 404 returned error can't find the container with id ec267027ba50b75b847de28df44927e8d0457359540619ddb9b5f5ff638724c0
Sep 06 01:02:01.550221 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:01.550203    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 01:02:01.560581 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:01.560558    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2" event={"ID":"c2b63864-a518-4d3f-9936-8d815c876ff2","Type":"ContainerStarted","Data":"ec267027ba50b75b847de28df44927e8d0457359540619ddb9b5f5ff638724c0"}
Sep 06 01:02:01.869973 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:01.869880    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:02:02.567258 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:02.567215    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2" event={"ID":"c2b63864-a518-4d3f-9936-8d815c876ff2","Type":"ContainerStarted","Data":"d84f85338c85e9aa5693dda64173e3f45fa307c22e77f969719a2cbc5c2a2a56"}
Sep 06 01:02:02.588368 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:02.588301    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2" podStartSLOduration=2.43425188 podStartE2EDuration="2.588283136s" totalImagesPullingTime="154.031256ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:02:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:02:02.58598766 +0000 UTC m=+680.622130617" watchObservedRunningTime="2026-09-06 01:02:02.588283136 +0000 UTC m=+680.624426093"
Sep 06 01:02:10.673614 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:10.673579    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-hvtc5"]
Sep 06 01:02:10.676219 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:10.676199    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvtc5"
Sep 06 01:02:10.678737 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:10.678705    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 06 01:02:10.690374 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:10.690345    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-hvtc5"]
Sep 06 01:02:10.766766 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:10.766727    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/150005cd-9a0c-42e3-a8c9-7b2d1f3aecaa-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hvtc5\" (UID: \"150005cd-9a0c-42e3-a8c9-7b2d1f3aecaa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvtc5"
Sep 06 01:02:10.766766 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:10.766768    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/150005cd-9a0c-42e3-a8c9-7b2d1f3aecaa-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hvtc5\" (UID: \"150005cd-9a0c-42e3-a8c9-7b2d1f3aecaa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvtc5"
Sep 06 01:02:10.767019 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:10.766833    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/150005cd-9a0c-42e3-a8c9-7b2d1f3aecaa-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hvtc5\" (UID: \"150005cd-9a0c-42e3-a8c9-7b2d1f3aecaa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvtc5"
Sep 06 01:02:10.767019 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:10.766897    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/150005cd-9a0c-42e3-a8c9-7b2d1f3aecaa-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hvtc5\" (UID: \"150005cd-9a0c-42e3-a8c9-7b2d1f3aecaa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvtc5"
Sep 06 01:02:10.767019 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:10.766927    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/150005cd-9a0c-42e3-a8c9-7b2d1f3aecaa-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hvtc5\" (UID: \"150005cd-9a0c-42e3-a8c9-7b2d1f3aecaa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvtc5"
Sep 06 01:02:10.767019 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:10.766988    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69tw7\" (UniqueName: \"kubernetes.io/projected/150005cd-9a0c-42e3-a8c9-7b2d1f3aecaa-kube-api-access-69tw7\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hvtc5\" (UID: \"150005cd-9a0c-42e3-a8c9-7b2d1f3aecaa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvtc5"
Sep 06 01:02:10.867996 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:10.867948    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/150005cd-9a0c-42e3-a8c9-7b2d1f3aecaa-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hvtc5\" (UID: \"150005cd-9a0c-42e3-a8c9-7b2d1f3aecaa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvtc5"
Sep 06 01:02:10.867996 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:10.867998    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/150005cd-9a0c-42e3-a8c9-7b2d1f3aecaa-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hvtc5\" (UID: \"150005cd-9a0c-42e3-a8c9-7b2d1f3aecaa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvtc5"
Sep 06 01:02:10.868255 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:10.868034    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69tw7\" (UniqueName: \"kubernetes.io/projected/150005cd-9a0c-42e3-a8c9-7b2d1f3aecaa-kube-api-access-69tw7\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hvtc5\" (UID: \"150005cd-9a0c-42e3-a8c9-7b2d1f3aecaa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvtc5"
Sep 06 01:02:10.868255 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:10.868074    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/150005cd-9a0c-42e3-a8c9-7b2d1f3aecaa-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hvtc5\" (UID: \"150005cd-9a0c-42e3-a8c9-7b2d1f3aecaa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvtc5"
Sep 06 01:02:10.868255 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:10.868094    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/150005cd-9a0c-42e3-a8c9-7b2d1f3aecaa-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hvtc5\" (UID: \"150005cd-9a0c-42e3-a8c9-7b2d1f3aecaa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvtc5"
Sep 06 01:02:10.868255 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:10.868133    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/150005cd-9a0c-42e3-a8c9-7b2d1f3aecaa-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hvtc5\" (UID: \"150005cd-9a0c-42e3-a8c9-7b2d1f3aecaa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvtc5"
Sep 06 01:02:10.868516 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:10.868455    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/150005cd-9a0c-42e3-a8c9-7b2d1f3aecaa-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hvtc5\" (UID: \"150005cd-9a0c-42e3-a8c9-7b2d1f3aecaa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvtc5"
Sep 06 01:02:10.868516 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:10.868490    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/150005cd-9a0c-42e3-a8c9-7b2d1f3aecaa-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hvtc5\" (UID: \"150005cd-9a0c-42e3-a8c9-7b2d1f3aecaa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvtc5"
Sep 06 01:02:10.868589 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:10.868523    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/150005cd-9a0c-42e3-a8c9-7b2d1f3aecaa-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hvtc5\" (UID: \"150005cd-9a0c-42e3-a8c9-7b2d1f3aecaa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvtc5"
Sep 06 01:02:10.870505 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:10.870485    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/150005cd-9a0c-42e3-a8c9-7b2d1f3aecaa-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hvtc5\" (UID: \"150005cd-9a0c-42e3-a8c9-7b2d1f3aecaa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvtc5"
Sep 06 01:02:10.870742 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:10.870726    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/150005cd-9a0c-42e3-a8c9-7b2d1f3aecaa-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hvtc5\" (UID: \"150005cd-9a0c-42e3-a8c9-7b2d1f3aecaa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvtc5"
Sep 06 01:02:10.876339 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:10.876306    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69tw7\" (UniqueName: \"kubernetes.io/projected/150005cd-9a0c-42e3-a8c9-7b2d1f3aecaa-kube-api-access-69tw7\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hvtc5\" (UID: \"150005cd-9a0c-42e3-a8c9-7b2d1f3aecaa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvtc5"
Sep 06 01:02:10.987601 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:10.987521    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvtc5"
Sep 06 01:02:11.262987 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:11.262959    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-hvtc5"]
Sep 06 01:02:11.264709 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:02:11.264685    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod150005cd_9a0c_42e3_a8c9_7b2d1f3aecaa.slice/crio-0c9fbef4d6e99eab4442161e44ac560b2d4ca3069e67081dd7ef859cff7975f8 WatchSource:0}: Error finding container 0c9fbef4d6e99eab4442161e44ac560b2d4ca3069e67081dd7ef859cff7975f8: Status 404 returned error can't find the container with id 0c9fbef4d6e99eab4442161e44ac560b2d4ca3069e67081dd7ef859cff7975f8
Sep 06 01:02:11.276822 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:11.276801    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2"
Sep 06 01:02:11.276925 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:11.276855    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2"
Sep 06 01:02:11.289238 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:11.289220    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2"
Sep 06 01:02:11.618070 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:11.617952    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvtc5" event={"ID":"150005cd-9a0c-42e3-a8c9-7b2d1f3aecaa","Type":"ContainerStarted","Data":"a98c67f53c28fb1a555335d2a157558cc97a580f6c6669b034f7973fe6a3fbc3"}
Sep 06 01:02:11.618070 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:11.618011    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvtc5" event={"ID":"150005cd-9a0c-42e3-a8c9-7b2d1f3aecaa","Type":"ContainerStarted","Data":"0c9fbef4d6e99eab4442161e44ac560b2d4ca3069e67081dd7ef859cff7975f8"}
Sep 06 01:02:11.629525 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:11.629496    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2"
Sep 06 01:02:11.635293 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:11.635239    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvtc5" podStartSLOduration=1.475473192 podStartE2EDuration="1.635221451s" totalImagesPullingTime="159.748259ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:02:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:02:11.634791829 +0000 UTC m=+689.670934788" watchObservedRunningTime="2026-09-06 01:02:11.635221451 +0000 UTC m=+689.671364409"
Sep 06 01:02:12.565885 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:12.565845    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:02:20.988205 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:20.988168    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvtc5"
Sep 06 01:02:20.988581 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:20.988291    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvtc5"
Sep 06 01:02:21.000592 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:21.000566    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvtc5"
Sep 06 01:02:21.687525 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:21.687499    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hvtc5"
Sep 06 01:02:29.170224 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:02:29.170190    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:04:00.218428 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:00.218389    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-66855f56bd-w8pbj"]
Sep 06 01:04:00.219066 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:00.218593    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-66855f56bd-w8pbj" podUID="3882567c-3a8d-4a81-bb65-08a58c10edaf" containerName="authorino" containerID="cri-o://e68526b95d05362bf90f3ecf6dec0f8814dc2f467d66a3b37241510fe5f5b78c" gracePeriod=30
Sep 06 01:04:00.473754 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:00.473693    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66855f56bd-w8pbj"
Sep 06 01:04:00.563174 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:00.563146    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcxdj\" (UniqueName: \"kubernetes.io/projected/3882567c-3a8d-4a81-bb65-08a58c10edaf-kube-api-access-dcxdj\") pod \"3882567c-3a8d-4a81-bb65-08a58c10edaf\" (UID: \"3882567c-3a8d-4a81-bb65-08a58c10edaf\") "
Sep 06 01:04:00.563396 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:00.563199    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3882567c-3a8d-4a81-bb65-08a58c10edaf-tls-cert\") pod \"3882567c-3a8d-4a81-bb65-08a58c10edaf\" (UID: \"3882567c-3a8d-4a81-bb65-08a58c10edaf\") "
Sep 06 01:04:00.565551 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:00.565516    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3882567c-3a8d-4a81-bb65-08a58c10edaf-kube-api-access-dcxdj" (OuterVolumeSpecName: "kube-api-access-dcxdj") pod "3882567c-3a8d-4a81-bb65-08a58c10edaf" (UID: "3882567c-3a8d-4a81-bb65-08a58c10edaf"). InnerVolumeSpecName "kube-api-access-dcxdj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:04:00.574550 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:00.574518    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3882567c-3a8d-4a81-bb65-08a58c10edaf-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "3882567c-3a8d-4a81-bb65-08a58c10edaf" (UID: "3882567c-3a8d-4a81-bb65-08a58c10edaf"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:04:00.664696 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:00.664663    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcxdj\" (UniqueName: \"kubernetes.io/projected/3882567c-3a8d-4a81-bb65-08a58c10edaf-kube-api-access-dcxdj\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:04:00.664696 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:00.664688    2577 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3882567c-3a8d-4a81-bb65-08a58c10edaf-tls-cert\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:04:01.182460 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:01.182424    2577 generic.go:356] "Generic (PLEG): container finished" podID="3882567c-3a8d-4a81-bb65-08a58c10edaf" containerID="e68526b95d05362bf90f3ecf6dec0f8814dc2f467d66a3b37241510fe5f5b78c" exitCode=0
Sep 06 01:04:01.182635 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:01.182469    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66855f56bd-w8pbj"
Sep 06 01:04:01.182635 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:01.182461    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66855f56bd-w8pbj" event={"ID":"3882567c-3a8d-4a81-bb65-08a58c10edaf","Type":"ContainerDied","Data":"e68526b95d05362bf90f3ecf6dec0f8814dc2f467d66a3b37241510fe5f5b78c"}
Sep 06 01:04:01.182635 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:01.182577    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66855f56bd-w8pbj" event={"ID":"3882567c-3a8d-4a81-bb65-08a58c10edaf","Type":"ContainerDied","Data":"a83c81f0e94915dec24bb4698b41cd6fd622dae74da324ea98f94dccc49f6fc7"}
Sep 06 01:04:01.182635 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:01.182593    2577 scope.go:117] "RemoveContainer" containerID="e68526b95d05362bf90f3ecf6dec0f8814dc2f467d66a3b37241510fe5f5b78c"
Sep 06 01:04:01.192051 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:01.192034    2577 scope.go:117] "RemoveContainer" containerID="e68526b95d05362bf90f3ecf6dec0f8814dc2f467d66a3b37241510fe5f5b78c"
Sep 06 01:04:01.192339 ip-10-0-140-57 kubenswrapper[2577]: E0906 01:04:01.192305    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e68526b95d05362bf90f3ecf6dec0f8814dc2f467d66a3b37241510fe5f5b78c\": container with ID starting with e68526b95d05362bf90f3ecf6dec0f8814dc2f467d66a3b37241510fe5f5b78c not found: ID does not exist" containerID="e68526b95d05362bf90f3ecf6dec0f8814dc2f467d66a3b37241510fe5f5b78c"
Sep 06 01:04:01.192399 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:01.192351    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e68526b95d05362bf90f3ecf6dec0f8814dc2f467d66a3b37241510fe5f5b78c"} err="failed to get container status \"e68526b95d05362bf90f3ecf6dec0f8814dc2f467d66a3b37241510fe5f5b78c\": rpc error: code = NotFound desc = could not find container \"e68526b95d05362bf90f3ecf6dec0f8814dc2f467d66a3b37241510fe5f5b78c\": container with ID starting with e68526b95d05362bf90f3ecf6dec0f8814dc2f467d66a3b37241510fe5f5b78c not found: ID does not exist"
Sep 06 01:04:01.210444 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:01.210423    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-66855f56bd-w8pbj"]
Sep 06 01:04:01.221109 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:01.221090    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-66855f56bd-w8pbj"]
Sep 06 01:04:02.410147 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:02.410115    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3882567c-3a8d-4a81-bb65-08a58c10edaf" path="/var/lib/kubelet/pods/3882567c-3a8d-4a81-bb65-08a58c10edaf/volumes"
Sep 06 01:04:26.227828 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:26.227794    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"]
Sep 06 01:04:26.228470 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:26.228447    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3882567c-3a8d-4a81-bb65-08a58c10edaf" containerName="authorino"
Sep 06 01:04:26.228582 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:26.228474    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3882567c-3a8d-4a81-bb65-08a58c10edaf" containerName="authorino"
Sep 06 01:04:26.228680 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:26.228658    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3882567c-3a8d-4a81-bb65-08a58c10edaf" containerName="authorino"
Sep 06 01:04:26.232042 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:26.232024    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"
Sep 06 01:04:26.234709 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:26.234685    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-701b5b-openshift-default-dockercfg-nc99b\""
Sep 06 01:04:26.242516 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:26.242492    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"]
Sep 06 01:04:26.404850 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:26.404816    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab0266b8-91cc-4e7f-93a5-ff58468c8342-credential-socket\") pod \"e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b\" (UID: \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\") " pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"
Sep 06 01:04:26.404850 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:26.404855    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab0266b8-91cc-4e7f-93a5-ff58468c8342-workload-certs\") pod \"e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b\" (UID: \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\") " pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"
Sep 06 01:04:26.405102 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:26.404871    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvqqx\" (UniqueName: \"kubernetes.io/projected/ab0266b8-91cc-4e7f-93a5-ff58468c8342-kube-api-access-gvqqx\") pod \"e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b\" (UID: \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\") " pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"
Sep 06 01:04:26.405102 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:26.404924    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab0266b8-91cc-4e7f-93a5-ff58468c8342-istio-envoy\") pod \"e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b\" (UID: \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\") " pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"
Sep 06 01:04:26.405102 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:26.404981    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab0266b8-91cc-4e7f-93a5-ff58468c8342-istio-token\") pod \"e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b\" (UID: \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\") " pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"
Sep 06 01:04:26.405102 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:26.405021    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab0266b8-91cc-4e7f-93a5-ff58468c8342-istiod-ca-cert\") pod \"e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b\" (UID: \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\") " pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"
Sep 06 01:04:26.405102 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:26.405092    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab0266b8-91cc-4e7f-93a5-ff58468c8342-istio-data\") pod \"e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b\" (UID: \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\") " pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"
Sep 06 01:04:26.405371 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:26.405135    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab0266b8-91cc-4e7f-93a5-ff58468c8342-workload-socket\") pod \"e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b\" (UID: \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\") " pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"
Sep 06 01:04:26.405371 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:26.405158    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab0266b8-91cc-4e7f-93a5-ff58468c8342-istio-podinfo\") pod \"e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b\" (UID: \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\") " pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"
Sep 06 01:04:26.506222 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:26.506139    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab0266b8-91cc-4e7f-93a5-ff58468c8342-istio-envoy\") pod \"e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b\" (UID: \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\") " pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"
Sep 06 01:04:26.506222 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:26.506185    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab0266b8-91cc-4e7f-93a5-ff58468c8342-istio-token\") pod \"e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b\" (UID: \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\") " pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"
Sep 06 01:04:26.506452 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:26.506342    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab0266b8-91cc-4e7f-93a5-ff58468c8342-istiod-ca-cert\") pod \"e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b\" (UID: \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\") " pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"
Sep 06 01:04:26.506504 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:26.506463    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab0266b8-91cc-4e7f-93a5-ff58468c8342-istio-data\") pod \"e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b\" (UID: \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\") " pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"
Sep 06 01:04:26.506561 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:26.506513    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab0266b8-91cc-4e7f-93a5-ff58468c8342-workload-socket\") pod \"e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b\" (UID: \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\") " pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"
Sep 06 01:04:26.506561 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:26.506545    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab0266b8-91cc-4e7f-93a5-ff58468c8342-istio-podinfo\") pod \"e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b\" (UID: \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\") " pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"
Sep 06 01:04:26.506675 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:26.506608    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab0266b8-91cc-4e7f-93a5-ff58468c8342-credential-socket\") pod \"e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b\" (UID: \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\") " pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"
Sep 06 01:04:26.506675 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:26.506644    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab0266b8-91cc-4e7f-93a5-ff58468c8342-workload-certs\") pod \"e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b\" (UID: \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\") " pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"
Sep 06 01:04:26.506675 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:26.506668    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvqqx\" (UniqueName: \"kubernetes.io/projected/ab0266b8-91cc-4e7f-93a5-ff58468c8342-kube-api-access-gvqqx\") pod \"e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b\" (UID: \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\") " pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"
Sep 06 01:04:26.506913 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:26.506892    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab0266b8-91cc-4e7f-93a5-ff58468c8342-istio-data\") pod \"e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b\" (UID: \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\") " pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"
Sep 06 01:04:26.507190 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:26.507160    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab0266b8-91cc-4e7f-93a5-ff58468c8342-istiod-ca-cert\") pod \"e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b\" (UID: \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\") " pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"
Sep 06 01:04:26.507485 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:26.507462    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab0266b8-91cc-4e7f-93a5-ff58468c8342-workload-socket\") pod \"e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b\" (UID: \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\") " pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"
Sep 06 01:04:26.507602 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:26.507578    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab0266b8-91cc-4e7f-93a5-ff58468c8342-credential-socket\") pod \"e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b\" (UID: \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\") " pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"
Sep 06 01:04:26.507684 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:26.507657    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab0266b8-91cc-4e7f-93a5-ff58468c8342-workload-certs\") pod \"e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b\" (UID: \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\") " pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"
Sep 06 01:04:26.509027 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:26.508994    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab0266b8-91cc-4e7f-93a5-ff58468c8342-istio-envoy\") pod \"e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b\" (UID: \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\") " pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"
Sep 06 01:04:26.509851 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:26.509823    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab0266b8-91cc-4e7f-93a5-ff58468c8342-istio-podinfo\") pod \"e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b\" (UID: \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\") " pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"
Sep 06 01:04:26.514795 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:26.514773    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab0266b8-91cc-4e7f-93a5-ff58468c8342-istio-token\") pod \"e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b\" (UID: \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\") " pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"
Sep 06 01:04:26.515466 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:26.515378    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvqqx\" (UniqueName: \"kubernetes.io/projected/ab0266b8-91cc-4e7f-93a5-ff58468c8342-kube-api-access-gvqqx\") pod \"e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b\" (UID: \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\") " pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"
Sep 06 01:04:26.543452 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:26.543428    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"
Sep 06 01:04:26.823929 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:26.823910    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"]
Sep 06 01:04:26.826291 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:04:26.826267    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab0266b8_91cc_4e7f_93a5_ff58468c8342.slice/crio-3ac830cfed8bccf39a38e85f5d53d95209ea122e41ae6c6d1e9ec8119608cf76 WatchSource:0}: Error finding container 3ac830cfed8bccf39a38e85f5d53d95209ea122e41ae6c6d1e9ec8119608cf76: Status 404 returned error can't find the container with id 3ac830cfed8bccf39a38e85f5d53d95209ea122e41ae6c6d1e9ec8119608cf76
Sep 06 01:04:26.828827 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:26.828791    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:04:26.828927 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:26.828870    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:04:26.828927 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:26.828907    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:04:27.317702 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:27.317661    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b" event={"ID":"ab0266b8-91cc-4e7f-93a5-ff58468c8342","Type":"ContainerStarted","Data":"4e7a13d03f0702ea71d1c98188b1403d568858a2a6c6f4305ef51a3d17880178"}
Sep 06 01:04:27.318071 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:27.317726    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b" event={"ID":"ab0266b8-91cc-4e7f-93a5-ff58468c8342","Type":"ContainerStarted","Data":"3ac830cfed8bccf39a38e85f5d53d95209ea122e41ae6c6d1e9ec8119608cf76"}
Sep 06 01:04:27.350603 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:27.350540    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b" podStartSLOduration=1.350519032 podStartE2EDuration="1.350519032s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:04:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:04:27.348085175 +0000 UTC m=+825.384228132" watchObservedRunningTime="2026-09-06 01:04:27.350519032 +0000 UTC m=+825.386661989"
Sep 06 01:04:27.544268 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:27.544242    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"
Sep 06 01:04:27.548897 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:27.548872    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"
Sep 06 01:04:28.322972 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:28.322942    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"
Sep 06 01:04:28.323895 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:28.323877    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"
Sep 06 01:04:29.886590 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:29.886554    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:04:31.198359 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:31.198303    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-701b5b-586d9ccff4-bwfmd"]
Sep 06 01:04:31.202865 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:31.202845    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-701b5b-586d9ccff4-bwfmd"
Sep 06 01:04:31.205466 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:31.205448    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-701b5b\""
Sep 06 01:04:31.216569 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:31.216544    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-701b5b-586d9ccff4-bwfmd"]
Sep 06 01:04:31.229704 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:31.229629    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-701b5b-858d6b8b8c-pjw8r"]
Sep 06 01:04:31.233958 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:31.233934    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-701b5b-858d6b8b8c-pjw8r"
Sep 06 01:04:31.236630 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:31.236602    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-701b5b-dockercfg-fl622\""
Sep 06 01:04:31.245991 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:31.245061    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-701b5b-858d6b8b8c-pjw8r"]
Sep 06 01:04:31.255991 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:31.255958    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mvlw\" (UniqueName: \"kubernetes.io/projected/c00fca49-423e-48a9-b8d6-0b4bcb3441f6-kube-api-access-2mvlw\") pod \"payload-processing-e2e-inf-a-701b5b-858d6b8b8c-pjw8r\" (UID: \"c00fca49-423e-48a9-b8d6-0b4bcb3441f6\") " pod="openshift-ingress/payload-processing-e2e-inf-a-701b5b-858d6b8b8c-pjw8r"
Sep 06 01:04:31.256111 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:31.256036    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4thn\" (UniqueName: \"kubernetes.io/projected/e449e8cb-bb1c-4363-ba2d-557816d6e9bd-kube-api-access-q4thn\") pod \"payload-pre-processing-e2e-inf-a-701b5b-586d9ccff4-bwfmd\" (UID: \"e449e8cb-bb1c-4363-ba2d-557816d6e9bd\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-701b5b-586d9ccff4-bwfmd"
Sep 06 01:04:31.256111 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:31.256076    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e449e8cb-bb1c-4363-ba2d-557816d6e9bd-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-701b5b-586d9ccff4-bwfmd\" (UID: \"e449e8cb-bb1c-4363-ba2d-557816d6e9bd\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-701b5b-586d9ccff4-bwfmd"
Sep 06 01:04:31.256237 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:31.256117    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c00fca49-423e-48a9-b8d6-0b4bcb3441f6-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-701b5b-858d6b8b8c-pjw8r\" (UID: \"c00fca49-423e-48a9-b8d6-0b4bcb3441f6\") " pod="openshift-ingress/payload-processing-e2e-inf-a-701b5b-858d6b8b8c-pjw8r"
Sep 06 01:04:31.357703 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:31.357670    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mvlw\" (UniqueName: \"kubernetes.io/projected/c00fca49-423e-48a9-b8d6-0b4bcb3441f6-kube-api-access-2mvlw\") pod \"payload-processing-e2e-inf-a-701b5b-858d6b8b8c-pjw8r\" (UID: \"c00fca49-423e-48a9-b8d6-0b4bcb3441f6\") " pod="openshift-ingress/payload-processing-e2e-inf-a-701b5b-858d6b8b8c-pjw8r"
Sep 06 01:04:31.357905 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:31.357734    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4thn\" (UniqueName: \"kubernetes.io/projected/e449e8cb-bb1c-4363-ba2d-557816d6e9bd-kube-api-access-q4thn\") pod \"payload-pre-processing-e2e-inf-a-701b5b-586d9ccff4-bwfmd\" (UID: \"e449e8cb-bb1c-4363-ba2d-557816d6e9bd\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-701b5b-586d9ccff4-bwfmd"
Sep 06 01:04:31.357905 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:31.357768    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e449e8cb-bb1c-4363-ba2d-557816d6e9bd-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-701b5b-586d9ccff4-bwfmd\" (UID: \"e449e8cb-bb1c-4363-ba2d-557816d6e9bd\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-701b5b-586d9ccff4-bwfmd"
Sep 06 01:04:31.357905 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:31.357807    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c00fca49-423e-48a9-b8d6-0b4bcb3441f6-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-701b5b-858d6b8b8c-pjw8r\" (UID: \"c00fca49-423e-48a9-b8d6-0b4bcb3441f6\") " pod="openshift-ingress/payload-processing-e2e-inf-a-701b5b-858d6b8b8c-pjw8r"
Sep 06 01:04:31.358781 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:31.358752    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c00fca49-423e-48a9-b8d6-0b4bcb3441f6-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-701b5b-858d6b8b8c-pjw8r\" (UID: \"c00fca49-423e-48a9-b8d6-0b4bcb3441f6\") " pod="openshift-ingress/payload-processing-e2e-inf-a-701b5b-858d6b8b8c-pjw8r"
Sep 06 01:04:31.358905 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:31.358759    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e449e8cb-bb1c-4363-ba2d-557816d6e9bd-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-701b5b-586d9ccff4-bwfmd\" (UID: \"e449e8cb-bb1c-4363-ba2d-557816d6e9bd\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-701b5b-586d9ccff4-bwfmd"
Sep 06 01:04:31.366264 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:31.366239    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4thn\" (UniqueName: \"kubernetes.io/projected/e449e8cb-bb1c-4363-ba2d-557816d6e9bd-kube-api-access-q4thn\") pod \"payload-pre-processing-e2e-inf-a-701b5b-586d9ccff4-bwfmd\" (UID: \"e449e8cb-bb1c-4363-ba2d-557816d6e9bd\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-701b5b-586d9ccff4-bwfmd"
Sep 06 01:04:31.366759 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:31.366741    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mvlw\" (UniqueName: \"kubernetes.io/projected/c00fca49-423e-48a9-b8d6-0b4bcb3441f6-kube-api-access-2mvlw\") pod \"payload-processing-e2e-inf-a-701b5b-858d6b8b8c-pjw8r\" (UID: \"c00fca49-423e-48a9-b8d6-0b4bcb3441f6\") " pod="openshift-ingress/payload-processing-e2e-inf-a-701b5b-858d6b8b8c-pjw8r"
Sep 06 01:04:31.517610 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:31.517510    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-701b5b-586d9ccff4-bwfmd"
Sep 06 01:04:31.551868 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:31.551818    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-701b5b-858d6b8b8c-pjw8r"
Sep 06 01:04:31.809274 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:31.809188    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-701b5b-586d9ccff4-bwfmd"]
Sep 06 01:04:31.814463 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:04:31.814439    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode449e8cb_bb1c_4363_ba2d_557816d6e9bd.slice/crio-28ded5bb230263ab4c5b7121f0cb295311115894e530a86b4786f7691981a86a WatchSource:0}: Error finding container 28ded5bb230263ab4c5b7121f0cb295311115894e530a86b4786f7691981a86a: Status 404 returned error can't find the container with id 28ded5bb230263ab4c5b7121f0cb295311115894e530a86b4786f7691981a86a
Sep 06 01:04:31.858144 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:31.858124    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-701b5b-858d6b8b8c-pjw8r"]
Sep 06 01:04:31.861420 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:04:31.861394    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc00fca49_423e_48a9_b8d6_0b4bcb3441f6.slice/crio-4ec91b5bdb60533511d4e90f30510d02ba8ea783e2c3a9d52d50fa3fc977efad WatchSource:0}: Error finding container 4ec91b5bdb60533511d4e90f30510d02ba8ea783e2c3a9d52d50fa3fc977efad: Status 404 returned error can't find the container with id 4ec91b5bdb60533511d4e90f30510d02ba8ea783e2c3a9d52d50fa3fc977efad
Sep 06 01:04:32.347030 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:32.346993    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-701b5b-586d9ccff4-bwfmd" event={"ID":"e449e8cb-bb1c-4363-ba2d-557816d6e9bd","Type":"ContainerStarted","Data":"402dd771b2ee2125ee1027b8064ba0d5685240dd76040c1d5ea5a645b8265eaa"}
Sep 06 01:04:32.347491 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:32.347051    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-701b5b-586d9ccff4-bwfmd" event={"ID":"e449e8cb-bb1c-4363-ba2d-557816d6e9bd","Type":"ContainerStarted","Data":"28ded5bb230263ab4c5b7121f0cb295311115894e530a86b4786f7691981a86a"}
Sep 06 01:04:32.347491 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:32.347081    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-701b5b-586d9ccff4-bwfmd"
Sep 06 01:04:32.348802 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:32.348774    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-701b5b-858d6b8b8c-pjw8r" event={"ID":"c00fca49-423e-48a9-b8d6-0b4bcb3441f6","Type":"ContainerStarted","Data":"416fb84fdc5f7dd1353c608526585f0d82d578267bf2d287eeb166659c00cc84"}
Sep 06 01:04:32.348909 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:32.348828    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-701b5b-858d6b8b8c-pjw8r" event={"ID":"c00fca49-423e-48a9-b8d6-0b4bcb3441f6","Type":"ContainerStarted","Data":"4ec91b5bdb60533511d4e90f30510d02ba8ea783e2c3a9d52d50fa3fc977efad"}
Sep 06 01:04:32.348909 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:32.348855    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-701b5b-858d6b8b8c-pjw8r"
Sep 06 01:04:32.377080 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:32.377031    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-701b5b-586d9ccff4-bwfmd" podStartSLOduration=1.377012622 podStartE2EDuration="1.377012622s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:04:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:04:32.37607641 +0000 UTC m=+830.412219397" watchObservedRunningTime="2026-09-06 01:04:32.377012622 +0000 UTC m=+830.413155582"
Sep 06 01:04:40.435487 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:40.435433    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-701b5b-858d6b8b8c-pjw8r" podStartSLOduration=9.435410149 podStartE2EDuration="9.435410149s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:04:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:04:32.414509012 +0000 UTC m=+830.450651969" watchObservedRunningTime="2026-09-06 01:04:40.435410149 +0000 UTC m=+838.471553108"
Sep 06 01:04:40.436020 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:40.436003    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:04:40.996396 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:40.996366    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d3f8b122-57d75dc9c5-m8lcn"]
Sep 06 01:04:41.000617 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:41.000596    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d3f8b122-57d75dc9c5-m8lcn"
Sep 06 01:04:41.023223 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:41.019609    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-d3f8b122\""
Sep 06 01:04:41.023223 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:41.019927    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-d3f8b122-dockercfg-r8pbb\""
Sep 06 01:04:41.032341 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:41.028604    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d3f8b122-57d75dc9c5-m8lcn"]
Sep 06 01:04:41.056953 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:41.056921    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d78a8745-2c7f-4024-88ad-0a9b0d2f5b46-plugins-config-volume\") pod \"payload-processing-e2e-ait-d3f8b122-57d75dc9c5-m8lcn\" (UID: \"d78a8745-2c7f-4024-88ad-0a9b0d2f5b46\") " pod="openshift-ingress/payload-processing-e2e-ait-d3f8b122-57d75dc9c5-m8lcn"
Sep 06 01:04:41.057116 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:41.056988    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzkdz\" (UniqueName: \"kubernetes.io/projected/d78a8745-2c7f-4024-88ad-0a9b0d2f5b46-kube-api-access-zzkdz\") pod \"payload-processing-e2e-ait-d3f8b122-57d75dc9c5-m8lcn\" (UID: \"d78a8745-2c7f-4024-88ad-0a9b0d2f5b46\") " pod="openshift-ingress/payload-processing-e2e-ait-d3f8b122-57d75dc9c5-m8lcn"
Sep 06 01:04:41.158072 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:41.158037    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d78a8745-2c7f-4024-88ad-0a9b0d2f5b46-plugins-config-volume\") pod \"payload-processing-e2e-ait-d3f8b122-57d75dc9c5-m8lcn\" (UID: \"d78a8745-2c7f-4024-88ad-0a9b0d2f5b46\") " pod="openshift-ingress/payload-processing-e2e-ait-d3f8b122-57d75dc9c5-m8lcn"
Sep 06 01:04:41.158230 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:41.158125    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzkdz\" (UniqueName: \"kubernetes.io/projected/d78a8745-2c7f-4024-88ad-0a9b0d2f5b46-kube-api-access-zzkdz\") pod \"payload-processing-e2e-ait-d3f8b122-57d75dc9c5-m8lcn\" (UID: \"d78a8745-2c7f-4024-88ad-0a9b0d2f5b46\") " pod="openshift-ingress/payload-processing-e2e-ait-d3f8b122-57d75dc9c5-m8lcn"
Sep 06 01:04:41.158869 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:41.158847    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d78a8745-2c7f-4024-88ad-0a9b0d2f5b46-plugins-config-volume\") pod \"payload-processing-e2e-ait-d3f8b122-57d75dc9c5-m8lcn\" (UID: \"d78a8745-2c7f-4024-88ad-0a9b0d2f5b46\") " pod="openshift-ingress/payload-processing-e2e-ait-d3f8b122-57d75dc9c5-m8lcn"
Sep 06 01:04:41.170283 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:41.170255    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzkdz\" (UniqueName: \"kubernetes.io/projected/d78a8745-2c7f-4024-88ad-0a9b0d2f5b46-kube-api-access-zzkdz\") pod \"payload-processing-e2e-ait-d3f8b122-57d75dc9c5-m8lcn\" (UID: \"d78a8745-2c7f-4024-88ad-0a9b0d2f5b46\") " pod="openshift-ingress/payload-processing-e2e-ait-d3f8b122-57d75dc9c5-m8lcn"
Sep 06 01:04:41.339863 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:41.339780    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d3f8b122-57d75dc9c5-m8lcn"
Sep 06 01:04:41.645592 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:04:41.645555    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd78a8745_2c7f_4024_88ad_0a9b0d2f5b46.slice/crio-7440fc88f5d37fb65956388c735196c51e1b3d62f26dda2348056bcee9d4a0fe WatchSource:0}: Error finding container 7440fc88f5d37fb65956388c735196c51e1b3d62f26dda2348056bcee9d4a0fe: Status 404 returned error can't find the container with id 7440fc88f5d37fb65956388c735196c51e1b3d62f26dda2348056bcee9d4a0fe
Sep 06 01:04:41.658349 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:41.658305    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d3f8b122-57d75dc9c5-m8lcn"]
Sep 06 01:04:42.419649 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:42.419604    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d3f8b122-57d75dc9c5-m8lcn" event={"ID":"d78a8745-2c7f-4024-88ad-0a9b0d2f5b46","Type":"ContainerStarted","Data":"fd30ef9d048a9589678b1ee4bc422c157720219b0cc23d74cd1d7309ec76616f"}
Sep 06 01:04:42.419848 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:42.419674    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d3f8b122-57d75dc9c5-m8lcn" event={"ID":"d78a8745-2c7f-4024-88ad-0a9b0d2f5b46","Type":"ContainerStarted","Data":"7440fc88f5d37fb65956388c735196c51e1b3d62f26dda2348056bcee9d4a0fe"}
Sep 06 01:04:42.420479 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:42.420452    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-d3f8b122-57d75dc9c5-m8lcn"
Sep 06 01:04:42.461357 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:42.460312    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-d3f8b122-57d75dc9c5-m8lcn" podStartSLOduration=2.460291774 podStartE2EDuration="2.460291774s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:04:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:04:42.459617566 +0000 UTC m=+840.495760525" watchObservedRunningTime="2026-09-06 01:04:42.460291774 +0000 UTC m=+840.496434732"
Sep 06 01:04:43.357025 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:43.356992    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-701b5b-858d6b8b8c-pjw8r"
Sep 06 01:04:43.357541 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:43.357070    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-701b5b-586d9ccff4-bwfmd"
Sep 06 01:04:47.453510 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:47.453476    2577 generic.go:356] "Generic (PLEG): container finished" podID="ab0266b8-91cc-4e7f-93a5-ff58468c8342" containerID="4e7a13d03f0702ea71d1c98188b1403d568858a2a6c6f4305ef51a3d17880178" exitCode=0
Sep 06 01:04:47.453901 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:47.453548    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b" event={"ID":"ab0266b8-91cc-4e7f-93a5-ff58468c8342","Type":"ContainerDied","Data":"4e7a13d03f0702ea71d1c98188b1403d568858a2a6c6f4305ef51a3d17880178"}
Sep 06 01:04:47.453961 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:47.453947    2577 scope.go:117] "RemoveContainer" containerID="4e7a13d03f0702ea71d1c98188b1403d568858a2a6c6f4305ef51a3d17880178"
Sep 06 01:04:47.455089 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:47.455061    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:04:47.455155 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:47.455132    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:04:47.455202 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:47.455168    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:04:48.460836 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:48.460798    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b" event={"ID":"ab0266b8-91cc-4e7f-93a5-ff58468c8342","Type":"ContainerStarted","Data":"a2b14566fbf075df26fbbac0693a0d0a2c02a6586141c39c1d123cd14e9acdfd"}
Sep 06 01:04:48.544622 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:48.544594    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"
Sep 06 01:04:48.544855 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:48.544832    2577 patch_prober.go:28] interesting pod/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 06 01:04:48.544935 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:48.544914    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b" podUID="ab0266b8-91cc-4e7f-93a5-ff58468c8342" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 06 01:04:49.544625 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:49.544587    2577 patch_prober.go:28] interesting pod/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 06 01:04:49.545039 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:49.544645    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b" podUID="ab0266b8-91cc-4e7f-93a5-ff58468c8342" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 06 01:04:50.544813 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:50.544771    2577 patch_prober.go:28] interesting pod/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 06 01:04:50.545303 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:50.544853    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b" podUID="ab0266b8-91cc-4e7f-93a5-ff58468c8342" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 06 01:04:51.544007 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:51.543976    2577 patch_prober.go:28] interesting pod/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 06 01:04:51.544168 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:51.544045    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b" podUID="ab0266b8-91cc-4e7f-93a5-ff58468c8342" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 06 01:04:52.544477 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:52.544439    2577 patch_prober.go:28] interesting pod/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 06 01:04:52.544935 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:52.544506    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b" podUID="ab0266b8-91cc-4e7f-93a5-ff58468c8342" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 06 01:04:53.544406 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:53.544365    2577 patch_prober.go:28] interesting pod/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 06 01:04:53.544587 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:53.544442    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b" podUID="ab0266b8-91cc-4e7f-93a5-ff58468c8342" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 06 01:04:54.435182 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:54.435146    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-d3f8b122-57d75dc9c5-m8lcn"
Sep 06 01:04:54.548202 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:54.548173    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"
Sep 06 01:04:54.548699 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:54.548604    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"
Sep 06 01:04:54.549242 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:54.549225    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"
Sep 06 01:04:54.888913 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:54.888829    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"]
Sep 06 01:04:54.891695 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:54.891670    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"
Sep 06 01:04:54.894169 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:54.894145    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-8d5457-openshift-default-dockercfg-zjk2w\""
Sep 06 01:04:54.910000 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:54.909972    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"]
Sep 06 01:04:55.001681 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:55.001648    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6190fbea-4c15-41e7-a113-174215c22258-istiod-ca-cert\") pod \"e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z\" (UID: \"6190fbea-4c15-41e7-a113-174215c22258\") " pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"
Sep 06 01:04:55.001854 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:55.001735    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6190fbea-4c15-41e7-a113-174215c22258-workload-certs\") pod \"e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z\" (UID: \"6190fbea-4c15-41e7-a113-174215c22258\") " pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"
Sep 06 01:04:55.001854 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:55.001761    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6190fbea-4c15-41e7-a113-174215c22258-credential-socket\") pod \"e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z\" (UID: \"6190fbea-4c15-41e7-a113-174215c22258\") " pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"
Sep 06 01:04:55.001854 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:55.001793    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6190fbea-4c15-41e7-a113-174215c22258-istio-envoy\") pod \"e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z\" (UID: \"6190fbea-4c15-41e7-a113-174215c22258\") " pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"
Sep 06 01:04:55.001854 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:55.001835    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6190fbea-4c15-41e7-a113-174215c22258-istio-data\") pod \"e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z\" (UID: \"6190fbea-4c15-41e7-a113-174215c22258\") " pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"
Sep 06 01:04:55.002004 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:55.001855    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6190fbea-4c15-41e7-a113-174215c22258-istio-token\") pod \"e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z\" (UID: \"6190fbea-4c15-41e7-a113-174215c22258\") " pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"
Sep 06 01:04:55.002004 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:55.001879    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7cz9\" (UniqueName: \"kubernetes.io/projected/6190fbea-4c15-41e7-a113-174215c22258-kube-api-access-c7cz9\") pod \"e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z\" (UID: \"6190fbea-4c15-41e7-a113-174215c22258\") " pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"
Sep 06 01:04:55.002004 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:55.001909    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6190fbea-4c15-41e7-a113-174215c22258-workload-socket\") pod \"e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z\" (UID: \"6190fbea-4c15-41e7-a113-174215c22258\") " pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"
Sep 06 01:04:55.002004 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:55.001958    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6190fbea-4c15-41e7-a113-174215c22258-istio-podinfo\") pod \"e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z\" (UID: \"6190fbea-4c15-41e7-a113-174215c22258\") " pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"
Sep 06 01:04:55.102706 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:55.102672    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6190fbea-4c15-41e7-a113-174215c22258-istiod-ca-cert\") pod \"e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z\" (UID: \"6190fbea-4c15-41e7-a113-174215c22258\") " pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"
Sep 06 01:04:55.102875 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:55.102727    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6190fbea-4c15-41e7-a113-174215c22258-workload-certs\") pod \"e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z\" (UID: \"6190fbea-4c15-41e7-a113-174215c22258\") " pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"
Sep 06 01:04:55.102875 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:55.102751    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6190fbea-4c15-41e7-a113-174215c22258-credential-socket\") pod \"e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z\" (UID: \"6190fbea-4c15-41e7-a113-174215c22258\") " pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"
Sep 06 01:04:55.102875 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:55.102774    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6190fbea-4c15-41e7-a113-174215c22258-istio-envoy\") pod \"e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z\" (UID: \"6190fbea-4c15-41e7-a113-174215c22258\") " pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"
Sep 06 01:04:55.102875 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:55.102796    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6190fbea-4c15-41e7-a113-174215c22258-istio-data\") pod \"e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z\" (UID: \"6190fbea-4c15-41e7-a113-174215c22258\") " pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"
Sep 06 01:04:55.102875 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:55.102813    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6190fbea-4c15-41e7-a113-174215c22258-istio-token\") pod \"e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z\" (UID: \"6190fbea-4c15-41e7-a113-174215c22258\") " pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"
Sep 06 01:04:55.102875 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:55.102830    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7cz9\" (UniqueName: \"kubernetes.io/projected/6190fbea-4c15-41e7-a113-174215c22258-kube-api-access-c7cz9\") pod \"e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z\" (UID: \"6190fbea-4c15-41e7-a113-174215c22258\") " pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"
Sep 06 01:04:55.102875 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:55.102845    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6190fbea-4c15-41e7-a113-174215c22258-workload-socket\") pod \"e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z\" (UID: \"6190fbea-4c15-41e7-a113-174215c22258\") " pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"
Sep 06 01:04:55.103248 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:55.102884    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6190fbea-4c15-41e7-a113-174215c22258-istio-podinfo\") pod \"e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z\" (UID: \"6190fbea-4c15-41e7-a113-174215c22258\") " pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"
Sep 06 01:04:55.103248 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:55.103187    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6190fbea-4c15-41e7-a113-174215c22258-credential-socket\") pod \"e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z\" (UID: \"6190fbea-4c15-41e7-a113-174215c22258\") " pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"
Sep 06 01:04:55.103248 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:55.103241    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6190fbea-4c15-41e7-a113-174215c22258-istio-data\") pod \"e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z\" (UID: \"6190fbea-4c15-41e7-a113-174215c22258\") " pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"
Sep 06 01:04:55.103450 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:55.103308    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6190fbea-4c15-41e7-a113-174215c22258-workload-certs\") pod \"e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z\" (UID: \"6190fbea-4c15-41e7-a113-174215c22258\") " pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"
Sep 06 01:04:55.103508 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:55.103479    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6190fbea-4c15-41e7-a113-174215c22258-workload-socket\") pod \"e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z\" (UID: \"6190fbea-4c15-41e7-a113-174215c22258\") " pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"
Sep 06 01:04:55.103564 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:55.103544    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6190fbea-4c15-41e7-a113-174215c22258-istiod-ca-cert\") pod \"e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z\" (UID: \"6190fbea-4c15-41e7-a113-174215c22258\") " pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"
Sep 06 01:04:55.105403 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:55.105377    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6190fbea-4c15-41e7-a113-174215c22258-istio-envoy\") pod \"e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z\" (UID: \"6190fbea-4c15-41e7-a113-174215c22258\") " pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"
Sep 06 01:04:55.105659 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:55.105640    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6190fbea-4c15-41e7-a113-174215c22258-istio-podinfo\") pod \"e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z\" (UID: \"6190fbea-4c15-41e7-a113-174215c22258\") " pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"
Sep 06 01:04:55.111503 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:55.111475    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6190fbea-4c15-41e7-a113-174215c22258-istio-token\") pod \"e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z\" (UID: \"6190fbea-4c15-41e7-a113-174215c22258\") " pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"
Sep 06 01:04:55.111919 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:55.111899    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7cz9\" (UniqueName: \"kubernetes.io/projected/6190fbea-4c15-41e7-a113-174215c22258-kube-api-access-c7cz9\") pod \"e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z\" (UID: \"6190fbea-4c15-41e7-a113-174215c22258\") " pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"
Sep 06 01:04:55.205156 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:55.205114    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"
Sep 06 01:04:55.486313 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:55.486290    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"]
Sep 06 01:04:55.488546 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:04:55.488519    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6190fbea_4c15_41e7_a113_174215c22258.slice/crio-71c5b4e8618b85e4e3654f6e011a9d1bcd7959cf5a2a6335d19b4e3bca270ed9 WatchSource:0}: Error finding container 71c5b4e8618b85e4e3654f6e011a9d1bcd7959cf5a2a6335d19b4e3bca270ed9: Status 404 returned error can't find the container with id 71c5b4e8618b85e4e3654f6e011a9d1bcd7959cf5a2a6335d19b4e3bca270ed9
Sep 06 01:04:55.490746 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:55.490716    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:04:55.490834 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:55.490779    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:04:55.490834 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:55.490808    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:04:55.503400 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:55.503360    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z" event={"ID":"6190fbea-4c15-41e7-a113-174215c22258","Type":"ContainerStarted","Data":"71c5b4e8618b85e4e3654f6e011a9d1bcd7959cf5a2a6335d19b4e3bca270ed9"}
Sep 06 01:04:56.513033 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:56.512995    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z" event={"ID":"6190fbea-4c15-41e7-a113-174215c22258","Type":"ContainerStarted","Data":"1763853c7a116bfc5ddc2bf35594f897f9db5b93ea60275f0c70332e1b46e3eb"}
Sep 06 01:04:56.535798 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:56.535751    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z" podStartSLOduration=2.535733653 podStartE2EDuration="2.535733653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:04:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:04:56.53295035 +0000 UTC m=+854.569093323" watchObservedRunningTime="2026-09-06 01:04:56.535733653 +0000 UTC m=+854.571876610"
Sep 06 01:04:57.205866 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:57.205826    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"
Sep 06 01:04:57.210918 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:57.210892    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"
Sep 06 01:04:57.519503 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:57.519429    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"
Sep 06 01:04:57.520398 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:57.520381    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"
Sep 06 01:04:59.696465 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:04:59.696435    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:05:00.446912 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:00.446880    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-8d5457-7bd89c7ffc-xmd2x"]
Sep 06 01:05:00.449683 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:00.449661    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-8d5457-7bd89c7ffc-xmd2x"
Sep 06 01:05:00.452175 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:00.452142    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-8d5457\""
Sep 06 01:05:00.452355 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:00.452311    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-8d5457-dockercfg-zrps5\""
Sep 06 01:05:00.464675 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:00.464653    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-8d5457-7bd89c7ffc-xmd2x"]
Sep 06 01:05:00.527033 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:00.526998    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-8d5457-5bb98cfbc8-4jqxr"]
Sep 06 01:05:00.529910 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:00.529881    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8d5457-5bb98cfbc8-4jqxr"
Sep 06 01:05:00.542399 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:00.542368    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-8d5457-5bb98cfbc8-4jqxr"]
Sep 06 01:05:00.555763 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:00.555731    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2rx2\" (UniqueName: \"kubernetes.io/projected/bb2ba3e8-ca46-475f-b29d-54a3e5f7f7ad-kube-api-access-m2rx2\") pod \"payload-processing-e2e-inf-b-8d5457-7bd89c7ffc-xmd2x\" (UID: \"bb2ba3e8-ca46-475f-b29d-54a3e5f7f7ad\") " pod="openshift-ingress/payload-processing-e2e-inf-b-8d5457-7bd89c7ffc-xmd2x"
Sep 06 01:05:00.555981 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:00.555814    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb2ba3e8-ca46-475f-b29d-54a3e5f7f7ad-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-8d5457-7bd89c7ffc-xmd2x\" (UID: \"bb2ba3e8-ca46-475f-b29d-54a3e5f7f7ad\") " pod="openshift-ingress/payload-processing-e2e-inf-b-8d5457-7bd89c7ffc-xmd2x"
Sep 06 01:05:00.657309 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:00.657274    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb2ba3e8-ca46-475f-b29d-54a3e5f7f7ad-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-8d5457-7bd89c7ffc-xmd2x\" (UID: \"bb2ba3e8-ca46-475f-b29d-54a3e5f7f7ad\") " pod="openshift-ingress/payload-processing-e2e-inf-b-8d5457-7bd89c7ffc-xmd2x"
Sep 06 01:05:00.657309 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:00.657334    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm5j5\" (UniqueName: \"kubernetes.io/projected/1335615f-ccbf-4626-a64c-d2cb084a7dd0-kube-api-access-qm5j5\") pod \"payload-pre-processing-e2e-inf-b-8d5457-5bb98cfbc8-4jqxr\" (UID: \"1335615f-ccbf-4626-a64c-d2cb084a7dd0\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8d5457-5bb98cfbc8-4jqxr"
Sep 06 01:05:00.657578 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:00.657419    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1335615f-ccbf-4626-a64c-d2cb084a7dd0-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-8d5457-5bb98cfbc8-4jqxr\" (UID: \"1335615f-ccbf-4626-a64c-d2cb084a7dd0\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8d5457-5bb98cfbc8-4jqxr"
Sep 06 01:05:00.657578 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:00.657448    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2rx2\" (UniqueName: \"kubernetes.io/projected/bb2ba3e8-ca46-475f-b29d-54a3e5f7f7ad-kube-api-access-m2rx2\") pod \"payload-processing-e2e-inf-b-8d5457-7bd89c7ffc-xmd2x\" (UID: \"bb2ba3e8-ca46-475f-b29d-54a3e5f7f7ad\") " pod="openshift-ingress/payload-processing-e2e-inf-b-8d5457-7bd89c7ffc-xmd2x"
Sep 06 01:05:00.657982 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:00.657963    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb2ba3e8-ca46-475f-b29d-54a3e5f7f7ad-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-8d5457-7bd89c7ffc-xmd2x\" (UID: \"bb2ba3e8-ca46-475f-b29d-54a3e5f7f7ad\") " pod="openshift-ingress/payload-processing-e2e-inf-b-8d5457-7bd89c7ffc-xmd2x"
Sep 06 01:05:00.687049 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:00.687017    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2rx2\" (UniqueName: \"kubernetes.io/projected/bb2ba3e8-ca46-475f-b29d-54a3e5f7f7ad-kube-api-access-m2rx2\") pod \"payload-processing-e2e-inf-b-8d5457-7bd89c7ffc-xmd2x\" (UID: \"bb2ba3e8-ca46-475f-b29d-54a3e5f7f7ad\") " pod="openshift-ingress/payload-processing-e2e-inf-b-8d5457-7bd89c7ffc-xmd2x"
Sep 06 01:05:00.758256 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:00.758165    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1335615f-ccbf-4626-a64c-d2cb084a7dd0-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-8d5457-5bb98cfbc8-4jqxr\" (UID: \"1335615f-ccbf-4626-a64c-d2cb084a7dd0\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8d5457-5bb98cfbc8-4jqxr"
Sep 06 01:05:00.758256 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:00.758254    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm5j5\" (UniqueName: \"kubernetes.io/projected/1335615f-ccbf-4626-a64c-d2cb084a7dd0-kube-api-access-qm5j5\") pod \"payload-pre-processing-e2e-inf-b-8d5457-5bb98cfbc8-4jqxr\" (UID: \"1335615f-ccbf-4626-a64c-d2cb084a7dd0\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8d5457-5bb98cfbc8-4jqxr"
Sep 06 01:05:00.758999 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:00.758977    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1335615f-ccbf-4626-a64c-d2cb084a7dd0-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-8d5457-5bb98cfbc8-4jqxr\" (UID: \"1335615f-ccbf-4626-a64c-d2cb084a7dd0\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8d5457-5bb98cfbc8-4jqxr"
Sep 06 01:05:00.760923 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:00.760908    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-8d5457-7bd89c7ffc-xmd2x"
Sep 06 01:05:00.768278 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:00.768249    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm5j5\" (UniqueName: \"kubernetes.io/projected/1335615f-ccbf-4626-a64c-d2cb084a7dd0-kube-api-access-qm5j5\") pod \"payload-pre-processing-e2e-inf-b-8d5457-5bb98cfbc8-4jqxr\" (UID: \"1335615f-ccbf-4626-a64c-d2cb084a7dd0\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8d5457-5bb98cfbc8-4jqxr"
Sep 06 01:05:00.846748 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:00.846710    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8d5457-5bb98cfbc8-4jqxr"
Sep 06 01:05:01.040938 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:01.040916    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-8d5457-7bd89c7ffc-xmd2x"]
Sep 06 01:05:01.043206 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:05:01.043178    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb2ba3e8_ca46_475f_b29d_54a3e5f7f7ad.slice/crio-f0cad1a0a4f62b3755419c47ea39e155ed3a8c83312d159cd730c20804d6e8b2 WatchSource:0}: Error finding container f0cad1a0a4f62b3755419c47ea39e155ed3a8c83312d159cd730c20804d6e8b2: Status 404 returned error can't find the container with id f0cad1a0a4f62b3755419c47ea39e155ed3a8c83312d159cd730c20804d6e8b2
Sep 06 01:05:01.127111 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:01.127084    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-8d5457-5bb98cfbc8-4jqxr"]
Sep 06 01:05:01.129292 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:05:01.129260    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1335615f_ccbf_4626_a64c_d2cb084a7dd0.slice/crio-65b6009690616f274c5699345b773a35625ce2d0b0a023198b11ea5883d85e11 WatchSource:0}: Error finding container 65b6009690616f274c5699345b773a35625ce2d0b0a023198b11ea5883d85e11: Status 404 returned error can't find the container with id 65b6009690616f274c5699345b773a35625ce2d0b0a023198b11ea5883d85e11
Sep 06 01:05:01.547432 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:01.547385    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8d5457-5bb98cfbc8-4jqxr" event={"ID":"1335615f-ccbf-4626-a64c-d2cb084a7dd0","Type":"ContainerStarted","Data":"3f7c178e4b5b44acbb621c509f92dc9298cb78642d1f9391213fb825289c6975"}
Sep 06 01:05:01.547630 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:01.547474    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8d5457-5bb98cfbc8-4jqxr" event={"ID":"1335615f-ccbf-4626-a64c-d2cb084a7dd0","Type":"ContainerStarted","Data":"65b6009690616f274c5699345b773a35625ce2d0b0a023198b11ea5883d85e11"}
Sep 06 01:05:01.548432 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:01.548406    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8d5457-5bb98cfbc8-4jqxr"
Sep 06 01:05:01.550658 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:01.550626    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-8d5457-7bd89c7ffc-xmd2x" event={"ID":"bb2ba3e8-ca46-475f-b29d-54a3e5f7f7ad","Type":"ContainerStarted","Data":"6ce917347f1b9bf835876dee93ba94388f134f2ef5b4367f6e52f86d179b0773"}
Sep 06 01:05:01.550762 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:01.550683    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-8d5457-7bd89c7ffc-xmd2x" event={"ID":"bb2ba3e8-ca46-475f-b29d-54a3e5f7f7ad","Type":"ContainerStarted","Data":"f0cad1a0a4f62b3755419c47ea39e155ed3a8c83312d159cd730c20804d6e8b2"}
Sep 06 01:05:01.550893 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:01.550876    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-8d5457-7bd89c7ffc-xmd2x"
Sep 06 01:05:01.571436 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:01.571387    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8d5457-5bb98cfbc8-4jqxr" podStartSLOduration=1.571371107 podStartE2EDuration="1.571371107s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:05:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:05:01.567500594 +0000 UTC m=+859.603643551" watchObservedRunningTime="2026-09-06 01:05:01.571371107 +0000 UTC m=+859.607514065"
Sep 06 01:05:12.558679 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:12.558648    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-8d5457-7bd89c7ffc-xmd2x"
Sep 06 01:05:12.581460 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:12.580454    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-8d5457-7bd89c7ffc-xmd2x" podStartSLOduration=12.580436222 podStartE2EDuration="12.580436222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:05:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:05:01.58490989 +0000 UTC m=+859.621052857" watchObservedRunningTime="2026-09-06 01:05:12.580436222 +0000 UTC m=+870.616579181"
Sep 06 01:05:13.563773 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:13.563738    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8d5457-5bb98cfbc8-4jqxr"
Sep 06 01:05:14.499799 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:14.499771    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:05:19.672281 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:19.672250    2577 generic.go:356] "Generic (PLEG): container finished" podID="6190fbea-4c15-41e7-a113-174215c22258" containerID="1763853c7a116bfc5ddc2bf35594f897f9db5b93ea60275f0c70332e1b46e3eb" exitCode=0
Sep 06 01:05:19.672726 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:19.672300    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z" event={"ID":"6190fbea-4c15-41e7-a113-174215c22258","Type":"ContainerDied","Data":"1763853c7a116bfc5ddc2bf35594f897f9db5b93ea60275f0c70332e1b46e3eb"}
Sep 06 01:05:19.672785 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:19.672769    2577 scope.go:117] "RemoveContainer" containerID="1763853c7a116bfc5ddc2bf35594f897f9db5b93ea60275f0c70332e1b46e3eb"
Sep 06 01:05:19.673847 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:19.673811    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:05:19.673950 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:19.673898    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:05:19.673950 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:19.673944    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:05:20.679064 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:20.679033    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z" event={"ID":"6190fbea-4c15-41e7-a113-174215c22258","Type":"ContainerStarted","Data":"54f52afc4ee541d4d8d5f0fd7c14aa07f30e130dbc2b0dd66c2b886ad0e335a2"}
Sep 06 01:05:21.206225 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:21.206134    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"
Sep 06 01:05:21.206571 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:21.206544    2577 patch_prober.go:28] interesting pod/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 06 01:05:21.207067 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:21.206787    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z" podUID="6190fbea-4c15-41e7-a113-174215c22258" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 06 01:05:21.968113 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:21.968078    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d3f8b122-57d75dc9c5-m8lcn"]
Sep 06 01:05:21.968877 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:21.968839    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-d3f8b122-57d75dc9c5-m8lcn" podUID="d78a8745-2c7f-4024-88ad-0a9b0d2f5b46" containerName="payload-processing" containerID="cri-o://fd30ef9d048a9589678b1ee4bc422c157720219b0cc23d74cd1d7309ec76616f" gracePeriod=30
Sep 06 01:05:22.210140 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:22.209702    2577 patch_prober.go:28] interesting pod/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 06 01:05:22.210140 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:22.209762    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z" podUID="6190fbea-4c15-41e7-a113-174215c22258" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 06 01:05:22.280882 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:22.280857    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d3f8b122-57d75dc9c5-m8lcn"
Sep 06 01:05:22.379844 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:22.379762    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzkdz\" (UniqueName: \"kubernetes.io/projected/d78a8745-2c7f-4024-88ad-0a9b0d2f5b46-kube-api-access-zzkdz\") pod \"d78a8745-2c7f-4024-88ad-0a9b0d2f5b46\" (UID: \"d78a8745-2c7f-4024-88ad-0a9b0d2f5b46\") "
Sep 06 01:05:22.380013 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:22.379865    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d78a8745-2c7f-4024-88ad-0a9b0d2f5b46-plugins-config-volume\") pod \"d78a8745-2c7f-4024-88ad-0a9b0d2f5b46\" (UID: \"d78a8745-2c7f-4024-88ad-0a9b0d2f5b46\") "
Sep 06 01:05:22.380486 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:22.380428    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d78a8745-2c7f-4024-88ad-0a9b0d2f5b46-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d78a8745-2c7f-4024-88ad-0a9b0d2f5b46" (UID: "d78a8745-2c7f-4024-88ad-0a9b0d2f5b46"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:05:22.382621 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:22.382600    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d78a8745-2c7f-4024-88ad-0a9b0d2f5b46-kube-api-access-zzkdz" (OuterVolumeSpecName: "kube-api-access-zzkdz") pod "d78a8745-2c7f-4024-88ad-0a9b0d2f5b46" (UID: "d78a8745-2c7f-4024-88ad-0a9b0d2f5b46"). InnerVolumeSpecName "kube-api-access-zzkdz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:05:22.480799 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:22.480765    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzkdz\" (UniqueName: \"kubernetes.io/projected/d78a8745-2c7f-4024-88ad-0a9b0d2f5b46-kube-api-access-zzkdz\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:05:22.480799 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:22.480790    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d78a8745-2c7f-4024-88ad-0a9b0d2f5b46-plugins-config-volume\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:05:22.692128 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:22.692099    2577 generic.go:356] "Generic (PLEG): container finished" podID="d78a8745-2c7f-4024-88ad-0a9b0d2f5b46" containerID="fd30ef9d048a9589678b1ee4bc422c157720219b0cc23d74cd1d7309ec76616f" exitCode=0
Sep 06 01:05:22.692307 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:22.692143    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d3f8b122-57d75dc9c5-m8lcn"
Sep 06 01:05:22.692307 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:22.692148    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d3f8b122-57d75dc9c5-m8lcn" event={"ID":"d78a8745-2c7f-4024-88ad-0a9b0d2f5b46","Type":"ContainerDied","Data":"fd30ef9d048a9589678b1ee4bc422c157720219b0cc23d74cd1d7309ec76616f"}
Sep 06 01:05:22.692307 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:22.692189    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d3f8b122-57d75dc9c5-m8lcn" event={"ID":"d78a8745-2c7f-4024-88ad-0a9b0d2f5b46","Type":"ContainerDied","Data":"7440fc88f5d37fb65956388c735196c51e1b3d62f26dda2348056bcee9d4a0fe"}
Sep 06 01:05:22.692307 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:22.692211    2577 scope.go:117] "RemoveContainer" containerID="fd30ef9d048a9589678b1ee4bc422c157720219b0cc23d74cd1d7309ec76616f"
Sep 06 01:05:22.701596 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:22.701576    2577 scope.go:117] "RemoveContainer" containerID="fd30ef9d048a9589678b1ee4bc422c157720219b0cc23d74cd1d7309ec76616f"
Sep 06 01:05:22.701865 ip-10-0-140-57 kubenswrapper[2577]: E0906 01:05:22.701847    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd30ef9d048a9589678b1ee4bc422c157720219b0cc23d74cd1d7309ec76616f\": container with ID starting with fd30ef9d048a9589678b1ee4bc422c157720219b0cc23d74cd1d7309ec76616f not found: ID does not exist" containerID="fd30ef9d048a9589678b1ee4bc422c157720219b0cc23d74cd1d7309ec76616f"
Sep 06 01:05:22.701915 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:22.701876    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd30ef9d048a9589678b1ee4bc422c157720219b0cc23d74cd1d7309ec76616f"} err="failed to get container status \"fd30ef9d048a9589678b1ee4bc422c157720219b0cc23d74cd1d7309ec76616f\": rpc error: code = NotFound desc = could not find container \"fd30ef9d048a9589678b1ee4bc422c157720219b0cc23d74cd1d7309ec76616f\": container with ID starting with fd30ef9d048a9589678b1ee4bc422c157720219b0cc23d74cd1d7309ec76616f not found: ID does not exist"
Sep 06 01:05:22.724347 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:22.720371    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d3f8b122-57d75dc9c5-m8lcn"]
Sep 06 01:05:22.732811 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:22.732777    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d3f8b122-57d75dc9c5-m8lcn"]
Sep 06 01:05:23.205793 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:23.205757    2577 patch_prober.go:28] interesting pod/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 06 01:05:23.206748 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:23.206714    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z" podUID="6190fbea-4c15-41e7-a113-174215c22258" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 06 01:05:24.212434 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:24.208682    2577 patch_prober.go:28] interesting pod/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 06 01:05:24.212434 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:24.208747    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z" podUID="6190fbea-4c15-41e7-a113-174215c22258" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 06 01:05:24.413821 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:24.413767    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d78a8745-2c7f-4024-88ad-0a9b0d2f5b46" path="/var/lib/kubelet/pods/d78a8745-2c7f-4024-88ad-0a9b0d2f5b46/volumes"
Sep 06 01:05:25.205720 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:25.205676    2577 patch_prober.go:28] interesting pod/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 06 01:05:25.205929 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:25.205747    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z" podUID="6190fbea-4c15-41e7-a113-174215c22258" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 06 01:05:26.211231 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:26.211193    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"
Sep 06 01:05:26.211664 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:26.211535    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"
Sep 06 01:05:26.212187 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:26.212171    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"
Sep 06 01:05:31.767144 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:31.767109    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:05:42.408277 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:42.406984    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2z66_e100e633-d18a-4d68-9c81-0ff379c12d2f/ovn-acl-logging/0.log"
Sep 06 01:05:42.413055 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:42.413035    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2z66_e100e633-d18a-4d68-9c81-0ff379c12d2f/ovn-acl-logging/0.log"
Sep 06 01:05:43.664698 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:43.664660    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w"]
Sep 06 01:05:43.665424 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:43.665404    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d78a8745-2c7f-4024-88ad-0a9b0d2f5b46" containerName="payload-processing"
Sep 06 01:05:43.665487 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:43.665428    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d78a8745-2c7f-4024-88ad-0a9b0d2f5b46" containerName="payload-processing"
Sep 06 01:05:43.665585 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:43.665570    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d78a8745-2c7f-4024-88ad-0a9b0d2f5b46" containerName="payload-processing"
Sep 06 01:05:43.670593 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:43.670569    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w"
Sep 06 01:05:43.672950 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:43.672925    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-b-fbcd50d1-kserve-self-signed-certs\""
Sep 06 01:05:43.680642 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:43.680619    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w"]
Sep 06 01:05:43.798056 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:43.798021    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h78mq\" (UniqueName: \"kubernetes.io/projected/3f876576-9bdd-4d95-9914-b37549d3c526-kube-api-access-h78mq\") pod \"e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w\" (UID: \"3f876576-9bdd-4d95-9914-b37549d3c526\") " pod="llm/e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w"
Sep 06 01:05:43.798228 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:43.798067    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f876576-9bdd-4d95-9914-b37549d3c526-model-cache\") pod \"e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w\" (UID: \"3f876576-9bdd-4d95-9914-b37549d3c526\") " pod="llm/e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w"
Sep 06 01:05:43.798228 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:43.798085    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f876576-9bdd-4d95-9914-b37549d3c526-tls-certs\") pod \"e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w\" (UID: \"3f876576-9bdd-4d95-9914-b37549d3c526\") " pod="llm/e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w"
Sep 06 01:05:43.798228 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:43.798177    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f876576-9bdd-4d95-9914-b37549d3c526-dshm\") pod \"e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w\" (UID: \"3f876576-9bdd-4d95-9914-b37549d3c526\") " pod="llm/e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w"
Sep 06 01:05:43.798349 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:43.798267    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f876576-9bdd-4d95-9914-b37549d3c526-tmp-dir\") pod \"e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w\" (UID: \"3f876576-9bdd-4d95-9914-b37549d3c526\") " pod="llm/e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w"
Sep 06 01:05:43.798390 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:43.798349    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f876576-9bdd-4d95-9914-b37549d3c526-home\") pod \"e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w\" (UID: \"3f876576-9bdd-4d95-9914-b37549d3c526\") " pod="llm/e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w"
Sep 06 01:05:43.899757 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:43.899723    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f876576-9bdd-4d95-9914-b37549d3c526-dshm\") pod \"e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w\" (UID: \"3f876576-9bdd-4d95-9914-b37549d3c526\") " pod="llm/e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w"
Sep 06 01:05:43.899921 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:43.899788    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f876576-9bdd-4d95-9914-b37549d3c526-tmp-dir\") pod \"e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w\" (UID: \"3f876576-9bdd-4d95-9914-b37549d3c526\") " pod="llm/e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w"
Sep 06 01:05:43.899921 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:43.899820    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f876576-9bdd-4d95-9914-b37549d3c526-home\") pod \"e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w\" (UID: \"3f876576-9bdd-4d95-9914-b37549d3c526\") " pod="llm/e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w"
Sep 06 01:05:43.899921 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:43.899853    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h78mq\" (UniqueName: \"kubernetes.io/projected/3f876576-9bdd-4d95-9914-b37549d3c526-kube-api-access-h78mq\") pod \"e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w\" (UID: \"3f876576-9bdd-4d95-9914-b37549d3c526\") " pod="llm/e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w"
Sep 06 01:05:43.899921 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:43.899886    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f876576-9bdd-4d95-9914-b37549d3c526-model-cache\") pod \"e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w\" (UID: \"3f876576-9bdd-4d95-9914-b37549d3c526\") " pod="llm/e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w"
Sep 06 01:05:43.899921 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:43.899910    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f876576-9bdd-4d95-9914-b37549d3c526-tls-certs\") pod \"e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w\" (UID: \"3f876576-9bdd-4d95-9914-b37549d3c526\") " pod="llm/e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w"
Sep 06 01:05:43.900243 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:43.900214    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f876576-9bdd-4d95-9914-b37549d3c526-tmp-dir\") pod \"e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w\" (UID: \"3f876576-9bdd-4d95-9914-b37549d3c526\") " pod="llm/e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w"
Sep 06 01:05:43.900243 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:43.900240    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f876576-9bdd-4d95-9914-b37549d3c526-home\") pod \"e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w\" (UID: \"3f876576-9bdd-4d95-9914-b37549d3c526\") " pod="llm/e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w"
Sep 06 01:05:43.900434 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:43.900276    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f876576-9bdd-4d95-9914-b37549d3c526-model-cache\") pod \"e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w\" (UID: \"3f876576-9bdd-4d95-9914-b37549d3c526\") " pod="llm/e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w"
Sep 06 01:05:43.902090 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:43.902067    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f876576-9bdd-4d95-9914-b37549d3c526-dshm\") pod \"e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w\" (UID: \"3f876576-9bdd-4d95-9914-b37549d3c526\") " pod="llm/e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w"
Sep 06 01:05:43.902357 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:43.902340    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f876576-9bdd-4d95-9914-b37549d3c526-tls-certs\") pod \"e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w\" (UID: \"3f876576-9bdd-4d95-9914-b37549d3c526\") " pod="llm/e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w"
Sep 06 01:05:43.908927 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:43.908903    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h78mq\" (UniqueName: \"kubernetes.io/projected/3f876576-9bdd-4d95-9914-b37549d3c526-kube-api-access-h78mq\") pod \"e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w\" (UID: \"3f876576-9bdd-4d95-9914-b37549d3c526\") " pod="llm/e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w"
Sep 06 01:05:43.981119 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:43.981041    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w"
Sep 06 01:05:44.264681 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:44.264656    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w"]
Sep 06 01:05:44.267213 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:05:44.267187    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3f876576_9bdd_4d95_9914_b37549d3c526.slice/crio-8edf407ee983bccf4a1010822cdf3a599c630b0990664dcef899862793d54541 WatchSource:0}: Error finding container 8edf407ee983bccf4a1010822cdf3a599c630b0990664dcef899862793d54541: Status 404 returned error can't find the container with id 8edf407ee983bccf4a1010822cdf3a599c630b0990664dcef899862793d54541
Sep 06 01:05:44.820225 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:44.820188    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w" event={"ID":"3f876576-9bdd-4d95-9914-b37549d3c526","Type":"ContainerStarted","Data":"5d1430dbc5a015e8ec2613c95945cb54db4c89337b7820f794acc6bbca008d62"}
Sep 06 01:05:44.820676 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:44.820238    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w" event={"ID":"3f876576-9bdd-4d95-9914-b37549d3c526","Type":"ContainerStarted","Data":"8edf407ee983bccf4a1010822cdf3a599c630b0990664dcef899862793d54541"}
Sep 06 01:05:44.839312 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:44.839259    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w" podStartSLOduration=1.839243508 podStartE2EDuration="1.839243508s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:05:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:05:44.837949521 +0000 UTC m=+902.874092479" watchObservedRunningTime="2026-09-06 01:05:44.839243508 +0000 UTC m=+902.875386493"
Sep 06 01:05:47.766680 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:47.766645    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:05:52.288926 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:52.288887    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2460bb62-7hn29"]
Sep 06 01:05:52.292963 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:52.292941    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2460bb62-7hn29"
Sep 06 01:05:52.296218 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:52.296186    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xjq68\""
Sep 06 01:05:52.301559 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:52.301530    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2460bb62-7hn29"]
Sep 06 01:05:52.382449 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:52.382412    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/94e0563a-471e-49c1-8c25-e6d8b98705a5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-2460bb62-7hn29\" (UID: \"94e0563a-471e-49c1-8c25-e6d8b98705a5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2460bb62-7hn29"
Sep 06 01:05:52.483907 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:52.483876    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/94e0563a-471e-49c1-8c25-e6d8b98705a5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-2460bb62-7hn29\" (UID: \"94e0563a-471e-49c1-8c25-e6d8b98705a5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2460bb62-7hn29"
Sep 06 01:05:52.484482 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:52.484461    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/94e0563a-471e-49c1-8c25-e6d8b98705a5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-2460bb62-7hn29\" (UID: \"94e0563a-471e-49c1-8c25-e6d8b98705a5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2460bb62-7hn29"
Sep 06 01:05:52.606070 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:52.605986    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2460bb62-7hn29"
Sep 06 01:05:52.881944 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:52.881907    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2460bb62-7hn29"]
Sep 06 01:05:52.883410 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:05:52.883375    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94e0563a_471e_49c1_8c25_e6d8b98705a5.slice/crio-123b546a353a3e9a27cdcd58ceb30026e65351fe47aa2b8cbf19785b57aac28b WatchSource:0}: Error finding container 123b546a353a3e9a27cdcd58ceb30026e65351fe47aa2b8cbf19785b57aac28b: Status 404 returned error can't find the container with id 123b546a353a3e9a27cdcd58ceb30026e65351fe47aa2b8cbf19785b57aac28b
Sep 06 01:05:53.873072 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:53.873035    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2460bb62-7hn29" event={"ID":"94e0563a-471e-49c1-8c25-e6d8b98705a5","Type":"ContainerStarted","Data":"123b546a353a3e9a27cdcd58ceb30026e65351fe47aa2b8cbf19785b57aac28b"}
Sep 06 01:05:53.981771 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:53.981736    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w"
Sep 06 01:05:53.982305 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:53.981996    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w"
Sep 06 01:05:53.997272 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:53.997249    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w"
Sep 06 01:05:54.890569 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:54.890541    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w"
Sep 06 01:05:55.885016 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:55.884978    2577 generic.go:356] "Generic (PLEG): container finished" podID="94e0563a-471e-49c1-8c25-e6d8b98705a5" containerID="413c38a80991e4b0cc6616dc4986fec15a99c4ad1b3b3f49f68a9c892bfadfb5" exitCode=0
Sep 06 01:05:55.885169 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:55.885064    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2460bb62-7hn29" event={"ID":"94e0563a-471e-49c1-8c25-e6d8b98705a5","Type":"ContainerDied","Data":"413c38a80991e4b0cc6616dc4986fec15a99c4ad1b3b3f49f68a9c892bfadfb5"}
Sep 06 01:05:57.034797 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:57.034774    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2460bb62-7hn29"
Sep 06 01:05:57.136471 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:57.136438    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/94e0563a-471e-49c1-8c25-e6d8b98705a5-maas-api-service-ca\") pod \"94e0563a-471e-49c1-8c25-e6d8b98705a5\" (UID: \"94e0563a-471e-49c1-8c25-e6d8b98705a5\") "
Sep 06 01:05:57.136820 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:57.136799    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94e0563a-471e-49c1-8c25-e6d8b98705a5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "94e0563a-471e-49c1-8c25-e6d8b98705a5" (UID: "94e0563a-471e-49c1-8c25-e6d8b98705a5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:05:57.237426 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:57.237395    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/94e0563a-471e-49c1-8c25-e6d8b98705a5-maas-api-service-ca\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:05:57.897458 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:57.897424    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2460bb62-7hn29" event={"ID":"94e0563a-471e-49c1-8c25-e6d8b98705a5","Type":"ContainerDied","Data":"123b546a353a3e9a27cdcd58ceb30026e65351fe47aa2b8cbf19785b57aac28b"}
Sep 06 01:05:57.897643 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:57.897472    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="123b546a353a3e9a27cdcd58ceb30026e65351fe47aa2b8cbf19785b57aac28b"
Sep 06 01:05:57.897643 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:57.897435    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2460bb62-7hn29"
Sep 06 01:05:58.924308 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:58.924273    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2460bb62-7hn29"]
Sep 06 01:05:58.929343 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:05:58.929300    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2460bb62-7hn29"]
Sep 06 01:06:00.409886 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:00.409847    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94e0563a-471e-49c1-8c25-e6d8b98705a5" path="/var/lib/kubelet/pods/94e0563a-471e-49c1-8c25-e6d8b98705a5/volumes"
Sep 06 01:06:04.007841 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:04.007804    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-6cee6e60-6f58c7f698-529k5"]
Sep 06 01:06:04.008383 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:04.008355    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94e0563a-471e-49c1-8c25-e6d8b98705a5" containerName="revoke-keys"
Sep 06 01:06:04.008383 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:04.008369    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="94e0563a-471e-49c1-8c25-e6d8b98705a5" containerName="revoke-keys"
Sep 06 01:06:04.008501 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:04.008457    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="94e0563a-471e-49c1-8c25-e6d8b98705a5" containerName="revoke-keys"
Sep 06 01:06:04.012011 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:04.011982    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-6cee6e60-6f58c7f698-529k5"
Sep 06 01:06:04.015297 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:04.015277    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-6cee6e60\""
Sep 06 01:06:04.023143 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:04.023112    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-6cee6e60-6f58c7f698-529k5"]
Sep 06 01:06:04.055833 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:04.055799    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-6cee6e60-686bff95b7-sgxr5"]
Sep 06 01:06:04.059405 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:04.059387    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-6cee6e60-686bff95b7-sgxr5"
Sep 06 01:06:04.062035 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:04.062015    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-6cee6e60-dockercfg-fpn2l\""
Sep 06 01:06:04.068392 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:04.068365    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-6cee6e60-686bff95b7-sgxr5"]
Sep 06 01:06:04.119357 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:04.119291    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfvhm\" (UniqueName: \"kubernetes.io/projected/df75dc9b-ded3-4f52-ab12-a7c43a4a69cc-kube-api-access-hfvhm\") pod \"payload-pre-processing-e2e-ait-6cee6e60-6f58c7f698-529k5\" (UID: \"df75dc9b-ded3-4f52-ab12-a7c43a4a69cc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-6cee6e60-6f58c7f698-529k5"
Sep 06 01:06:04.119753 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:04.119719    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-668zx\" (UniqueName: \"kubernetes.io/projected/db7c4b34-e1fe-4386-91bb-3d9420921899-kube-api-access-668zx\") pod \"payload-processing-e2e-ait-6cee6e60-686bff95b7-sgxr5\" (UID: \"db7c4b34-e1fe-4386-91bb-3d9420921899\") " pod="openshift-ingress/payload-processing-e2e-ait-6cee6e60-686bff95b7-sgxr5"
Sep 06 01:06:04.119912 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:04.119894    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db7c4b34-e1fe-4386-91bb-3d9420921899-plugins-config-volume\") pod \"payload-processing-e2e-ait-6cee6e60-686bff95b7-sgxr5\" (UID: \"db7c4b34-e1fe-4386-91bb-3d9420921899\") " pod="openshift-ingress/payload-processing-e2e-ait-6cee6e60-686bff95b7-sgxr5"
Sep 06 01:06:04.120110 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:04.120073    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df75dc9b-ded3-4f52-ab12-a7c43a4a69cc-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-6cee6e60-6f58c7f698-529k5\" (UID: \"df75dc9b-ded3-4f52-ab12-a7c43a4a69cc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-6cee6e60-6f58c7f698-529k5"
Sep 06 01:06:04.221048 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:04.221013    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df75dc9b-ded3-4f52-ab12-a7c43a4a69cc-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-6cee6e60-6f58c7f698-529k5\" (UID: \"df75dc9b-ded3-4f52-ab12-a7c43a4a69cc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-6cee6e60-6f58c7f698-529k5"
Sep 06 01:06:04.221233 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:04.221070    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfvhm\" (UniqueName: \"kubernetes.io/projected/df75dc9b-ded3-4f52-ab12-a7c43a4a69cc-kube-api-access-hfvhm\") pod \"payload-pre-processing-e2e-ait-6cee6e60-6f58c7f698-529k5\" (UID: \"df75dc9b-ded3-4f52-ab12-a7c43a4a69cc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-6cee6e60-6f58c7f698-529k5"
Sep 06 01:06:04.221233 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:04.221125    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-668zx\" (UniqueName: \"kubernetes.io/projected/db7c4b34-e1fe-4386-91bb-3d9420921899-kube-api-access-668zx\") pod \"payload-processing-e2e-ait-6cee6e60-686bff95b7-sgxr5\" (UID: \"db7c4b34-e1fe-4386-91bb-3d9420921899\") " pod="openshift-ingress/payload-processing-e2e-ait-6cee6e60-686bff95b7-sgxr5"
Sep 06 01:06:04.221233 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:04.221152    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db7c4b34-e1fe-4386-91bb-3d9420921899-plugins-config-volume\") pod \"payload-processing-e2e-ait-6cee6e60-686bff95b7-sgxr5\" (UID: \"db7c4b34-e1fe-4386-91bb-3d9420921899\") " pod="openshift-ingress/payload-processing-e2e-ait-6cee6e60-686bff95b7-sgxr5"
Sep 06 01:06:04.221890 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:04.221866    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db7c4b34-e1fe-4386-91bb-3d9420921899-plugins-config-volume\") pod \"payload-processing-e2e-ait-6cee6e60-686bff95b7-sgxr5\" (UID: \"db7c4b34-e1fe-4386-91bb-3d9420921899\") " pod="openshift-ingress/payload-processing-e2e-ait-6cee6e60-686bff95b7-sgxr5"
Sep 06 01:06:04.221890 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:04.221879    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df75dc9b-ded3-4f52-ab12-a7c43a4a69cc-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-6cee6e60-6f58c7f698-529k5\" (UID: \"df75dc9b-ded3-4f52-ab12-a7c43a4a69cc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-6cee6e60-6f58c7f698-529k5"
Sep 06 01:06:04.236894 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:04.236869    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfvhm\" (UniqueName: \"kubernetes.io/projected/df75dc9b-ded3-4f52-ab12-a7c43a4a69cc-kube-api-access-hfvhm\") pod \"payload-pre-processing-e2e-ait-6cee6e60-6f58c7f698-529k5\" (UID: \"df75dc9b-ded3-4f52-ab12-a7c43a4a69cc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-6cee6e60-6f58c7f698-529k5"
Sep 06 01:06:04.237073 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:04.237055    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-668zx\" (UniqueName: \"kubernetes.io/projected/db7c4b34-e1fe-4386-91bb-3d9420921899-kube-api-access-668zx\") pod \"payload-processing-e2e-ait-6cee6e60-686bff95b7-sgxr5\" (UID: \"db7c4b34-e1fe-4386-91bb-3d9420921899\") " pod="openshift-ingress/payload-processing-e2e-ait-6cee6e60-686bff95b7-sgxr5"
Sep 06 01:06:04.325527 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:04.325437    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-6cee6e60-6f58c7f698-529k5"
Sep 06 01:06:04.372210 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:04.372181    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-6cee6e60-686bff95b7-sgxr5"
Sep 06 01:06:04.614668 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:04.614642    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-6cee6e60-6f58c7f698-529k5"]
Sep 06 01:06:04.617271 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:06:04.617235    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf75dc9b_ded3_4f52_ab12_a7c43a4a69cc.slice/crio-24cf5d88bc6aaf6f85822554c5cdb7eeb15a82ad18c0e44cc794b479013a48ca WatchSource:0}: Error finding container 24cf5d88bc6aaf6f85822554c5cdb7eeb15a82ad18c0e44cc794b479013a48ca: Status 404 returned error can't find the container with id 24cf5d88bc6aaf6f85822554c5cdb7eeb15a82ad18c0e44cc794b479013a48ca
Sep 06 01:06:04.664862 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:04.664838    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-6cee6e60-686bff95b7-sgxr5"]
Sep 06 01:06:04.666201 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:06:04.666180    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb7c4b34_e1fe_4386_91bb_3d9420921899.slice/crio-cff5c8107bd27299093a60199e0b70b45c0d36f139e6f57c7f0c78de5025777e WatchSource:0}: Error finding container cff5c8107bd27299093a60199e0b70b45c0d36f139e6f57c7f0c78de5025777e: Status 404 returned error can't find the container with id cff5c8107bd27299093a60199e0b70b45c0d36f139e6f57c7f0c78de5025777e
Sep 06 01:06:04.941125 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:04.941084    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-6cee6e60-686bff95b7-sgxr5" event={"ID":"db7c4b34-e1fe-4386-91bb-3d9420921899","Type":"ContainerStarted","Data":"37aa59cf6ef1bdab57b51e32758428c809b714d310c87d93adcea0d9b7d7b913"}
Sep 06 01:06:04.941362 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:04.941144    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-6cee6e60-686bff95b7-sgxr5" event={"ID":"db7c4b34-e1fe-4386-91bb-3d9420921899","Type":"ContainerStarted","Data":"cff5c8107bd27299093a60199e0b70b45c0d36f139e6f57c7f0c78de5025777e"}
Sep 06 01:06:04.941362 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:04.941200    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-6cee6e60-686bff95b7-sgxr5"
Sep 06 01:06:04.942858 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:04.942834    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-6cee6e60-6f58c7f698-529k5" event={"ID":"df75dc9b-ded3-4f52-ab12-a7c43a4a69cc","Type":"ContainerStarted","Data":"9ab82b223e3f95d50ae2c1987779042124a0ef5105971e1ea6771957aecda7ef"}
Sep 06 01:06:04.942983 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:04.942875    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-6cee6e60-6f58c7f698-529k5" event={"ID":"df75dc9b-ded3-4f52-ab12-a7c43a4a69cc","Type":"ContainerStarted","Data":"24cf5d88bc6aaf6f85822554c5cdb7eeb15a82ad18c0e44cc794b479013a48ca"}
Sep 06 01:06:04.943043 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:04.943003    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-6cee6e60-6f58c7f698-529k5"
Sep 06 01:06:04.959375 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:04.959309    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-6cee6e60-686bff95b7-sgxr5" podStartSLOduration=0.959296266 podStartE2EDuration="959.296266ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:06:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:06:04.957079979 +0000 UTC m=+922.993222961" watchObservedRunningTime="2026-09-06 01:06:04.959296266 +0000 UTC m=+922.995439243"
Sep 06 01:06:04.974543 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:04.974502    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-6cee6e60-6f58c7f698-529k5" podStartSLOduration=1.9744885509999999 podStartE2EDuration="1.974488551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:06:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:06:04.972587686 +0000 UTC m=+923.008730643" watchObservedRunningTime="2026-09-06 01:06:04.974488551 +0000 UTC m=+923.010631508"
Sep 06 01:06:09.679702 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:09.679657    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:06:15.645296 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:15.645254    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w"]
Sep 06 01:06:15.950829 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:15.950797    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-6cee6e60-686bff95b7-sgxr5"
Sep 06 01:06:15.951011 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:15.950867    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-6cee6e60-6f58c7f698-529k5"
Sep 06 01:06:26.162336 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:26.162298    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:06:30.665854 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:30.665812    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w" podUID="3f876576-9bdd-4d95-9914-b37549d3c526" containerName="main" containerID="cri-o://5d1430dbc5a015e8ec2613c95945cb54db4c89337b7820f794acc6bbca008d62" gracePeriod=45
Sep 06 01:06:30.925264 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:30.925209    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w"
Sep 06 01:06:31.004891 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:31.004862    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f876576-9bdd-4d95-9914-b37549d3c526-tls-certs\") pod \"3f876576-9bdd-4d95-9914-b37549d3c526\" (UID: \"3f876576-9bdd-4d95-9914-b37549d3c526\") "
Sep 06 01:06:31.005087 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:31.004919    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f876576-9bdd-4d95-9914-b37549d3c526-model-cache\") pod \"3f876576-9bdd-4d95-9914-b37549d3c526\" (UID: \"3f876576-9bdd-4d95-9914-b37549d3c526\") "
Sep 06 01:06:31.005087 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:31.004949    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h78mq\" (UniqueName: \"kubernetes.io/projected/3f876576-9bdd-4d95-9914-b37549d3c526-kube-api-access-h78mq\") pod \"3f876576-9bdd-4d95-9914-b37549d3c526\" (UID: \"3f876576-9bdd-4d95-9914-b37549d3c526\") "
Sep 06 01:06:31.005087 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:31.004976    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f876576-9bdd-4d95-9914-b37549d3c526-dshm\") pod \"3f876576-9bdd-4d95-9914-b37549d3c526\" (UID: \"3f876576-9bdd-4d95-9914-b37549d3c526\") "
Sep 06 01:06:31.005087 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:31.005047    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f876576-9bdd-4d95-9914-b37549d3c526-home\") pod \"3f876576-9bdd-4d95-9914-b37549d3c526\" (UID: \"3f876576-9bdd-4d95-9914-b37549d3c526\") "
Sep 06 01:06:31.005304 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:31.005118    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f876576-9bdd-4d95-9914-b37549d3c526-tmp-dir\") pod \"3f876576-9bdd-4d95-9914-b37549d3c526\" (UID: \"3f876576-9bdd-4d95-9914-b37549d3c526\") "
Sep 06 01:06:31.005304 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:31.005187    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f876576-9bdd-4d95-9914-b37549d3c526-model-cache" (OuterVolumeSpecName: "model-cache") pod "3f876576-9bdd-4d95-9914-b37549d3c526" (UID: "3f876576-9bdd-4d95-9914-b37549d3c526"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:06:31.005477 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:31.005444    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f876576-9bdd-4d95-9914-b37549d3c526-home" (OuterVolumeSpecName: "home") pod "3f876576-9bdd-4d95-9914-b37549d3c526" (UID: "3f876576-9bdd-4d95-9914-b37549d3c526"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:06:31.005538 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:31.005522    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f876576-9bdd-4d95-9914-b37549d3c526-model-cache\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:06:31.005588 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:31.005540    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f876576-9bdd-4d95-9914-b37549d3c526-home\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:06:31.005635 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:31.005599    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f876576-9bdd-4d95-9914-b37549d3c526-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3f876576-9bdd-4d95-9914-b37549d3c526" (UID: "3f876576-9bdd-4d95-9914-b37549d3c526"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:06:31.007438 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:31.007404    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f876576-9bdd-4d95-9914-b37549d3c526-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3f876576-9bdd-4d95-9914-b37549d3c526" (UID: "3f876576-9bdd-4d95-9914-b37549d3c526"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:06:31.007580 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:31.007492    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f876576-9bdd-4d95-9914-b37549d3c526-kube-api-access-h78mq" (OuterVolumeSpecName: "kube-api-access-h78mq") pod "3f876576-9bdd-4d95-9914-b37549d3c526" (UID: "3f876576-9bdd-4d95-9914-b37549d3c526"). InnerVolumeSpecName "kube-api-access-h78mq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:06:31.007840 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:31.007818    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f876576-9bdd-4d95-9914-b37549d3c526-dshm" (OuterVolumeSpecName: "dshm") pod "3f876576-9bdd-4d95-9914-b37549d3c526" (UID: "3f876576-9bdd-4d95-9914-b37549d3c526"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:06:31.093525 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:31.093494    2577 generic.go:356] "Generic (PLEG): container finished" podID="3f876576-9bdd-4d95-9914-b37549d3c526" containerID="5d1430dbc5a015e8ec2613c95945cb54db4c89337b7820f794acc6bbca008d62" exitCode=0
Sep 06 01:06:31.093695 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:31.093545    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w"
Sep 06 01:06:31.093695 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:31.093584    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w" event={"ID":"3f876576-9bdd-4d95-9914-b37549d3c526","Type":"ContainerDied","Data":"5d1430dbc5a015e8ec2613c95945cb54db4c89337b7820f794acc6bbca008d62"}
Sep 06 01:06:31.093695 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:31.093626    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w" event={"ID":"3f876576-9bdd-4d95-9914-b37549d3c526","Type":"ContainerDied","Data":"8edf407ee983bccf4a1010822cdf3a599c630b0990664dcef899862793d54541"}
Sep 06 01:06:31.093695 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:31.093645    2577 scope.go:117] "RemoveContainer" containerID="5d1430dbc5a015e8ec2613c95945cb54db4c89337b7820f794acc6bbca008d62"
Sep 06 01:06:31.103262 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:31.103244    2577 scope.go:117] "RemoveContainer" containerID="5d1430dbc5a015e8ec2613c95945cb54db4c89337b7820f794acc6bbca008d62"
Sep 06 01:06:31.103564 ip-10-0-140-57 kubenswrapper[2577]: E0906 01:06:31.103543    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d1430dbc5a015e8ec2613c95945cb54db4c89337b7820f794acc6bbca008d62\": container with ID starting with 5d1430dbc5a015e8ec2613c95945cb54db4c89337b7820f794acc6bbca008d62 not found: ID does not exist" containerID="5d1430dbc5a015e8ec2613c95945cb54db4c89337b7820f794acc6bbca008d62"
Sep 06 01:06:31.103630 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:31.103577    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d1430dbc5a015e8ec2613c95945cb54db4c89337b7820f794acc6bbca008d62"} err="failed to get container status \"5d1430dbc5a015e8ec2613c95945cb54db4c89337b7820f794acc6bbca008d62\": rpc error: code = NotFound desc = could not find container \"5d1430dbc5a015e8ec2613c95945cb54db4c89337b7820f794acc6bbca008d62\": container with ID starting with 5d1430dbc5a015e8ec2613c95945cb54db4c89337b7820f794acc6bbca008d62 not found: ID does not exist"
Sep 06 01:06:31.106938 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:31.106915    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f876576-9bdd-4d95-9914-b37549d3c526-tls-certs\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:06:31.107042 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:31.106941    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h78mq\" (UniqueName: \"kubernetes.io/projected/3f876576-9bdd-4d95-9914-b37549d3c526-kube-api-access-h78mq\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:06:31.107042 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:31.106955    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f876576-9bdd-4d95-9914-b37549d3c526-dshm\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:06:31.107042 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:31.106967    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f876576-9bdd-4d95-9914-b37549d3c526-tmp-dir\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:06:31.117450 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:31.117424    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w"]
Sep 06 01:06:31.120165 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:31.120146    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-b-fbcd50d1-kserve-c64844c5b-rdt8w"]
Sep 06 01:06:32.411214 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:32.411186    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f876576-9bdd-4d95-9914-b37549d3c526" path="/var/lib/kubelet/pods/3f876576-9bdd-4d95-9914-b37549d3c526/volumes"
Sep 06 01:06:33.994648 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:33.994613    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-6cee6e60-686bff95b7-sgxr5"]
Sep 06 01:06:33.995099 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:33.994811    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-6cee6e60-686bff95b7-sgxr5" podUID="db7c4b34-e1fe-4386-91bb-3d9420921899" containerName="payload-processing" containerID="cri-o://37aa59cf6ef1bdab57b51e32758428c809b714d310c87d93adcea0d9b7d7b913" gracePeriod=30
Sep 06 01:06:34.004179 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:34.004155    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-6cee6e60-6f58c7f698-529k5"]
Sep 06 01:06:34.005377 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:34.004439    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-6cee6e60-6f58c7f698-529k5" podUID="df75dc9b-ded3-4f52-ab12-a7c43a4a69cc" containerName="payload-pre-processing" containerID="cri-o://9ab82b223e3f95d50ae2c1987779042124a0ef5105971e1ea6771957aecda7ef" gracePeriod=30
Sep 06 01:06:34.114484 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:34.114453    2577 generic.go:356] "Generic (PLEG): container finished" podID="db7c4b34-e1fe-4386-91bb-3d9420921899" containerID="37aa59cf6ef1bdab57b51e32758428c809b714d310c87d93adcea0d9b7d7b913" exitCode=0
Sep 06 01:06:34.114619 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:34.114518    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-6cee6e60-686bff95b7-sgxr5" event={"ID":"db7c4b34-e1fe-4386-91bb-3d9420921899","Type":"ContainerDied","Data":"37aa59cf6ef1bdab57b51e32758428c809b714d310c87d93adcea0d9b7d7b913"}
Sep 06 01:06:34.255367 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:34.255292    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-6cee6e60-686bff95b7-sgxr5"
Sep 06 01:06:34.289481 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:34.289449    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-6cee6e60-6f58c7f698-529k5"
Sep 06 01:06:34.346761 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:34.346730    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db7c4b34-e1fe-4386-91bb-3d9420921899-plugins-config-volume\") pod \"db7c4b34-e1fe-4386-91bb-3d9420921899\" (UID: \"db7c4b34-e1fe-4386-91bb-3d9420921899\") "
Sep 06 01:06:34.346921 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:34.346860    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-668zx\" (UniqueName: \"kubernetes.io/projected/db7c4b34-e1fe-4386-91bb-3d9420921899-kube-api-access-668zx\") pod \"db7c4b34-e1fe-4386-91bb-3d9420921899\" (UID: \"db7c4b34-e1fe-4386-91bb-3d9420921899\") "
Sep 06 01:06:34.347127 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:34.347104    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db7c4b34-e1fe-4386-91bb-3d9420921899-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "db7c4b34-e1fe-4386-91bb-3d9420921899" (UID: "db7c4b34-e1fe-4386-91bb-3d9420921899"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:06:34.349118 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:34.349097    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db7c4b34-e1fe-4386-91bb-3d9420921899-kube-api-access-668zx" (OuterVolumeSpecName: "kube-api-access-668zx") pod "db7c4b34-e1fe-4386-91bb-3d9420921899" (UID: "db7c4b34-e1fe-4386-91bb-3d9420921899"). InnerVolumeSpecName "kube-api-access-668zx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:06:34.448065 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:34.448036    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfvhm\" (UniqueName: \"kubernetes.io/projected/df75dc9b-ded3-4f52-ab12-a7c43a4a69cc-kube-api-access-hfvhm\") pod \"df75dc9b-ded3-4f52-ab12-a7c43a4a69cc\" (UID: \"df75dc9b-ded3-4f52-ab12-a7c43a4a69cc\") "
Sep 06 01:06:34.448191 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:34.448151    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df75dc9b-ded3-4f52-ab12-a7c43a4a69cc-plugins-config-volume\") pod \"df75dc9b-ded3-4f52-ab12-a7c43a4a69cc\" (UID: \"df75dc9b-ded3-4f52-ab12-a7c43a4a69cc\") "
Sep 06 01:06:34.448370 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:34.448355    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db7c4b34-e1fe-4386-91bb-3d9420921899-plugins-config-volume\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:06:34.448414 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:34.448375    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-668zx\" (UniqueName: \"kubernetes.io/projected/db7c4b34-e1fe-4386-91bb-3d9420921899-kube-api-access-668zx\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:06:34.448519 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:34.448497    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df75dc9b-ded3-4f52-ab12-a7c43a4a69cc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "df75dc9b-ded3-4f52-ab12-a7c43a4a69cc" (UID: "df75dc9b-ded3-4f52-ab12-a7c43a4a69cc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:06:34.450270 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:34.450252    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df75dc9b-ded3-4f52-ab12-a7c43a4a69cc-kube-api-access-hfvhm" (OuterVolumeSpecName: "kube-api-access-hfvhm") pod "df75dc9b-ded3-4f52-ab12-a7c43a4a69cc" (UID: "df75dc9b-ded3-4f52-ab12-a7c43a4a69cc"). InnerVolumeSpecName "kube-api-access-hfvhm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:06:34.549781 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:34.549691    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df75dc9b-ded3-4f52-ab12-a7c43a4a69cc-plugins-config-volume\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:06:34.549781 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:34.549722    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfvhm\" (UniqueName: \"kubernetes.io/projected/df75dc9b-ded3-4f52-ab12-a7c43a4a69cc-kube-api-access-hfvhm\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:06:35.121661 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:35.121620    2577 generic.go:356] "Generic (PLEG): container finished" podID="df75dc9b-ded3-4f52-ab12-a7c43a4a69cc" containerID="9ab82b223e3f95d50ae2c1987779042124a0ef5105971e1ea6771957aecda7ef" exitCode=0
Sep 06 01:06:35.122095 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:35.121685    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-6cee6e60-6f58c7f698-529k5"
Sep 06 01:06:35.122095 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:35.121703    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-6cee6e60-6f58c7f698-529k5" event={"ID":"df75dc9b-ded3-4f52-ab12-a7c43a4a69cc","Type":"ContainerDied","Data":"9ab82b223e3f95d50ae2c1987779042124a0ef5105971e1ea6771957aecda7ef"}
Sep 06 01:06:35.122095 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:35.121760    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-6cee6e60-6f58c7f698-529k5" event={"ID":"df75dc9b-ded3-4f52-ab12-a7c43a4a69cc","Type":"ContainerDied","Data":"24cf5d88bc6aaf6f85822554c5cdb7eeb15a82ad18c0e44cc794b479013a48ca"}
Sep 06 01:06:35.122095 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:35.121785    2577 scope.go:117] "RemoveContainer" containerID="9ab82b223e3f95d50ae2c1987779042124a0ef5105971e1ea6771957aecda7ef"
Sep 06 01:06:35.124302 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:35.124275    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-6cee6e60-686bff95b7-sgxr5"
Sep 06 01:06:35.124430 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:35.124278    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-6cee6e60-686bff95b7-sgxr5" event={"ID":"db7c4b34-e1fe-4386-91bb-3d9420921899","Type":"ContainerDied","Data":"cff5c8107bd27299093a60199e0b70b45c0d36f139e6f57c7f0c78de5025777e"}
Sep 06 01:06:35.135615 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:35.135602    2577 scope.go:117] "RemoveContainer" containerID="9ab82b223e3f95d50ae2c1987779042124a0ef5105971e1ea6771957aecda7ef"
Sep 06 01:06:35.135908 ip-10-0-140-57 kubenswrapper[2577]: E0906 01:06:35.135890    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ab82b223e3f95d50ae2c1987779042124a0ef5105971e1ea6771957aecda7ef\": container with ID starting with 9ab82b223e3f95d50ae2c1987779042124a0ef5105971e1ea6771957aecda7ef not found: ID does not exist" containerID="9ab82b223e3f95d50ae2c1987779042124a0ef5105971e1ea6771957aecda7ef"
Sep 06 01:06:35.135958 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:35.135920    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ab82b223e3f95d50ae2c1987779042124a0ef5105971e1ea6771957aecda7ef"} err="failed to get container status \"9ab82b223e3f95d50ae2c1987779042124a0ef5105971e1ea6771957aecda7ef\": rpc error: code = NotFound desc = could not find container \"9ab82b223e3f95d50ae2c1987779042124a0ef5105971e1ea6771957aecda7ef\": container with ID starting with 9ab82b223e3f95d50ae2c1987779042124a0ef5105971e1ea6771957aecda7ef not found: ID does not exist"
Sep 06 01:06:35.135958 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:35.135936    2577 scope.go:117] "RemoveContainer" containerID="37aa59cf6ef1bdab57b51e32758428c809b714d310c87d93adcea0d9b7d7b913"
Sep 06 01:06:35.153025 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:35.152916    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-6cee6e60-686bff95b7-sgxr5"]
Sep 06 01:06:35.156795 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:35.156769    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-6cee6e60-686bff95b7-sgxr5"]
Sep 06 01:06:35.177699 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:35.177673    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-6cee6e60-6f58c7f698-529k5"]
Sep 06 01:06:35.186388 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:35.186366    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-6cee6e60-6f58c7f698-529k5"]
Sep 06 01:06:36.411952 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:36.411915    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db7c4b34-e1fe-4386-91bb-3d9420921899" path="/var/lib/kubelet/pods/db7c4b34-e1fe-4386-91bb-3d9420921899/volumes"
Sep 06 01:06:36.412414 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:36.412400    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df75dc9b-ded3-4f52-ab12-a7c43a4a69cc" path="/var/lib/kubelet/pods/df75dc9b-ded3-4f52-ab12-a7c43a4a69cc/volumes"
Sep 06 01:06:37.432448 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:37.432416    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"]
Sep 06 01:06:37.432920 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:37.432906    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db7c4b34-e1fe-4386-91bb-3d9420921899" containerName="payload-processing"
Sep 06 01:06:37.432964 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:37.432922    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="db7c4b34-e1fe-4386-91bb-3d9420921899" containerName="payload-processing"
Sep 06 01:06:37.432964 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:37.432944    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f876576-9bdd-4d95-9914-b37549d3c526" containerName="main"
Sep 06 01:06:37.432964 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:37.432953    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f876576-9bdd-4d95-9914-b37549d3c526" containerName="main"
Sep 06 01:06:37.432964 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:37.432964    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df75dc9b-ded3-4f52-ab12-a7c43a4a69cc" containerName="payload-pre-processing"
Sep 06 01:06:37.433085 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:37.432969    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="df75dc9b-ded3-4f52-ab12-a7c43a4a69cc" containerName="payload-pre-processing"
Sep 06 01:06:37.433085 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:37.433033    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="db7c4b34-e1fe-4386-91bb-3d9420921899" containerName="payload-processing"
Sep 06 01:06:37.433085 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:37.433045    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f876576-9bdd-4d95-9914-b37549d3c526" containerName="main"
Sep 06 01:06:37.433085 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:37.433051    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="df75dc9b-ded3-4f52-ab12-a7c43a4a69cc" containerName="payload-pre-processing"
Sep 06 01:06:37.438097 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:37.438077    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"
Sep 06 01:06:37.440684 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:37.440660    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-1fc789-openshift-default-dockercfg-gkj97\""
Sep 06 01:06:37.451193 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:37.451173    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"]
Sep 06 01:06:37.582291 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:37.582256    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17200dd1-1359-416a-a5b0-3805772d737a-workload-socket\") pod \"e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk\" (UID: \"17200dd1-1359-416a-a5b0-3805772d737a\") " pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"
Sep 06 01:06:37.582502 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:37.582354    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rklp\" (UniqueName: \"kubernetes.io/projected/17200dd1-1359-416a-a5b0-3805772d737a-kube-api-access-9rklp\") pod \"e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk\" (UID: \"17200dd1-1359-416a-a5b0-3805772d737a\") " pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"
Sep 06 01:06:37.582502 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:37.582403    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17200dd1-1359-416a-a5b0-3805772d737a-credential-socket\") pod \"e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk\" (UID: \"17200dd1-1359-416a-a5b0-3805772d737a\") " pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"
Sep 06 01:06:37.582502 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:37.582453    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17200dd1-1359-416a-a5b0-3805772d737a-istio-podinfo\") pod \"e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk\" (UID: \"17200dd1-1359-416a-a5b0-3805772d737a\") " pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"
Sep 06 01:06:37.582502 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:37.582477    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17200dd1-1359-416a-a5b0-3805772d737a-istio-data\") pod \"e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk\" (UID: \"17200dd1-1359-416a-a5b0-3805772d737a\") " pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"
Sep 06 01:06:37.582502 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:37.582495    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17200dd1-1359-416a-a5b0-3805772d737a-istio-envoy\") pod \"e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk\" (UID: \"17200dd1-1359-416a-a5b0-3805772d737a\") " pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"
Sep 06 01:06:37.582696 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:37.582536    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17200dd1-1359-416a-a5b0-3805772d737a-istiod-ca-cert\") pod \"e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk\" (UID: \"17200dd1-1359-416a-a5b0-3805772d737a\") " pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"
Sep 06 01:06:37.582696 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:37.582561    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17200dd1-1359-416a-a5b0-3805772d737a-workload-certs\") pod \"e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk\" (UID: \"17200dd1-1359-416a-a5b0-3805772d737a\") " pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"
Sep 06 01:06:37.582696 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:37.582576    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17200dd1-1359-416a-a5b0-3805772d737a-istio-token\") pod \"e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk\" (UID: \"17200dd1-1359-416a-a5b0-3805772d737a\") " pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"
Sep 06 01:06:37.683855 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:37.683751    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17200dd1-1359-416a-a5b0-3805772d737a-workload-socket\") pod \"e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk\" (UID: \"17200dd1-1359-416a-a5b0-3805772d737a\") " pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"
Sep 06 01:06:37.683855 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:37.683825    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rklp\" (UniqueName: \"kubernetes.io/projected/17200dd1-1359-416a-a5b0-3805772d737a-kube-api-access-9rklp\") pod \"e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk\" (UID: \"17200dd1-1359-416a-a5b0-3805772d737a\") " pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"
Sep 06 01:06:37.683855 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:37.683849    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17200dd1-1359-416a-a5b0-3805772d737a-credential-socket\") pod \"e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk\" (UID: \"17200dd1-1359-416a-a5b0-3805772d737a\") " pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"
Sep 06 01:06:37.684141 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:37.683901    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17200dd1-1359-416a-a5b0-3805772d737a-istio-podinfo\") pod \"e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk\" (UID: \"17200dd1-1359-416a-a5b0-3805772d737a\") " pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"
Sep 06 01:06:37.684141 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:37.683931    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17200dd1-1359-416a-a5b0-3805772d737a-istio-data\") pod \"e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk\" (UID: \"17200dd1-1359-416a-a5b0-3805772d737a\") " pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"
Sep 06 01:06:37.684141 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:37.683972    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17200dd1-1359-416a-a5b0-3805772d737a-istio-envoy\") pod \"e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk\" (UID: \"17200dd1-1359-416a-a5b0-3805772d737a\") " pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"
Sep 06 01:06:37.684141 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:37.684016    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17200dd1-1359-416a-a5b0-3805772d737a-istiod-ca-cert\") pod \"e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk\" (UID: \"17200dd1-1359-416a-a5b0-3805772d737a\") " pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"
Sep 06 01:06:37.684141 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:37.684061    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17200dd1-1359-416a-a5b0-3805772d737a-workload-certs\") pod \"e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk\" (UID: \"17200dd1-1359-416a-a5b0-3805772d737a\") " pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"
Sep 06 01:06:37.684141 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:37.684098    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17200dd1-1359-416a-a5b0-3805772d737a-istio-token\") pod \"e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk\" (UID: \"17200dd1-1359-416a-a5b0-3805772d737a\") " pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"
Sep 06 01:06:37.684495 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:37.684232    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17200dd1-1359-416a-a5b0-3805772d737a-workload-socket\") pod \"e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk\" (UID: \"17200dd1-1359-416a-a5b0-3805772d737a\") " pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"
Sep 06 01:06:37.684495 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:37.684270    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17200dd1-1359-416a-a5b0-3805772d737a-credential-socket\") pod \"e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk\" (UID: \"17200dd1-1359-416a-a5b0-3805772d737a\") " pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"
Sep 06 01:06:37.684771 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:37.684747    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17200dd1-1359-416a-a5b0-3805772d737a-istio-data\") pod \"e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk\" (UID: \"17200dd1-1359-416a-a5b0-3805772d737a\") " pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"
Sep 06 01:06:37.684904 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:37.684825    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17200dd1-1359-416a-a5b0-3805772d737a-workload-certs\") pod \"e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk\" (UID: \"17200dd1-1359-416a-a5b0-3805772d737a\") " pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"
Sep 06 01:06:37.684972 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:37.684922    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17200dd1-1359-416a-a5b0-3805772d737a-istiod-ca-cert\") pod \"e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk\" (UID: \"17200dd1-1359-416a-a5b0-3805772d737a\") " pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"
Sep 06 01:06:37.687457 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:37.687432    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17200dd1-1359-416a-a5b0-3805772d737a-istio-podinfo\") pod \"e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk\" (UID: \"17200dd1-1359-416a-a5b0-3805772d737a\") " pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"
Sep 06 01:06:37.687581 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:37.687517    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17200dd1-1359-416a-a5b0-3805772d737a-istio-envoy\") pod \"e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk\" (UID: \"17200dd1-1359-416a-a5b0-3805772d737a\") " pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"
Sep 06 01:06:37.692765 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:37.692742    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rklp\" (UniqueName: \"kubernetes.io/projected/17200dd1-1359-416a-a5b0-3805772d737a-kube-api-access-9rklp\") pod \"e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk\" (UID: \"17200dd1-1359-416a-a5b0-3805772d737a\") " pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"
Sep 06 01:06:37.693182 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:37.693167    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17200dd1-1359-416a-a5b0-3805772d737a-istio-token\") pod \"e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk\" (UID: \"17200dd1-1359-416a-a5b0-3805772d737a\") " pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"
Sep 06 01:06:37.749490 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:37.749464    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"
Sep 06 01:06:38.025613 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:38.025585    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"]
Sep 06 01:06:38.027748 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:06:38.027711    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17200dd1_1359_416a_a5b0_3805772d737a.slice/crio-12bbab4b227fc7bd06c80cc47d02006fffe6e7353426fae2da1b20ffa6109567 WatchSource:0}: Error finding container 12bbab4b227fc7bd06c80cc47d02006fffe6e7353426fae2da1b20ffa6109567: Status 404 returned error can't find the container with id 12bbab4b227fc7bd06c80cc47d02006fffe6e7353426fae2da1b20ffa6109567
Sep 06 01:06:38.030188 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:38.030157    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:06:38.030273 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:38.030222    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:06:38.030273 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:38.030251    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:06:38.147651 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:38.147609    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk" event={"ID":"17200dd1-1359-416a-a5b0-3805772d737a","Type":"ContainerStarted","Data":"1a80b915de044c0d5e99dd62c9bb609a75701dbadf7e97c0a3e95655f8099078"}
Sep 06 01:06:38.147819 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:38.147698    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk" event={"ID":"17200dd1-1359-416a-a5b0-3805772d737a","Type":"ContainerStarted","Data":"12bbab4b227fc7bd06c80cc47d02006fffe6e7353426fae2da1b20ffa6109567"}
Sep 06 01:06:38.172897 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:38.172848    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk" podStartSLOduration=1.172834213 podStartE2EDuration="1.172834213s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:06:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:06:38.171266364 +0000 UTC m=+956.207409312" watchObservedRunningTime="2026-09-06 01:06:38.172834213 +0000 UTC m=+956.208977170"
Sep 06 01:06:38.749967 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:38.749933    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"
Sep 06 01:06:39.755001 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:39.754967    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"
Sep 06 01:06:40.159814 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:40.159782    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"
Sep 06 01:06:40.161424 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:40.161382    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"
Sep 06 01:06:41.484698 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:06:41.484660    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:07:01.287075 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:01.287044    2577 generic.go:356] "Generic (PLEG): container finished" podID="17200dd1-1359-416a-a5b0-3805772d737a" containerID="1a80b915de044c0d5e99dd62c9bb609a75701dbadf7e97c0a3e95655f8099078" exitCode=0
Sep 06 01:07:01.287625 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:01.287118    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk" event={"ID":"17200dd1-1359-416a-a5b0-3805772d737a","Type":"ContainerDied","Data":"1a80b915de044c0d5e99dd62c9bb609a75701dbadf7e97c0a3e95655f8099078"}
Sep 06 01:07:01.287625 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:01.287613    2577 scope.go:117] "RemoveContainer" containerID="1a80b915de044c0d5e99dd62c9bb609a75701dbadf7e97c0a3e95655f8099078"
Sep 06 01:07:01.288688 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:01.288659    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:07:01.288772 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:01.288731    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:07:01.288772 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:01.288761    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:07:02.271546 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:02.271503    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:07:02.295348 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:02.295297    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk" event={"ID":"17200dd1-1359-416a-a5b0-3805772d737a","Type":"ContainerStarted","Data":"acd6d2f8500680f80f9efddb8851e8de6bff77a230463bf45b4752aabc75c2fc"}
Sep 06 01:07:02.750037 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:02.750002    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"
Sep 06 01:07:02.750255 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:02.750233    2577 patch_prober.go:28] interesting pod/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 06 01:07:02.750312 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:02.750292    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk" podUID="17200dd1-1359-416a-a5b0-3805772d737a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 06 01:07:03.750018 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:03.749981    2577 patch_prober.go:28] interesting pod/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 06 01:07:03.750522 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:03.750044    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk" podUID="17200dd1-1359-416a-a5b0-3805772d737a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 06 01:07:04.750358 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:04.750299    2577 patch_prober.go:28] interesting pod/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 06 01:07:04.750826 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:04.750383    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk" podUID="17200dd1-1359-416a-a5b0-3805772d737a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 06 01:07:05.750517 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:05.750480    2577 patch_prober.go:28] interesting pod/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 06 01:07:05.750901 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:05.750552    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk" podUID="17200dd1-1359-416a-a5b0-3805772d737a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 06 01:07:06.749930 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:06.749894    2577 patch_prober.go:28] interesting pod/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 06 01:07:06.750112 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:06.749951    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk" podUID="17200dd1-1359-416a-a5b0-3805772d737a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 06 01:07:07.963190 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:07.963155    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"
Sep 06 01:07:07.963682 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:07.963585    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"
Sep 06 01:07:07.965216 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:07.965192    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"
Sep 06 01:07:18.767399 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:18.767364    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:07:34.669958 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:34.669924    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:07:49.164469 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:49.164435    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:07:51.067192 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:51.067161    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"]
Sep 06 01:07:51.067684 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:51.067488    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk" podUID="17200dd1-1359-416a-a5b0-3805772d737a" containerName="istio-proxy" containerID="cri-o://acd6d2f8500680f80f9efddb8851e8de6bff77a230463bf45b4752aabc75c2fc" gracePeriod=30
Sep 06 01:07:52.966386 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:52.966345    2577 patch_prober.go:28] interesting pod/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 06 01:07:52.966755 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:52.966413    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk" podUID="17200dd1-1359-416a-a5b0-3805772d737a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 06 01:07:56.317977 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:56.317950    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"
Sep 06 01:07:56.477571 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:56.477533    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rklp\" (UniqueName: \"kubernetes.io/projected/17200dd1-1359-416a-a5b0-3805772d737a-kube-api-access-9rklp\") pod \"17200dd1-1359-416a-a5b0-3805772d737a\" (UID: \"17200dd1-1359-416a-a5b0-3805772d737a\") "
Sep 06 01:07:56.477571 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:56.477572    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17200dd1-1359-416a-a5b0-3805772d737a-workload-certs\") pod \"17200dd1-1359-416a-a5b0-3805772d737a\" (UID: \"17200dd1-1359-416a-a5b0-3805772d737a\") "
Sep 06 01:07:56.477842 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:56.477609    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17200dd1-1359-416a-a5b0-3805772d737a-credential-socket\") pod \"17200dd1-1359-416a-a5b0-3805772d737a\" (UID: \"17200dd1-1359-416a-a5b0-3805772d737a\") "
Sep 06 01:07:56.477842 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:56.477645    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17200dd1-1359-416a-a5b0-3805772d737a-istio-data\") pod \"17200dd1-1359-416a-a5b0-3805772d737a\" (UID: \"17200dd1-1359-416a-a5b0-3805772d737a\") "
Sep 06 01:07:56.477842 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:56.477712    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17200dd1-1359-416a-a5b0-3805772d737a-istio-token\") pod \"17200dd1-1359-416a-a5b0-3805772d737a\" (UID: \"17200dd1-1359-416a-a5b0-3805772d737a\") "
Sep 06 01:07:56.477842 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:56.477742    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17200dd1-1359-416a-a5b0-3805772d737a-workload-socket\") pod \"17200dd1-1359-416a-a5b0-3805772d737a\" (UID: \"17200dd1-1359-416a-a5b0-3805772d737a\") "
Sep 06 01:07:56.477842 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:56.477778    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17200dd1-1359-416a-a5b0-3805772d737a-istio-podinfo\") pod \"17200dd1-1359-416a-a5b0-3805772d737a\" (UID: \"17200dd1-1359-416a-a5b0-3805772d737a\") "
Sep 06 01:07:56.477842 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:56.477824    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17200dd1-1359-416a-a5b0-3805772d737a-istiod-ca-cert\") pod \"17200dd1-1359-416a-a5b0-3805772d737a\" (UID: \"17200dd1-1359-416a-a5b0-3805772d737a\") "
Sep 06 01:07:56.478188 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:56.477846    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17200dd1-1359-416a-a5b0-3805772d737a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "17200dd1-1359-416a-a5b0-3805772d737a" (UID: "17200dd1-1359-416a-a5b0-3805772d737a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:07:56.478188 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:56.477876    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17200dd1-1359-416a-a5b0-3805772d737a-istio-envoy\") pod \"17200dd1-1359-416a-a5b0-3805772d737a\" (UID: \"17200dd1-1359-416a-a5b0-3805772d737a\") "
Sep 06 01:07:56.478188 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:56.478165    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17200dd1-1359-416a-a5b0-3805772d737a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "17200dd1-1359-416a-a5b0-3805772d737a" (UID: "17200dd1-1359-416a-a5b0-3805772d737a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:07:56.478384 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:56.478277    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17200dd1-1359-416a-a5b0-3805772d737a-workload-certs\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:07:56.478384 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:56.478296    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17200dd1-1359-416a-a5b0-3805772d737a-credential-socket\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:07:56.478560 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:56.478526    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17200dd1-1359-416a-a5b0-3805772d737a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "17200dd1-1359-416a-a5b0-3805772d737a" (UID: "17200dd1-1359-416a-a5b0-3805772d737a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:07:56.478631 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:56.478601    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17200dd1-1359-416a-a5b0-3805772d737a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "17200dd1-1359-416a-a5b0-3805772d737a" (UID: "17200dd1-1359-416a-a5b0-3805772d737a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:07:56.478742 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:56.478715    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17200dd1-1359-416a-a5b0-3805772d737a-istio-data" (OuterVolumeSpecName: "istio-data") pod "17200dd1-1359-416a-a5b0-3805772d737a" (UID: "17200dd1-1359-416a-a5b0-3805772d737a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:07:56.481137 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:56.481108    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17200dd1-1359-416a-a5b0-3805772d737a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "17200dd1-1359-416a-a5b0-3805772d737a" (UID: "17200dd1-1359-416a-a5b0-3805772d737a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:07:56.481282 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:56.481181    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17200dd1-1359-416a-a5b0-3805772d737a-istio-token" (OuterVolumeSpecName: "istio-token") pod "17200dd1-1359-416a-a5b0-3805772d737a" (UID: "17200dd1-1359-416a-a5b0-3805772d737a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:07:56.481282 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:56.481198    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17200dd1-1359-416a-a5b0-3805772d737a-kube-api-access-9rklp" (OuterVolumeSpecName: "kube-api-access-9rklp") pod "17200dd1-1359-416a-a5b0-3805772d737a" (UID: "17200dd1-1359-416a-a5b0-3805772d737a"). InnerVolumeSpecName "kube-api-access-9rklp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:07:56.481606 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:56.481581    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/17200dd1-1359-416a-a5b0-3805772d737a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "17200dd1-1359-416a-a5b0-3805772d737a" (UID: "17200dd1-1359-416a-a5b0-3805772d737a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 01:07:56.579207 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:56.579174    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17200dd1-1359-416a-a5b0-3805772d737a-istio-token\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:07:56.579207 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:56.579200    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17200dd1-1359-416a-a5b0-3805772d737a-workload-socket\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:07:56.579207 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:56.579208    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17200dd1-1359-416a-a5b0-3805772d737a-istio-podinfo\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:07:56.579207 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:56.579218    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17200dd1-1359-416a-a5b0-3805772d737a-istiod-ca-cert\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:07:56.579598 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:56.579225    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17200dd1-1359-416a-a5b0-3805772d737a-istio-envoy\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:07:56.579598 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:56.579234    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rklp\" (UniqueName: \"kubernetes.io/projected/17200dd1-1359-416a-a5b0-3805772d737a-kube-api-access-9rklp\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:07:56.579598 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:56.579242    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17200dd1-1359-416a-a5b0-3805772d737a-istio-data\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:07:56.626087 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:56.626048    2577 generic.go:356] "Generic (PLEG): container finished" podID="17200dd1-1359-416a-a5b0-3805772d737a" containerID="acd6d2f8500680f80f9efddb8851e8de6bff77a230463bf45b4752aabc75c2fc" exitCode=0
Sep 06 01:07:56.626277 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:56.626111    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"
Sep 06 01:07:56.626277 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:56.626177    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk" event={"ID":"17200dd1-1359-416a-a5b0-3805772d737a","Type":"ContainerDied","Data":"acd6d2f8500680f80f9efddb8851e8de6bff77a230463bf45b4752aabc75c2fc"}
Sep 06 01:07:56.626277 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:56.626241    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk" event={"ID":"17200dd1-1359-416a-a5b0-3805772d737a","Type":"ContainerDied","Data":"12bbab4b227fc7bd06c80cc47d02006fffe6e7353426fae2da1b20ffa6109567"}
Sep 06 01:07:56.626277 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:56.626275    2577 scope.go:117] "RemoveContainer" containerID="acd6d2f8500680f80f9efddb8851e8de6bff77a230463bf45b4752aabc75c2fc"
Sep 06 01:07:56.640164 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:56.640140    2577 scope.go:117] "RemoveContainer" containerID="1a80b915de044c0d5e99dd62c9bb609a75701dbadf7e97c0a3e95655f8099078"
Sep 06 01:07:56.650057 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:56.650037    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"]
Sep 06 01:07:56.651917 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:56.651885    2577 scope.go:117] "RemoveContainer" containerID="acd6d2f8500680f80f9efddb8851e8de6bff77a230463bf45b4752aabc75c2fc"
Sep 06 01:07:56.652296 ip-10-0-140-57 kubenswrapper[2577]: E0906 01:07:56.652269    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acd6d2f8500680f80f9efddb8851e8de6bff77a230463bf45b4752aabc75c2fc\": container with ID starting with acd6d2f8500680f80f9efddb8851e8de6bff77a230463bf45b4752aabc75c2fc not found: ID does not exist" containerID="acd6d2f8500680f80f9efddb8851e8de6bff77a230463bf45b4752aabc75c2fc"
Sep 06 01:07:56.652417 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:56.652307    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acd6d2f8500680f80f9efddb8851e8de6bff77a230463bf45b4752aabc75c2fc"} err="failed to get container status \"acd6d2f8500680f80f9efddb8851e8de6bff77a230463bf45b4752aabc75c2fc\": rpc error: code = NotFound desc = could not find container \"acd6d2f8500680f80f9efddb8851e8de6bff77a230463bf45b4752aabc75c2fc\": container with ID starting with acd6d2f8500680f80f9efddb8851e8de6bff77a230463bf45b4752aabc75c2fc not found: ID does not exist"
Sep 06 01:07:56.652417 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:56.652351    2577 scope.go:117] "RemoveContainer" containerID="1a80b915de044c0d5e99dd62c9bb609a75701dbadf7e97c0a3e95655f8099078"
Sep 06 01:07:56.652717 ip-10-0-140-57 kubenswrapper[2577]: E0906 01:07:56.652690    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a80b915de044c0d5e99dd62c9bb609a75701dbadf7e97c0a3e95655f8099078\": container with ID starting with 1a80b915de044c0d5e99dd62c9bb609a75701dbadf7e97c0a3e95655f8099078 not found: ID does not exist" containerID="1a80b915de044c0d5e99dd62c9bb609a75701dbadf7e97c0a3e95655f8099078"
Sep 06 01:07:56.652794 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:56.652726    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a80b915de044c0d5e99dd62c9bb609a75701dbadf7e97c0a3e95655f8099078"} err="failed to get container status \"1a80b915de044c0d5e99dd62c9bb609a75701dbadf7e97c0a3e95655f8099078\": rpc error: code = NotFound desc = could not find container \"1a80b915de044c0d5e99dd62c9bb609a75701dbadf7e97c0a3e95655f8099078\": container with ID starting with 1a80b915de044c0d5e99dd62c9bb609a75701dbadf7e97c0a3e95655f8099078 not found: ID does not exist"
Sep 06 01:07:56.653415 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:56.653363    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-1fc789-openshift-default-864cbcbf4d-g8dsk"]
Sep 06 01:07:58.409869 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:07:58.409833    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17200dd1-1359-416a-a5b0-3805772d737a" path="/var/lib/kubelet/pods/17200dd1-1359-416a-a5b0-3805772d737a/volumes"
Sep 06 01:08:13.664357 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:13.664313    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:08:38.567609 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:38.567521    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:08:53.005912 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:53.005868    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-40d55b26-75cc7f8998-zms8w"]
Sep 06 01:08:53.007026 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:53.006644    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17200dd1-1359-416a-a5b0-3805772d737a" containerName="istio-proxy"
Sep 06 01:08:53.007026 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:53.006669    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="17200dd1-1359-416a-a5b0-3805772d737a" containerName="istio-proxy"
Sep 06 01:08:53.007026 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:53.006687    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17200dd1-1359-416a-a5b0-3805772d737a" containerName="istio-proxy"
Sep 06 01:08:53.007026 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:53.006696    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="17200dd1-1359-416a-a5b0-3805772d737a" containerName="istio-proxy"
Sep 06 01:08:53.007026 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:53.006814    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="17200dd1-1359-416a-a5b0-3805772d737a" containerName="istio-proxy"
Sep 06 01:08:53.011523 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:53.011501    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-40d55b26-75cc7f8998-zms8w"
Sep 06 01:08:53.013912 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:53.013876    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-40d55b26\""
Sep 06 01:08:53.014029 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:53.013929    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-40d55b26-dockercfg-ljbhp\""
Sep 06 01:08:53.021623 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:53.021598    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-40d55b26-75cc7f8998-zms8w"]
Sep 06 01:08:53.089639 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:53.089602    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:08:53.119499 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:53.119462    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67th8\" (UniqueName: \"kubernetes.io/projected/04fd2140-0de1-49ef-88c1-d46e8468ae0b-kube-api-access-67th8\") pod \"payload-pre-processing-e2e-mt-40d55b26-75cc7f8998-zms8w\" (UID: \"04fd2140-0de1-49ef-88c1-d46e8468ae0b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-40d55b26-75cc7f8998-zms8w"
Sep 06 01:08:53.119672 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:53.119613    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04fd2140-0de1-49ef-88c1-d46e8468ae0b-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-40d55b26-75cc7f8998-zms8w\" (UID: \"04fd2140-0de1-49ef-88c1-d46e8468ae0b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-40d55b26-75cc7f8998-zms8w"
Sep 06 01:08:53.220637 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:53.220601    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67th8\" (UniqueName: \"kubernetes.io/projected/04fd2140-0de1-49ef-88c1-d46e8468ae0b-kube-api-access-67th8\") pod \"payload-pre-processing-e2e-mt-40d55b26-75cc7f8998-zms8w\" (UID: \"04fd2140-0de1-49ef-88c1-d46e8468ae0b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-40d55b26-75cc7f8998-zms8w"
Sep 06 01:08:53.220852 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:53.220649    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04fd2140-0de1-49ef-88c1-d46e8468ae0b-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-40d55b26-75cc7f8998-zms8w\" (UID: \"04fd2140-0de1-49ef-88c1-d46e8468ae0b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-40d55b26-75cc7f8998-zms8w"
Sep 06 01:08:53.221334 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:53.221302    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04fd2140-0de1-49ef-88c1-d46e8468ae0b-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-40d55b26-75cc7f8998-zms8w\" (UID: \"04fd2140-0de1-49ef-88c1-d46e8468ae0b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-40d55b26-75cc7f8998-zms8w"
Sep 06 01:08:53.228599 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:53.228575    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67th8\" (UniqueName: \"kubernetes.io/projected/04fd2140-0de1-49ef-88c1-d46e8468ae0b-kube-api-access-67th8\") pod \"payload-pre-processing-e2e-mt-40d55b26-75cc7f8998-zms8w\" (UID: \"04fd2140-0de1-49ef-88c1-d46e8468ae0b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-40d55b26-75cc7f8998-zms8w"
Sep 06 01:08:53.323713 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:53.323616    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-40d55b26-75cc7f8998-zms8w"
Sep 06 01:08:53.596198 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:53.596168    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-40d55b26-75cc7f8998-zms8w"]
Sep 06 01:08:53.598457 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:08:53.598433    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04fd2140_0de1_49ef_88c1_d46e8468ae0b.slice/crio-519d24db32dd0594acee22811633850e584f21767f7f17a39d6a87c276993fa7 WatchSource:0}: Error finding container 519d24db32dd0594acee22811633850e584f21767f7f17a39d6a87c276993fa7: Status 404 returned error can't find the container with id 519d24db32dd0594acee22811633850e584f21767f7f17a39d6a87c276993fa7
Sep 06 01:08:53.951816 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:53.951782    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-40d55b26-75cc7f8998-zms8w" event={"ID":"04fd2140-0de1-49ef-88c1-d46e8468ae0b","Type":"ContainerStarted","Data":"aa55ed0d75a5c0d9719f573b945de91f0113e09c7db385da20e44a256b191233"}
Sep 06 01:08:53.951991 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:53.951845    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-40d55b26-75cc7f8998-zms8w" event={"ID":"04fd2140-0de1-49ef-88c1-d46e8468ae0b","Type":"ContainerStarted","Data":"519d24db32dd0594acee22811633850e584f21767f7f17a39d6a87c276993fa7"}
Sep 06 01:08:53.951991 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:53.951890    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-40d55b26-75cc7f8998-zms8w"
Sep 06 01:08:53.973194 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:53.973145    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-40d55b26-75cc7f8998-zms8w" podStartSLOduration=1.9731307980000001 podStartE2EDuration="1.973130798s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:08:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:08:53.970834044 +0000 UTC m=+1092.006977002" watchObservedRunningTime="2026-09-06 01:08:53.973130798 +0000 UTC m=+1092.009273754"
Sep 06 01:08:56.222751 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:56.222555    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-701b5b-858d6b8b8c-pjw8r"]
Sep 06 01:08:56.223244 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:56.222873    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-701b5b-858d6b8b8c-pjw8r" podUID="c00fca49-423e-48a9-b8d6-0b4bcb3441f6" containerName="payload-processing" containerID="cri-o://416fb84fdc5f7dd1353c608526585f0d82d578267bf2d287eeb166659c00cc84" gracePeriod=30
Sep 06 01:08:56.225655 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:56.225629    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-701b5b-586d9ccff4-bwfmd"]
Sep 06 01:08:56.225864 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:56.225811    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-701b5b-586d9ccff4-bwfmd" podUID="e449e8cb-bb1c-4363-ba2d-557816d6e9bd" containerName="payload-pre-processing" containerID="cri-o://402dd771b2ee2125ee1027b8064ba0d5685240dd76040c1d5ea5a645b8265eaa" gracePeriod=30
Sep 06 01:08:56.487528 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:56.487464    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-701b5b-586d9ccff4-bwfmd"
Sep 06 01:08:56.524957 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:56.524928    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-701b5b-858d6b8b8c-pjw8r"
Sep 06 01:08:56.559112 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:56.558545    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e449e8cb-bb1c-4363-ba2d-557816d6e9bd-plugins-config-volume\") pod \"e449e8cb-bb1c-4363-ba2d-557816d6e9bd\" (UID: \"e449e8cb-bb1c-4363-ba2d-557816d6e9bd\") "
Sep 06 01:08:56.559112 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:56.558609    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4thn\" (UniqueName: \"kubernetes.io/projected/e449e8cb-bb1c-4363-ba2d-557816d6e9bd-kube-api-access-q4thn\") pod \"e449e8cb-bb1c-4363-ba2d-557816d6e9bd\" (UID: \"e449e8cb-bb1c-4363-ba2d-557816d6e9bd\") "
Sep 06 01:08:56.559112 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:56.558743    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2mvlw\" (UniqueName: \"kubernetes.io/projected/c00fca49-423e-48a9-b8d6-0b4bcb3441f6-kube-api-access-2mvlw\") pod \"c00fca49-423e-48a9-b8d6-0b4bcb3441f6\" (UID: \"c00fca49-423e-48a9-b8d6-0b4bcb3441f6\") "
Sep 06 01:08:56.559112 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:56.558788    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c00fca49-423e-48a9-b8d6-0b4bcb3441f6-plugins-config-volume\") pod \"c00fca49-423e-48a9-b8d6-0b4bcb3441f6\" (UID: \"c00fca49-423e-48a9-b8d6-0b4bcb3441f6\") "
Sep 06 01:08:56.561285 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:56.559112    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e449e8cb-bb1c-4363-ba2d-557816d6e9bd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e449e8cb-bb1c-4363-ba2d-557816d6e9bd" (UID: "e449e8cb-bb1c-4363-ba2d-557816d6e9bd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:08:56.561285 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:56.559465    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c00fca49-423e-48a9-b8d6-0b4bcb3441f6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c00fca49-423e-48a9-b8d6-0b4bcb3441f6" (UID: "c00fca49-423e-48a9-b8d6-0b4bcb3441f6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:08:56.562261 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:56.562238    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c00fca49-423e-48a9-b8d6-0b4bcb3441f6-kube-api-access-2mvlw" (OuterVolumeSpecName: "kube-api-access-2mvlw") pod "c00fca49-423e-48a9-b8d6-0b4bcb3441f6" (UID: "c00fca49-423e-48a9-b8d6-0b4bcb3441f6"). InnerVolumeSpecName "kube-api-access-2mvlw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:08:56.562535 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:56.562512    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e449e8cb-bb1c-4363-ba2d-557816d6e9bd-kube-api-access-q4thn" (OuterVolumeSpecName: "kube-api-access-q4thn") pod "e449e8cb-bb1c-4363-ba2d-557816d6e9bd" (UID: "e449e8cb-bb1c-4363-ba2d-557816d6e9bd"). InnerVolumeSpecName "kube-api-access-q4thn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:08:56.660101 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:56.660068    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c00fca49-423e-48a9-b8d6-0b4bcb3441f6-plugins-config-volume\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:08:56.660101 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:56.660099    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e449e8cb-bb1c-4363-ba2d-557816d6e9bd-plugins-config-volume\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:08:56.660101 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:56.660108    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4thn\" (UniqueName: \"kubernetes.io/projected/e449e8cb-bb1c-4363-ba2d-557816d6e9bd-kube-api-access-q4thn\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:08:56.660385 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:56.660116    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mvlw\" (UniqueName: \"kubernetes.io/projected/c00fca49-423e-48a9-b8d6-0b4bcb3441f6-kube-api-access-2mvlw\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:08:56.969266 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:56.969190    2577 generic.go:356] "Generic (PLEG): container finished" podID="e449e8cb-bb1c-4363-ba2d-557816d6e9bd" containerID="402dd771b2ee2125ee1027b8064ba0d5685240dd76040c1d5ea5a645b8265eaa" exitCode=0
Sep 06 01:08:56.969266 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:56.969263    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-701b5b-586d9ccff4-bwfmd" event={"ID":"e449e8cb-bb1c-4363-ba2d-557816d6e9bd","Type":"ContainerDied","Data":"402dd771b2ee2125ee1027b8064ba0d5685240dd76040c1d5ea5a645b8265eaa"}
Sep 06 01:08:56.969550 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:56.969242    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-701b5b-586d9ccff4-bwfmd"
Sep 06 01:08:56.969550 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:56.969309    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-701b5b-586d9ccff4-bwfmd" event={"ID":"e449e8cb-bb1c-4363-ba2d-557816d6e9bd","Type":"ContainerDied","Data":"28ded5bb230263ab4c5b7121f0cb295311115894e530a86b4786f7691981a86a"}
Sep 06 01:08:56.969550 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:56.969357    2577 scope.go:117] "RemoveContainer" containerID="402dd771b2ee2125ee1027b8064ba0d5685240dd76040c1d5ea5a645b8265eaa"
Sep 06 01:08:56.970723 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:56.970701    2577 generic.go:356] "Generic (PLEG): container finished" podID="c00fca49-423e-48a9-b8d6-0b4bcb3441f6" containerID="416fb84fdc5f7dd1353c608526585f0d82d578267bf2d287eeb166659c00cc84" exitCode=0
Sep 06 01:08:56.970811 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:56.970743    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-701b5b-858d6b8b8c-pjw8r"
Sep 06 01:08:56.970856 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:56.970743    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-701b5b-858d6b8b8c-pjw8r" event={"ID":"c00fca49-423e-48a9-b8d6-0b4bcb3441f6","Type":"ContainerDied","Data":"416fb84fdc5f7dd1353c608526585f0d82d578267bf2d287eeb166659c00cc84"}
Sep 06 01:08:56.970898 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:56.970877    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-701b5b-858d6b8b8c-pjw8r" event={"ID":"c00fca49-423e-48a9-b8d6-0b4bcb3441f6","Type":"ContainerDied","Data":"4ec91b5bdb60533511d4e90f30510d02ba8ea783e2c3a9d52d50fa3fc977efad"}
Sep 06 01:08:56.980414 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:56.980397    2577 scope.go:117] "RemoveContainer" containerID="402dd771b2ee2125ee1027b8064ba0d5685240dd76040c1d5ea5a645b8265eaa"
Sep 06 01:08:56.980696 ip-10-0-140-57 kubenswrapper[2577]: E0906 01:08:56.980673    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"402dd771b2ee2125ee1027b8064ba0d5685240dd76040c1d5ea5a645b8265eaa\": container with ID starting with 402dd771b2ee2125ee1027b8064ba0d5685240dd76040c1d5ea5a645b8265eaa not found: ID does not exist" containerID="402dd771b2ee2125ee1027b8064ba0d5685240dd76040c1d5ea5a645b8265eaa"
Sep 06 01:08:56.980757 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:56.980708    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"402dd771b2ee2125ee1027b8064ba0d5685240dd76040c1d5ea5a645b8265eaa"} err="failed to get container status \"402dd771b2ee2125ee1027b8064ba0d5685240dd76040c1d5ea5a645b8265eaa\": rpc error: code = NotFound desc = could not find container \"402dd771b2ee2125ee1027b8064ba0d5685240dd76040c1d5ea5a645b8265eaa\": container with ID starting with 402dd771b2ee2125ee1027b8064ba0d5685240dd76040c1d5ea5a645b8265eaa not found: ID does not exist"
Sep 06 01:08:56.980757 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:56.980730    2577 scope.go:117] "RemoveContainer" containerID="416fb84fdc5f7dd1353c608526585f0d82d578267bf2d287eeb166659c00cc84"
Sep 06 01:08:56.989019 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:56.988999    2577 scope.go:117] "RemoveContainer" containerID="416fb84fdc5f7dd1353c608526585f0d82d578267bf2d287eeb166659c00cc84"
Sep 06 01:08:56.989375 ip-10-0-140-57 kubenswrapper[2577]: E0906 01:08:56.989309    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"416fb84fdc5f7dd1353c608526585f0d82d578267bf2d287eeb166659c00cc84\": container with ID starting with 416fb84fdc5f7dd1353c608526585f0d82d578267bf2d287eeb166659c00cc84 not found: ID does not exist" containerID="416fb84fdc5f7dd1353c608526585f0d82d578267bf2d287eeb166659c00cc84"
Sep 06 01:08:56.989450 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:56.989382    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"416fb84fdc5f7dd1353c608526585f0d82d578267bf2d287eeb166659c00cc84"} err="failed to get container status \"416fb84fdc5f7dd1353c608526585f0d82d578267bf2d287eeb166659c00cc84\": rpc error: code = NotFound desc = could not find container \"416fb84fdc5f7dd1353c608526585f0d82d578267bf2d287eeb166659c00cc84\": container with ID starting with 416fb84fdc5f7dd1353c608526585f0d82d578267bf2d287eeb166659c00cc84 not found: ID does not exist"
Sep 06 01:08:56.991330 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:56.991295    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-701b5b-586d9ccff4-bwfmd"]
Sep 06 01:08:56.994913 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:56.994893    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-701b5b-586d9ccff4-bwfmd"]
Sep 06 01:08:57.004561 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:57.004537    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-701b5b-858d6b8b8c-pjw8r"]
Sep 06 01:08:57.009490 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:57.009463    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-701b5b-858d6b8b8c-pjw8r"]
Sep 06 01:08:58.412264 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:58.412225    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c00fca49-423e-48a9-b8d6-0b4bcb3441f6" path="/var/lib/kubelet/pods/c00fca49-423e-48a9-b8d6-0b4bcb3441f6/volumes"
Sep 06 01:08:58.412687 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:08:58.412672    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e449e8cb-bb1c-4363-ba2d-557816d6e9bd" path="/var/lib/kubelet/pods/e449e8cb-bb1c-4363-ba2d-557816d6e9bd/volumes"
Sep 06 01:09:02.806216 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:02.806170    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"]
Sep 06 01:09:02.806715 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:02.806474    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b" podUID="ab0266b8-91cc-4e7f-93a5-ff58468c8342" containerName="istio-proxy" containerID="cri-o://a2b14566fbf075df26fbbac0693a0d0a2c02a6586141c39c1d123cd14e9acdfd" gracePeriod=30
Sep 06 01:09:04.959952 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:04.959922    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-40d55b26-75cc7f8998-zms8w"
Sep 06 01:09:04.973048 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:04.973021    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:09:08.039446 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:08.039148    2577 generic.go:356] "Generic (PLEG): container finished" podID="ab0266b8-91cc-4e7f-93a5-ff58468c8342" containerID="a2b14566fbf075df26fbbac0693a0d0a2c02a6586141c39c1d123cd14e9acdfd" exitCode=0
Sep 06 01:09:08.039446 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:08.039222    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b" event={"ID":"ab0266b8-91cc-4e7f-93a5-ff58468c8342","Type":"ContainerDied","Data":"a2b14566fbf075df26fbbac0693a0d0a2c02a6586141c39c1d123cd14e9acdfd"}
Sep 06 01:09:08.039446 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:08.039281    2577 scope.go:117] "RemoveContainer" containerID="4e7a13d03f0702ea71d1c98188b1403d568858a2a6c6f4305ef51a3d17880178"
Sep 06 01:09:08.075921 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:08.075868    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"
Sep 06 01:09:08.171697 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:08.171666    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab0266b8-91cc-4e7f-93a5-ff58468c8342-istiod-ca-cert\") pod \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\" (UID: \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\") "
Sep 06 01:09:08.171859 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:08.171724    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab0266b8-91cc-4e7f-93a5-ff58468c8342-workload-socket\") pod \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\" (UID: \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\") "
Sep 06 01:09:08.171859 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:08.171761    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab0266b8-91cc-4e7f-93a5-ff58468c8342-istio-podinfo\") pod \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\" (UID: \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\") "
Sep 06 01:09:08.171859 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:08.171779    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab0266b8-91cc-4e7f-93a5-ff58468c8342-istio-token\") pod \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\" (UID: \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\") "
Sep 06 01:09:08.171859 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:08.171819    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab0266b8-91cc-4e7f-93a5-ff58468c8342-credential-socket\") pod \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\" (UID: \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\") "
Sep 06 01:09:08.172092 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:08.171883    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvqqx\" (UniqueName: \"kubernetes.io/projected/ab0266b8-91cc-4e7f-93a5-ff58468c8342-kube-api-access-gvqqx\") pod \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\" (UID: \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\") "
Sep 06 01:09:08.172092 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:08.171911    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab0266b8-91cc-4e7f-93a5-ff58468c8342-workload-certs\") pod \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\" (UID: \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\") "
Sep 06 01:09:08.172092 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:08.171939    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab0266b8-91cc-4e7f-93a5-ff58468c8342-istio-envoy\") pod \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\" (UID: \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\") "
Sep 06 01:09:08.172092 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:08.171974    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab0266b8-91cc-4e7f-93a5-ff58468c8342-istio-data\") pod \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\" (UID: \"ab0266b8-91cc-4e7f-93a5-ff58468c8342\") "
Sep 06 01:09:08.172092 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:08.172004    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab0266b8-91cc-4e7f-93a5-ff58468c8342-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ab0266b8-91cc-4e7f-93a5-ff58468c8342" (UID: "ab0266b8-91cc-4e7f-93a5-ff58468c8342"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:09:08.172314 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:08.172173    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab0266b8-91cc-4e7f-93a5-ff58468c8342-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ab0266b8-91cc-4e7f-93a5-ff58468c8342" (UID: "ab0266b8-91cc-4e7f-93a5-ff58468c8342"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:09:08.172314 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:08.172239    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab0266b8-91cc-4e7f-93a5-ff58468c8342-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ab0266b8-91cc-4e7f-93a5-ff58468c8342" (UID: "ab0266b8-91cc-4e7f-93a5-ff58468c8342"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:09:08.172314 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:08.172248    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab0266b8-91cc-4e7f-93a5-ff58468c8342-istio-data" (OuterVolumeSpecName: "istio-data") pod "ab0266b8-91cc-4e7f-93a5-ff58468c8342" (UID: "ab0266b8-91cc-4e7f-93a5-ff58468c8342"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:09:08.172314 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:08.172263    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab0266b8-91cc-4e7f-93a5-ff58468c8342-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ab0266b8-91cc-4e7f-93a5-ff58468c8342" (UID: "ab0266b8-91cc-4e7f-93a5-ff58468c8342"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:09:08.172518 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:08.172386    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab0266b8-91cc-4e7f-93a5-ff58468c8342-workload-certs\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:09:08.172518 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:08.172407    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab0266b8-91cc-4e7f-93a5-ff58468c8342-istio-data\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:09:08.172518 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:08.172421    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab0266b8-91cc-4e7f-93a5-ff58468c8342-istiod-ca-cert\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:09:08.172518 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:08.172433    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab0266b8-91cc-4e7f-93a5-ff58468c8342-workload-socket\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:09:08.172518 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:08.172446    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab0266b8-91cc-4e7f-93a5-ff58468c8342-credential-socket\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:09:08.174201 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:08.174168    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab0266b8-91cc-4e7f-93a5-ff58468c8342-kube-api-access-gvqqx" (OuterVolumeSpecName: "kube-api-access-gvqqx") pod "ab0266b8-91cc-4e7f-93a5-ff58468c8342" (UID: "ab0266b8-91cc-4e7f-93a5-ff58468c8342"). InnerVolumeSpecName "kube-api-access-gvqqx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:09:08.174388 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:08.174215    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab0266b8-91cc-4e7f-93a5-ff58468c8342-istio-token" (OuterVolumeSpecName: "istio-token") pod "ab0266b8-91cc-4e7f-93a5-ff58468c8342" (UID: "ab0266b8-91cc-4e7f-93a5-ff58468c8342"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:09:08.174388 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:08.174364    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ab0266b8-91cc-4e7f-93a5-ff58468c8342-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ab0266b8-91cc-4e7f-93a5-ff58468c8342" (UID: "ab0266b8-91cc-4e7f-93a5-ff58468c8342"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 01:09:08.174521 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:08.174406    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab0266b8-91cc-4e7f-93a5-ff58468c8342-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ab0266b8-91cc-4e7f-93a5-ff58468c8342" (UID: "ab0266b8-91cc-4e7f-93a5-ff58468c8342"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:09:08.273966 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:08.273928    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvqqx\" (UniqueName: \"kubernetes.io/projected/ab0266b8-91cc-4e7f-93a5-ff58468c8342-kube-api-access-gvqqx\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:09:08.273966 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:08.273960    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab0266b8-91cc-4e7f-93a5-ff58468c8342-istio-envoy\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:09:08.273966 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:08.273969    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab0266b8-91cc-4e7f-93a5-ff58468c8342-istio-podinfo\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:09:08.274193 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:08.273977    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab0266b8-91cc-4e7f-93a5-ff58468c8342-istio-token\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:09:09.047467 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:09.047377    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"
Sep 06 01:09:09.047467 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:09.047378    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b" event={"ID":"ab0266b8-91cc-4e7f-93a5-ff58468c8342","Type":"ContainerDied","Data":"3ac830cfed8bccf39a38e85f5d53d95209ea122e41ae6c6d1e9ec8119608cf76"}
Sep 06 01:09:09.048003 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:09.047516    2577 scope.go:117] "RemoveContainer" containerID="a2b14566fbf075df26fbbac0693a0d0a2c02a6586141c39c1d123cd14e9acdfd"
Sep 06 01:09:09.069074 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:09.069050    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"]
Sep 06 01:09:09.073961 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:09.073940    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-701b5b-openshift-default-84bf8647fb-f9h8b"]
Sep 06 01:09:10.410855 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:10.410811    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab0266b8-91cc-4e7f-93a5-ff58468c8342" path="/var/lib/kubelet/pods/ab0266b8-91cc-4e7f-93a5-ff58468c8342/volumes"
Sep 06 01:09:13.901236 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:13.901206    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-8d5457-7bd89c7ffc-xmd2x"]
Sep 06 01:09:13.901735 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:13.901428    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-8d5457-7bd89c7ffc-xmd2x" podUID="bb2ba3e8-ca46-475f-b29d-54a3e5f7f7ad" containerName="payload-processing" containerID="cri-o://6ce917347f1b9bf835876dee93ba94388f134f2ef5b4367f6e52f86d179b0773" gracePeriod=30
Sep 06 01:09:13.909761 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:13.909733    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-8d5457-5bb98cfbc8-4jqxr"]
Sep 06 01:09:13.910206 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:13.910172    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8d5457-5bb98cfbc8-4jqxr" podUID="1335615f-ccbf-4626-a64c-d2cb084a7dd0" containerName="payload-pre-processing" containerID="cri-o://3f7c178e4b5b44acbb621c509f92dc9298cb78642d1f9391213fb825289c6975" gracePeriod=30
Sep 06 01:09:14.086864 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:14.086821    2577 generic.go:356] "Generic (PLEG): container finished" podID="1335615f-ccbf-4626-a64c-d2cb084a7dd0" containerID="3f7c178e4b5b44acbb621c509f92dc9298cb78642d1f9391213fb825289c6975" exitCode=0
Sep 06 01:09:14.087368 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:14.087046    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8d5457-5bb98cfbc8-4jqxr" event={"ID":"1335615f-ccbf-4626-a64c-d2cb084a7dd0","Type":"ContainerDied","Data":"3f7c178e4b5b44acbb621c509f92dc9298cb78642d1f9391213fb825289c6975"}
Sep 06 01:09:14.090805 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:14.090664    2577 generic.go:356] "Generic (PLEG): container finished" podID="bb2ba3e8-ca46-475f-b29d-54a3e5f7f7ad" containerID="6ce917347f1b9bf835876dee93ba94388f134f2ef5b4367f6e52f86d179b0773" exitCode=0
Sep 06 01:09:14.090805 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:14.090753    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-8d5457-7bd89c7ffc-xmd2x" event={"ID":"bb2ba3e8-ca46-475f-b29d-54a3e5f7f7ad","Type":"ContainerDied","Data":"6ce917347f1b9bf835876dee93ba94388f134f2ef5b4367f6e52f86d179b0773"}
Sep 06 01:09:14.198201 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:14.198178    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-8d5457-7bd89c7ffc-xmd2x"
Sep 06 01:09:14.200269 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:14.200251    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8d5457-5bb98cfbc8-4jqxr"
Sep 06 01:09:14.330235 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:14.330200    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb2ba3e8-ca46-475f-b29d-54a3e5f7f7ad-plugins-config-volume\") pod \"bb2ba3e8-ca46-475f-b29d-54a3e5f7f7ad\" (UID: \"bb2ba3e8-ca46-475f-b29d-54a3e5f7f7ad\") "
Sep 06 01:09:14.330430 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:14.330256    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1335615f-ccbf-4626-a64c-d2cb084a7dd0-plugins-config-volume\") pod \"1335615f-ccbf-4626-a64c-d2cb084a7dd0\" (UID: \"1335615f-ccbf-4626-a64c-d2cb084a7dd0\") "
Sep 06 01:09:14.330430 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:14.330296    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qm5j5\" (UniqueName: \"kubernetes.io/projected/1335615f-ccbf-4626-a64c-d2cb084a7dd0-kube-api-access-qm5j5\") pod \"1335615f-ccbf-4626-a64c-d2cb084a7dd0\" (UID: \"1335615f-ccbf-4626-a64c-d2cb084a7dd0\") "
Sep 06 01:09:14.330430 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:14.330381    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2rx2\" (UniqueName: \"kubernetes.io/projected/bb2ba3e8-ca46-475f-b29d-54a3e5f7f7ad-kube-api-access-m2rx2\") pod \"bb2ba3e8-ca46-475f-b29d-54a3e5f7f7ad\" (UID: \"bb2ba3e8-ca46-475f-b29d-54a3e5f7f7ad\") "
Sep 06 01:09:14.330661 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:14.330630    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb2ba3e8-ca46-475f-b29d-54a3e5f7f7ad-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bb2ba3e8-ca46-475f-b29d-54a3e5f7f7ad" (UID: "bb2ba3e8-ca46-475f-b29d-54a3e5f7f7ad"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:09:14.330739 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:14.330691    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1335615f-ccbf-4626-a64c-d2cb084a7dd0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1335615f-ccbf-4626-a64c-d2cb084a7dd0" (UID: "1335615f-ccbf-4626-a64c-d2cb084a7dd0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:09:14.332650 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:14.332611    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1335615f-ccbf-4626-a64c-d2cb084a7dd0-kube-api-access-qm5j5" (OuterVolumeSpecName: "kube-api-access-qm5j5") pod "1335615f-ccbf-4626-a64c-d2cb084a7dd0" (UID: "1335615f-ccbf-4626-a64c-d2cb084a7dd0"). InnerVolumeSpecName "kube-api-access-qm5j5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:09:14.332650 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:14.332616    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb2ba3e8-ca46-475f-b29d-54a3e5f7f7ad-kube-api-access-m2rx2" (OuterVolumeSpecName: "kube-api-access-m2rx2") pod "bb2ba3e8-ca46-475f-b29d-54a3e5f7f7ad" (UID: "bb2ba3e8-ca46-475f-b29d-54a3e5f7f7ad"). InnerVolumeSpecName "kube-api-access-m2rx2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:09:14.431480 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:14.431454    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb2ba3e8-ca46-475f-b29d-54a3e5f7f7ad-plugins-config-volume\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:09:14.431480 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:14.431479    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1335615f-ccbf-4626-a64c-d2cb084a7dd0-plugins-config-volume\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:09:14.431632 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:14.431489    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qm5j5\" (UniqueName: \"kubernetes.io/projected/1335615f-ccbf-4626-a64c-d2cb084a7dd0-kube-api-access-qm5j5\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:09:14.431632 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:14.431497    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2rx2\" (UniqueName: \"kubernetes.io/projected/bb2ba3e8-ca46-475f-b29d-54a3e5f7f7ad-kube-api-access-m2rx2\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:09:15.098004 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:15.097972    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-8d5457-7bd89c7ffc-xmd2x"
Sep 06 01:09:15.098451 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:15.098008    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-8d5457-7bd89c7ffc-xmd2x" event={"ID":"bb2ba3e8-ca46-475f-b29d-54a3e5f7f7ad","Type":"ContainerDied","Data":"f0cad1a0a4f62b3755419c47ea39e155ed3a8c83312d159cd730c20804d6e8b2"}
Sep 06 01:09:15.098451 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:15.098073    2577 scope.go:117] "RemoveContainer" containerID="6ce917347f1b9bf835876dee93ba94388f134f2ef5b4367f6e52f86d179b0773"
Sep 06 01:09:15.099414 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:15.099391    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8d5457-5bb98cfbc8-4jqxr" event={"ID":"1335615f-ccbf-4626-a64c-d2cb084a7dd0","Type":"ContainerDied","Data":"65b6009690616f274c5699345b773a35625ce2d0b0a023198b11ea5883d85e11"}
Sep 06 01:09:15.099492 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:15.099423    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8d5457-5bb98cfbc8-4jqxr"
Sep 06 01:09:15.107547 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:15.107526    2577 scope.go:117] "RemoveContainer" containerID="3f7c178e4b5b44acbb621c509f92dc9298cb78642d1f9391213fb825289c6975"
Sep 06 01:09:15.132897 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:15.132868    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-8d5457-5bb98cfbc8-4jqxr"]
Sep 06 01:09:15.138563 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:15.138541    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-8d5457-5bb98cfbc8-4jqxr"]
Sep 06 01:09:15.151410 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:15.151381    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-8d5457-7bd89c7ffc-xmd2x"]
Sep 06 01:09:15.155598 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:15.155576    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-8d5457-7bd89c7ffc-xmd2x"]
Sep 06 01:09:16.409507 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:16.409477    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1335615f-ccbf-4626-a64c-d2cb084a7dd0" path="/var/lib/kubelet/pods/1335615f-ccbf-4626-a64c-d2cb084a7dd0/volumes"
Sep 06 01:09:16.409884 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:16.409845    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb2ba3e8-ca46-475f-b29d-54a3e5f7f7ad" path="/var/lib/kubelet/pods/bb2ba3e8-ca46-475f-b29d-54a3e5f7f7ad/volumes"
Sep 06 01:09:17.661395 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:17.661363    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:09:20.720196 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:20.720154    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"]
Sep 06 01:09:20.720930 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:20.720887    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z" podUID="6190fbea-4c15-41e7-a113-174215c22258" containerName="istio-proxy" containerID="cri-o://54f52afc4ee541d4d8d5f0fd7c14aa07f30e130dbc2b0dd66c2b886ad0e335a2" gracePeriod=30
Sep 06 01:09:21.591494 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.591464    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"]
Sep 06 01:09:21.591880 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.591868    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb2ba3e8-ca46-475f-b29d-54a3e5f7f7ad" containerName="payload-processing"
Sep 06 01:09:21.591941 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.591882    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb2ba3e8-ca46-475f-b29d-54a3e5f7f7ad" containerName="payload-processing"
Sep 06 01:09:21.591941 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.591893    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c00fca49-423e-48a9-b8d6-0b4bcb3441f6" containerName="payload-processing"
Sep 06 01:09:21.591941 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.591898    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c00fca49-423e-48a9-b8d6-0b4bcb3441f6" containerName="payload-processing"
Sep 06 01:09:21.591941 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.591907    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab0266b8-91cc-4e7f-93a5-ff58468c8342" containerName="istio-proxy"
Sep 06 01:09:21.591941 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.591913    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab0266b8-91cc-4e7f-93a5-ff58468c8342" containerName="istio-proxy"
Sep 06 01:09:21.591941 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.591935    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1335615f-ccbf-4626-a64c-d2cb084a7dd0" containerName="payload-pre-processing"
Sep 06 01:09:21.591941 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.591940    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1335615f-ccbf-4626-a64c-d2cb084a7dd0" containerName="payload-pre-processing"
Sep 06 01:09:21.592171 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.591951    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e449e8cb-bb1c-4363-ba2d-557816d6e9bd" containerName="payload-pre-processing"
Sep 06 01:09:21.592171 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.591956    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e449e8cb-bb1c-4363-ba2d-557816d6e9bd" containerName="payload-pre-processing"
Sep 06 01:09:21.592171 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.592011    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb2ba3e8-ca46-475f-b29d-54a3e5f7f7ad" containerName="payload-processing"
Sep 06 01:09:21.592171 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.592019    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab0266b8-91cc-4e7f-93a5-ff58468c8342" containerName="istio-proxy"
Sep 06 01:09:21.592171 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.592024    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="17200dd1-1359-416a-a5b0-3805772d737a" containerName="istio-proxy"
Sep 06 01:09:21.592171 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.592029    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e449e8cb-bb1c-4363-ba2d-557816d6e9bd" containerName="payload-pre-processing"
Sep 06 01:09:21.592171 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.592036    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c00fca49-423e-48a9-b8d6-0b4bcb3441f6" containerName="payload-processing"
Sep 06 01:09:21.592171 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.592045    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1335615f-ccbf-4626-a64c-d2cb084a7dd0" containerName="payload-pre-processing"
Sep 06 01:09:21.597199 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.597177    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"
Sep 06 01:09:21.599635 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.599610    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-5844a8-openshift-default-dockercfg-6trzl\""
Sep 06 01:09:21.607338 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.607291    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"]
Sep 06 01:09:21.710981 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.710937    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-credential-socket\") pod \"e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs\" (UID: \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\") " pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"
Sep 06 01:09:21.711217 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.711176    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-istio-envoy\") pod \"e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs\" (UID: \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\") " pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"
Sep 06 01:09:21.711657 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.711568    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-istio-token\") pod \"e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs\" (UID: \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\") " pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"
Sep 06 01:09:21.711657 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.711603    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-istio-data\") pod \"e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs\" (UID: \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\") " pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"
Sep 06 01:09:21.711876 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.711635    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-workload-certs\") pod \"e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs\" (UID: \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\") " pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"
Sep 06 01:09:21.711876 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.711762    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-istio-podinfo\") pod \"e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs\" (UID: \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\") " pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"
Sep 06 01:09:21.711876 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.711830    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-istiod-ca-cert\") pod \"e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs\" (UID: \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\") " pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"
Sep 06 01:09:21.712033 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.711873    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-workload-socket\") pod \"e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs\" (UID: \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\") " pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"
Sep 06 01:09:21.712033 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.711956    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9lv6\" (UniqueName: \"kubernetes.io/projected/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-kube-api-access-f9lv6\") pod \"e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs\" (UID: \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\") " pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"
Sep 06 01:09:21.812863 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.812828    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-istio-podinfo\") pod \"e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs\" (UID: \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\") " pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"
Sep 06 01:09:21.813351 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.812877    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-istiod-ca-cert\") pod \"e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs\" (UID: \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\") " pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"
Sep 06 01:09:21.813351 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.813013    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-workload-socket\") pod \"e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs\" (UID: \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\") " pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"
Sep 06 01:09:21.813351 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.813056    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9lv6\" (UniqueName: \"kubernetes.io/projected/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-kube-api-access-f9lv6\") pod \"e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs\" (UID: \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\") " pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"
Sep 06 01:09:21.813351 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.813130    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-credential-socket\") pod \"e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs\" (UID: \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\") " pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"
Sep 06 01:09:21.813351 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.813165    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-istio-envoy\") pod \"e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs\" (UID: \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\") " pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"
Sep 06 01:09:21.813351 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.813201    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-istio-token\") pod \"e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs\" (UID: \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\") " pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"
Sep 06 01:09:21.813351 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.813235    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-istio-data\") pod \"e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs\" (UID: \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\") " pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"
Sep 06 01:09:21.813351 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.813280    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-workload-certs\") pod \"e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs\" (UID: \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\") " pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"
Sep 06 01:09:21.813771 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.813441    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-workload-socket\") pod \"e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs\" (UID: \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\") " pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"
Sep 06 01:09:21.813771 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.813556    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-credential-socket\") pod \"e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs\" (UID: \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\") " pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"
Sep 06 01:09:21.813771 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.813631    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-workload-certs\") pod \"e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs\" (UID: \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\") " pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"
Sep 06 01:09:21.813771 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.813635    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-istiod-ca-cert\") pod \"e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs\" (UID: \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\") " pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"
Sep 06 01:09:21.813771 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.813719    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-istio-data\") pod \"e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs\" (UID: \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\") " pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"
Sep 06 01:09:21.815663 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.815631    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-istio-podinfo\") pod \"e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs\" (UID: \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\") " pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"
Sep 06 01:09:21.815783 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.815767    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-istio-envoy\") pod \"e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs\" (UID: \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\") " pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"
Sep 06 01:09:21.822340 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.822301    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9lv6\" (UniqueName: \"kubernetes.io/projected/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-kube-api-access-f9lv6\") pod \"e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs\" (UID: \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\") " pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"
Sep 06 01:09:21.822461 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.822445    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-istio-token\") pod \"e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs\" (UID: \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\") " pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"
Sep 06 01:09:21.908618 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:21.908586    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"
Sep 06 01:09:22.188740 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:22.188703    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"]
Sep 06 01:09:22.191000 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:09:22.190973    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb10f642_efa8_4864_bd6c_f2f610c6e3f2.slice/crio-18b973f823c3b6b9dc3f5460496f6bb79cc8dcbe7f105d92e353c5c4aca2aa43 WatchSource:0}: Error finding container 18b973f823c3b6b9dc3f5460496f6bb79cc8dcbe7f105d92e353c5c4aca2aa43: Status 404 returned error can't find the container with id 18b973f823c3b6b9dc3f5460496f6bb79cc8dcbe7f105d92e353c5c4aca2aa43
Sep 06 01:09:22.192964 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:22.192930    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:09:22.193049 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:22.192995    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:09:22.193049 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:22.193022    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:09:23.146670 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:23.146640    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs" event={"ID":"fb10f642-efa8-4864-bd6c-f2f610c6e3f2","Type":"ContainerStarted","Data":"74587a33526910265e843312057374a86e63470dbc4138b054d4c9944dbcb14d"}
Sep 06 01:09:23.147103 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:23.146693    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs" event={"ID":"fb10f642-efa8-4864-bd6c-f2f610c6e3f2","Type":"ContainerStarted","Data":"18b973f823c3b6b9dc3f5460496f6bb79cc8dcbe7f105d92e353c5c4aca2aa43"}
Sep 06 01:09:23.167219 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:23.167160    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs" podStartSLOduration=2.167141391 podStartE2EDuration="2.167141391s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:09:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:23.165088569 +0000 UTC m=+1121.201231537" watchObservedRunningTime="2026-09-06 01:09:23.167141391 +0000 UTC m=+1121.203284347"
Sep 06 01:09:23.908808 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:23.908773    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"
Sep 06 01:09:23.913854 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:23.913827    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"
Sep 06 01:09:24.153241 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:24.153209    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"
Sep 06 01:09:24.154331 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:24.154299    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"
Sep 06 01:09:25.978112 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:25.978090    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"
Sep 06 01:09:26.053995 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:26.053909    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6190fbea-4c15-41e7-a113-174215c22258-istio-token\") pod \"6190fbea-4c15-41e7-a113-174215c22258\" (UID: \"6190fbea-4c15-41e7-a113-174215c22258\") "
Sep 06 01:09:26.053995 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:26.053943    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6190fbea-4c15-41e7-a113-174215c22258-workload-socket\") pod \"6190fbea-4c15-41e7-a113-174215c22258\" (UID: \"6190fbea-4c15-41e7-a113-174215c22258\") "
Sep 06 01:09:26.053995 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:26.053972    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6190fbea-4c15-41e7-a113-174215c22258-workload-certs\") pod \"6190fbea-4c15-41e7-a113-174215c22258\" (UID: \"6190fbea-4c15-41e7-a113-174215c22258\") "
Sep 06 01:09:26.053995 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:26.053995    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7cz9\" (UniqueName: \"kubernetes.io/projected/6190fbea-4c15-41e7-a113-174215c22258-kube-api-access-c7cz9\") pod \"6190fbea-4c15-41e7-a113-174215c22258\" (UID: \"6190fbea-4c15-41e7-a113-174215c22258\") "
Sep 06 01:09:26.054367 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:26.054039    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6190fbea-4c15-41e7-a113-174215c22258-credential-socket\") pod \"6190fbea-4c15-41e7-a113-174215c22258\" (UID: \"6190fbea-4c15-41e7-a113-174215c22258\") "
Sep 06 01:09:26.054367 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:26.054092    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6190fbea-4c15-41e7-a113-174215c22258-istio-envoy\") pod \"6190fbea-4c15-41e7-a113-174215c22258\" (UID: \"6190fbea-4c15-41e7-a113-174215c22258\") "
Sep 06 01:09:26.054367 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:26.054212    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6190fbea-4c15-41e7-a113-174215c22258-istio-podinfo\") pod \"6190fbea-4c15-41e7-a113-174215c22258\" (UID: \"6190fbea-4c15-41e7-a113-174215c22258\") "
Sep 06 01:09:26.054367 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:26.054255    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6190fbea-4c15-41e7-a113-174215c22258-istiod-ca-cert\") pod \"6190fbea-4c15-41e7-a113-174215c22258\" (UID: \"6190fbea-4c15-41e7-a113-174215c22258\") "
Sep 06 01:09:26.054367 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:26.054287    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6190fbea-4c15-41e7-a113-174215c22258-istio-data\") pod \"6190fbea-4c15-41e7-a113-174215c22258\" (UID: \"6190fbea-4c15-41e7-a113-174215c22258\") "
Sep 06 01:09:26.054671 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:26.054356    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6190fbea-4c15-41e7-a113-174215c22258-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6190fbea-4c15-41e7-a113-174215c22258" (UID: "6190fbea-4c15-41e7-a113-174215c22258"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:09:26.054671 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:26.054381    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6190fbea-4c15-41e7-a113-174215c22258-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6190fbea-4c15-41e7-a113-174215c22258" (UID: "6190fbea-4c15-41e7-a113-174215c22258"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:09:26.054671 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:26.054458    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6190fbea-4c15-41e7-a113-174215c22258-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6190fbea-4c15-41e7-a113-174215c22258" (UID: "6190fbea-4c15-41e7-a113-174215c22258"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:09:26.054810 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:26.054671    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6190fbea-4c15-41e7-a113-174215c22258-istio-data" (OuterVolumeSpecName: "istio-data") pod "6190fbea-4c15-41e7-a113-174215c22258" (UID: "6190fbea-4c15-41e7-a113-174215c22258"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:09:26.054810 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:26.054695    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6190fbea-4c15-41e7-a113-174215c22258-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6190fbea-4c15-41e7-a113-174215c22258" (UID: "6190fbea-4c15-41e7-a113-174215c22258"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:09:26.054810 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:26.054772    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6190fbea-4c15-41e7-a113-174215c22258-istiod-ca-cert\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:09:26.054810 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:26.054789    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6190fbea-4c15-41e7-a113-174215c22258-istio-data\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:09:26.054810 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:26.054802    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6190fbea-4c15-41e7-a113-174215c22258-workload-socket\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:09:26.055001 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:26.054814    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6190fbea-4c15-41e7-a113-174215c22258-workload-certs\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:09:26.055001 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:26.054827    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6190fbea-4c15-41e7-a113-174215c22258-credential-socket\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:09:26.056547 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:26.056523    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6190fbea-4c15-41e7-a113-174215c22258-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6190fbea-4c15-41e7-a113-174215c22258" (UID: "6190fbea-4c15-41e7-a113-174215c22258"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 01:09:26.056547 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:26.056533    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6190fbea-4c15-41e7-a113-174215c22258-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6190fbea-4c15-41e7-a113-174215c22258" (UID: "6190fbea-4c15-41e7-a113-174215c22258"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:09:26.056789 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:26.056770    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6190fbea-4c15-41e7-a113-174215c22258-istio-token" (OuterVolumeSpecName: "istio-token") pod "6190fbea-4c15-41e7-a113-174215c22258" (UID: "6190fbea-4c15-41e7-a113-174215c22258"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:09:26.056848 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:26.056786    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6190fbea-4c15-41e7-a113-174215c22258-kube-api-access-c7cz9" (OuterVolumeSpecName: "kube-api-access-c7cz9") pod "6190fbea-4c15-41e7-a113-174215c22258" (UID: "6190fbea-4c15-41e7-a113-174215c22258"). InnerVolumeSpecName "kube-api-access-c7cz9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:09:26.155711 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:26.155677    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6190fbea-4c15-41e7-a113-174215c22258-istio-token\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:09:26.155711 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:26.155707    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7cz9\" (UniqueName: \"kubernetes.io/projected/6190fbea-4c15-41e7-a113-174215c22258-kube-api-access-c7cz9\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:09:26.155711 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:26.155718    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6190fbea-4c15-41e7-a113-174215c22258-istio-envoy\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:09:26.155949 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:26.155727    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6190fbea-4c15-41e7-a113-174215c22258-istio-podinfo\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:09:26.166026 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:26.165989    2577 generic.go:356] "Generic (PLEG): container finished" podID="6190fbea-4c15-41e7-a113-174215c22258" containerID="54f52afc4ee541d4d8d5f0fd7c14aa07f30e130dbc2b0dd66c2b886ad0e335a2" exitCode=0
Sep 06 01:09:26.166191 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:26.166061    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"
Sep 06 01:09:26.166191 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:26.166081    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z" event={"ID":"6190fbea-4c15-41e7-a113-174215c22258","Type":"ContainerDied","Data":"54f52afc4ee541d4d8d5f0fd7c14aa07f30e130dbc2b0dd66c2b886ad0e335a2"}
Sep 06 01:09:26.166191 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:26.166167    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z" event={"ID":"6190fbea-4c15-41e7-a113-174215c22258","Type":"ContainerDied","Data":"71c5b4e8618b85e4e3654f6e011a9d1bcd7959cf5a2a6335d19b4e3bca270ed9"}
Sep 06 01:09:26.166374 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:26.166245    2577 scope.go:117] "RemoveContainer" containerID="54f52afc4ee541d4d8d5f0fd7c14aa07f30e130dbc2b0dd66c2b886ad0e335a2"
Sep 06 01:09:26.175767 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:26.175748    2577 scope.go:117] "RemoveContainer" containerID="1763853c7a116bfc5ddc2bf35594f897f9db5b93ea60275f0c70332e1b46e3eb"
Sep 06 01:09:26.183844 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:26.183828    2577 scope.go:117] "RemoveContainer" containerID="54f52afc4ee541d4d8d5f0fd7c14aa07f30e130dbc2b0dd66c2b886ad0e335a2"
Sep 06 01:09:26.184121 ip-10-0-140-57 kubenswrapper[2577]: E0906 01:09:26.184101    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54f52afc4ee541d4d8d5f0fd7c14aa07f30e130dbc2b0dd66c2b886ad0e335a2\": container with ID starting with 54f52afc4ee541d4d8d5f0fd7c14aa07f30e130dbc2b0dd66c2b886ad0e335a2 not found: ID does not exist" containerID="54f52afc4ee541d4d8d5f0fd7c14aa07f30e130dbc2b0dd66c2b886ad0e335a2"
Sep 06 01:09:26.184168 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:26.184129    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54f52afc4ee541d4d8d5f0fd7c14aa07f30e130dbc2b0dd66c2b886ad0e335a2"} err="failed to get container status \"54f52afc4ee541d4d8d5f0fd7c14aa07f30e130dbc2b0dd66c2b886ad0e335a2\": rpc error: code = NotFound desc = could not find container \"54f52afc4ee541d4d8d5f0fd7c14aa07f30e130dbc2b0dd66c2b886ad0e335a2\": container with ID starting with 54f52afc4ee541d4d8d5f0fd7c14aa07f30e130dbc2b0dd66c2b886ad0e335a2 not found: ID does not exist"
Sep 06 01:09:26.184168 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:26.184145    2577 scope.go:117] "RemoveContainer" containerID="1763853c7a116bfc5ddc2bf35594f897f9db5b93ea60275f0c70332e1b46e3eb"
Sep 06 01:09:26.184411 ip-10-0-140-57 kubenswrapper[2577]: E0906 01:09:26.184395    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1763853c7a116bfc5ddc2bf35594f897f9db5b93ea60275f0c70332e1b46e3eb\": container with ID starting with 1763853c7a116bfc5ddc2bf35594f897f9db5b93ea60275f0c70332e1b46e3eb not found: ID does not exist" containerID="1763853c7a116bfc5ddc2bf35594f897f9db5b93ea60275f0c70332e1b46e3eb"
Sep 06 01:09:26.184471 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:26.184413    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1763853c7a116bfc5ddc2bf35594f897f9db5b93ea60275f0c70332e1b46e3eb"} err="failed to get container status \"1763853c7a116bfc5ddc2bf35594f897f9db5b93ea60275f0c70332e1b46e3eb\": rpc error: code = NotFound desc = could not find container \"1763853c7a116bfc5ddc2bf35594f897f9db5b93ea60275f0c70332e1b46e3eb\": container with ID starting with 1763853c7a116bfc5ddc2bf35594f897f9db5b93ea60275f0c70332e1b46e3eb not found: ID does not exist"
Sep 06 01:09:26.187589 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:26.187568    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"]
Sep 06 01:09:26.195418 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:26.195381    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-8d5457-openshift-default-85d67c57fd-q5z9z"]
Sep 06 01:09:26.412381 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:26.412348    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6190fbea-4c15-41e7-a113-174215c22258" path="/var/lib/kubelet/pods/6190fbea-4c15-41e7-a113-174215c22258/volumes"
Sep 06 01:09:27.012468 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:27.012431    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5844a8-f4c7954cd-njpxh"]
Sep 06 01:09:27.012891 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:27.012878    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6190fbea-4c15-41e7-a113-174215c22258" containerName="istio-proxy"
Sep 06 01:09:27.012935 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:27.012892    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6190fbea-4c15-41e7-a113-174215c22258" containerName="istio-proxy"
Sep 06 01:09:27.012935 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:27.012915    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab0266b8-91cc-4e7f-93a5-ff58468c8342" containerName="istio-proxy"
Sep 06 01:09:27.012935 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:27.012921    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab0266b8-91cc-4e7f-93a5-ff58468c8342" containerName="istio-proxy"
Sep 06 01:09:27.013028 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:27.012977    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6190fbea-4c15-41e7-a113-174215c22258" containerName="istio-proxy"
Sep 06 01:09:27.013028 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:27.012987    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab0266b8-91cc-4e7f-93a5-ff58468c8342" containerName="istio-proxy"
Sep 06 01:09:27.013028 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:27.012994    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6190fbea-4c15-41e7-a113-174215c22258" containerName="istio-proxy"
Sep 06 01:09:27.017611 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:27.017589    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5844a8-f4c7954cd-njpxh"
Sep 06 01:09:27.020356 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:27.020332    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-5844a8\""
Sep 06 01:09:27.021034 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:27.021020    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-5844a8-dockercfg-qwknv\""
Sep 06 01:09:27.029620 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:27.029600    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5844a8-f4c7954cd-njpxh"]
Sep 06 01:09:27.065052 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:27.065022    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f326d5de-4074-4535-9d36-846f3e2c0561-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-5844a8-f4c7954cd-njpxh\" (UID: \"f326d5de-4074-4535-9d36-846f3e2c0561\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5844a8-f4c7954cd-njpxh"
Sep 06 01:09:27.065217 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:27.065081    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx6p7\" (UniqueName: \"kubernetes.io/projected/f326d5de-4074-4535-9d36-846f3e2c0561-kube-api-access-bx6p7\") pod \"payload-pre-processing-e2e-shared-a-w3-5844a8-f4c7954cd-njpxh\" (UID: \"f326d5de-4074-4535-9d36-846f3e2c0561\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5844a8-f4c7954cd-njpxh"
Sep 06 01:09:27.107627 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:27.107593    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-5844a8-855bd94cf-7rdst"]
Sep 06 01:09:27.108283 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:27.108266    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6190fbea-4c15-41e7-a113-174215c22258" containerName="istio-proxy"
Sep 06 01:09:27.108353 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:27.108288    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6190fbea-4c15-41e7-a113-174215c22258" containerName="istio-proxy"
Sep 06 01:09:27.118167 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:27.118129    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-5844a8-855bd94cf-7rdst"
Sep 06 01:09:27.121710 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:27.121683    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-5844a8-855bd94cf-7rdst"]
Sep 06 01:09:27.165873 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:27.165840    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f326d5de-4074-4535-9d36-846f3e2c0561-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-5844a8-f4c7954cd-njpxh\" (UID: \"f326d5de-4074-4535-9d36-846f3e2c0561\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5844a8-f4c7954cd-njpxh"
Sep 06 01:09:27.166037 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:27.165899    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx6p7\" (UniqueName: \"kubernetes.io/projected/f326d5de-4074-4535-9d36-846f3e2c0561-kube-api-access-bx6p7\") pod \"payload-pre-processing-e2e-shared-a-w3-5844a8-f4c7954cd-njpxh\" (UID: \"f326d5de-4074-4535-9d36-846f3e2c0561\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5844a8-f4c7954cd-njpxh"
Sep 06 01:09:27.166037 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:27.165937    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a21771ae-a2c0-4d7f-8f4c-cfce9eb1a474-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-5844a8-855bd94cf-7rdst\" (UID: \"a21771ae-a2c0-4d7f-8f4c-cfce9eb1a474\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-5844a8-855bd94cf-7rdst"
Sep 06 01:09:27.166037 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:27.165958    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cgfx\" (UniqueName: \"kubernetes.io/projected/a21771ae-a2c0-4d7f-8f4c-cfce9eb1a474-kube-api-access-2cgfx\") pod \"payload-processing-e2e-shared-a-w3-5844a8-855bd94cf-7rdst\" (UID: \"a21771ae-a2c0-4d7f-8f4c-cfce9eb1a474\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-5844a8-855bd94cf-7rdst"
Sep 06 01:09:27.166613 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:27.166592    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f326d5de-4074-4535-9d36-846f3e2c0561-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-5844a8-f4c7954cd-njpxh\" (UID: \"f326d5de-4074-4535-9d36-846f3e2c0561\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5844a8-f4c7954cd-njpxh"
Sep 06 01:09:27.174096 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:27.174065    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx6p7\" (UniqueName: \"kubernetes.io/projected/f326d5de-4074-4535-9d36-846f3e2c0561-kube-api-access-bx6p7\") pod \"payload-pre-processing-e2e-shared-a-w3-5844a8-f4c7954cd-njpxh\" (UID: \"f326d5de-4074-4535-9d36-846f3e2c0561\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5844a8-f4c7954cd-njpxh"
Sep 06 01:09:27.266906 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:27.266813    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a21771ae-a2c0-4d7f-8f4c-cfce9eb1a474-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-5844a8-855bd94cf-7rdst\" (UID: \"a21771ae-a2c0-4d7f-8f4c-cfce9eb1a474\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-5844a8-855bd94cf-7rdst"
Sep 06 01:09:27.266906 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:27.266854    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cgfx\" (UniqueName: \"kubernetes.io/projected/a21771ae-a2c0-4d7f-8f4c-cfce9eb1a474-kube-api-access-2cgfx\") pod \"payload-processing-e2e-shared-a-w3-5844a8-855bd94cf-7rdst\" (UID: \"a21771ae-a2c0-4d7f-8f4c-cfce9eb1a474\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-5844a8-855bd94cf-7rdst"
Sep 06 01:09:27.267518 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:27.267498    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a21771ae-a2c0-4d7f-8f4c-cfce9eb1a474-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-5844a8-855bd94cf-7rdst\" (UID: \"a21771ae-a2c0-4d7f-8f4c-cfce9eb1a474\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-5844a8-855bd94cf-7rdst"
Sep 06 01:09:27.274959 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:27.274938    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cgfx\" (UniqueName: \"kubernetes.io/projected/a21771ae-a2c0-4d7f-8f4c-cfce9eb1a474-kube-api-access-2cgfx\") pod \"payload-processing-e2e-shared-a-w3-5844a8-855bd94cf-7rdst\" (UID: \"a21771ae-a2c0-4d7f-8f4c-cfce9eb1a474\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-5844a8-855bd94cf-7rdst"
Sep 06 01:09:27.328090 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:27.328058    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5844a8-f4c7954cd-njpxh"
Sep 06 01:09:27.431699 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:27.431660    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-5844a8-855bd94cf-7rdst"
Sep 06 01:09:27.600768 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:27.600742    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5844a8-f4c7954cd-njpxh"]
Sep 06 01:09:27.602547 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:09:27.602523    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf326d5de_4074_4535_9d36_846f3e2c0561.slice/crio-370185a63242bbdfe718dc58290ffb966e2dd69bd95a02c9424565c14f16c34a WatchSource:0}: Error finding container 370185a63242bbdfe718dc58290ffb966e2dd69bd95a02c9424565c14f16c34a: Status 404 returned error can't find the container with id 370185a63242bbdfe718dc58290ffb966e2dd69bd95a02c9424565c14f16c34a
Sep 06 01:09:27.707399 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:27.707221    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-5844a8-855bd94cf-7rdst"]
Sep 06 01:09:27.710282 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:09:27.710238    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda21771ae_a2c0_4d7f_8f4c_cfce9eb1a474.slice/crio-3532bc644080bafc73dae431d9a7a6eeeea34058f2d9f0f5d3806382a380f567 WatchSource:0}: Error finding container 3532bc644080bafc73dae431d9a7a6eeeea34058f2d9f0f5d3806382a380f567: Status 404 returned error can't find the container with id 3532bc644080bafc73dae431d9a7a6eeeea34058f2d9f0f5d3806382a380f567
Sep 06 01:09:28.179528 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:28.179486    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5844a8-f4c7954cd-njpxh" event={"ID":"f326d5de-4074-4535-9d36-846f3e2c0561","Type":"ContainerStarted","Data":"a810024a057d0f2fae538ea5610fcb7cf648af86f5c4b61705c7e40c7b2a771f"}
Sep 06 01:09:28.179989 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:28.179551    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5844a8-f4c7954cd-njpxh" event={"ID":"f326d5de-4074-4535-9d36-846f3e2c0561","Type":"ContainerStarted","Data":"370185a63242bbdfe718dc58290ffb966e2dd69bd95a02c9424565c14f16c34a"}
Sep 06 01:09:28.179989 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:28.179687    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5844a8-f4c7954cd-njpxh"
Sep 06 01:09:28.181193 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:28.181168    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-5844a8-855bd94cf-7rdst" event={"ID":"a21771ae-a2c0-4d7f-8f4c-cfce9eb1a474","Type":"ContainerStarted","Data":"9892c08cf9cdd593c7f641d7f0f2aecc6d3db5489dce47977a9c38cbd06e0f3b"}
Sep 06 01:09:28.181293 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:28.181219    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-5844a8-855bd94cf-7rdst" event={"ID":"a21771ae-a2c0-4d7f-8f4c-cfce9eb1a474","Type":"ContainerStarted","Data":"3532bc644080bafc73dae431d9a7a6eeeea34058f2d9f0f5d3806382a380f567"}
Sep 06 01:09:28.181293 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:28.181248    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-5844a8-855bd94cf-7rdst"
Sep 06 01:09:28.197974 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:28.197924    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5844a8-f4c7954cd-njpxh" podStartSLOduration=2.197910707 podStartE2EDuration="2.197910707s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:09:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:28.195628811 +0000 UTC m=+1126.231771772" watchObservedRunningTime="2026-09-06 01:09:28.197910707 +0000 UTC m=+1126.234053664"
Sep 06 01:09:28.216115 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:28.216056    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-5844a8-855bd94cf-7rdst" podStartSLOduration=1.216034019 podStartE2EDuration="1.216034019s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:09:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:28.213125986 +0000 UTC m=+1126.249268944" watchObservedRunningTime="2026-09-06 01:09:28.216034019 +0000 UTC m=+1126.252176978"
Sep 06 01:09:31.062463 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:31.062435    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:09:34.743633 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:34.743275    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-40d55b26-75cc7f8998-zms8w"]
Sep 06 01:09:34.744115 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:34.743635    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-40d55b26-75cc7f8998-zms8w" podUID="04fd2140-0de1-49ef-88c1-d46e8468ae0b" containerName="payload-pre-processing" containerID="cri-o://aa55ed0d75a5c0d9719f573b945de91f0113e09c7db385da20e44a256b191233" gracePeriod=30
Sep 06 01:09:35.048750 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:35.048725    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-40d55b26-75cc7f8998-zms8w"
Sep 06 01:09:35.149434 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:35.149404    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04fd2140-0de1-49ef-88c1-d46e8468ae0b-plugins-config-volume\") pod \"04fd2140-0de1-49ef-88c1-d46e8468ae0b\" (UID: \"04fd2140-0de1-49ef-88c1-d46e8468ae0b\") "
Sep 06 01:09:35.149594 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:35.149444    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67th8\" (UniqueName: \"kubernetes.io/projected/04fd2140-0de1-49ef-88c1-d46e8468ae0b-kube-api-access-67th8\") pod \"04fd2140-0de1-49ef-88c1-d46e8468ae0b\" (UID: \"04fd2140-0de1-49ef-88c1-d46e8468ae0b\") "
Sep 06 01:09:35.149778 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:35.149758    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04fd2140-0de1-49ef-88c1-d46e8468ae0b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "04fd2140-0de1-49ef-88c1-d46e8468ae0b" (UID: "04fd2140-0de1-49ef-88c1-d46e8468ae0b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:09:35.151598 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:35.151576    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04fd2140-0de1-49ef-88c1-d46e8468ae0b-kube-api-access-67th8" (OuterVolumeSpecName: "kube-api-access-67th8") pod "04fd2140-0de1-49ef-88c1-d46e8468ae0b" (UID: "04fd2140-0de1-49ef-88c1-d46e8468ae0b"). InnerVolumeSpecName "kube-api-access-67th8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:09:35.237346 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:35.236902    2577 generic.go:356] "Generic (PLEG): container finished" podID="04fd2140-0de1-49ef-88c1-d46e8468ae0b" containerID="aa55ed0d75a5c0d9719f573b945de91f0113e09c7db385da20e44a256b191233" exitCode=0
Sep 06 01:09:35.237346 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:35.237026    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-40d55b26-75cc7f8998-zms8w" event={"ID":"04fd2140-0de1-49ef-88c1-d46e8468ae0b","Type":"ContainerDied","Data":"aa55ed0d75a5c0d9719f573b945de91f0113e09c7db385da20e44a256b191233"}
Sep 06 01:09:35.237346 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:35.237078    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-40d55b26-75cc7f8998-zms8w" event={"ID":"04fd2140-0de1-49ef-88c1-d46e8468ae0b","Type":"ContainerDied","Data":"519d24db32dd0594acee22811633850e584f21767f7f17a39d6a87c276993fa7"}
Sep 06 01:09:35.237346 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:35.237106    2577 scope.go:117] "RemoveContainer" containerID="aa55ed0d75a5c0d9719f573b945de91f0113e09c7db385da20e44a256b191233"
Sep 06 01:09:35.237346 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:35.237244    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-40d55b26-75cc7f8998-zms8w"
Sep 06 01:09:35.248615 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:35.248595    2577 scope.go:117] "RemoveContainer" containerID="aa55ed0d75a5c0d9719f573b945de91f0113e09c7db385da20e44a256b191233"
Sep 06 01:09:35.248904 ip-10-0-140-57 kubenswrapper[2577]: E0906 01:09:35.248874    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa55ed0d75a5c0d9719f573b945de91f0113e09c7db385da20e44a256b191233\": container with ID starting with aa55ed0d75a5c0d9719f573b945de91f0113e09c7db385da20e44a256b191233 not found: ID does not exist" containerID="aa55ed0d75a5c0d9719f573b945de91f0113e09c7db385da20e44a256b191233"
Sep 06 01:09:35.248996 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:35.248915    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa55ed0d75a5c0d9719f573b945de91f0113e09c7db385da20e44a256b191233"} err="failed to get container status \"aa55ed0d75a5c0d9719f573b945de91f0113e09c7db385da20e44a256b191233\": rpc error: code = NotFound desc = could not find container \"aa55ed0d75a5c0d9719f573b945de91f0113e09c7db385da20e44a256b191233\": container with ID starting with aa55ed0d75a5c0d9719f573b945de91f0113e09c7db385da20e44a256b191233 not found: ID does not exist"
Sep 06 01:09:35.250147 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:35.250131    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04fd2140-0de1-49ef-88c1-d46e8468ae0b-plugins-config-volume\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:09:35.250196 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:35.250149    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67th8\" (UniqueName: \"kubernetes.io/projected/04fd2140-0de1-49ef-88c1-d46e8468ae0b-kube-api-access-67th8\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:09:35.259440 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:35.259378    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-40d55b26-75cc7f8998-zms8w"]
Sep 06 01:09:35.269651 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:35.269629    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-40d55b26-75cc7f8998-zms8w"]
Sep 06 01:09:35.958623 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:35.958577    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-mt-40d55b26-75cc7f8998-zms8w" podUID="04fd2140-0de1-49ef-88c1-d46e8468ae0b" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.57:9004: i/o timeout"
Sep 06 01:09:36.413775 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:36.413730    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04fd2140-0de1-49ef-88c1-d46e8468ae0b" path="/var/lib/kubelet/pods/04fd2140-0de1-49ef-88c1-d46e8468ae0b/volumes"
Sep 06 01:09:39.188015 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:39.187986    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5844a8-f4c7954cd-njpxh"
Sep 06 01:09:39.188488 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:39.188055    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-5844a8-855bd94cf-7rdst"
Sep 06 01:09:39.962022 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:39.961986    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:09:40.194505 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:40.194461    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 06 01:09:40.194893 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:40.194535    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs" podUID="fb10f642-efa8-4864-bd6c-f2f610c6e3f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 06 01:09:41.274895 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:41.274804    2577 generic.go:356] "Generic (PLEG): container finished" podID="fb10f642-efa8-4864-bd6c-f2f610c6e3f2" containerID="74587a33526910265e843312057374a86e63470dbc4138b054d4c9944dbcb14d" exitCode=0
Sep 06 01:09:41.274895 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:41.274870    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs" event={"ID":"fb10f642-efa8-4864-bd6c-f2f610c6e3f2","Type":"ContainerDied","Data":"74587a33526910265e843312057374a86e63470dbc4138b054d4c9944dbcb14d"}
Sep 06 01:09:41.275469 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:41.275422    2577 scope.go:117] "RemoveContainer" containerID="74587a33526910265e843312057374a86e63470dbc4138b054d4c9944dbcb14d"
Sep 06 01:09:41.276527 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:41.276499    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:09:41.276624 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:41.276579    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:09:41.276624 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:41.276613    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:09:42.282621 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:42.282566    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs" event={"ID":"fb10f642-efa8-4864-bd6c-f2f610c6e3f2","Type":"ContainerStarted","Data":"1920a8c9d5d073963a939fea4e88f3149092a48f39fb6a708e32b35389e71e2b"}
Sep 06 01:09:42.909594 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:42.909558    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"
Sep 06 01:09:42.909946 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:42.909922    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 06 01:09:42.910134 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:42.910109    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs" podUID="fb10f642-efa8-4864-bd6c-f2f610c6e3f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 06 01:09:43.909008 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:43.908970    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 06 01:09:43.909641 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:43.909600    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs" podUID="fb10f642-efa8-4864-bd6c-f2f610c6e3f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 06 01:09:44.909809 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:44.909772    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 06 01:09:44.910408 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:44.910376    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs" podUID="fb10f642-efa8-4864-bd6c-f2f610c6e3f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 06 01:09:45.909027 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:45.908983    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 06 01:09:45.909241 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:45.909046    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs" podUID="fb10f642-efa8-4864-bd6c-f2f610c6e3f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 06 01:09:46.909552 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:46.909505    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 06 01:09:46.910046 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:46.909614    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs" podUID="fb10f642-efa8-4864-bd6c-f2f610c6e3f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 06 01:09:47.913498 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:47.913465    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"
Sep 06 01:09:47.913967 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:47.913760    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"
Sep 06 01:09:47.914386 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:47.914367    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"
Sep 06 01:09:56.145972 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:56.145931    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-470346-994b579d6-khxnn"]
Sep 06 01:09:56.146616 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:56.146590    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04fd2140-0de1-49ef-88c1-d46e8468ae0b" containerName="payload-pre-processing"
Sep 06 01:09:56.146616 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:56.146615    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="04fd2140-0de1-49ef-88c1-d46e8468ae0b" containerName="payload-pre-processing"
Sep 06 01:09:56.146769 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:56.146755    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="04fd2140-0de1-49ef-88c1-d46e8468ae0b" containerName="payload-pre-processing"
Sep 06 01:09:56.149999 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:56.149979    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-470346-994b579d6-khxnn"
Sep 06 01:09:56.152530 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:56.152502    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-470346-dockercfg-6lsss\""
Sep 06 01:09:56.152637 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:56.152502    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-470346\""
Sep 06 01:09:56.161135 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:56.161108    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-470346-994b579d6-khxnn"]
Sep 06 01:09:56.191423 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:56.191361    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-470346-8658668d5-w4pvx"]
Sep 06 01:09:56.200102 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:56.200071    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-470346-8658668d5-w4pvx"]
Sep 06 01:09:56.200495 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:56.200475    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-470346-8658668d5-w4pvx"
Sep 06 01:09:56.266396 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:56.266363    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wq2n\" (UniqueName: \"kubernetes.io/projected/b763764d-d8a7-447e-bab8-df1a1ad591d0-kube-api-access-7wq2n\") pod \"payload-pre-processing-e2e-shared-b-w3-470346-994b579d6-khxnn\" (UID: \"b763764d-d8a7-447e-bab8-df1a1ad591d0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-470346-994b579d6-khxnn"
Sep 06 01:09:56.266574 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:56.266441    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b763764d-d8a7-447e-bab8-df1a1ad591d0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-470346-994b579d6-khxnn\" (UID: \"b763764d-d8a7-447e-bab8-df1a1ad591d0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-470346-994b579d6-khxnn"
Sep 06 01:09:56.367433 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:56.367389    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wq2n\" (UniqueName: \"kubernetes.io/projected/b763764d-d8a7-447e-bab8-df1a1ad591d0-kube-api-access-7wq2n\") pod \"payload-pre-processing-e2e-shared-b-w3-470346-994b579d6-khxnn\" (UID: \"b763764d-d8a7-447e-bab8-df1a1ad591d0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-470346-994b579d6-khxnn"
Sep 06 01:09:56.367636 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:56.367455    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b763764d-d8a7-447e-bab8-df1a1ad591d0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-470346-994b579d6-khxnn\" (UID: \"b763764d-d8a7-447e-bab8-df1a1ad591d0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-470346-994b579d6-khxnn"
Sep 06 01:09:56.367636 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:56.367491    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7r6cs\" (UniqueName: \"kubernetes.io/projected/1aaea844-35f5-4688-8536-8f5cc1b76319-kube-api-access-7r6cs\") pod \"payload-processing-e2e-shared-b-w3-470346-8658668d5-w4pvx\" (UID: \"1aaea844-35f5-4688-8536-8f5cc1b76319\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-470346-8658668d5-w4pvx"
Sep 06 01:09:56.367636 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:56.367517    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1aaea844-35f5-4688-8536-8f5cc1b76319-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-470346-8658668d5-w4pvx\" (UID: \"1aaea844-35f5-4688-8536-8f5cc1b76319\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-470346-8658668d5-w4pvx"
Sep 06 01:09:56.368118 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:56.368098    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b763764d-d8a7-447e-bab8-df1a1ad591d0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-470346-994b579d6-khxnn\" (UID: \"b763764d-d8a7-447e-bab8-df1a1ad591d0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-470346-994b579d6-khxnn"
Sep 06 01:09:56.375565 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:56.375537    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wq2n\" (UniqueName: \"kubernetes.io/projected/b763764d-d8a7-447e-bab8-df1a1ad591d0-kube-api-access-7wq2n\") pod \"payload-pre-processing-e2e-shared-b-w3-470346-994b579d6-khxnn\" (UID: \"b763764d-d8a7-447e-bab8-df1a1ad591d0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-470346-994b579d6-khxnn"
Sep 06 01:09:56.461779 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:56.461756    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-470346-994b579d6-khxnn"
Sep 06 01:09:56.469299 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:56.469263    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7r6cs\" (UniqueName: \"kubernetes.io/projected/1aaea844-35f5-4688-8536-8f5cc1b76319-kube-api-access-7r6cs\") pod \"payload-processing-e2e-shared-b-w3-470346-8658668d5-w4pvx\" (UID: \"1aaea844-35f5-4688-8536-8f5cc1b76319\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-470346-8658668d5-w4pvx"
Sep 06 01:09:56.469451 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:56.469358    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1aaea844-35f5-4688-8536-8f5cc1b76319-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-470346-8658668d5-w4pvx\" (UID: \"1aaea844-35f5-4688-8536-8f5cc1b76319\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-470346-8658668d5-w4pvx"
Sep 06 01:09:56.470428 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:56.470368    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1aaea844-35f5-4688-8536-8f5cc1b76319-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-470346-8658668d5-w4pvx\" (UID: \"1aaea844-35f5-4688-8536-8f5cc1b76319\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-470346-8658668d5-w4pvx"
Sep 06 01:09:56.478089 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:56.478068    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7r6cs\" (UniqueName: \"kubernetes.io/projected/1aaea844-35f5-4688-8536-8f5cc1b76319-kube-api-access-7r6cs\") pod \"payload-processing-e2e-shared-b-w3-470346-8658668d5-w4pvx\" (UID: \"1aaea844-35f5-4688-8536-8f5cc1b76319\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-470346-8658668d5-w4pvx"
Sep 06 01:09:56.512811 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:56.512675    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-470346-8658668d5-w4pvx"
Sep 06 01:09:56.736798 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:56.736774    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-470346-994b579d6-khxnn"]
Sep 06 01:09:56.738844 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:09:56.738817    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb763764d_d8a7_447e_bab8_df1a1ad591d0.slice/crio-f583e6c93d5324ba056b61315b2300abb6d029c95ffa3222ce776ac744046560 WatchSource:0}: Error finding container f583e6c93d5324ba056b61315b2300abb6d029c95ffa3222ce776ac744046560: Status 404 returned error can't find the container with id f583e6c93d5324ba056b61315b2300abb6d029c95ffa3222ce776ac744046560
Sep 06 01:09:56.799041 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:56.799017    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-470346-8658668d5-w4pvx"]
Sep 06 01:09:56.801753 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:09:56.801732    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aaea844_35f5_4688_8536_8f5cc1b76319.slice/crio-de4f36fe476701a725cfe66308434963a71223409760ce292eeb02f7239770bf WatchSource:0}: Error finding container de4f36fe476701a725cfe66308434963a71223409760ce292eeb02f7239770bf: Status 404 returned error can't find the container with id de4f36fe476701a725cfe66308434963a71223409760ce292eeb02f7239770bf
Sep 06 01:09:57.368415 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:57.368384    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-470346-8658668d5-w4pvx" event={"ID":"1aaea844-35f5-4688-8536-8f5cc1b76319","Type":"ContainerStarted","Data":"ad01e875983b018d9c3eeb6c811bb52a37014c523b34077844229181622d46a8"}
Sep 06 01:09:57.368877 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:57.368448    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-470346-8658668d5-w4pvx"
Sep 06 01:09:57.368877 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:57.368473    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-470346-8658668d5-w4pvx" event={"ID":"1aaea844-35f5-4688-8536-8f5cc1b76319","Type":"ContainerStarted","Data":"de4f36fe476701a725cfe66308434963a71223409760ce292eeb02f7239770bf"}
Sep 06 01:09:57.370433 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:57.370403    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-470346-994b579d6-khxnn" event={"ID":"b763764d-d8a7-447e-bab8-df1a1ad591d0","Type":"ContainerStarted","Data":"3fe3a6dc4359352c51c61228e149a025abddc42ab327d833f0a3fc8e1af704a0"}
Sep 06 01:09:57.370546 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:57.370464    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-470346-994b579d6-khxnn"
Sep 06 01:09:57.370546 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:57.370487    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-470346-994b579d6-khxnn" event={"ID":"b763764d-d8a7-447e-bab8-df1a1ad591d0","Type":"ContainerStarted","Data":"f583e6c93d5324ba056b61315b2300abb6d029c95ffa3222ce776ac744046560"}
Sep 06 01:09:57.385739 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:57.385695    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-470346-8658668d5-w4pvx" podStartSLOduration=1.385680168 podStartE2EDuration="1.385680168s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:09:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:57.384034358 +0000 UTC m=+1155.420177317" watchObservedRunningTime="2026-09-06 01:09:57.385680168 +0000 UTC m=+1155.421823142"
Sep 06 01:09:57.403163 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:57.403115    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-470346-994b579d6-khxnn" podStartSLOduration=1.403095731 podStartE2EDuration="1.403095731s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:09:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:57.400537236 +0000 UTC m=+1155.436680194" watchObservedRunningTime="2026-09-06 01:09:57.403095731 +0000 UTC m=+1155.439238692"
Sep 06 01:09:59.081912 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:09:59.081881    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:10:08.377775 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:08.377745    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-470346-8658668d5-w4pvx"
Sep 06 01:10:08.378244 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:08.377827    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-470346-994b579d6-khxnn"
Sep 06 01:10:10.168813 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:10.168780    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:10:24.000212 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:24.000177    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"]
Sep 06 01:10:24.010608 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:24.010577    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"
Sep 06 01:10:24.013290 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:24.013266    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-812148-openshift-default-dockercfg-rdczf\""
Sep 06 01:10:24.016823 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:24.016803    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"]
Sep 06 01:10:24.138502 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:24.138470    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-credential-socket\") pod \"e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz\" (UID: \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\") " pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"
Sep 06 01:10:24.138700 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:24.138509    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-istio-token\") pod \"e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz\" (UID: \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\") " pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"
Sep 06 01:10:24.138700 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:24.138536    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-istiod-ca-cert\") pod \"e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz\" (UID: \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\") " pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"
Sep 06 01:10:24.138700 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:24.138667    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-workload-certs\") pod \"e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz\" (UID: \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\") " pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"
Sep 06 01:10:24.138877 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:24.138721    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-istio-envoy\") pod \"e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz\" (UID: \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\") " pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"
Sep 06 01:10:24.138877 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:24.138777    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-istio-data\") pod \"e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz\" (UID: \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\") " pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"
Sep 06 01:10:24.138877 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:24.138823    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v5xm\" (UniqueName: \"kubernetes.io/projected/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-kube-api-access-4v5xm\") pod \"e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz\" (UID: \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\") " pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"
Sep 06 01:10:24.138877 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:24.138863    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-workload-socket\") pod \"e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz\" (UID: \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\") " pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"
Sep 06 01:10:24.139043 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:24.138893    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-istio-podinfo\") pod \"e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz\" (UID: \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\") " pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"
Sep 06 01:10:24.240373 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:24.240334    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-istio-data\") pod \"e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz\" (UID: \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\") " pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"
Sep 06 01:10:24.240554 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:24.240382    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v5xm\" (UniqueName: \"kubernetes.io/projected/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-kube-api-access-4v5xm\") pod \"e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz\" (UID: \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\") " pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"
Sep 06 01:10:24.240554 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:24.240426    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-workload-socket\") pod \"e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz\" (UID: \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\") " pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"
Sep 06 01:10:24.240554 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:24.240452    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-istio-podinfo\") pod \"e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz\" (UID: \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\") " pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"
Sep 06 01:10:24.240554 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:24.240523    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-credential-socket\") pod \"e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz\" (UID: \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\") " pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"
Sep 06 01:10:24.240554 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:24.240553    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-istio-token\") pod \"e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz\" (UID: \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\") " pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"
Sep 06 01:10:24.240834 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:24.240591    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-istiod-ca-cert\") pod \"e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz\" (UID: \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\") " pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"
Sep 06 01:10:24.240834 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:24.240650    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-workload-certs\") pod \"e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz\" (UID: \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\") " pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"
Sep 06 01:10:24.240834 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:24.240694    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-istio-envoy\") pod \"e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz\" (UID: \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\") " pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"
Sep 06 01:10:24.240834 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:24.240794    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-istio-data\") pod \"e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz\" (UID: \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\") " pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"
Sep 06 01:10:24.241057 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:24.241032    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-workload-certs\") pod \"e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz\" (UID: \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\") " pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"
Sep 06 01:10:24.241118 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:24.241105    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-workload-socket\") pod \"e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz\" (UID: \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\") " pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"
Sep 06 01:10:24.241180 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:24.241110    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-credential-socket\") pod \"e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz\" (UID: \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\") " pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"
Sep 06 01:10:24.241407 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:24.241388    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-istiod-ca-cert\") pod \"e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz\" (UID: \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\") " pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"
Sep 06 01:10:24.243048 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:24.243019    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-istio-envoy\") pod \"e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz\" (UID: \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\") " pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"
Sep 06 01:10:24.243237 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:24.243221    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-istio-podinfo\") pod \"e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz\" (UID: \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\") " pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"
Sep 06 01:10:24.248219 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:24.248197    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-istio-token\") pod \"e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz\" (UID: \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\") " pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"
Sep 06 01:10:24.248373 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:24.248354    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v5xm\" (UniqueName: \"kubernetes.io/projected/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-kube-api-access-4v5xm\") pod \"e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz\" (UID: \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\") " pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"
Sep 06 01:10:24.323546 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:24.323472    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"
Sep 06 01:10:24.605215 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:24.605188    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"]
Sep 06 01:10:24.607890 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:10:24.607865    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ef62bfa_0af8_47de_8fb2_62c7c41cccf0.slice/crio-9c4b115cb0503aa3424a8cb103fcaceef37f159cc4a8d19cf781472710372687 WatchSource:0}: Error finding container 9c4b115cb0503aa3424a8cb103fcaceef37f159cc4a8d19cf781472710372687: Status 404 returned error can't find the container with id 9c4b115cb0503aa3424a8cb103fcaceef37f159cc4a8d19cf781472710372687
Sep 06 01:10:24.610665 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:24.610628    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:10:24.610751 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:24.610716    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:10:24.610793 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:24.610757    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:10:25.525299 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:25.525264    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz" event={"ID":"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0","Type":"ContainerStarted","Data":"595dc28bb28f1899cfd70418b0053b727d8945c8afb593823d46eea3014683e0"}
Sep 06 01:10:25.525803 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:25.525335    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz" event={"ID":"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0","Type":"ContainerStarted","Data":"9c4b115cb0503aa3424a8cb103fcaceef37f159cc4a8d19cf781472710372687"}
Sep 06 01:10:25.547860 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:25.547811    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz" podStartSLOduration=2.547790366 podStartE2EDuration="2.547790366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:10:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:10:25.546246812 +0000 UTC m=+1183.582389796" watchObservedRunningTime="2026-09-06 01:10:25.547790366 +0000 UTC m=+1183.583933320"
Sep 06 01:10:26.323801 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:26.323766    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"
Sep 06 01:10:26.328926 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:26.328903    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"
Sep 06 01:10:26.530671 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:26.530638    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"
Sep 06 01:10:26.531514 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:26.531496    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"
Sep 06 01:10:29.337264 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:29.337235    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-812148-c8878cb7-v5snr"]
Sep 06 01:10:29.341092 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:29.341072    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-812148-c8878cb7-v5snr"
Sep 06 01:10:29.344159 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:29.344135    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-812148\""
Sep 06 01:10:29.344274 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:29.344252    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-812148-dockercfg-6fl7t\""
Sep 06 01:10:29.354680 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:29.354656    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-812148-c8878cb7-v5snr"]
Sep 06 01:10:29.389625 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:29.389601    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:10:29.496858 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:29.496828    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6312025-b220-4433-9469-a98b45c070ad-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-812148-c8878cb7-v5snr\" (UID: \"a6312025-b220-4433-9469-a98b45c070ad\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-812148-c8878cb7-v5snr"
Sep 06 01:10:29.497027 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:29.497006    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsd4q\" (UniqueName: \"kubernetes.io/projected/a6312025-b220-4433-9469-a98b45c070ad-kube-api-access-jsd4q\") pod \"payload-processing-e2e-shared-b-w2-812148-c8878cb7-v5snr\" (UID: \"a6312025-b220-4433-9469-a98b45c070ad\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-812148-c8878cb7-v5snr"
Sep 06 01:10:29.598415 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:29.598305    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsd4q\" (UniqueName: \"kubernetes.io/projected/a6312025-b220-4433-9469-a98b45c070ad-kube-api-access-jsd4q\") pod \"payload-processing-e2e-shared-b-w2-812148-c8878cb7-v5snr\" (UID: \"a6312025-b220-4433-9469-a98b45c070ad\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-812148-c8878cb7-v5snr"
Sep 06 01:10:29.598415 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:29.598392    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6312025-b220-4433-9469-a98b45c070ad-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-812148-c8878cb7-v5snr\" (UID: \"a6312025-b220-4433-9469-a98b45c070ad\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-812148-c8878cb7-v5snr"
Sep 06 01:10:29.598997 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:29.598979    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6312025-b220-4433-9469-a98b45c070ad-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-812148-c8878cb7-v5snr\" (UID: \"a6312025-b220-4433-9469-a98b45c070ad\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-812148-c8878cb7-v5snr"
Sep 06 01:10:29.608239 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:29.608204    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsd4q\" (UniqueName: \"kubernetes.io/projected/a6312025-b220-4433-9469-a98b45c070ad-kube-api-access-jsd4q\") pod \"payload-processing-e2e-shared-b-w2-812148-c8878cb7-v5snr\" (UID: \"a6312025-b220-4433-9469-a98b45c070ad\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-812148-c8878cb7-v5snr"
Sep 06 01:10:29.653065 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:29.653033    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-812148-c8878cb7-v5snr"
Sep 06 01:10:29.923920 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:29.923892    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-812148-c8878cb7-v5snr"]
Sep 06 01:10:29.927265 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:10:29.927227    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6312025_b220_4433_9469_a98b45c070ad.slice/crio-682b90cb17673223bd5e97a14b5399c6196658ffd1bfceb658db81baa7473591 WatchSource:0}: Error finding container 682b90cb17673223bd5e97a14b5399c6196658ffd1bfceb658db81baa7473591: Status 404 returned error can't find the container with id 682b90cb17673223bd5e97a14b5399c6196658ffd1bfceb658db81baa7473591
Sep 06 01:10:30.555058 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:30.555020    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-812148-c8878cb7-v5snr" event={"ID":"a6312025-b220-4433-9469-a98b45c070ad","Type":"ContainerStarted","Data":"09f001f5c09a2cdd7e944b246a33b1b09a76d3b6b449d7823e41828cd37f27a8"}
Sep 06 01:10:30.555555 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:30.555074    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-812148-c8878cb7-v5snr" event={"ID":"a6312025-b220-4433-9469-a98b45c070ad","Type":"ContainerStarted","Data":"682b90cb17673223bd5e97a14b5399c6196658ffd1bfceb658db81baa7473591"}
Sep 06 01:10:30.555555 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:30.555106    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-812148-c8878cb7-v5snr"
Sep 06 01:10:30.575829 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:30.575781    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-812148-c8878cb7-v5snr" podStartSLOduration=1.575765812 podStartE2EDuration="1.575765812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:10:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:10:30.572976817 +0000 UTC m=+1188.609119779" watchObservedRunningTime="2026-09-06 01:10:30.575765812 +0000 UTC m=+1188.611908769"
Sep 06 01:10:41.563505 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:41.563472    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-812148-c8878cb7-v5snr"
Sep 06 01:10:42.467646 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:42.467615    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2z66_e100e633-d18a-4d68-9c81-0ff379c12d2f/ovn-acl-logging/0.log"
Sep 06 01:10:42.468376 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:42.468354    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2z66_e100e633-d18a-4d68-9c81-0ff379c12d2f/ovn-acl-logging/0.log"
Sep 06 01:10:44.864774 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:44.864739    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:10:47.659445 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:47.659413    2577 generic.go:356] "Generic (PLEG): container finished" podID="2ef62bfa-0af8-47de-8fb2-62c7c41cccf0" containerID="595dc28bb28f1899cfd70418b0053b727d8945c8afb593823d46eea3014683e0" exitCode=0
Sep 06 01:10:47.659938 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:47.659480    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz" event={"ID":"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0","Type":"ContainerDied","Data":"595dc28bb28f1899cfd70418b0053b727d8945c8afb593823d46eea3014683e0"}
Sep 06 01:10:47.659938 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:47.659925    2577 scope.go:117] "RemoveContainer" containerID="595dc28bb28f1899cfd70418b0053b727d8945c8afb593823d46eea3014683e0"
Sep 06 01:10:47.661061 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:47.661035    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:10:47.661148 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:47.661105    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:10:47.661148 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:47.661137    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:10:48.670727 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:48.670684    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz" event={"ID":"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0","Type":"ContainerStarted","Data":"57c70eb5176f865905aca3fbceb389848103f2d947069d0a2b281d4b5a8eb5ca"}
Sep 06 01:10:49.324945 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:49.324903    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"
Sep 06 01:10:49.325154 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:49.325042    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 06 01:10:49.325154 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:49.325108    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz" podUID="2ef62bfa-0af8-47de-8fb2-62c7c41cccf0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 06 01:10:50.323951 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:50.323901    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 06 01:10:50.324493 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:50.323979    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz" podUID="2ef62bfa-0af8-47de-8fb2-62c7c41cccf0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 06 01:10:51.324454 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:51.324411    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 06 01:10:51.324968 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:51.324504    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz" podUID="2ef62bfa-0af8-47de-8fb2-62c7c41cccf0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 06 01:10:52.324480 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:52.324441    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 06 01:10:52.325112 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:52.325080    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz" podUID="2ef62bfa-0af8-47de-8fb2-62c7c41cccf0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 06 01:10:53.324136 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:53.324095    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 06 01:10:53.324367 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:53.324210    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz" podUID="2ef62bfa-0af8-47de-8fb2-62c7c41cccf0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 06 01:10:54.328017 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:54.327987    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"
Sep 06 01:10:54.328406 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:54.328353    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"
Sep 06 01:10:54.329130 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:54.329112    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"
Sep 06 01:10:58.064904 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:10:58.064868    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:11:06.113926 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:06.113884    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"]
Sep 06 01:11:06.118838 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:06.118817    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"
Sep 06 01:11:06.121833 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:06.121806    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-7534e03d-openshift-default-dockercfg-qtz76\""
Sep 06 01:11:06.134220 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:06.134182    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"]
Sep 06 01:11:06.179570 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:06.179540    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-istio-token\") pod \"e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl\" (UID: \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\") " pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"
Sep 06 01:11:06.179721 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:06.179606    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-istio-podinfo\") pod \"e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl\" (UID: \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\") " pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"
Sep 06 01:11:06.179721 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:06.179687    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-workload-certs\") pod \"e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl\" (UID: \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\") " pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"
Sep 06 01:11:06.179721 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:06.179717    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-istio-data\") pod \"e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl\" (UID: \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\") " pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"
Sep 06 01:11:06.179886 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:06.179747    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-credential-socket\") pod \"e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl\" (UID: \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\") " pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"
Sep 06 01:11:06.179886 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:06.179822    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jktlx\" (UniqueName: \"kubernetes.io/projected/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-kube-api-access-jktlx\") pod \"e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl\" (UID: \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\") " pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"
Sep 06 01:11:06.179995 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:06.179925    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-workload-socket\") pod \"e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl\" (UID: \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\") " pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"
Sep 06 01:11:06.179995 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:06.179975    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-istiod-ca-cert\") pod \"e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl\" (UID: \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\") " pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"
Sep 06 01:11:06.180069 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:06.180033    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-istio-envoy\") pod \"e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl\" (UID: \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\") " pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"
Sep 06 01:11:06.281006 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:06.280967    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-istiod-ca-cert\") pod \"e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl\" (UID: \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\") " pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"
Sep 06 01:11:06.281202 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:06.281012    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-istio-envoy\") pod \"e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl\" (UID: \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\") " pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"
Sep 06 01:11:06.281202 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:06.281033    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-istio-token\") pod \"e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl\" (UID: \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\") " pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"
Sep 06 01:11:06.281202 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:06.281067    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-istio-podinfo\") pod \"e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl\" (UID: \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\") " pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"
Sep 06 01:11:06.281202 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:06.281097    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-workload-certs\") pod \"e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl\" (UID: \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\") " pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"
Sep 06 01:11:06.281202 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:06.281114    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-istio-data\") pod \"e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl\" (UID: \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\") " pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"
Sep 06 01:11:06.281202 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:06.281135    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-credential-socket\") pod \"e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl\" (UID: \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\") " pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"
Sep 06 01:11:06.281202 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:06.281164    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jktlx\" (UniqueName: \"kubernetes.io/projected/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-kube-api-access-jktlx\") pod \"e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl\" (UID: \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\") " pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"
Sep 06 01:11:06.281649 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:06.281234    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-workload-socket\") pod \"e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl\" (UID: \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\") " pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"
Sep 06 01:11:06.281649 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:06.281593    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-workload-certs\") pod \"e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl\" (UID: \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\") " pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"
Sep 06 01:11:06.281777 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:06.281743    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-credential-socket\") pod \"e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl\" (UID: \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\") " pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"
Sep 06 01:11:06.281917 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:06.281835    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-istio-data\") pod \"e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl\" (UID: \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\") " pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"
Sep 06 01:11:06.281917 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:06.281853    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-istiod-ca-cert\") pod \"e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl\" (UID: \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\") " pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"
Sep 06 01:11:06.282122 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:06.282004    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-workload-socket\") pod \"e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl\" (UID: \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\") " pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"
Sep 06 01:11:06.283474 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:06.283454    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-istio-envoy\") pod \"e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl\" (UID: \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\") " pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"
Sep 06 01:11:06.283667 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:06.283649    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-istio-podinfo\") pod \"e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl\" (UID: \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\") " pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"
Sep 06 01:11:06.292822 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:06.292791    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jktlx\" (UniqueName: \"kubernetes.io/projected/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-kube-api-access-jktlx\") pod \"e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl\" (UID: \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\") " pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"
Sep 06 01:11:06.294798 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:06.294776    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-istio-token\") pod \"e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl\" (UID: \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\") " pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"
Sep 06 01:11:06.433040 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:06.433012    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"
Sep 06 01:11:06.713845 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:06.713817    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"]
Sep 06 01:11:06.715798 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:11:06.715770    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dd82ab6_7fc0_47c9_9773_9e90545b6a64.slice/crio-61c51454b3ac41290d6ba3598bafdcd5a55dd6d95b607ba21c131e66c67f004e WatchSource:0}: Error finding container 61c51454b3ac41290d6ba3598bafdcd5a55dd6d95b607ba21c131e66c67f004e: Status 404 returned error can't find the container with id 61c51454b3ac41290d6ba3598bafdcd5a55dd6d95b607ba21c131e66c67f004e
Sep 06 01:11:06.718073 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:06.718040    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:11:06.718160 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:06.718103    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:11:06.718160 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:06.718131    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:11:06.771028 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:06.771003    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl" event={"ID":"5dd82ab6-7fc0-47c9-9773-9e90545b6a64","Type":"ContainerStarted","Data":"61c51454b3ac41290d6ba3598bafdcd5a55dd6d95b607ba21c131e66c67f004e"}
Sep 06 01:11:07.778001 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:07.777960    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl" event={"ID":"5dd82ab6-7fc0-47c9-9773-9e90545b6a64","Type":"ContainerStarted","Data":"4bb255edebcd896c63a05a1118840bacedb69b2355b35b9d7c1355e4f6ba1a7d"}
Sep 06 01:11:07.800035 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:07.799982    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl" podStartSLOduration=1.7999662330000001 podStartE2EDuration="1.799966233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:11:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:11:07.79823595 +0000 UTC m=+1225.834378921" watchObservedRunningTime="2026-09-06 01:11:07.799966233 +0000 UTC m=+1225.836109190"
Sep 06 01:11:08.433359 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:08.433305    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"
Sep 06 01:11:08.438750 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:08.438728    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"
Sep 06 01:11:08.783797 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:08.783709    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"
Sep 06 01:11:08.784630 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:08.784611    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"
Sep 06 01:11:11.809278 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:11.809238    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7534e03d-556dfb9bdb-86nkb"]
Sep 06 01:11:11.813419 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:11.813394    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-7534e03d-556dfb9bdb-86nkb"
Sep 06 01:11:11.817139 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:11.817118    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-7534e03d\""
Sep 06 01:11:11.817535 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:11.817514    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-7534e03d-dockercfg-c8qxm\""
Sep 06 01:11:11.824760 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:11.824737    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7534e03d-556dfb9bdb-86nkb"]
Sep 06 01:11:11.935894 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:11.935862    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/327e5be9-b702-4307-8df4-d383dafebf1f-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-7534e03d-556dfb9bdb-86nkb\" (UID: \"327e5be9-b702-4307-8df4-d383dafebf1f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7534e03d-556dfb9bdb-86nkb"
Sep 06 01:11:11.936162 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:11.936130    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x87nz\" (UniqueName: \"kubernetes.io/projected/327e5be9-b702-4307-8df4-d383dafebf1f-kube-api-access-x87nz\") pod \"payload-pre-processing-e2e-mt-7534e03d-556dfb9bdb-86nkb\" (UID: \"327e5be9-b702-4307-8df4-d383dafebf1f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7534e03d-556dfb9bdb-86nkb"
Sep 06 01:11:12.037768 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:12.037729    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x87nz\" (UniqueName: \"kubernetes.io/projected/327e5be9-b702-4307-8df4-d383dafebf1f-kube-api-access-x87nz\") pod \"payload-pre-processing-e2e-mt-7534e03d-556dfb9bdb-86nkb\" (UID: \"327e5be9-b702-4307-8df4-d383dafebf1f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7534e03d-556dfb9bdb-86nkb"
Sep 06 01:11:12.037924 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:12.037782    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/327e5be9-b702-4307-8df4-d383dafebf1f-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-7534e03d-556dfb9bdb-86nkb\" (UID: \"327e5be9-b702-4307-8df4-d383dafebf1f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7534e03d-556dfb9bdb-86nkb"
Sep 06 01:11:12.038441 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:12.038424    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/327e5be9-b702-4307-8df4-d383dafebf1f-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-7534e03d-556dfb9bdb-86nkb\" (UID: \"327e5be9-b702-4307-8df4-d383dafebf1f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7534e03d-556dfb9bdb-86nkb"
Sep 06 01:11:12.046792 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:12.046770    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x87nz\" (UniqueName: \"kubernetes.io/projected/327e5be9-b702-4307-8df4-d383dafebf1f-kube-api-access-x87nz\") pod \"payload-pre-processing-e2e-mt-7534e03d-556dfb9bdb-86nkb\" (UID: \"327e5be9-b702-4307-8df4-d383dafebf1f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7534e03d-556dfb9bdb-86nkb"
Sep 06 01:11:12.127665 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:12.127577    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-7534e03d-556dfb9bdb-86nkb"
Sep 06 01:11:12.401780 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:12.401755    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7534e03d-556dfb9bdb-86nkb"]
Sep 06 01:11:12.404090 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:11:12.404063    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod327e5be9_b702_4307_8df4_d383dafebf1f.slice/crio-01513c12c4a6be1528c8f26b30890d13525d7bfd4f9545e38dd18e910383af14 WatchSource:0}: Error finding container 01513c12c4a6be1528c8f26b30890d13525d7bfd4f9545e38dd18e910383af14: Status 404 returned error can't find the container with id 01513c12c4a6be1528c8f26b30890d13525d7bfd4f9545e38dd18e910383af14
Sep 06 01:11:12.568978 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:12.568945    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:11:12.810249 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:12.810217    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-7534e03d-556dfb9bdb-86nkb" event={"ID":"327e5be9-b702-4307-8df4-d383dafebf1f","Type":"ContainerStarted","Data":"1fd26d1ec470d8ad1eba15313e841afe68100c91f08532821f5ac3bad38f096f"}
Sep 06 01:11:12.810797 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:12.810291    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-7534e03d-556dfb9bdb-86nkb" event={"ID":"327e5be9-b702-4307-8df4-d383dafebf1f","Type":"ContainerStarted","Data":"01513c12c4a6be1528c8f26b30890d13525d7bfd4f9545e38dd18e910383af14"}
Sep 06 01:11:12.810797 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:12.810421    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-7534e03d-556dfb9bdb-86nkb"
Sep 06 01:11:12.829686 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:12.829629    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-7534e03d-556dfb9bdb-86nkb" podStartSLOduration=1.829608976 podStartE2EDuration="1.829608976s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:11:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:11:12.826392172 +0000 UTC m=+1230.862535131" watchObservedRunningTime="2026-09-06 01:11:12.829608976 +0000 UTC m=+1230.865751935"
Sep 06 01:11:23.818370 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:23.818337    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-7534e03d-556dfb9bdb-86nkb"
Sep 06 01:11:30.464870 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:30.464832    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:11:32.923870 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:32.923836    2577 generic.go:356] "Generic (PLEG): container finished" podID="5dd82ab6-7fc0-47c9-9773-9e90545b6a64" containerID="4bb255edebcd896c63a05a1118840bacedb69b2355b35b9d7c1355e4f6ba1a7d" exitCode=0
Sep 06 01:11:32.924289 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:32.923906    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl" event={"ID":"5dd82ab6-7fc0-47c9-9773-9e90545b6a64","Type":"ContainerDied","Data":"4bb255edebcd896c63a05a1118840bacedb69b2355b35b9d7c1355e4f6ba1a7d"}
Sep 06 01:11:32.924358 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:32.924303    2577 scope.go:117] "RemoveContainer" containerID="4bb255edebcd896c63a05a1118840bacedb69b2355b35b9d7c1355e4f6ba1a7d"
Sep 06 01:11:32.925417 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:32.925390    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:11:32.925477 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:32.925457    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:11:32.925520 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:32.925488    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:11:33.934234 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:33.934143    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl" event={"ID":"5dd82ab6-7fc0-47c9-9773-9e90545b6a64","Type":"ContainerStarted","Data":"ade485a6fcb4fd6b9456d6083ab5fe58cde34e034d56ac41b15c0268ef06a090"}
Sep 06 01:11:34.433418 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:34.433373    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"
Sep 06 01:11:34.435101 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:34.435075    2577 patch_prober.go:28] interesting pod/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 06 01:11:34.435257 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:34.435136    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl" podUID="5dd82ab6-7fc0-47c9-9773-9e90545b6a64" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 06 01:11:35.434611 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:35.434566    2577 patch_prober.go:28] interesting pod/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 06 01:11:35.435082 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:35.434632    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl" podUID="5dd82ab6-7fc0-47c9-9773-9e90545b6a64" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 06 01:11:36.434022 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:36.433987    2577 patch_prober.go:28] interesting pod/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 06 01:11:36.434305 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:36.434275    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl" podUID="5dd82ab6-7fc0-47c9-9773-9e90545b6a64" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 06 01:11:37.433896 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:37.433861    2577 patch_prober.go:28] interesting pod/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 06 01:11:37.434270 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:37.433920    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl" podUID="5dd82ab6-7fc0-47c9-9773-9e90545b6a64" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 06 01:11:38.434010 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:38.433967    2577 patch_prober.go:28] interesting pod/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 06 01:11:38.434539 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:38.434031    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl" podUID="5dd82ab6-7fc0-47c9-9773-9e90545b6a64" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 06 01:11:38.784615 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:38.784533    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"
Sep 06 01:11:39.437678 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:39.437647    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"
Sep 06 01:11:39.438745 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:39.438726    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"
Sep 06 01:11:49.861018 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:11:49.860983    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:12:08.463941 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:08.463905    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:12:14.254074 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:14.254037    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7534e03d-hqdlz"]
Sep 06 01:12:14.257733 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:14.257715    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7534e03d-hqdlz"
Sep 06 01:12:14.260133 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:14.260109    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xjq68\""
Sep 06 01:12:14.264174 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:14.264151    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7534e03d-hqdlz"]
Sep 06 01:12:14.375486 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:14.375306    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70e02e47-e8ac-4b82-a8bb-d8c0e36aa652-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7534e03d-hqdlz\" (UID: \"70e02e47-e8ac-4b82-a8bb-d8c0e36aa652\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7534e03d-hqdlz"
Sep 06 01:12:14.476202 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:14.476169    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70e02e47-e8ac-4b82-a8bb-d8c0e36aa652-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7534e03d-hqdlz\" (UID: \"70e02e47-e8ac-4b82-a8bb-d8c0e36aa652\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7534e03d-hqdlz"
Sep 06 01:12:14.476782 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:14.476761    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70e02e47-e8ac-4b82-a8bb-d8c0e36aa652-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7534e03d-hqdlz\" (UID: \"70e02e47-e8ac-4b82-a8bb-d8c0e36aa652\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7534e03d-hqdlz"
Sep 06 01:12:14.570688 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:14.570605    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7534e03d-hqdlz"
Sep 06 01:12:14.842223 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:14.842195    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7534e03d-hqdlz"]
Sep 06 01:12:14.843509 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:12:14.843486    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70e02e47_e8ac_4b82_a8bb_d8c0e36aa652.slice/crio-f9a5da597c9ea1897409656c802ba4e8fc71ab95c0a7a39b41c61721715ad577 WatchSource:0}: Error finding container f9a5da597c9ea1897409656c802ba4e8fc71ab95c0a7a39b41c61721715ad577: Status 404 returned error can't find the container with id f9a5da597c9ea1897409656c802ba4e8fc71ab95c0a7a39b41c61721715ad577
Sep 06 01:12:15.167253 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:15.167217    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7534e03d-hqdlz" event={"ID":"70e02e47-e8ac-4b82-a8bb-d8c0e36aa652","Type":"ContainerStarted","Data":"d831abc532d27eecec0644910e69b3c686690a46d24ab6c35baa526a14386a42"}
Sep 06 01:12:15.167438 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:15.167280    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7534e03d-hqdlz" event={"ID":"70e02e47-e8ac-4b82-a8bb-d8c0e36aa652","Type":"ContainerStarted","Data":"f9a5da597c9ea1897409656c802ba4e8fc71ab95c0a7a39b41c61721715ad577"}
Sep 06 01:12:15.184551 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:15.184501    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7534e03d-hqdlz" podStartSLOduration=1.184485862 podStartE2EDuration="1.184485862s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:12:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:12:15.181658088 +0000 UTC m=+1293.217801046" watchObservedRunningTime="2026-09-06 01:12:15.184485862 +0000 UTC m=+1293.220628818"
Sep 06 01:12:16.173790 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:16.173759    2577 generic.go:356] "Generic (PLEG): container finished" podID="70e02e47-e8ac-4b82-a8bb-d8c0e36aa652" containerID="d831abc532d27eecec0644910e69b3c686690a46d24ab6c35baa526a14386a42" exitCode=0
Sep 06 01:12:16.174196 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:16.173838    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7534e03d-hqdlz" event={"ID":"70e02e47-e8ac-4b82-a8bb-d8c0e36aa652","Type":"ContainerDied","Data":"d831abc532d27eecec0644910e69b3c686690a46d24ab6c35baa526a14386a42"}
Sep 06 01:12:17.325683 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:17.325658    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7534e03d-hqdlz"
Sep 06 01:12:17.403696 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:17.403664    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70e02e47-e8ac-4b82-a8bb-d8c0e36aa652-maas-api-service-ca\") pod \"70e02e47-e8ac-4b82-a8bb-d8c0e36aa652\" (UID: \"70e02e47-e8ac-4b82-a8bb-d8c0e36aa652\") "
Sep 06 01:12:17.404077 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:17.404047    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70e02e47-e8ac-4b82-a8bb-d8c0e36aa652-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "70e02e47-e8ac-4b82-a8bb-d8c0e36aa652" (UID: "70e02e47-e8ac-4b82-a8bb-d8c0e36aa652"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:12:17.505936 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:17.505664    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70e02e47-e8ac-4b82-a8bb-d8c0e36aa652-maas-api-service-ca\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:12:18.186696 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:18.186662    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7534e03d-hqdlz" event={"ID":"70e02e47-e8ac-4b82-a8bb-d8c0e36aa652","Type":"ContainerDied","Data":"f9a5da597c9ea1897409656c802ba4e8fc71ab95c0a7a39b41c61721715ad577"}
Sep 06 01:12:18.186696 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:18.186701    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7534e03d-hqdlz"
Sep 06 01:12:18.186907 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:18.186710    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f9a5da597c9ea1897409656c802ba4e8fc71ab95c0a7a39b41c61721715ad577"
Sep 06 01:12:25.961845 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:25.961810    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:12:29.879959 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:29.879927    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7534e03d-556dfb9bdb-86nkb"]
Sep 06 01:12:29.880370 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:29.880133    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-7534e03d-556dfb9bdb-86nkb" podUID="327e5be9-b702-4307-8df4-d383dafebf1f" containerName="payload-pre-processing" containerID="cri-o://1fd26d1ec470d8ad1eba15313e841afe68100c91f08532821f5ac3bad38f096f" gracePeriod=30
Sep 06 01:12:30.045833 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:30.045792    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7534e03d-hqdlz"]
Sep 06 01:12:30.048097 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:30.048068    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7534e03d-hqdlz"]
Sep 06 01:12:30.151309 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:30.151284    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-7534e03d-556dfb9bdb-86nkb"
Sep 06 01:12:30.254995 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:30.254958    2577 generic.go:356] "Generic (PLEG): container finished" podID="327e5be9-b702-4307-8df4-d383dafebf1f" containerID="1fd26d1ec470d8ad1eba15313e841afe68100c91f08532821f5ac3bad38f096f" exitCode=0
Sep 06 01:12:30.255160 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:30.255005    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-7534e03d-556dfb9bdb-86nkb"
Sep 06 01:12:30.255160 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:30.255045    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-7534e03d-556dfb9bdb-86nkb" event={"ID":"327e5be9-b702-4307-8df4-d383dafebf1f","Type":"ContainerDied","Data":"1fd26d1ec470d8ad1eba15313e841afe68100c91f08532821f5ac3bad38f096f"}
Sep 06 01:12:30.255160 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:30.255105    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-7534e03d-556dfb9bdb-86nkb" event={"ID":"327e5be9-b702-4307-8df4-d383dafebf1f","Type":"ContainerDied","Data":"01513c12c4a6be1528c8f26b30890d13525d7bfd4f9545e38dd18e910383af14"}
Sep 06 01:12:30.255160 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:30.255131    2577 scope.go:117] "RemoveContainer" containerID="1fd26d1ec470d8ad1eba15313e841afe68100c91f08532821f5ac3bad38f096f"
Sep 06 01:12:30.264183 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:30.264166    2577 scope.go:117] "RemoveContainer" containerID="1fd26d1ec470d8ad1eba15313e841afe68100c91f08532821f5ac3bad38f096f"
Sep 06 01:12:30.264482 ip-10-0-140-57 kubenswrapper[2577]: E0906 01:12:30.264464    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fd26d1ec470d8ad1eba15313e841afe68100c91f08532821f5ac3bad38f096f\": container with ID starting with 1fd26d1ec470d8ad1eba15313e841afe68100c91f08532821f5ac3bad38f096f not found: ID does not exist" containerID="1fd26d1ec470d8ad1eba15313e841afe68100c91f08532821f5ac3bad38f096f"
Sep 06 01:12:30.264557 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:30.264490    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fd26d1ec470d8ad1eba15313e841afe68100c91f08532821f5ac3bad38f096f"} err="failed to get container status \"1fd26d1ec470d8ad1eba15313e841afe68100c91f08532821f5ac3bad38f096f\": rpc error: code = NotFound desc = could not find container \"1fd26d1ec470d8ad1eba15313e841afe68100c91f08532821f5ac3bad38f096f\": container with ID starting with 1fd26d1ec470d8ad1eba15313e841afe68100c91f08532821f5ac3bad38f096f not found: ID does not exist"
Sep 06 01:12:30.338623 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:30.338586    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x87nz\" (UniqueName: \"kubernetes.io/projected/327e5be9-b702-4307-8df4-d383dafebf1f-kube-api-access-x87nz\") pod \"327e5be9-b702-4307-8df4-d383dafebf1f\" (UID: \"327e5be9-b702-4307-8df4-d383dafebf1f\") "
Sep 06 01:12:30.338810 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:30.338642    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/327e5be9-b702-4307-8df4-d383dafebf1f-plugins-config-volume\") pod \"327e5be9-b702-4307-8df4-d383dafebf1f\" (UID: \"327e5be9-b702-4307-8df4-d383dafebf1f\") "
Sep 06 01:12:30.339047 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:30.339024    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/327e5be9-b702-4307-8df4-d383dafebf1f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "327e5be9-b702-4307-8df4-d383dafebf1f" (UID: "327e5be9-b702-4307-8df4-d383dafebf1f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:12:30.340916 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:30.340889    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/327e5be9-b702-4307-8df4-d383dafebf1f-kube-api-access-x87nz" (OuterVolumeSpecName: "kube-api-access-x87nz") pod "327e5be9-b702-4307-8df4-d383dafebf1f" (UID: "327e5be9-b702-4307-8df4-d383dafebf1f"). InnerVolumeSpecName "kube-api-access-x87nz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:12:30.410530 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:30.410492    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70e02e47-e8ac-4b82-a8bb-d8c0e36aa652" path="/var/lib/kubelet/pods/70e02e47-e8ac-4b82-a8bb-d8c0e36aa652/volumes"
Sep 06 01:12:30.440050 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:30.440014    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x87nz\" (UniqueName: \"kubernetes.io/projected/327e5be9-b702-4307-8df4-d383dafebf1f-kube-api-access-x87nz\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:12:30.440050 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:30.440045    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/327e5be9-b702-4307-8df4-d383dafebf1f-plugins-config-volume\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:12:30.572178 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:30.572151    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7534e03d-556dfb9bdb-86nkb"]
Sep 06 01:12:30.576848 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:30.576819    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7534e03d-556dfb9bdb-86nkb"]
Sep 06 01:12:32.409724 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:32.409694    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="327e5be9-b702-4307-8df4-d383dafebf1f" path="/var/lib/kubelet/pods/327e5be9-b702-4307-8df4-d383dafebf1f/volumes"
Sep 06 01:12:42.587466 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:42.587436    2577 scope.go:117] "RemoveContainer" containerID="413c38a80991e4b0cc6616dc4986fec15a99c4ad1b3b3f49f68a9c892bfadfb5"
Sep 06 01:12:44.365086 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:12:44.365050    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:13:00.569413 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:00.569371    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:13:11.871930 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:11.871892    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:13:25.669520 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:25.669476    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:13:27.264360 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:27.264330    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"]
Sep 06 01:13:27.264758 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:27.264545    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl" podUID="5dd82ab6-7fc0-47c9-9773-9e90545b6a64" containerName="istio-proxy" containerID="cri-o://ade485a6fcb4fd6b9456d6083ab5fe58cde34e034d56ac41b15c0268ef06a090" gracePeriod=30
Sep 06 01:13:32.523508 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:32.523485    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"
Sep 06 01:13:32.610139 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:32.610056    2577 generic.go:356] "Generic (PLEG): container finished" podID="5dd82ab6-7fc0-47c9-9773-9e90545b6a64" containerID="ade485a6fcb4fd6b9456d6083ab5fe58cde34e034d56ac41b15c0268ef06a090" exitCode=0
Sep 06 01:13:32.610139 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:32.610119    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"
Sep 06 01:13:32.610310 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:32.610139    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl" event={"ID":"5dd82ab6-7fc0-47c9-9773-9e90545b6a64","Type":"ContainerDied","Data":"ade485a6fcb4fd6b9456d6083ab5fe58cde34e034d56ac41b15c0268ef06a090"}
Sep 06 01:13:32.610310 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:32.610198    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl" event={"ID":"5dd82ab6-7fc0-47c9-9773-9e90545b6a64","Type":"ContainerDied","Data":"61c51454b3ac41290d6ba3598bafdcd5a55dd6d95b607ba21c131e66c67f004e"}
Sep 06 01:13:32.610310 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:32.610227    2577 scope.go:117] "RemoveContainer" containerID="ade485a6fcb4fd6b9456d6083ab5fe58cde34e034d56ac41b15c0268ef06a090"
Sep 06 01:13:32.622039 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:32.622019    2577 scope.go:117] "RemoveContainer" containerID="4bb255edebcd896c63a05a1118840bacedb69b2355b35b9d7c1355e4f6ba1a7d"
Sep 06 01:13:32.630522 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:32.630505    2577 scope.go:117] "RemoveContainer" containerID="ade485a6fcb4fd6b9456d6083ab5fe58cde34e034d56ac41b15c0268ef06a090"
Sep 06 01:13:32.630800 ip-10-0-140-57 kubenswrapper[2577]: E0906 01:13:32.630781    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ade485a6fcb4fd6b9456d6083ab5fe58cde34e034d56ac41b15c0268ef06a090\": container with ID starting with ade485a6fcb4fd6b9456d6083ab5fe58cde34e034d56ac41b15c0268ef06a090 not found: ID does not exist" containerID="ade485a6fcb4fd6b9456d6083ab5fe58cde34e034d56ac41b15c0268ef06a090"
Sep 06 01:13:32.630843 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:32.630813    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ade485a6fcb4fd6b9456d6083ab5fe58cde34e034d56ac41b15c0268ef06a090"} err="failed to get container status \"ade485a6fcb4fd6b9456d6083ab5fe58cde34e034d56ac41b15c0268ef06a090\": rpc error: code = NotFound desc = could not find container \"ade485a6fcb4fd6b9456d6083ab5fe58cde34e034d56ac41b15c0268ef06a090\": container with ID starting with ade485a6fcb4fd6b9456d6083ab5fe58cde34e034d56ac41b15c0268ef06a090 not found: ID does not exist"
Sep 06 01:13:32.630843 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:32.630833    2577 scope.go:117] "RemoveContainer" containerID="4bb255edebcd896c63a05a1118840bacedb69b2355b35b9d7c1355e4f6ba1a7d"
Sep 06 01:13:32.631084 ip-10-0-140-57 kubenswrapper[2577]: E0906 01:13:32.631065    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bb255edebcd896c63a05a1118840bacedb69b2355b35b9d7c1355e4f6ba1a7d\": container with ID starting with 4bb255edebcd896c63a05a1118840bacedb69b2355b35b9d7c1355e4f6ba1a7d not found: ID does not exist" containerID="4bb255edebcd896c63a05a1118840bacedb69b2355b35b9d7c1355e4f6ba1a7d"
Sep 06 01:13:32.631133 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:32.631089    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bb255edebcd896c63a05a1118840bacedb69b2355b35b9d7c1355e4f6ba1a7d"} err="failed to get container status \"4bb255edebcd896c63a05a1118840bacedb69b2355b35b9d7c1355e4f6ba1a7d\": rpc error: code = NotFound desc = could not find container \"4bb255edebcd896c63a05a1118840bacedb69b2355b35b9d7c1355e4f6ba1a7d\": container with ID starting with 4bb255edebcd896c63a05a1118840bacedb69b2355b35b9d7c1355e4f6ba1a7d not found: ID does not exist"
Sep 06 01:13:32.684931 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:32.684900    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jktlx\" (UniqueName: \"kubernetes.io/projected/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-kube-api-access-jktlx\") pod \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\" (UID: \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\") "
Sep 06 01:13:32.685094 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:32.684957    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-istio-data\") pod \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\" (UID: \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\") "
Sep 06 01:13:32.685094 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:32.685005    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-istio-envoy\") pod \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\" (UID: \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\") "
Sep 06 01:13:32.685094 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:32.685041    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-istio-podinfo\") pod \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\" (UID: \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\") "
Sep 06 01:13:32.685094 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:32.685091    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-workload-socket\") pod \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\" (UID: \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\") "
Sep 06 01:13:32.685302 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:32.685125    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-credential-socket\") pod \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\" (UID: \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\") "
Sep 06 01:13:32.685302 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:32.685177    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-istiod-ca-cert\") pod \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\" (UID: \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\") "
Sep 06 01:13:32.685302 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:32.685207    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-istio-token\") pod \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\" (UID: \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\") "
Sep 06 01:13:32.685529 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:32.685354    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-workload-certs\") pod \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\" (UID: \"5dd82ab6-7fc0-47c9-9773-9e90545b6a64\") "
Sep 06 01:13:32.685529 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:32.685359    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-istio-data" (OuterVolumeSpecName: "istio-data") pod "5dd82ab6-7fc0-47c9-9773-9e90545b6a64" (UID: "5dd82ab6-7fc0-47c9-9773-9e90545b6a64"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:13:32.685668 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:32.685640    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5dd82ab6-7fc0-47c9-9773-9e90545b6a64" (UID: "5dd82ab6-7fc0-47c9-9773-9e90545b6a64"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:13:32.685861 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:32.685833    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5dd82ab6-7fc0-47c9-9773-9e90545b6a64" (UID: "5dd82ab6-7fc0-47c9-9773-9e90545b6a64"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:13:32.685991 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:32.685925    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5dd82ab6-7fc0-47c9-9773-9e90545b6a64" (UID: "5dd82ab6-7fc0-47c9-9773-9e90545b6a64"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:13:32.685991 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:32.685940    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-istio-data\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:13:32.685991 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:32.685962    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-credential-socket\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:13:32.685991 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:32.685964    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5dd82ab6-7fc0-47c9-9773-9e90545b6a64" (UID: "5dd82ab6-7fc0-47c9-9773-9e90545b6a64"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:13:32.687406 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:32.687383    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5dd82ab6-7fc0-47c9-9773-9e90545b6a64" (UID: "5dd82ab6-7fc0-47c9-9773-9e90545b6a64"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:13:32.687505 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:32.687403    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-kube-api-access-jktlx" (OuterVolumeSpecName: "kube-api-access-jktlx") pod "5dd82ab6-7fc0-47c9-9773-9e90545b6a64" (UID: "5dd82ab6-7fc0-47c9-9773-9e90545b6a64"). InnerVolumeSpecName "kube-api-access-jktlx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:13:32.687900 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:32.687868    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5dd82ab6-7fc0-47c9-9773-9e90545b6a64" (UID: "5dd82ab6-7fc0-47c9-9773-9e90545b6a64"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 01:13:32.688003 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:32.687964    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-istio-token" (OuterVolumeSpecName: "istio-token") pod "5dd82ab6-7fc0-47c9-9773-9e90545b6a64" (UID: "5dd82ab6-7fc0-47c9-9773-9e90545b6a64"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:13:32.786571 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:32.786537    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-istio-token\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:13:32.786571 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:32.786566    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-workload-certs\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:13:32.786571 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:32.786575    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jktlx\" (UniqueName: \"kubernetes.io/projected/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-kube-api-access-jktlx\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:13:32.786571 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:32.786584    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-istio-envoy\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:13:32.786842 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:32.786593    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-istio-podinfo\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:13:32.786842 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:32.786600    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-workload-socket\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:13:32.786842 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:32.786607    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5dd82ab6-7fc0-47c9-9773-9e90545b6a64-istiod-ca-cert\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:13:32.935581 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:32.935548    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"]
Sep 06 01:13:32.937516 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:32.937493    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-7534e03d-openshift-default-8c78b7cdd-r58hl"]
Sep 06 01:13:34.411210 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:34.411172    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5dd82ab6-7fc0-47c9-9773-9e90545b6a64" path="/var/lib/kubelet/pods/5dd82ab6-7fc0-47c9-9773-9e90545b6a64/volumes"
Sep 06 01:13:41.070101 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:41.070067    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:13:54.573555 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:13:54.573518    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:14:13.864875 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:13.864836    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:14:21.912962 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:21.912920    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"]
Sep 06 01:14:21.914121 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:21.914096    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dd82ab6-7fc0-47c9-9773-9e90545b6a64" containerName="istio-proxy"
Sep 06 01:14:21.914227 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:21.914130    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dd82ab6-7fc0-47c9-9773-9e90545b6a64" containerName="istio-proxy"
Sep 06 01:14:21.914227 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:21.914151    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="327e5be9-b702-4307-8df4-d383dafebf1f" containerName="payload-pre-processing"
Sep 06 01:14:21.914227 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:21.914159    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="327e5be9-b702-4307-8df4-d383dafebf1f" containerName="payload-pre-processing"
Sep 06 01:14:21.914227 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:21.914196    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dd82ab6-7fc0-47c9-9773-9e90545b6a64" containerName="istio-proxy"
Sep 06 01:14:21.914227 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:21.914205    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dd82ab6-7fc0-47c9-9773-9e90545b6a64" containerName="istio-proxy"
Sep 06 01:14:21.914500 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:21.914236    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70e02e47-e8ac-4b82-a8bb-d8c0e36aa652" containerName="revoke-keys"
Sep 06 01:14:21.914500 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:21.914244    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="70e02e47-e8ac-4b82-a8bb-d8c0e36aa652" containerName="revoke-keys"
Sep 06 01:14:21.914500 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:21.914480    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="327e5be9-b702-4307-8df4-d383dafebf1f" containerName="payload-pre-processing"
Sep 06 01:14:21.914500 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:21.914495    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="70e02e47-e8ac-4b82-a8bb-d8c0e36aa652" containerName="revoke-keys"
Sep 06 01:14:21.914676 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:21.914513    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5dd82ab6-7fc0-47c9-9773-9e90545b6a64" containerName="istio-proxy"
Sep 06 01:14:21.914676 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:21.914529    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5dd82ab6-7fc0-47c9-9773-9e90545b6a64" containerName="istio-proxy"
Sep 06 01:14:21.924512 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:21.923701    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"
Sep 06 01:14:21.925903 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:21.925875    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"]
Sep 06 01:14:21.926559 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:21.926538    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-2d5f29-openshift-default-dockercfg-wq9qc\""
Sep 06 01:14:21.986143 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:21.986108    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa99e966-b218-499d-8aa5-75da31cdc5f8-istiod-ca-cert\") pod \"e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj\" (UID: \"fa99e966-b218-499d-8aa5-75da31cdc5f8\") " pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"
Sep 06 01:14:21.986353 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:21.986149    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa99e966-b218-499d-8aa5-75da31cdc5f8-istio-data\") pod \"e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj\" (UID: \"fa99e966-b218-499d-8aa5-75da31cdc5f8\") " pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"
Sep 06 01:14:21.986353 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:21.986171    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44kgk\" (UniqueName: \"kubernetes.io/projected/fa99e966-b218-499d-8aa5-75da31cdc5f8-kube-api-access-44kgk\") pod \"e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj\" (UID: \"fa99e966-b218-499d-8aa5-75da31cdc5f8\") " pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"
Sep 06 01:14:21.986353 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:21.986242    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa99e966-b218-499d-8aa5-75da31cdc5f8-credential-socket\") pod \"e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj\" (UID: \"fa99e966-b218-499d-8aa5-75da31cdc5f8\") " pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"
Sep 06 01:14:21.986353 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:21.986278    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa99e966-b218-499d-8aa5-75da31cdc5f8-workload-socket\") pod \"e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj\" (UID: \"fa99e966-b218-499d-8aa5-75da31cdc5f8\") " pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"
Sep 06 01:14:21.986519 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:21.986354    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa99e966-b218-499d-8aa5-75da31cdc5f8-istio-envoy\") pod \"e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj\" (UID: \"fa99e966-b218-499d-8aa5-75da31cdc5f8\") " pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"
Sep 06 01:14:21.986519 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:21.986374    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa99e966-b218-499d-8aa5-75da31cdc5f8-istio-token\") pod \"e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj\" (UID: \"fa99e966-b218-499d-8aa5-75da31cdc5f8\") " pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"
Sep 06 01:14:21.986519 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:21.986391    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa99e966-b218-499d-8aa5-75da31cdc5f8-istio-podinfo\") pod \"e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj\" (UID: \"fa99e966-b218-499d-8aa5-75da31cdc5f8\") " pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"
Sep 06 01:14:21.986519 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:21.986459    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa99e966-b218-499d-8aa5-75da31cdc5f8-workload-certs\") pod \"e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj\" (UID: \"fa99e966-b218-499d-8aa5-75da31cdc5f8\") " pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"
Sep 06 01:14:22.087293 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:22.087257    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa99e966-b218-499d-8aa5-75da31cdc5f8-workload-certs\") pod \"e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj\" (UID: \"fa99e966-b218-499d-8aa5-75da31cdc5f8\") " pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"
Sep 06 01:14:22.087508 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:22.087311    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa99e966-b218-499d-8aa5-75da31cdc5f8-istiod-ca-cert\") pod \"e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj\" (UID: \"fa99e966-b218-499d-8aa5-75da31cdc5f8\") " pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"
Sep 06 01:14:22.087508 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:22.087383    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa99e966-b218-499d-8aa5-75da31cdc5f8-istio-data\") pod \"e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj\" (UID: \"fa99e966-b218-499d-8aa5-75da31cdc5f8\") " pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"
Sep 06 01:14:22.087508 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:22.087407    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44kgk\" (UniqueName: \"kubernetes.io/projected/fa99e966-b218-499d-8aa5-75da31cdc5f8-kube-api-access-44kgk\") pod \"e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj\" (UID: \"fa99e966-b218-499d-8aa5-75da31cdc5f8\") " pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"
Sep 06 01:14:22.087508 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:22.087448    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa99e966-b218-499d-8aa5-75da31cdc5f8-credential-socket\") pod \"e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj\" (UID: \"fa99e966-b218-499d-8aa5-75da31cdc5f8\") " pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"
Sep 06 01:14:22.087508 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:22.087501    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa99e966-b218-499d-8aa5-75da31cdc5f8-workload-socket\") pod \"e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj\" (UID: \"fa99e966-b218-499d-8aa5-75da31cdc5f8\") " pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"
Sep 06 01:14:22.087777 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:22.087551    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa99e966-b218-499d-8aa5-75da31cdc5f8-istio-envoy\") pod \"e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj\" (UID: \"fa99e966-b218-499d-8aa5-75da31cdc5f8\") " pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"
Sep 06 01:14:22.087777 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:22.087573    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa99e966-b218-499d-8aa5-75da31cdc5f8-istio-token\") pod \"e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj\" (UID: \"fa99e966-b218-499d-8aa5-75da31cdc5f8\") " pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"
Sep 06 01:14:22.087777 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:22.087598    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa99e966-b218-499d-8aa5-75da31cdc5f8-istio-podinfo\") pod \"e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj\" (UID: \"fa99e966-b218-499d-8aa5-75da31cdc5f8\") " pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"
Sep 06 01:14:22.087932 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:22.087850    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa99e966-b218-499d-8aa5-75da31cdc5f8-workload-certs\") pod \"e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj\" (UID: \"fa99e966-b218-499d-8aa5-75da31cdc5f8\") " pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"
Sep 06 01:14:22.087932 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:22.087876    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa99e966-b218-499d-8aa5-75da31cdc5f8-istio-data\") pod \"e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj\" (UID: \"fa99e966-b218-499d-8aa5-75da31cdc5f8\") " pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"
Sep 06 01:14:22.088041 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:22.087957    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa99e966-b218-499d-8aa5-75da31cdc5f8-credential-socket\") pod \"e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj\" (UID: \"fa99e966-b218-499d-8aa5-75da31cdc5f8\") " pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"
Sep 06 01:14:22.088041 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:22.087989    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa99e966-b218-499d-8aa5-75da31cdc5f8-workload-socket\") pod \"e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj\" (UID: \"fa99e966-b218-499d-8aa5-75da31cdc5f8\") " pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"
Sep 06 01:14:22.088427 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:22.088406    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa99e966-b218-499d-8aa5-75da31cdc5f8-istiod-ca-cert\") pod \"e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj\" (UID: \"fa99e966-b218-499d-8aa5-75da31cdc5f8\") " pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"
Sep 06 01:14:22.089945 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:22.089923    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa99e966-b218-499d-8aa5-75da31cdc5f8-istio-envoy\") pod \"e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj\" (UID: \"fa99e966-b218-499d-8aa5-75da31cdc5f8\") " pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"
Sep 06 01:14:22.090147 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:22.090128    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa99e966-b218-499d-8aa5-75da31cdc5f8-istio-podinfo\") pod \"e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj\" (UID: \"fa99e966-b218-499d-8aa5-75da31cdc5f8\") " pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"
Sep 06 01:14:22.097826 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:22.097800    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa99e966-b218-499d-8aa5-75da31cdc5f8-istio-token\") pod \"e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj\" (UID: \"fa99e966-b218-499d-8aa5-75da31cdc5f8\") " pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"
Sep 06 01:14:22.098074 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:22.098054    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44kgk\" (UniqueName: \"kubernetes.io/projected/fa99e966-b218-499d-8aa5-75da31cdc5f8-kube-api-access-44kgk\") pod \"e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj\" (UID: \"fa99e966-b218-499d-8aa5-75da31cdc5f8\") " pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"
Sep 06 01:14:22.236021 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:22.235932    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"
Sep 06 01:14:22.519168 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:22.519069    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"]
Sep 06 01:14:22.521718 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:14:22.521690    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa99e966_b218_499d_8aa5_75da31cdc5f8.slice/crio-6b0fe56b8d3e64d174ee13b90e3b63e8e87091c0abedeede4a3e6bc4b02ff7a0 WatchSource:0}: Error finding container 6b0fe56b8d3e64d174ee13b90e3b63e8e87091c0abedeede4a3e6bc4b02ff7a0: Status 404 returned error can't find the container with id 6b0fe56b8d3e64d174ee13b90e3b63e8e87091c0abedeede4a3e6bc4b02ff7a0
Sep 06 01:14:22.524166 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:22.524133    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:14:22.524249 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:22.524199    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:14:22.524249 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:22.524226    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:14:22.891843 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:22.891755    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj" event={"ID":"fa99e966-b218-499d-8aa5-75da31cdc5f8","Type":"ContainerStarted","Data":"6615852da2c991bfd967971b8484e0488b6b94ccbbf34f78f1ef504213d8ef08"}
Sep 06 01:14:22.891843 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:22.891806    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj" event={"ID":"fa99e966-b218-499d-8aa5-75da31cdc5f8","Type":"ContainerStarted","Data":"6b0fe56b8d3e64d174ee13b90e3b63e8e87091c0abedeede4a3e6bc4b02ff7a0"}
Sep 06 01:14:22.911065 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:22.910998    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj" podStartSLOduration=1.91097782 podStartE2EDuration="1.91097782s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:14:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:14:22.91066805 +0000 UTC m=+1420.946811006" watchObservedRunningTime="2026-09-06 01:14:22.91097782 +0000 UTC m=+1420.947120778"
Sep 06 01:14:23.236257 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:23.236223    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"
Sep 06 01:14:23.241494 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:23.241470    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"
Sep 06 01:14:23.897592 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:23.897553    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"
Sep 06 01:14:23.898442 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:23.898424    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"
Sep 06 01:14:26.761414 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:26.761366    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2d5f29-6d9d987f74-959jg"]
Sep 06 01:14:26.765451 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:26.765430    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2d5f29-6d9d987f74-959jg"
Sep 06 01:14:26.771389 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:26.771363    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-2d5f29\""
Sep 06 01:14:26.771522 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:26.771389    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-2d5f29-dockercfg-mqv79\""
Sep 06 01:14:26.777697 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:26.777674    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2d5f29-6d9d987f74-959jg"]
Sep 06 01:14:26.839217 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:26.839182    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7829c3ba-339a-48e5-81c7-4faca16fddf0-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-2d5f29-6d9d987f74-959jg\" (UID: \"7829c3ba-339a-48e5-81c7-4faca16fddf0\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2d5f29-6d9d987f74-959jg"
Sep 06 01:14:26.839422 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:26.839242    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ccq8\" (UniqueName: \"kubernetes.io/projected/7829c3ba-339a-48e5-81c7-4faca16fddf0-kube-api-access-9ccq8\") pod \"payload-pre-processing-e2e-api-a-2d5f29-6d9d987f74-959jg\" (UID: \"7829c3ba-339a-48e5-81c7-4faca16fddf0\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2d5f29-6d9d987f74-959jg"
Sep 06 01:14:26.939976 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:26.939939    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ccq8\" (UniqueName: \"kubernetes.io/projected/7829c3ba-339a-48e5-81c7-4faca16fddf0-kube-api-access-9ccq8\") pod \"payload-pre-processing-e2e-api-a-2d5f29-6d9d987f74-959jg\" (UID: \"7829c3ba-339a-48e5-81c7-4faca16fddf0\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2d5f29-6d9d987f74-959jg"
Sep 06 01:14:26.940147 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:26.940069    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7829c3ba-339a-48e5-81c7-4faca16fddf0-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-2d5f29-6d9d987f74-959jg\" (UID: \"7829c3ba-339a-48e5-81c7-4faca16fddf0\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2d5f29-6d9d987f74-959jg"
Sep 06 01:14:26.940804 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:26.940781    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7829c3ba-339a-48e5-81c7-4faca16fddf0-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-2d5f29-6d9d987f74-959jg\" (UID: \"7829c3ba-339a-48e5-81c7-4faca16fddf0\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2d5f29-6d9d987f74-959jg"
Sep 06 01:14:26.950740 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:26.950712    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ccq8\" (UniqueName: \"kubernetes.io/projected/7829c3ba-339a-48e5-81c7-4faca16fddf0-kube-api-access-9ccq8\") pod \"payload-pre-processing-e2e-api-a-2d5f29-6d9d987f74-959jg\" (UID: \"7829c3ba-339a-48e5-81c7-4faca16fddf0\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2d5f29-6d9d987f74-959jg"
Sep 06 01:14:27.077733 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:27.077648    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2d5f29-6d9d987f74-959jg"
Sep 06 01:14:27.351871 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:27.351847    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2d5f29-6d9d987f74-959jg"]
Sep 06 01:14:27.353821 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:14:27.353799    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7829c3ba_339a_48e5_81c7_4faca16fddf0.slice/crio-586518cdbd6ce9155e88a2db33088110d433d5c7a3f22aeec8dd379b8c33c3ca WatchSource:0}: Error finding container 586518cdbd6ce9155e88a2db33088110d433d5c7a3f22aeec8dd379b8c33c3ca: Status 404 returned error can't find the container with id 586518cdbd6ce9155e88a2db33088110d433d5c7a3f22aeec8dd379b8c33c3ca
Sep 06 01:14:27.922672 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:27.922634    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2d5f29-6d9d987f74-959jg" event={"ID":"7829c3ba-339a-48e5-81c7-4faca16fddf0","Type":"ContainerStarted","Data":"20b93096bf6ad2645eaf8cfa78492d2874461389b73bd7e2083735b93f2bff91"}
Sep 06 01:14:27.923478 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:27.922694    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2d5f29-6d9d987f74-959jg" event={"ID":"7829c3ba-339a-48e5-81c7-4faca16fddf0","Type":"ContainerStarted","Data":"586518cdbd6ce9155e88a2db33088110d433d5c7a3f22aeec8dd379b8c33c3ca"}
Sep 06 01:14:27.923478 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:27.922742    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2d5f29-6d9d987f74-959jg"
Sep 06 01:14:27.940393 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:27.940292    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2d5f29-6d9d987f74-959jg" podStartSLOduration=1.940277338 podStartE2EDuration="1.940277338s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:14:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:14:27.939230227 +0000 UTC m=+1425.975373186" watchObservedRunningTime="2026-09-06 01:14:27.940277338 +0000 UTC m=+1425.976420295"
Sep 06 01:14:29.866739 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:29.866695    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:14:38.930078 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:38.930047    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2d5f29-6d9d987f74-959jg"
Sep 06 01:14:39.939509 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:39.939459    2577 patch_prober.go:28] interesting pod/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 06 01:14:39.939988 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:39.939526    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj" podUID="fa99e966-b218-499d-8aa5-75da31cdc5f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 06 01:14:42.016008 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:42.015973    2577 generic.go:356] "Generic (PLEG): container finished" podID="fa99e966-b218-499d-8aa5-75da31cdc5f8" containerID="6615852da2c991bfd967971b8484e0488b6b94ccbbf34f78f1ef504213d8ef08" exitCode=0
Sep 06 01:14:42.016473 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:42.016049    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj" event={"ID":"fa99e966-b218-499d-8aa5-75da31cdc5f8","Type":"ContainerDied","Data":"6615852da2c991bfd967971b8484e0488b6b94ccbbf34f78f1ef504213d8ef08"}
Sep 06 01:14:42.016524 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:42.016476    2577 scope.go:117] "RemoveContainer" containerID="6615852da2c991bfd967971b8484e0488b6b94ccbbf34f78f1ef504213d8ef08"
Sep 06 01:14:42.017652 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:42.017624    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:14:42.017722 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:42.017691    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:14:42.017760 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:42.017720    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:14:43.028716 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:43.028670    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj" event={"ID":"fa99e966-b218-499d-8aa5-75da31cdc5f8","Type":"ContainerStarted","Data":"787633149f0dbf948925a32329060ad6c7690978234a9a9391fb78353a415ed7"}
Sep 06 01:14:43.236520 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:43.236472    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"
Sep 06 01:14:43.236749 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:43.236727    2577 patch_prober.go:28] interesting pod/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 06 01:14:43.236794 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:43.236779    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj" podUID="fa99e966-b218-499d-8aa5-75da31cdc5f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 06 01:14:44.236601 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:44.236559    2577 patch_prober.go:28] interesting pod/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 06 01:14:44.237088 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:44.236628    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj" podUID="fa99e966-b218-499d-8aa5-75da31cdc5f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 06 01:14:45.236619 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:45.236585    2577 patch_prober.go:28] interesting pod/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 06 01:14:45.236994 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:45.236645    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj" podUID="fa99e966-b218-499d-8aa5-75da31cdc5f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 06 01:14:46.237392 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:46.237341    2577 patch_prober.go:28] interesting pod/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 06 01:14:46.237858 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:46.237415    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj" podUID="fa99e966-b218-499d-8aa5-75da31cdc5f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 06 01:14:47.237043 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:47.236998    2577 patch_prober.go:28] interesting pod/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 06 01:14:47.237230 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:47.237080    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj" podUID="fa99e966-b218-499d-8aa5-75da31cdc5f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 06 01:14:48.412949 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:48.412921    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"
Sep 06 01:14:48.413411 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:48.413199    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"
Sep 06 01:14:48.414068 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:48.414049    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"
Sep 06 01:14:48.769989 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:14:48.769907    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:15:00.150204 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:00.150165    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-5844a8-29810955-7rt78"]
Sep 06 01:15:00.158340 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:00.155625    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-812148-29810955-fgq87"]
Sep 06 01:15:00.160876 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:00.160849    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-5844a8-29810955-7rt78"
Sep 06 01:15:00.162288 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:00.161370    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-e6b4e2-29810955-p75qv"]
Sep 06 01:15:00.162288 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:00.161967    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-812148-29810955-fgq87"
Sep 06 01:15:00.165066 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:00.165045    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xjq68\""
Sep 06 01:15:00.170223 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:00.170198    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-5844a8-29810955-7rt78"]
Sep 06 01:15:00.170384 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:00.170239    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-812148-29810955-fgq87"]
Sep 06 01:15:00.170384 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:00.170354    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-e6b4e2-29810955-p75qv"
Sep 06 01:15:00.172992 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:00.172967    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-e6b4e2-29810955-p75qv"]
Sep 06 01:15:00.177865 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:00.177843    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-1f7961-29810955-k2lhm"]
Sep 06 01:15:00.179552 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:00.179524    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-5844a8-29810955-7rt78"
Sep 06 01:15:00.183298 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:00.182885    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-1f7961-29810955-k2lhm"
Sep 06 01:15:00.188206 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:00.188188    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-812148-29810955-fgq87"
Sep 06 01:15:00.198682 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:00.198663    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-1f7961-29810955-k2lhm"]
Sep 06 01:15:00.232488 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:00.232446    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-e6b4e2-29810955-p75qv"
Sep 06 01:15:00.240162 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:00.240138    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-1f7961-29810955-k2lhm"
Sep 06 01:15:00.468120 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:00.468090    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-5844a8-29810955-7rt78"]
Sep 06 01:15:00.469796 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:15:00.469770    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b80965c_a90a_480b_b3ff_28fe34696faa.slice/crio-a046f07ba7acdc55a3660fdec9ba91b26ee86ab16d4ace58f83bc03489d0cf7c WatchSource:0}: Error finding container a046f07ba7acdc55a3660fdec9ba91b26ee86ab16d4ace58f83bc03489d0cf7c: Status 404 returned error can't find the container with id a046f07ba7acdc55a3660fdec9ba91b26ee86ab16d4ace58f83bc03489d0cf7c
Sep 06 01:15:00.496976 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:00.496956    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-812148-29810955-fgq87"]
Sep 06 01:15:00.503493 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:15:00.503469    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod785e1add_4b51_4a73_a07f_8550720e1f69.slice/crio-7278b4a0fc349bfeb1d93e523c60260a1b469496489d20d5bc0aeb675a078e36 WatchSource:0}: Error finding container 7278b4a0fc349bfeb1d93e523c60260a1b469496489d20d5bc0aeb675a078e36: Status 404 returned error can't find the container with id 7278b4a0fc349bfeb1d93e523c60260a1b469496489d20d5bc0aeb675a078e36
Sep 06 01:15:00.555331 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:00.555284    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-1f7961-29810955-k2lhm"]
Sep 06 01:15:00.556619 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:15:00.556596    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80c8ceb4_75b4_4bc9_b5e5_4accbec4ae8f.slice/crio-0c2fe8690c5e51ba097769dcc130dc7607c04826b4ca00105f5e7ab4b9c8204c WatchSource:0}: Error finding container 0c2fe8690c5e51ba097769dcc130dc7607c04826b4ca00105f5e7ab4b9c8204c: Status 404 returned error can't find the container with id 0c2fe8690c5e51ba097769dcc130dc7607c04826b4ca00105f5e7ab4b9c8204c
Sep 06 01:15:00.557416 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:15:00.557376    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8d86cad_35d6_45fa_8a2b_e660f2f26112.slice/crio-1770d14ef54a3543d1aeaf3e0fd64291ad6e9ec54e3d9f748ea023dec217fb85 WatchSource:0}: Error finding container 1770d14ef54a3543d1aeaf3e0fd64291ad6e9ec54e3d9f748ea023dec217fb85: Status 404 returned error can't find the container with id 1770d14ef54a3543d1aeaf3e0fd64291ad6e9ec54e3d9f748ea023dec217fb85
Sep 06 01:15:00.557494 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:00.557448    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-e6b4e2-29810955-p75qv"]
Sep 06 01:15:01.135717 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:01.135687    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-812148-29810955-fgq87" event={"ID":"785e1add-4b51-4a73-a07f-8550720e1f69","Type":"ContainerStarted","Data":"8688457d021f373b071188dba3484c0ce25a320e331d8a620d0107c96f77409d"}
Sep 06 01:15:01.135903 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:01.135745    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-812148-29810955-fgq87" event={"ID":"785e1add-4b51-4a73-a07f-8550720e1f69","Type":"ContainerStarted","Data":"7278b4a0fc349bfeb1d93e523c60260a1b469496489d20d5bc0aeb675a078e36"}
Sep 06 01:15:01.137415 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:01.137383    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-5844a8-29810955-7rt78" event={"ID":"1b80965c-a90a-480b-b3ff-28fe34696faa","Type":"ContainerStarted","Data":"756b29768fc0b03f91d3f0bcbb2f2de92002de44dbb031647f4d1b793acce2ee"}
Sep 06 01:15:01.137530 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:01.137434    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-5844a8-29810955-7rt78" event={"ID":"1b80965c-a90a-480b-b3ff-28fe34696faa","Type":"ContainerStarted","Data":"a046f07ba7acdc55a3660fdec9ba91b26ee86ab16d4ace58f83bc03489d0cf7c"}
Sep 06 01:15:01.138869 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:01.138849    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-1f7961-29810955-k2lhm" event={"ID":"c8d86cad-35d6-45fa-8a2b-e660f2f26112","Type":"ContainerStarted","Data":"c311a92e0cc3708c358d07f308b10438a778fa6bb4d945e76c7073403ddfe7dc"}
Sep 06 01:15:01.138960 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:01.138892    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-1f7961-29810955-k2lhm" event={"ID":"c8d86cad-35d6-45fa-8a2b-e660f2f26112","Type":"ContainerStarted","Data":"1770d14ef54a3543d1aeaf3e0fd64291ad6e9ec54e3d9f748ea023dec217fb85"}
Sep 06 01:15:01.140404 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:01.140382    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-e6b4e2-29810955-p75qv" event={"ID":"80c8ceb4-75b4-4bc9-b5e5-4accbec4ae8f","Type":"ContainerStarted","Data":"853ca15ff38f35c86344026054216debc6663bd24f90ac2d40d2545f458734a4"}
Sep 06 01:15:01.140511 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:01.140418    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-e6b4e2-29810955-p75qv" event={"ID":"80c8ceb4-75b4-4bc9-b5e5-4accbec4ae8f","Type":"ContainerStarted","Data":"0c2fe8690c5e51ba097769dcc130dc7607c04826b4ca00105f5e7ab4b9c8204c"}
Sep 06 01:15:01.154267 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:01.154224    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-812148-29810955-fgq87" podStartSLOduration=1.15421141 podStartE2EDuration="1.15421141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:15:01.151100019 +0000 UTC m=+1459.187242976" watchObservedRunningTime="2026-09-06 01:15:01.15421141 +0000 UTC m=+1459.190354363"
Sep 06 01:15:01.166811 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:01.166775    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-5844a8-29810955-7rt78" podStartSLOduration=1.166759203 podStartE2EDuration="1.166759203s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:15:01.165690031 +0000 UTC m=+1459.201832992" watchObservedRunningTime="2026-09-06 01:15:01.166759203 +0000 UTC m=+1459.202902162"
Sep 06 01:15:01.180866 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:01.180828    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-1f7961-29810955-k2lhm" podStartSLOduration=1.180815319 podStartE2EDuration="1.180815319s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:15:01.18054362 +0000 UTC m=+1459.216686578" watchObservedRunningTime="2026-09-06 01:15:01.180815319 +0000 UTC m=+1459.216958275"
Sep 06 01:15:01.194171 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:01.194127    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-e6b4e2-29810955-p75qv" podStartSLOduration=1.194111502 podStartE2EDuration="1.194111502s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:15:01.193482641 +0000 UTC m=+1459.229625607" watchObservedRunningTime="2026-09-06 01:15:01.194111502 +0000 UTC m=+1459.230254462"
Sep 06 01:15:01.775527 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:01.775497    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:15:02.147408 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:02.147308    2577 generic.go:356] "Generic (PLEG): container finished" podID="785e1add-4b51-4a73-a07f-8550720e1f69" containerID="8688457d021f373b071188dba3484c0ce25a320e331d8a620d0107c96f77409d" exitCode=0
Sep 06 01:15:02.147408 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:02.147366    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-812148-29810955-fgq87" event={"ID":"785e1add-4b51-4a73-a07f-8550720e1f69","Type":"ContainerDied","Data":"8688457d021f373b071188dba3484c0ce25a320e331d8a620d0107c96f77409d"}
Sep 06 01:15:02.148944 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:02.148923    2577 generic.go:356] "Generic (PLEG): container finished" podID="1b80965c-a90a-480b-b3ff-28fe34696faa" containerID="756b29768fc0b03f91d3f0bcbb2f2de92002de44dbb031647f4d1b793acce2ee" exitCode=0
Sep 06 01:15:02.149087 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:02.148952    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-5844a8-29810955-7rt78" event={"ID":"1b80965c-a90a-480b-b3ff-28fe34696faa","Type":"ContainerDied","Data":"756b29768fc0b03f91d3f0bcbb2f2de92002de44dbb031647f4d1b793acce2ee"}
Sep 06 01:15:02.150628 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:02.150604    2577 generic.go:356] "Generic (PLEG): container finished" podID="c8d86cad-35d6-45fa-8a2b-e660f2f26112" containerID="c311a92e0cc3708c358d07f308b10438a778fa6bb4d945e76c7073403ddfe7dc" exitCode=7
Sep 06 01:15:02.150752 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:02.150687    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-1f7961-29810955-k2lhm" event={"ID":"c8d86cad-35d6-45fa-8a2b-e660f2f26112","Type":"ContainerDied","Data":"c311a92e0cc3708c358d07f308b10438a778fa6bb4d945e76c7073403ddfe7dc"}
Sep 06 01:15:02.150825 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:02.150813    2577 scope.go:117] "RemoveContainer" containerID="c311a92e0cc3708c358d07f308b10438a778fa6bb4d945e76c7073403ddfe7dc"
Sep 06 01:15:02.152282 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:02.152260    2577 generic.go:356] "Generic (PLEG): container finished" podID="80c8ceb4-75b4-4bc9-b5e5-4accbec4ae8f" containerID="853ca15ff38f35c86344026054216debc6663bd24f90ac2d40d2545f458734a4" exitCode=0
Sep 06 01:15:02.152398 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:02.152355    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-e6b4e2-29810955-p75qv" event={"ID":"80c8ceb4-75b4-4bc9-b5e5-4accbec4ae8f","Type":"ContainerDied","Data":"853ca15ff38f35c86344026054216debc6663bd24f90ac2d40d2545f458734a4"}
Sep 06 01:15:03.160310 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:03.160273    2577 generic.go:356] "Generic (PLEG): container finished" podID="c8d86cad-35d6-45fa-8a2b-e660f2f26112" containerID="d1f50c2b005a7970539184139fc48b2926c1638ee94fe209a4fdc32ad6dd553c" exitCode=0
Sep 06 01:15:03.160692 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:03.160352    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-1f7961-29810955-k2lhm" event={"ID":"c8d86cad-35d6-45fa-8a2b-e660f2f26112","Type":"ContainerDied","Data":"d1f50c2b005a7970539184139fc48b2926c1638ee94fe209a4fdc32ad6dd553c"}
Sep 06 01:15:03.160692 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:03.160411    2577 scope.go:117] "RemoveContainer" containerID="c311a92e0cc3708c358d07f308b10438a778fa6bb4d945e76c7073403ddfe7dc"
Sep 06 01:15:03.336690 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:03.336655    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-e6b4e2-29810955-p75qv"
Sep 06 01:15:03.379017 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:03.378992    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-5844a8-29810955-7rt78"
Sep 06 01:15:03.382360 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:03.382311    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-812148-29810955-fgq87"
Sep 06 01:15:04.167524 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.167499    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-5844a8-29810955-7rt78"
Sep 06 01:15:04.167524 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.167510    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-5844a8-29810955-7rt78" event={"ID":"1b80965c-a90a-480b-b3ff-28fe34696faa","Type":"ContainerDied","Data":"a046f07ba7acdc55a3660fdec9ba91b26ee86ab16d4ace58f83bc03489d0cf7c"}
Sep 06 01:15:04.167976 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.167561    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a046f07ba7acdc55a3660fdec9ba91b26ee86ab16d4ace58f83bc03489d0cf7c"
Sep 06 01:15:04.170893 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.170866    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-e6b4e2-29810955-p75qv"
Sep 06 01:15:04.171025 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.170901    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-e6b4e2-29810955-p75qv" event={"ID":"80c8ceb4-75b4-4bc9-b5e5-4accbec4ae8f","Type":"ContainerDied","Data":"0c2fe8690c5e51ba097769dcc130dc7607c04826b4ca00105f5e7ab4b9c8204c"}
Sep 06 01:15:04.171025 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.170949    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0c2fe8690c5e51ba097769dcc130dc7607c04826b4ca00105f5e7ab4b9c8204c"
Sep 06 01:15:04.172298 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.172273    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-812148-29810955-fgq87" event={"ID":"785e1add-4b51-4a73-a07f-8550720e1f69","Type":"ContainerDied","Data":"7278b4a0fc349bfeb1d93e523c60260a1b469496489d20d5bc0aeb675a078e36"}
Sep 06 01:15:04.172419 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.172357    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7278b4a0fc349bfeb1d93e523c60260a1b469496489d20d5bc0aeb675a078e36"
Sep 06 01:15:04.172419 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.172365    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-812148-29810955-fgq87"
Sep 06 01:15:04.318604 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.318576    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-1f7961-29810955-k2lhm"
Sep 06 01:15:04.755917 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.755826    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-470346/rate-test-model-470346-kserve-84bdc58475-lp4mg"]
Sep 06 01:15:04.756408 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.756390    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b80965c-a90a-480b-b3ff-28fe34696faa" containerName="cleanup"
Sep 06 01:15:04.756497 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.756409    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b80965c-a90a-480b-b3ff-28fe34696faa" containerName="cleanup"
Sep 06 01:15:04.756497 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.756424    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8d86cad-35d6-45fa-8a2b-e660f2f26112" containerName="cleanup"
Sep 06 01:15:04.756497 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.756431    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8d86cad-35d6-45fa-8a2b-e660f2f26112" containerName="cleanup"
Sep 06 01:15:04.756497 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.756453    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="785e1add-4b51-4a73-a07f-8550720e1f69" containerName="cleanup"
Sep 06 01:15:04.756497 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.756461    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="785e1add-4b51-4a73-a07f-8550720e1f69" containerName="cleanup"
Sep 06 01:15:04.756497 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.756469    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8d86cad-35d6-45fa-8a2b-e660f2f26112" containerName="cleanup"
Sep 06 01:15:04.756497 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.756477    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8d86cad-35d6-45fa-8a2b-e660f2f26112" containerName="cleanup"
Sep 06 01:15:04.756497 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.756490    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80c8ceb4-75b4-4bc9-b5e5-4accbec4ae8f" containerName="cleanup"
Sep 06 01:15:04.756497 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.756497    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="80c8ceb4-75b4-4bc9-b5e5-4accbec4ae8f" containerName="cleanup"
Sep 06 01:15:04.756915 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.756610    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8d86cad-35d6-45fa-8a2b-e660f2f26112" containerName="cleanup"
Sep 06 01:15:04.756915 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.756625    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b80965c-a90a-480b-b3ff-28fe34696faa" containerName="cleanup"
Sep 06 01:15:04.756915 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.756639    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="80c8ceb4-75b4-4bc9-b5e5-4accbec4ae8f" containerName="cleanup"
Sep 06 01:15:04.756915 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.756649    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="785e1add-4b51-4a73-a07f-8550720e1f69" containerName="cleanup"
Sep 06 01:15:04.759925 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.759906    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-470346/rate-test-model-470346-kserve-84bdc58475-lp4mg"
Sep 06 01:15:04.763086 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.763058    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-470346\"/\"default-dockercfg-pvm25\""
Sep 06 01:15:04.763086 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.763071    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-470346\"/\"kube-root-ca.crt\""
Sep 06 01:15:04.763277 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.763093    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-470346\"/\"rate-test-model-470346-kserve-self-signed-certs\""
Sep 06 01:15:04.763277 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.763124    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-470346\"/\"openshift-service-ca.crt\""
Sep 06 01:15:04.768757 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.768733    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-470346/rate-test-model-470346-kserve-84bdc58475-lp4mg"]
Sep 06 01:15:04.848372 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.848335    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49641640-12bd-4360-b539-5f15d3574d40-home\") pod \"rate-test-model-470346-kserve-84bdc58475-lp4mg\" (UID: \"49641640-12bd-4360-b539-5f15d3574d40\") " pod="ai-tenant-e2e-shared-b-w3-470346/rate-test-model-470346-kserve-84bdc58475-lp4mg"
Sep 06 01:15:04.848543 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.848400    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49641640-12bd-4360-b539-5f15d3574d40-tmp-dir\") pod \"rate-test-model-470346-kserve-84bdc58475-lp4mg\" (UID: \"49641640-12bd-4360-b539-5f15d3574d40\") " pod="ai-tenant-e2e-shared-b-w3-470346/rate-test-model-470346-kserve-84bdc58475-lp4mg"
Sep 06 01:15:04.848543 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.848438    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49641640-12bd-4360-b539-5f15d3574d40-model-cache\") pod \"rate-test-model-470346-kserve-84bdc58475-lp4mg\" (UID: \"49641640-12bd-4360-b539-5f15d3574d40\") " pod="ai-tenant-e2e-shared-b-w3-470346/rate-test-model-470346-kserve-84bdc58475-lp4mg"
Sep 06 01:15:04.848543 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.848455    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvr9w\" (UniqueName: \"kubernetes.io/projected/49641640-12bd-4360-b539-5f15d3574d40-kube-api-access-zvr9w\") pod \"rate-test-model-470346-kserve-84bdc58475-lp4mg\" (UID: \"49641640-12bd-4360-b539-5f15d3574d40\") " pod="ai-tenant-e2e-shared-b-w3-470346/rate-test-model-470346-kserve-84bdc58475-lp4mg"
Sep 06 01:15:04.848667 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.848561    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49641640-12bd-4360-b539-5f15d3574d40-tls-certs\") pod \"rate-test-model-470346-kserve-84bdc58475-lp4mg\" (UID: \"49641640-12bd-4360-b539-5f15d3574d40\") " pod="ai-tenant-e2e-shared-b-w3-470346/rate-test-model-470346-kserve-84bdc58475-lp4mg"
Sep 06 01:15:04.848667 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.848607    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49641640-12bd-4360-b539-5f15d3574d40-dshm\") pod \"rate-test-model-470346-kserve-84bdc58475-lp4mg\" (UID: \"49641640-12bd-4360-b539-5f15d3574d40\") " pod="ai-tenant-e2e-shared-b-w3-470346/rate-test-model-470346-kserve-84bdc58475-lp4mg"
Sep 06 01:15:04.949561 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.949523    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49641640-12bd-4360-b539-5f15d3574d40-home\") pod \"rate-test-model-470346-kserve-84bdc58475-lp4mg\" (UID: \"49641640-12bd-4360-b539-5f15d3574d40\") " pod="ai-tenant-e2e-shared-b-w3-470346/rate-test-model-470346-kserve-84bdc58475-lp4mg"
Sep 06 01:15:04.949736 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.949581    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49641640-12bd-4360-b539-5f15d3574d40-tmp-dir\") pod \"rate-test-model-470346-kserve-84bdc58475-lp4mg\" (UID: \"49641640-12bd-4360-b539-5f15d3574d40\") " pod="ai-tenant-e2e-shared-b-w3-470346/rate-test-model-470346-kserve-84bdc58475-lp4mg"
Sep 06 01:15:04.949736 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.949619    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49641640-12bd-4360-b539-5f15d3574d40-model-cache\") pod \"rate-test-model-470346-kserve-84bdc58475-lp4mg\" (UID: \"49641640-12bd-4360-b539-5f15d3574d40\") " pod="ai-tenant-e2e-shared-b-w3-470346/rate-test-model-470346-kserve-84bdc58475-lp4mg"
Sep 06 01:15:04.949736 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.949638    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvr9w\" (UniqueName: \"kubernetes.io/projected/49641640-12bd-4360-b539-5f15d3574d40-kube-api-access-zvr9w\") pod \"rate-test-model-470346-kserve-84bdc58475-lp4mg\" (UID: \"49641640-12bd-4360-b539-5f15d3574d40\") " pod="ai-tenant-e2e-shared-b-w3-470346/rate-test-model-470346-kserve-84bdc58475-lp4mg"
Sep 06 01:15:04.949736 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.949703    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49641640-12bd-4360-b539-5f15d3574d40-tls-certs\") pod \"rate-test-model-470346-kserve-84bdc58475-lp4mg\" (UID: \"49641640-12bd-4360-b539-5f15d3574d40\") " pod="ai-tenant-e2e-shared-b-w3-470346/rate-test-model-470346-kserve-84bdc58475-lp4mg"
Sep 06 01:15:04.949962 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.949756    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49641640-12bd-4360-b539-5f15d3574d40-dshm\") pod \"rate-test-model-470346-kserve-84bdc58475-lp4mg\" (UID: \"49641640-12bd-4360-b539-5f15d3574d40\") " pod="ai-tenant-e2e-shared-b-w3-470346/rate-test-model-470346-kserve-84bdc58475-lp4mg"
Sep 06 01:15:04.950022 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.949978    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49641640-12bd-4360-b539-5f15d3574d40-home\") pod \"rate-test-model-470346-kserve-84bdc58475-lp4mg\" (UID: \"49641640-12bd-4360-b539-5f15d3574d40\") " pod="ai-tenant-e2e-shared-b-w3-470346/rate-test-model-470346-kserve-84bdc58475-lp4mg"
Sep 06 01:15:04.950076 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.950056    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49641640-12bd-4360-b539-5f15d3574d40-tmp-dir\") pod \"rate-test-model-470346-kserve-84bdc58475-lp4mg\" (UID: \"49641640-12bd-4360-b539-5f15d3574d40\") " pod="ai-tenant-e2e-shared-b-w3-470346/rate-test-model-470346-kserve-84bdc58475-lp4mg"
Sep 06 01:15:04.950116 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.950076    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49641640-12bd-4360-b539-5f15d3574d40-model-cache\") pod \"rate-test-model-470346-kserve-84bdc58475-lp4mg\" (UID: \"49641640-12bd-4360-b539-5f15d3574d40\") " pod="ai-tenant-e2e-shared-b-w3-470346/rate-test-model-470346-kserve-84bdc58475-lp4mg"
Sep 06 01:15:04.952201 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.952175    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49641640-12bd-4360-b539-5f15d3574d40-dshm\") pod \"rate-test-model-470346-kserve-84bdc58475-lp4mg\" (UID: \"49641640-12bd-4360-b539-5f15d3574d40\") " pod="ai-tenant-e2e-shared-b-w3-470346/rate-test-model-470346-kserve-84bdc58475-lp4mg"
Sep 06 01:15:04.952368 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.952349    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49641640-12bd-4360-b539-5f15d3574d40-tls-certs\") pod \"rate-test-model-470346-kserve-84bdc58475-lp4mg\" (UID: \"49641640-12bd-4360-b539-5f15d3574d40\") " pod="ai-tenant-e2e-shared-b-w3-470346/rate-test-model-470346-kserve-84bdc58475-lp4mg"
Sep 06 01:15:04.957655 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:04.957633    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvr9w\" (UniqueName: \"kubernetes.io/projected/49641640-12bd-4360-b539-5f15d3574d40-kube-api-access-zvr9w\") pod \"rate-test-model-470346-kserve-84bdc58475-lp4mg\" (UID: \"49641640-12bd-4360-b539-5f15d3574d40\") " pod="ai-tenant-e2e-shared-b-w3-470346/rate-test-model-470346-kserve-84bdc58475-lp4mg"
Sep 06 01:15:05.070683 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:05.070592    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-470346/rate-test-model-470346-kserve-84bdc58475-lp4mg"
Sep 06 01:15:05.179666 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:05.179634    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-1f7961-29810955-k2lhm" event={"ID":"c8d86cad-35d6-45fa-8a2b-e660f2f26112","Type":"ContainerDied","Data":"1770d14ef54a3543d1aeaf3e0fd64291ad6e9ec54e3d9f748ea023dec217fb85"}
Sep 06 01:15:05.180043 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:05.179690    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1770d14ef54a3543d1aeaf3e0fd64291ad6e9ec54e3d9f748ea023dec217fb85"
Sep 06 01:15:05.180043 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:05.179642    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-1f7961-29810955-k2lhm"
Sep 06 01:15:05.350369 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:05.350346    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-470346/rate-test-model-470346-kserve-84bdc58475-lp4mg"]
Sep 06 01:15:05.352621 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:15:05.352590    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod49641640_12bd_4360_b539_5f15d3574d40.slice/crio-a5d74de6b45f80a99ca42e8c706320e788adc1b7ff149cb13599951512337360 WatchSource:0}: Error finding container a5d74de6b45f80a99ca42e8c706320e788adc1b7ff149cb13599951512337360: Status 404 returned error can't find the container with id a5d74de6b45f80a99ca42e8c706320e788adc1b7ff149cb13599951512337360
Sep 06 01:15:06.187561 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:06.187531    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-470346/rate-test-model-470346-kserve-84bdc58475-lp4mg" event={"ID":"49641640-12bd-4360-b539-5f15d3574d40","Type":"ContainerStarted","Data":"f6064e491ad1e78b8921281ea0f6fe68fee3890024531bbf13246f8109bea9ca"}
Sep 06 01:15:06.187952 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:06.187570    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-470346/rate-test-model-470346-kserve-84bdc58475-lp4mg" event={"ID":"49641640-12bd-4360-b539-5f15d3574d40","Type":"ContainerStarted","Data":"a5d74de6b45f80a99ca42e8c706320e788adc1b7ff149cb13599951512337360"}
Sep 06 01:15:06.206810 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:06.206742    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-470346/rate-test-model-470346-kserve-84bdc58475-lp4mg" podStartSLOduration=2.206721814 podStartE2EDuration="2.206721814s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:15:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:15:06.203047999 +0000 UTC m=+1464.239190957" watchObservedRunningTime="2026-09-06 01:15:06.206721814 +0000 UTC m=+1464.242864773"
Sep 06 01:15:15.070969 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:15.070931    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-470346/rate-test-model-470346-kserve-84bdc58475-lp4mg"
Sep 06 01:15:15.071403 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:15.070985    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-470346/rate-test-model-470346-kserve-84bdc58475-lp4mg"
Sep 06 01:15:15.083860 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:15.083829    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-470346/rate-test-model-470346-kserve-84bdc58475-lp4mg"
Sep 06 01:15:15.255954 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:15.255922    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-470346/rate-test-model-470346-kserve-84bdc58475-lp4mg"
Sep 06 01:15:18.262066 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:18.262037    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:15:21.572421 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:21.572390    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2d5f29-kbn2x"]
Sep 06 01:15:21.572957 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:21.572944    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8d86cad-35d6-45fa-8a2b-e660f2f26112" containerName="cleanup"
Sep 06 01:15:21.576304 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:21.576289    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2d5f29-kbn2x"
Sep 06 01:15:21.578653 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:21.578636    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xjq68\""
Sep 06 01:15:21.583260 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:21.583216    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2d5f29-kbn2x"]
Sep 06 01:15:21.616303 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:21.616274    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a75901a-03a6-41f5-adca-1df643a0180d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-2d5f29-kbn2x\" (UID: \"6a75901a-03a6-41f5-adca-1df643a0180d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2d5f29-kbn2x"
Sep 06 01:15:21.717702 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:21.717669    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a75901a-03a6-41f5-adca-1df643a0180d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-2d5f29-kbn2x\" (UID: \"6a75901a-03a6-41f5-adca-1df643a0180d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2d5f29-kbn2x"
Sep 06 01:15:21.718236 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:21.718216    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a75901a-03a6-41f5-adca-1df643a0180d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-2d5f29-kbn2x\" (UID: \"6a75901a-03a6-41f5-adca-1df643a0180d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2d5f29-kbn2x"
Sep 06 01:15:21.888470 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:21.888385    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2d5f29-kbn2x"
Sep 06 01:15:22.161041 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:22.161019    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2d5f29-kbn2x"]
Sep 06 01:15:22.163023 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:15:22.162996    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a75901a_03a6_41f5_adca_1df643a0180d.slice/crio-4a10a210d33b36cd9f01013db52ac936968bca7fd7132215c5bf2f6f9f7f64a3 WatchSource:0}: Error finding container 4a10a210d33b36cd9f01013db52ac936968bca7fd7132215c5bf2f6f9f7f64a3: Status 404 returned error can't find the container with id 4a10a210d33b36cd9f01013db52ac936968bca7fd7132215c5bf2f6f9f7f64a3
Sep 06 01:15:22.288703 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:22.288673    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2d5f29-kbn2x" event={"ID":"6a75901a-03a6-41f5-adca-1df643a0180d","Type":"ContainerStarted","Data":"4a10a210d33b36cd9f01013db52ac936968bca7fd7132215c5bf2f6f9f7f64a3"}
Sep 06 01:15:23.295927 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:23.295891    2577 generic.go:356] "Generic (PLEG): container finished" podID="6a75901a-03a6-41f5-adca-1df643a0180d" containerID="142b71229b8cb6a7a7655c51b3045eaea8717c02c2ee7fd9151ae1e563125832" exitCode=0
Sep 06 01:15:23.296371 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:23.295961    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2d5f29-kbn2x" event={"ID":"6a75901a-03a6-41f5-adca-1df643a0180d","Type":"ContainerDied","Data":"142b71229b8cb6a7a7655c51b3045eaea8717c02c2ee7fd9151ae1e563125832"}
Sep 06 01:15:24.447633 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:24.447611    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2d5f29-kbn2x"
Sep 06 01:15:24.540309 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:24.540279    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a75901a-03a6-41f5-adca-1df643a0180d-maas-api-service-ca\") pod \"6a75901a-03a6-41f5-adca-1df643a0180d\" (UID: \"6a75901a-03a6-41f5-adca-1df643a0180d\") "
Sep 06 01:15:24.540619 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:24.540597    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a75901a-03a6-41f5-adca-1df643a0180d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6a75901a-03a6-41f5-adca-1df643a0180d" (UID: "6a75901a-03a6-41f5-adca-1df643a0180d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:15:24.641378 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:24.641301    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a75901a-03a6-41f5-adca-1df643a0180d-maas-api-service-ca\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:15:25.308334 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:25.308288    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2d5f29-kbn2x"
Sep 06 01:15:25.308524 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:25.308339    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2d5f29-kbn2x" event={"ID":"6a75901a-03a6-41f5-adca-1df643a0180d","Type":"ContainerDied","Data":"4a10a210d33b36cd9f01013db52ac936968bca7fd7132215c5bf2f6f9f7f64a3"}
Sep 06 01:15:25.308524 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:25.308390    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4a10a210d33b36cd9f01013db52ac936968bca7fd7132215c5bf2f6f9f7f64a3"
Sep 06 01:15:37.174764 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:37.174728    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:15:37.231953 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:37.231915    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2d5f29-6d9d987f74-959jg"]
Sep 06 01:15:37.232142 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:37.232111    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2d5f29-6d9d987f74-959jg" podUID="7829c3ba-339a-48e5-81c7-4faca16fddf0" containerName="payload-pre-processing" containerID="cri-o://20b93096bf6ad2645eaf8cfa78492d2874461389b73bd7e2083735b93f2bff91" gracePeriod=30
Sep 06 01:15:37.383298 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:37.383211    2577 generic.go:356] "Generic (PLEG): container finished" podID="7829c3ba-339a-48e5-81c7-4faca16fddf0" containerID="20b93096bf6ad2645eaf8cfa78492d2874461389b73bd7e2083735b93f2bff91" exitCode=0
Sep 06 01:15:37.383298 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:37.383286    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2d5f29-6d9d987f74-959jg" event={"ID":"7829c3ba-339a-48e5-81c7-4faca16fddf0","Type":"ContainerDied","Data":"20b93096bf6ad2645eaf8cfa78492d2874461389b73bd7e2083735b93f2bff91"}
Sep 06 01:15:37.402208 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:37.402181    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2d5f29-kbn2x"]
Sep 06 01:15:37.415592 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:37.415561    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2d5f29-kbn2x"]
Sep 06 01:15:37.504451 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:37.504425    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2d5f29-6d9d987f74-959jg"
Sep 06 01:15:37.566197 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:37.566166    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7829c3ba-339a-48e5-81c7-4faca16fddf0-plugins-config-volume\") pod \"7829c3ba-339a-48e5-81c7-4faca16fddf0\" (UID: \"7829c3ba-339a-48e5-81c7-4faca16fddf0\") "
Sep 06 01:15:37.566403 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:37.566217    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9ccq8\" (UniqueName: \"kubernetes.io/projected/7829c3ba-339a-48e5-81c7-4faca16fddf0-kube-api-access-9ccq8\") pod \"7829c3ba-339a-48e5-81c7-4faca16fddf0\" (UID: \"7829c3ba-339a-48e5-81c7-4faca16fddf0\") "
Sep 06 01:15:37.568453 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:37.566971    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7829c3ba-339a-48e5-81c7-4faca16fddf0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7829c3ba-339a-48e5-81c7-4faca16fddf0" (UID: "7829c3ba-339a-48e5-81c7-4faca16fddf0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:15:37.576184 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:37.576145    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7829c3ba-339a-48e5-81c7-4faca16fddf0-kube-api-access-9ccq8" (OuterVolumeSpecName: "kube-api-access-9ccq8") pod "7829c3ba-339a-48e5-81c7-4faca16fddf0" (UID: "7829c3ba-339a-48e5-81c7-4faca16fddf0"). InnerVolumeSpecName "kube-api-access-9ccq8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:15:37.667997 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:37.667930    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7829c3ba-339a-48e5-81c7-4faca16fddf0-plugins-config-volume\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:15:37.667997 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:37.667989    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ccq8\" (UniqueName: \"kubernetes.io/projected/7829c3ba-339a-48e5-81c7-4faca16fddf0-kube-api-access-9ccq8\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:15:38.391448 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:38.391415    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2d5f29-6d9d987f74-959jg" event={"ID":"7829c3ba-339a-48e5-81c7-4faca16fddf0","Type":"ContainerDied","Data":"586518cdbd6ce9155e88a2db33088110d433d5c7a3f22aeec8dd379b8c33c3ca"}
Sep 06 01:15:38.391897 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:38.391477    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2d5f29-6d9d987f74-959jg"
Sep 06 01:15:38.391897 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:38.391503    2577 scope.go:117] "RemoveContainer" containerID="20b93096bf6ad2645eaf8cfa78492d2874461389b73bd7e2083735b93f2bff91"
Sep 06 01:15:38.410504 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:38.410476    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a75901a-03a6-41f5-adca-1df643a0180d" path="/var/lib/kubelet/pods/6a75901a-03a6-41f5-adca-1df643a0180d/volumes"
Sep 06 01:15:38.419556 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:38.419536    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2d5f29-6d9d987f74-959jg"]
Sep 06 01:15:38.423626 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:38.423604    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2d5f29-6d9d987f74-959jg"]
Sep 06 01:15:40.410539 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:40.410498    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7829c3ba-339a-48e5-81c7-4faca16fddf0" path="/var/lib/kubelet/pods/7829c3ba-339a-48e5-81c7-4faca16fddf0/volumes"
Sep 06 01:15:42.516894 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:42.516865    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2z66_e100e633-d18a-4d68-9c81-0ff379c12d2f/ovn-acl-logging/0.log"
Sep 06 01:15:42.518040 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:42.518015    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2z66_e100e633-d18a-4d68-9c81-0ff379c12d2f/ovn-acl-logging/0.log"
Sep 06 01:15:44.298813 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:44.298777    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"]
Sep 06 01:15:44.299281 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:44.298998    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj" podUID="fa99e966-b218-499d-8aa5-75da31cdc5f8" containerName="istio-proxy" containerID="cri-o://787633149f0dbf948925a32329060ad6c7690978234a9a9391fb78353a415ed7" gracePeriod=30
Sep 06 01:15:44.740739 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:44.740701    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1f7961-gm6xk"]
Sep 06 01:15:44.741283 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:44.741264    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a75901a-03a6-41f5-adca-1df643a0180d" containerName="revoke-keys"
Sep 06 01:15:44.741416 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:44.741285    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a75901a-03a6-41f5-adca-1df643a0180d" containerName="revoke-keys"
Sep 06 01:15:44.741416 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:44.741308    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7829c3ba-339a-48e5-81c7-4faca16fddf0" containerName="payload-pre-processing"
Sep 06 01:15:44.741416 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:44.741334    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7829c3ba-339a-48e5-81c7-4faca16fddf0" containerName="payload-pre-processing"
Sep 06 01:15:44.741583 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:44.741458    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7829c3ba-339a-48e5-81c7-4faca16fddf0" containerName="payload-pre-processing"
Sep 06 01:15:44.741583 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:44.741472    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a75901a-03a6-41f5-adca-1df643a0180d" containerName="revoke-keys"
Sep 06 01:15:44.745978 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:44.745958    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1f7961-gm6xk"
Sep 06 01:15:44.749271 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:44.749250    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xjq68\""
Sep 06 01:15:44.758883 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:44.758858    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1f7961-gm6xk"]
Sep 06 01:15:44.839280 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:44.839250    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d123193f-0cb6-44e6-b898-5e6fa91e875b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-1f7961-gm6xk\" (UID: \"d123193f-0cb6-44e6-b898-5e6fa91e875b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1f7961-gm6xk"
Sep 06 01:15:44.940789 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:44.940752    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d123193f-0cb6-44e6-b898-5e6fa91e875b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-1f7961-gm6xk\" (UID: \"d123193f-0cb6-44e6-b898-5e6fa91e875b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1f7961-gm6xk"
Sep 06 01:15:44.941383 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:44.941363    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d123193f-0cb6-44e6-b898-5e6fa91e875b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-1f7961-gm6xk\" (UID: \"d123193f-0cb6-44e6-b898-5e6fa91e875b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1f7961-gm6xk"
Sep 06 01:15:45.057834 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:45.057747    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1f7961-gm6xk"
Sep 06 01:15:45.333085 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:45.333058    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1f7961-gm6xk"]
Sep 06 01:15:45.334994 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:15:45.334970    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd123193f_0cb6_44e6_b898_5e6fa91e875b.slice/crio-3d1ec3fc4c2c74feddd004353adef60ec49d19b4fb4959b8f8d3c4ddb1dca7ca WatchSource:0}: Error finding container 3d1ec3fc4c2c74feddd004353adef60ec49d19b4fb4959b8f8d3c4ddb1dca7ca: Status 404 returned error can't find the container with id 3d1ec3fc4c2c74feddd004353adef60ec49d19b4fb4959b8f8d3c4ddb1dca7ca
Sep 06 01:15:45.438543 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:45.438511    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1f7961-gm6xk" event={"ID":"d123193f-0cb6-44e6-b898-5e6fa91e875b","Type":"ContainerStarted","Data":"3d1ec3fc4c2c74feddd004353adef60ec49d19b4fb4959b8f8d3c4ddb1dca7ca"}
Sep 06 01:15:45.455740 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:45.455705    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-470346/rate-test-model-470346-kserve-84bdc58475-lp4mg"]
Sep 06 01:15:46.289653 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:46.289619    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"]
Sep 06 01:15:46.293764 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:46.293745    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"
Sep 06 01:15:46.296105 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:46.296087    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-b2e4f6-openshift-default-dockercfg-t8js8\""
Sep 06 01:15:46.304495 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:46.304466    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"]
Sep 06 01:15:46.355084 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:46.355055    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-istio-podinfo\") pod \"e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h\" (UID: \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\") " pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"
Sep 06 01:15:46.355084 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:46.355084    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-istiod-ca-cert\") pod \"e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h\" (UID: \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\") " pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"
Sep 06 01:15:46.355603 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:46.355111    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-workload-certs\") pod \"e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h\" (UID: \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\") " pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"
Sep 06 01:15:46.355603 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:46.355236    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-istio-data\") pod \"e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h\" (UID: \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\") " pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"
Sep 06 01:15:46.355603 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:46.355303    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-credential-socket\") pod \"e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h\" (UID: \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\") " pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"
Sep 06 01:15:46.355603 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:46.355395    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-workload-socket\") pod \"e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h\" (UID: \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\") " pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"
Sep 06 01:15:46.355603 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:46.355421    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-istio-envoy\") pod \"e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h\" (UID: \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\") " pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"
Sep 06 01:15:46.355603 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:46.355513    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2zr5\" (UniqueName: \"kubernetes.io/projected/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-kube-api-access-m2zr5\") pod \"e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h\" (UID: \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\") " pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"
Sep 06 01:15:46.355603 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:46.355564    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-istio-token\") pod \"e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h\" (UID: \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\") " pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"
Sep 06 01:15:46.445803 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:46.445773    2577 generic.go:356] "Generic (PLEG): container finished" podID="d123193f-0cb6-44e6-b898-5e6fa91e875b" containerID="ed805ca987eb137d674c4a371ef69966408a19dbb6ca5ebc1702e3fd5c772dcc" exitCode=0
Sep 06 01:15:46.446009 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:46.445838    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1f7961-gm6xk" event={"ID":"d123193f-0cb6-44e6-b898-5e6fa91e875b","Type":"ContainerDied","Data":"ed805ca987eb137d674c4a371ef69966408a19dbb6ca5ebc1702e3fd5c772dcc"}
Sep 06 01:15:46.456558 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:46.456475    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2zr5\" (UniqueName: \"kubernetes.io/projected/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-kube-api-access-m2zr5\") pod \"e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h\" (UID: \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\") " pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"
Sep 06 01:15:46.456558 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:46.456519    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-istio-token\") pod \"e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h\" (UID: \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\") " pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"
Sep 06 01:15:46.456761 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:46.456665    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-istio-podinfo\") pod \"e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h\" (UID: \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\") " pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"
Sep 06 01:15:46.456761 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:46.456691    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-istiod-ca-cert\") pod \"e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h\" (UID: \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\") " pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"
Sep 06 01:15:46.456761 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:46.456735    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-workload-certs\") pod \"e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h\" (UID: \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\") " pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"
Sep 06 01:15:46.456910 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:46.456895    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-istio-data\") pod \"e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h\" (UID: \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\") " pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"
Sep 06 01:15:46.457009 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:46.456985    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-credential-socket\") pod \"e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h\" (UID: \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\") " pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"
Sep 06 01:15:46.457148 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:46.457049    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-workload-socket\") pod \"e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h\" (UID: \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\") " pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"
Sep 06 01:15:46.457148 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:46.457076    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-istio-envoy\") pod \"e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h\" (UID: \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\") " pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"
Sep 06 01:15:46.457148 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:46.457108    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-workload-certs\") pod \"e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h\" (UID: \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\") " pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"
Sep 06 01:15:46.457288 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:46.457153    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-istio-data\") pod \"e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h\" (UID: \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\") " pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"
Sep 06 01:15:46.457392 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:46.457361    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-credential-socket\") pod \"e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h\" (UID: \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\") " pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"
Sep 06 01:15:46.457458 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:46.457424    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-workload-socket\") pod \"e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h\" (UID: \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\") " pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"
Sep 06 01:15:46.457689 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:46.457673    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-istiod-ca-cert\") pod \"e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h\" (UID: \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\") " pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"
Sep 06 01:15:46.459272 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:46.459254    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-istio-envoy\") pod \"e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h\" (UID: \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\") " pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"
Sep 06 01:15:46.459340 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:46.459295    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-istio-podinfo\") pod \"e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h\" (UID: \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\") " pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"
Sep 06 01:15:46.466988 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:46.466964    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-istio-token\") pod \"e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h\" (UID: \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\") " pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"
Sep 06 01:15:46.467947 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:46.467930    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2zr5\" (UniqueName: \"kubernetes.io/projected/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-kube-api-access-m2zr5\") pod \"e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h\" (UID: \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\") " pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"
Sep 06 01:15:46.606257 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:46.606223    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"
Sep 06 01:15:46.885991 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:46.885961    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"]
Sep 06 01:15:46.886616 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:15:46.886594    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded7b10fd_46c2_4be0_91db_6e756dc33c9d.slice/crio-7b07224762e931dd2fd76cc2f79f32f7575184f320fd2c975e9452966e137d63 WatchSource:0}: Error finding container 7b07224762e931dd2fd76cc2f79f32f7575184f320fd2c975e9452966e137d63: Status 404 returned error can't find the container with id 7b07224762e931dd2fd76cc2f79f32f7575184f320fd2c975e9452966e137d63
Sep 06 01:15:46.888979 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:46.888946    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:15:46.889094 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:46.889005    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:15:46.889094 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:46.889031    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:15:47.456170 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:47.456127    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h" event={"ID":"ed7b10fd-46c2-4be0-91db-6e756dc33c9d","Type":"ContainerStarted","Data":"d0158d8551db05d67d2041b05a5bc9f0ad116f1d4ff73314bd7b0af94a7a4cd2"}
Sep 06 01:15:47.456654 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:47.456181    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h" event={"ID":"ed7b10fd-46c2-4be0-91db-6e756dc33c9d","Type":"ContainerStarted","Data":"7b07224762e931dd2fd76cc2f79f32f7575184f320fd2c975e9452966e137d63"}
Sep 06 01:15:47.477377 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:47.477266    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h" podStartSLOduration=1.477249072 podStartE2EDuration="1.477249072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:15:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:15:47.475681003 +0000 UTC m=+1505.511823952" watchObservedRunningTime="2026-09-06 01:15:47.477249072 +0000 UTC m=+1505.513392057"
Sep 06 01:15:47.606994 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:47.606965    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"
Sep 06 01:15:47.612502 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:47.612479    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"
Sep 06 01:15:47.625951 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:47.625920    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1f7961-gm6xk"
Sep 06 01:15:47.773248 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:47.773165    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d123193f-0cb6-44e6-b898-5e6fa91e875b-maas-api-service-ca\") pod \"d123193f-0cb6-44e6-b898-5e6fa91e875b\" (UID: \"d123193f-0cb6-44e6-b898-5e6fa91e875b\") "
Sep 06 01:15:47.773575 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:47.773552    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d123193f-0cb6-44e6-b898-5e6fa91e875b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d123193f-0cb6-44e6-b898-5e6fa91e875b" (UID: "d123193f-0cb6-44e6-b898-5e6fa91e875b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:15:47.874496 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:47.874460    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d123193f-0cb6-44e6-b898-5e6fa91e875b-maas-api-service-ca\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:15:48.416194 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:48.416155    2577 patch_prober.go:28] interesting pod/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 06 01:15:48.416390 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:48.416220    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj" podUID="fa99e966-b218-499d-8aa5-75da31cdc5f8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 06 01:15:48.464503 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:48.464468    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1f7961-gm6xk"
Sep 06 01:15:48.464936 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:48.464506    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1f7961-gm6xk" event={"ID":"d123193f-0cb6-44e6-b898-5e6fa91e875b","Type":"ContainerDied","Data":"3d1ec3fc4c2c74feddd004353adef60ec49d19b4fb4959b8f8d3c4ddb1dca7ca"}
Sep 06 01:15:48.464936 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:48.464560    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3d1ec3fc4c2c74feddd004353adef60ec49d19b4fb4959b8f8d3c4ddb1dca7ca"
Sep 06 01:15:48.465061 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:48.464936    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"
Sep 06 01:15:48.465964 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:48.465942    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"
Sep 06 01:15:49.476019 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:49.475905    2577 generic.go:356] "Generic (PLEG): container finished" podID="fa99e966-b218-499d-8aa5-75da31cdc5f8" containerID="787633149f0dbf948925a32329060ad6c7690978234a9a9391fb78353a415ed7" exitCode=0
Sep 06 01:15:49.477022 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:49.476258    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj" event={"ID":"fa99e966-b218-499d-8aa5-75da31cdc5f8","Type":"ContainerDied","Data":"787633149f0dbf948925a32329060ad6c7690978234a9a9391fb78353a415ed7"}
Sep 06 01:15:49.477022 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:49.476360    2577 scope.go:117] "RemoveContainer" containerID="6615852da2c991bfd967971b8484e0488b6b94ccbbf34f78f1ef504213d8ef08"
Sep 06 01:15:49.560218 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:49.560196    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"
Sep 06 01:15:49.692481 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:49.692450    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa99e966-b218-499d-8aa5-75da31cdc5f8-workload-certs\") pod \"fa99e966-b218-499d-8aa5-75da31cdc5f8\" (UID: \"fa99e966-b218-499d-8aa5-75da31cdc5f8\") "
Sep 06 01:15:49.692656 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:49.692508    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44kgk\" (UniqueName: \"kubernetes.io/projected/fa99e966-b218-499d-8aa5-75da31cdc5f8-kube-api-access-44kgk\") pod \"fa99e966-b218-499d-8aa5-75da31cdc5f8\" (UID: \"fa99e966-b218-499d-8aa5-75da31cdc5f8\") "
Sep 06 01:15:49.692656 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:49.692528    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa99e966-b218-499d-8aa5-75da31cdc5f8-istio-token\") pod \"fa99e966-b218-499d-8aa5-75da31cdc5f8\" (UID: \"fa99e966-b218-499d-8aa5-75da31cdc5f8\") "
Sep 06 01:15:49.692656 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:49.692551    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa99e966-b218-499d-8aa5-75da31cdc5f8-istio-envoy\") pod \"fa99e966-b218-499d-8aa5-75da31cdc5f8\" (UID: \"fa99e966-b218-499d-8aa5-75da31cdc5f8\") "
Sep 06 01:15:49.692656 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:49.692574    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa99e966-b218-499d-8aa5-75da31cdc5f8-credential-socket\") pod \"fa99e966-b218-499d-8aa5-75da31cdc5f8\" (UID: \"fa99e966-b218-499d-8aa5-75da31cdc5f8\") "
Sep 06 01:15:49.692656 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:49.692600    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa99e966-b218-499d-8aa5-75da31cdc5f8-istio-data\") pod \"fa99e966-b218-499d-8aa5-75da31cdc5f8\" (UID: \"fa99e966-b218-499d-8aa5-75da31cdc5f8\") "
Sep 06 01:15:49.692656 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:49.692639    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa99e966-b218-499d-8aa5-75da31cdc5f8-istiod-ca-cert\") pod \"fa99e966-b218-499d-8aa5-75da31cdc5f8\" (UID: \"fa99e966-b218-499d-8aa5-75da31cdc5f8\") "
Sep 06 01:15:49.692979 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:49.692702    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa99e966-b218-499d-8aa5-75da31cdc5f8-istio-podinfo\") pod \"fa99e966-b218-499d-8aa5-75da31cdc5f8\" (UID: \"fa99e966-b218-499d-8aa5-75da31cdc5f8\") "
Sep 06 01:15:49.692979 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:49.692729    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa99e966-b218-499d-8aa5-75da31cdc5f8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fa99e966-b218-499d-8aa5-75da31cdc5f8" (UID: "fa99e966-b218-499d-8aa5-75da31cdc5f8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:15:49.692979 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:49.692752    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa99e966-b218-499d-8aa5-75da31cdc5f8-workload-socket\") pod \"fa99e966-b218-499d-8aa5-75da31cdc5f8\" (UID: \"fa99e966-b218-499d-8aa5-75da31cdc5f8\") "
Sep 06 01:15:49.692979 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:49.692907    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa99e966-b218-499d-8aa5-75da31cdc5f8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fa99e966-b218-499d-8aa5-75da31cdc5f8" (UID: "fa99e966-b218-499d-8aa5-75da31cdc5f8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:15:49.692979 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:49.692923    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa99e966-b218-499d-8aa5-75da31cdc5f8-istio-data" (OuterVolumeSpecName: "istio-data") pod "fa99e966-b218-499d-8aa5-75da31cdc5f8" (UID: "fa99e966-b218-499d-8aa5-75da31cdc5f8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:15:49.693234 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:49.693062    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa99e966-b218-499d-8aa5-75da31cdc5f8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fa99e966-b218-499d-8aa5-75da31cdc5f8" (UID: "fa99e966-b218-499d-8aa5-75da31cdc5f8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:15:49.693234 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:49.693109    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa99e966-b218-499d-8aa5-75da31cdc5f8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fa99e966-b218-499d-8aa5-75da31cdc5f8" (UID: "fa99e966-b218-499d-8aa5-75da31cdc5f8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:15:49.693234 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:49.693219    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa99e966-b218-499d-8aa5-75da31cdc5f8-workload-socket\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:15:49.693439 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:49.693238    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa99e966-b218-499d-8aa5-75da31cdc5f8-workload-certs\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:15:49.693439 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:49.693251    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa99e966-b218-499d-8aa5-75da31cdc5f8-credential-socket\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:15:49.693439 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:49.693266    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa99e966-b218-499d-8aa5-75da31cdc5f8-istio-data\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:15:49.693439 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:49.693278    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa99e966-b218-499d-8aa5-75da31cdc5f8-istiod-ca-cert\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:15:49.694859 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:49.694830    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa99e966-b218-499d-8aa5-75da31cdc5f8-kube-api-access-44kgk" (OuterVolumeSpecName: "kube-api-access-44kgk") pod "fa99e966-b218-499d-8aa5-75da31cdc5f8" (UID: "fa99e966-b218-499d-8aa5-75da31cdc5f8"). InnerVolumeSpecName "kube-api-access-44kgk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:15:49.694955 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:49.694866    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fa99e966-b218-499d-8aa5-75da31cdc5f8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fa99e966-b218-499d-8aa5-75da31cdc5f8" (UID: "fa99e966-b218-499d-8aa5-75da31cdc5f8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 01:15:49.695283 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:49.695269    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa99e966-b218-499d-8aa5-75da31cdc5f8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fa99e966-b218-499d-8aa5-75da31cdc5f8" (UID: "fa99e966-b218-499d-8aa5-75da31cdc5f8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:15:49.695466 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:49.695441    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa99e966-b218-499d-8aa5-75da31cdc5f8-istio-token" (OuterVolumeSpecName: "istio-token") pod "fa99e966-b218-499d-8aa5-75da31cdc5f8" (UID: "fa99e966-b218-499d-8aa5-75da31cdc5f8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:15:49.794097 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:49.794057    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44kgk\" (UniqueName: \"kubernetes.io/projected/fa99e966-b218-499d-8aa5-75da31cdc5f8-kube-api-access-44kgk\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:15:49.794097 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:49.794094    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa99e966-b218-499d-8aa5-75da31cdc5f8-istio-token\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:15:49.794097 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:49.794104    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa99e966-b218-499d-8aa5-75da31cdc5f8-istio-envoy\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:15:49.794288 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:49.794112    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa99e966-b218-499d-8aa5-75da31cdc5f8-istio-podinfo\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:15:50.483188 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:50.483158    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"
Sep 06 01:15:50.483188 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:50.483176    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj" event={"ID":"fa99e966-b218-499d-8aa5-75da31cdc5f8","Type":"ContainerDied","Data":"6b0fe56b8d3e64d174ee13b90e3b63e8e87091c0abedeede4a3e6bc4b02ff7a0"}
Sep 06 01:15:50.483735 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:50.483233    2577 scope.go:117] "RemoveContainer" containerID="787633149f0dbf948925a32329060ad6c7690978234a9a9391fb78353a415ed7"
Sep 06 01:15:50.502731 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:50.502704    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"]
Sep 06 01:15:50.507245 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:50.507219    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-2d5f29-openshift-default-5fc5b58c9b-bpvwj"]
Sep 06 01:15:51.179999 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:51.179969    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:15:51.621918 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:51.621825    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b2e4f6-54fb4fcbd6-dk652"]
Sep 06 01:15:51.622594 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:51.622575    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d123193f-0cb6-44e6-b898-5e6fa91e875b" containerName="revoke-keys"
Sep 06 01:15:51.622651 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:51.622598    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d123193f-0cb6-44e6-b898-5e6fa91e875b" containerName="revoke-keys"
Sep 06 01:15:51.622651 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:51.622623    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa99e966-b218-499d-8aa5-75da31cdc5f8" containerName="istio-proxy"
Sep 06 01:15:51.622651 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:51.622632    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa99e966-b218-499d-8aa5-75da31cdc5f8" containerName="istio-proxy"
Sep 06 01:15:51.622764 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:51.622652    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa99e966-b218-499d-8aa5-75da31cdc5f8" containerName="istio-proxy"
Sep 06 01:15:51.622764 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:51.622661    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa99e966-b218-499d-8aa5-75da31cdc5f8" containerName="istio-proxy"
Sep 06 01:15:51.622764 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:51.622762    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa99e966-b218-499d-8aa5-75da31cdc5f8" containerName="istio-proxy"
Sep 06 01:15:51.622879 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:51.622775    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d123193f-0cb6-44e6-b898-5e6fa91e875b" containerName="revoke-keys"
Sep 06 01:15:51.626184 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:51.626168    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b2e4f6-54fb4fcbd6-dk652"
Sep 06 01:15:51.628961 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:51.628937    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-b2e4f6-dockercfg-rsqxk\""
Sep 06 01:15:51.629100 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:51.628976    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-b2e4f6\""
Sep 06 01:15:51.635349 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:51.634947    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b2e4f6-54fb4fcbd6-dk652"]
Sep 06 01:15:51.714386 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:51.714341    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2feb306e-a0c3-45bb-aad2-d67e232316d3-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-b2e4f6-54fb4fcbd6-dk652\" (UID: \"2feb306e-a0c3-45bb-aad2-d67e232316d3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b2e4f6-54fb4fcbd6-dk652"
Sep 06 01:15:51.714566 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:51.714468    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vvc7\" (UniqueName: \"kubernetes.io/projected/2feb306e-a0c3-45bb-aad2-d67e232316d3-kube-api-access-2vvc7\") pod \"payload-pre-processing-e2e-ipp-a-b2e4f6-54fb4fcbd6-dk652\" (UID: \"2feb306e-a0c3-45bb-aad2-d67e232316d3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b2e4f6-54fb4fcbd6-dk652"
Sep 06 01:15:51.815817 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:51.815788    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2feb306e-a0c3-45bb-aad2-d67e232316d3-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-b2e4f6-54fb4fcbd6-dk652\" (UID: \"2feb306e-a0c3-45bb-aad2-d67e232316d3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b2e4f6-54fb4fcbd6-dk652"
Sep 06 01:15:51.816005 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:51.815856    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vvc7\" (UniqueName: \"kubernetes.io/projected/2feb306e-a0c3-45bb-aad2-d67e232316d3-kube-api-access-2vvc7\") pod \"payload-pre-processing-e2e-ipp-a-b2e4f6-54fb4fcbd6-dk652\" (UID: \"2feb306e-a0c3-45bb-aad2-d67e232316d3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b2e4f6-54fb4fcbd6-dk652"
Sep 06 01:15:51.816577 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:51.816549    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2feb306e-a0c3-45bb-aad2-d67e232316d3-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-b2e4f6-54fb4fcbd6-dk652\" (UID: \"2feb306e-a0c3-45bb-aad2-d67e232316d3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b2e4f6-54fb4fcbd6-dk652"
Sep 06 01:15:51.826387 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:51.826361    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vvc7\" (UniqueName: \"kubernetes.io/projected/2feb306e-a0c3-45bb-aad2-d67e232316d3-kube-api-access-2vvc7\") pod \"payload-pre-processing-e2e-ipp-a-b2e4f6-54fb4fcbd6-dk652\" (UID: \"2feb306e-a0c3-45bb-aad2-d67e232316d3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b2e4f6-54fb4fcbd6-dk652"
Sep 06 01:15:51.939966 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:51.939936    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b2e4f6-54fb4fcbd6-dk652"
Sep 06 01:15:52.213040 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:52.213009    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b2e4f6-54fb4fcbd6-dk652"]
Sep 06 01:15:52.214097 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:15:52.214066    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2feb306e_a0c3_45bb_aad2_d67e232316d3.slice/crio-19f96f5b0a5d853e7e9a1c0b2ec5cb7724b7a3d2e862ff25ef518dd6e103ae41 WatchSource:0}: Error finding container 19f96f5b0a5d853e7e9a1c0b2ec5cb7724b7a3d2e862ff25ef518dd6e103ae41: Status 404 returned error can't find the container with id 19f96f5b0a5d853e7e9a1c0b2ec5cb7724b7a3d2e862ff25ef518dd6e103ae41
Sep 06 01:15:52.413303 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:52.413269    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa99e966-b218-499d-8aa5-75da31cdc5f8" path="/var/lib/kubelet/pods/fa99e966-b218-499d-8aa5-75da31cdc5f8/volumes"
Sep 06 01:15:52.498237 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:52.498150    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b2e4f6-54fb4fcbd6-dk652" event={"ID":"2feb306e-a0c3-45bb-aad2-d67e232316d3","Type":"ContainerStarted","Data":"92122a4e4a60c44009096952e736690ce931540772f888961b029a08aa2bdf16"}
Sep 06 01:15:52.498237 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:52.498202    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b2e4f6-54fb4fcbd6-dk652" event={"ID":"2feb306e-a0c3-45bb-aad2-d67e232316d3","Type":"ContainerStarted","Data":"19f96f5b0a5d853e7e9a1c0b2ec5cb7724b7a3d2e862ff25ef518dd6e103ae41"}
Sep 06 01:15:52.498237 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:52.498224    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b2e4f6-54fb4fcbd6-dk652"
Sep 06 01:15:52.515958 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:15:52.515910    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b2e4f6-54fb4fcbd6-dk652" podStartSLOduration=1.515893058 podStartE2EDuration="1.515893058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:15:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:15:52.513755521 +0000 UTC m=+1510.549898479" watchObservedRunningTime="2026-09-06 01:15:52.515893058 +0000 UTC m=+1510.552036014"
Sep 06 01:16:00.477042 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:00.476972    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-470346/rate-test-model-470346-kserve-84bdc58475-lp4mg" podUID="49641640-12bd-4360-b539-5f15d3574d40" containerName="main" containerID="cri-o://f6064e491ad1e78b8921281ea0f6fe68fee3890024531bbf13246f8109bea9ca" gracePeriod=45
Sep 06 01:16:00.630925 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:00.630868    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-1f7961-29810955-k2lhm"]
Sep 06 01:16:00.633519 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:00.633492    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-1f7961-29810955-k2lhm"]
Sep 06 01:16:00.834752 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:00.834688    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1f7961-gm6xk"]
Sep 06 01:16:00.836534 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:00.836502    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1f7961-gm6xk"]
Sep 06 01:16:00.841089 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:00.841066    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-470346/rate-test-model-470346-kserve-84bdc58475-lp4mg"
Sep 06 01:16:01.024342 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:01.018652    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvr9w\" (UniqueName: \"kubernetes.io/projected/49641640-12bd-4360-b539-5f15d3574d40-kube-api-access-zvr9w\") pod \"49641640-12bd-4360-b539-5f15d3574d40\" (UID: \"49641640-12bd-4360-b539-5f15d3574d40\") "
Sep 06 01:16:01.024342 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:01.018763    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49641640-12bd-4360-b539-5f15d3574d40-tmp-dir\") pod \"49641640-12bd-4360-b539-5f15d3574d40\" (UID: \"49641640-12bd-4360-b539-5f15d3574d40\") "
Sep 06 01:16:01.024342 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:01.018796    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49641640-12bd-4360-b539-5f15d3574d40-tls-certs\") pod \"49641640-12bd-4360-b539-5f15d3574d40\" (UID: \"49641640-12bd-4360-b539-5f15d3574d40\") "
Sep 06 01:16:01.024342 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:01.018844    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49641640-12bd-4360-b539-5f15d3574d40-dshm\") pod \"49641640-12bd-4360-b539-5f15d3574d40\" (UID: \"49641640-12bd-4360-b539-5f15d3574d40\") "
Sep 06 01:16:01.024342 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:01.018904    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49641640-12bd-4360-b539-5f15d3574d40-home\") pod \"49641640-12bd-4360-b539-5f15d3574d40\" (UID: \"49641640-12bd-4360-b539-5f15d3574d40\") "
Sep 06 01:16:01.024342 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:01.018989    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49641640-12bd-4360-b539-5f15d3574d40-model-cache\") pod \"49641640-12bd-4360-b539-5f15d3574d40\" (UID: \"49641640-12bd-4360-b539-5f15d3574d40\") "
Sep 06 01:16:01.024342 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:01.019577    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49641640-12bd-4360-b539-5f15d3574d40-model-cache" (OuterVolumeSpecName: "model-cache") pod "49641640-12bd-4360-b539-5f15d3574d40" (UID: "49641640-12bd-4360-b539-5f15d3574d40"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:16:01.024342 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:01.021996    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49641640-12bd-4360-b539-5f15d3574d40-home" (OuterVolumeSpecName: "home") pod "49641640-12bd-4360-b539-5f15d3574d40" (UID: "49641640-12bd-4360-b539-5f15d3574d40"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:16:01.024342 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:01.022159    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49641640-12bd-4360-b539-5f15d3574d40-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "49641640-12bd-4360-b539-5f15d3574d40" (UID: "49641640-12bd-4360-b539-5f15d3574d40"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:16:01.036346 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:01.026740    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49641640-12bd-4360-b539-5f15d3574d40-kube-api-access-zvr9w" (OuterVolumeSpecName: "kube-api-access-zvr9w") pod "49641640-12bd-4360-b539-5f15d3574d40" (UID: "49641640-12bd-4360-b539-5f15d3574d40"). InnerVolumeSpecName "kube-api-access-zvr9w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:16:01.036346 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:01.035770    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49641640-12bd-4360-b539-5f15d3574d40-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "49641640-12bd-4360-b539-5f15d3574d40" (UID: "49641640-12bd-4360-b539-5f15d3574d40"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:16:01.036680 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:01.036459    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49641640-12bd-4360-b539-5f15d3574d40-dshm" (OuterVolumeSpecName: "dshm") pod "49641640-12bd-4360-b539-5f15d3574d40" (UID: "49641640-12bd-4360-b539-5f15d3574d40"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:16:01.120394 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:01.120354    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49641640-12bd-4360-b539-5f15d3574d40-home\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:16:01.120394 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:01.120394    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49641640-12bd-4360-b539-5f15d3574d40-model-cache\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:16:01.120650 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:01.120410    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvr9w\" (UniqueName: \"kubernetes.io/projected/49641640-12bd-4360-b539-5f15d3574d40-kube-api-access-zvr9w\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:16:01.120650 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:01.120423    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49641640-12bd-4360-b539-5f15d3574d40-tmp-dir\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:16:01.120650 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:01.120437    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49641640-12bd-4360-b539-5f15d3574d40-tls-certs\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:16:01.120650 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:01.120450    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49641640-12bd-4360-b539-5f15d3574d40-dshm\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:16:01.554126 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:01.554091    2577 generic.go:356] "Generic (PLEG): container finished" podID="49641640-12bd-4360-b539-5f15d3574d40" containerID="f6064e491ad1e78b8921281ea0f6fe68fee3890024531bbf13246f8109bea9ca" exitCode=0
Sep 06 01:16:01.554581 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:01.554139    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-470346/rate-test-model-470346-kserve-84bdc58475-lp4mg"
Sep 06 01:16:01.554581 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:01.554173    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-470346/rate-test-model-470346-kserve-84bdc58475-lp4mg" event={"ID":"49641640-12bd-4360-b539-5f15d3574d40","Type":"ContainerDied","Data":"f6064e491ad1e78b8921281ea0f6fe68fee3890024531bbf13246f8109bea9ca"}
Sep 06 01:16:01.554581 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:01.554219    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-470346/rate-test-model-470346-kserve-84bdc58475-lp4mg" event={"ID":"49641640-12bd-4360-b539-5f15d3574d40","Type":"ContainerDied","Data":"a5d74de6b45f80a99ca42e8c706320e788adc1b7ff149cb13599951512337360"}
Sep 06 01:16:01.554581 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:01.554240    2577 scope.go:117] "RemoveContainer" containerID="f6064e491ad1e78b8921281ea0f6fe68fee3890024531bbf13246f8109bea9ca"
Sep 06 01:16:01.563822 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:01.563805    2577 scope.go:117] "RemoveContainer" containerID="f6064e491ad1e78b8921281ea0f6fe68fee3890024531bbf13246f8109bea9ca"
Sep 06 01:16:01.564086 ip-10-0-140-57 kubenswrapper[2577]: E0906 01:16:01.564068    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6064e491ad1e78b8921281ea0f6fe68fee3890024531bbf13246f8109bea9ca\": container with ID starting with f6064e491ad1e78b8921281ea0f6fe68fee3890024531bbf13246f8109bea9ca not found: ID does not exist" containerID="f6064e491ad1e78b8921281ea0f6fe68fee3890024531bbf13246f8109bea9ca"
Sep 06 01:16:01.564142 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:01.564095    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6064e491ad1e78b8921281ea0f6fe68fee3890024531bbf13246f8109bea9ca"} err="failed to get container status \"f6064e491ad1e78b8921281ea0f6fe68fee3890024531bbf13246f8109bea9ca\": rpc error: code = NotFound desc = could not find container \"f6064e491ad1e78b8921281ea0f6fe68fee3890024531bbf13246f8109bea9ca\": container with ID starting with f6064e491ad1e78b8921281ea0f6fe68fee3890024531bbf13246f8109bea9ca not found: ID does not exist"
Sep 06 01:16:01.575484 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:01.575461    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-470346/rate-test-model-470346-kserve-84bdc58475-lp4mg"]
Sep 06 01:16:01.582046 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:01.582024    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-470346/rate-test-model-470346-kserve-84bdc58475-lp4mg"]
Sep 06 01:16:02.416876 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:02.416832    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49641640-12bd-4360-b539-5f15d3574d40" path="/var/lib/kubelet/pods/49641640-12bd-4360-b539-5f15d3574d40/volumes"
Sep 06 01:16:02.417332 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:02.417288    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8d86cad-35d6-45fa-8a2b-e660f2f26112" path="/var/lib/kubelet/pods/c8d86cad-35d6-45fa-8a2b-e660f2f26112/volumes"
Sep 06 01:16:02.421342 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:02.417728    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d123193f-0cb6-44e6-b898-5e6fa91e875b" path="/var/lib/kubelet/pods/d123193f-0cb6-44e6-b898-5e6fa91e875b/volumes"
Sep 06 01:16:03.506210 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:03.506172    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b2e4f6-54fb4fcbd6-dk652"
Sep 06 01:16:07.162467 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:07.162423    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:16:09.605090 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:09.604997    2577 generic.go:356] "Generic (PLEG): container finished" podID="ed7b10fd-46c2-4be0-91db-6e756dc33c9d" containerID="d0158d8551db05d67d2041b05a5bc9f0ad116f1d4ff73314bd7b0af94a7a4cd2" exitCode=0
Sep 06 01:16:09.605090 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:09.605075    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h" event={"ID":"ed7b10fd-46c2-4be0-91db-6e756dc33c9d","Type":"ContainerDied","Data":"d0158d8551db05d67d2041b05a5bc9f0ad116f1d4ff73314bd7b0af94a7a4cd2"}
Sep 06 01:16:09.605539 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:09.605528    2577 scope.go:117] "RemoveContainer" containerID="d0158d8551db05d67d2041b05a5bc9f0ad116f1d4ff73314bd7b0af94a7a4cd2"
Sep 06 01:16:09.606691 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:09.606665    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:16:09.606762 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:09.606730    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:16:09.606798 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:09.606764    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:16:10.615375 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:10.615343    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h" event={"ID":"ed7b10fd-46c2-4be0-91db-6e756dc33c9d","Type":"ContainerStarted","Data":"43121bb676c0f79e6202e8cc28603446b9f2721761a8b5366a43e91dfed5a157"}
Sep 06 01:16:11.607008 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:11.606919    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"
Sep 06 01:16:11.607214 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:11.607159    2577 patch_prober.go:28] interesting pod/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Sep 06 01:16:11.607285 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:11.607214    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h" podUID="ed7b10fd-46c2-4be0-91db-6e756dc33c9d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Sep 06 01:16:12.608801 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:12.608761    2577 patch_prober.go:28] interesting pod/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Sep 06 01:16:12.609365 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:12.609311    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h" podUID="ed7b10fd-46c2-4be0-91db-6e756dc33c9d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Sep 06 01:16:13.607418 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:13.607380    2577 patch_prober.go:28] interesting pod/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Sep 06 01:16:13.607641 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:13.607449    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h" podUID="ed7b10fd-46c2-4be0-91db-6e756dc33c9d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Sep 06 01:16:14.607571 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:14.607530    2577 patch_prober.go:28] interesting pod/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Sep 06 01:16:14.608071 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:14.607605    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h" podUID="ed7b10fd-46c2-4be0-91db-6e756dc33c9d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Sep 06 01:16:15.607782 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:15.607743    2577 patch_prober.go:28] interesting pod/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Sep 06 01:16:15.608438 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:15.608401    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h" podUID="ed7b10fd-46c2-4be0-91db-6e756dc33c9d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Sep 06 01:16:16.614496 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:16.614462    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"
Sep 06 01:16:16.614932 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:16.614851    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"
Sep 06 01:16:16.615849 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:16.615826    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"
Sep 06 01:16:18.322289 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:18.322243    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-e6b4e2-29810955-p75qv"]
Sep 06 01:16:18.324868 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:18.324843    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-e6b4e2-29810955-p75qv"]
Sep 06 01:16:18.410855 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:18.410822    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80c8ceb4-75b4-4bc9-b5e5-4accbec4ae8f" path="/var/lib/kubelet/pods/80c8ceb4-75b4-4bc9-b5e5-4accbec4ae8f/volumes"
Sep 06 01:16:21.564100 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:21.564070    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:16:33.868817 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:33.868782    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:16:36.243982 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:36.243944    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-812148-29810955-fgq87"]
Sep 06 01:16:36.247158 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:36.247122    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-812148-29810955-fgq87"]
Sep 06 01:16:36.267661 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:36.267633    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-812148-c8878cb7-v5snr"]
Sep 06 01:16:36.267958 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:36.267903    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-812148-c8878cb7-v5snr" podUID="a6312025-b220-4433-9469-a98b45c070ad" containerName="payload-processing" containerID="cri-o://09f001f5c09a2cdd7e944b246a33b1b09a76d3b6b449d7823e41828cd37f27a8" gracePeriod=30
Sep 06 01:16:36.412817 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:36.412782    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="785e1add-4b51-4a73-a07f-8550720e1f69" path="/var/lib/kubelet/pods/785e1add-4b51-4a73-a07f-8550720e1f69/volumes"
Sep 06 01:16:36.550365 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:36.550302    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-812148-c8878cb7-v5snr"
Sep 06 01:16:36.693456 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:36.693421    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jsd4q\" (UniqueName: \"kubernetes.io/projected/a6312025-b220-4433-9469-a98b45c070ad-kube-api-access-jsd4q\") pod \"a6312025-b220-4433-9469-a98b45c070ad\" (UID: \"a6312025-b220-4433-9469-a98b45c070ad\") "
Sep 06 01:16:36.693641 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:36.693533    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6312025-b220-4433-9469-a98b45c070ad-plugins-config-volume\") pod \"a6312025-b220-4433-9469-a98b45c070ad\" (UID: \"a6312025-b220-4433-9469-a98b45c070ad\") "
Sep 06 01:16:36.693858 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:36.693834    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6312025-b220-4433-9469-a98b45c070ad-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a6312025-b220-4433-9469-a98b45c070ad" (UID: "a6312025-b220-4433-9469-a98b45c070ad"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:16:36.695689 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:36.695661    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6312025-b220-4433-9469-a98b45c070ad-kube-api-access-jsd4q" (OuterVolumeSpecName: "kube-api-access-jsd4q") pod "a6312025-b220-4433-9469-a98b45c070ad" (UID: "a6312025-b220-4433-9469-a98b45c070ad"). InnerVolumeSpecName "kube-api-access-jsd4q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:16:36.794386 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:36.794282    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6312025-b220-4433-9469-a98b45c070ad-plugins-config-volume\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:16:36.794386 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:36.794310    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jsd4q\" (UniqueName: \"kubernetes.io/projected/a6312025-b220-4433-9469-a98b45c070ad-kube-api-access-jsd4q\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:16:36.796673 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:36.796647    2577 generic.go:356] "Generic (PLEG): container finished" podID="a6312025-b220-4433-9469-a98b45c070ad" containerID="09f001f5c09a2cdd7e944b246a33b1b09a76d3b6b449d7823e41828cd37f27a8" exitCode=0
Sep 06 01:16:36.796794 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:36.796693    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-812148-c8878cb7-v5snr"
Sep 06 01:16:36.796794 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:36.796694    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-812148-c8878cb7-v5snr" event={"ID":"a6312025-b220-4433-9469-a98b45c070ad","Type":"ContainerDied","Data":"09f001f5c09a2cdd7e944b246a33b1b09a76d3b6b449d7823e41828cd37f27a8"}
Sep 06 01:16:36.796864 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:36.796817    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-812148-c8878cb7-v5snr" event={"ID":"a6312025-b220-4433-9469-a98b45c070ad","Type":"ContainerDied","Data":"682b90cb17673223bd5e97a14b5399c6196658ffd1bfceb658db81baa7473591"}
Sep 06 01:16:36.796864 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:36.796846    2577 scope.go:117] "RemoveContainer" containerID="09f001f5c09a2cdd7e944b246a33b1b09a76d3b6b449d7823e41828cd37f27a8"
Sep 06 01:16:36.807430 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:36.807407    2577 scope.go:117] "RemoveContainer" containerID="09f001f5c09a2cdd7e944b246a33b1b09a76d3b6b449d7823e41828cd37f27a8"
Sep 06 01:16:36.807775 ip-10-0-140-57 kubenswrapper[2577]: E0906 01:16:36.807756    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09f001f5c09a2cdd7e944b246a33b1b09a76d3b6b449d7823e41828cd37f27a8\": container with ID starting with 09f001f5c09a2cdd7e944b246a33b1b09a76d3b6b449d7823e41828cd37f27a8 not found: ID does not exist" containerID="09f001f5c09a2cdd7e944b246a33b1b09a76d3b6b449d7823e41828cd37f27a8"
Sep 06 01:16:36.807845 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:36.807787    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09f001f5c09a2cdd7e944b246a33b1b09a76d3b6b449d7823e41828cd37f27a8"} err="failed to get container status \"09f001f5c09a2cdd7e944b246a33b1b09a76d3b6b449d7823e41828cd37f27a8\": rpc error: code = NotFound desc = could not find container \"09f001f5c09a2cdd7e944b246a33b1b09a76d3b6b449d7823e41828cd37f27a8\": container with ID starting with 09f001f5c09a2cdd7e944b246a33b1b09a76d3b6b449d7823e41828cd37f27a8 not found: ID does not exist"
Sep 06 01:16:36.832948 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:36.832917    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-812148-c8878cb7-v5snr"]
Sep 06 01:16:36.835357 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:36.835333    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-812148-c8878cb7-v5snr"]
Sep 06 01:16:38.411181 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:38.411142    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6312025-b220-4433-9469-a98b45c070ad" path="/var/lib/kubelet/pods/a6312025-b220-4433-9469-a98b45c070ad/volumes"
Sep 06 01:16:42.962966 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:42.962876    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:16:43.637956 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:43.637925    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"]
Sep 06 01:16:43.638192 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:43.638169    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz" podUID="2ef62bfa-0af8-47de-8fb2-62c7c41cccf0" containerName="istio-proxy" containerID="cri-o://57c70eb5176f865905aca3fbceb389848103f2d947069d0a2b281d4b5a8eb5ca" gracePeriod=30
Sep 06 01:16:48.870646 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:48.870611    2577 generic.go:356] "Generic (PLEG): container finished" podID="2ef62bfa-0af8-47de-8fb2-62c7c41cccf0" containerID="57c70eb5176f865905aca3fbceb389848103f2d947069d0a2b281d4b5a8eb5ca" exitCode=0
Sep 06 01:16:48.871028 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:48.870685    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz" event={"ID":"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0","Type":"ContainerDied","Data":"57c70eb5176f865905aca3fbceb389848103f2d947069d0a2b281d4b5a8eb5ca"}
Sep 06 01:16:48.871028 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:48.870755    2577 scope.go:117] "RemoveContainer" containerID="595dc28bb28f1899cfd70418b0053b727d8945c8afb593823d46eea3014683e0"
Sep 06 01:16:48.906372 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:48.906347    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"
Sep 06 01:16:49.010388 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:49.010350    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-workload-certs\") pod \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\" (UID: \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\") "
Sep 06 01:16:49.010577 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:49.010404    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-istio-envoy\") pod \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\" (UID: \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\") "
Sep 06 01:16:49.010577 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:49.010441    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-workload-socket\") pod \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\" (UID: \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\") "
Sep 06 01:16:49.010577 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:49.010458    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-istiod-ca-cert\") pod \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\" (UID: \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\") "
Sep 06 01:16:49.010577 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:49.010492    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-istio-podinfo\") pod \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\" (UID: \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\") "
Sep 06 01:16:49.010577 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:49.010534    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-istio-data\") pod \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\" (UID: \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\") "
Sep 06 01:16:49.010577 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:49.010579    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4v5xm\" (UniqueName: \"kubernetes.io/projected/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-kube-api-access-4v5xm\") pod \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\" (UID: \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\") "
Sep 06 01:16:49.010905 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:49.010650    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2ef62bfa-0af8-47de-8fb2-62c7c41cccf0" (UID: "2ef62bfa-0af8-47de-8fb2-62c7c41cccf0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:16:49.010905 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:49.010664    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-istio-token\") pod \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\" (UID: \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\") "
Sep 06 01:16:49.010905 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:49.010762    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-credential-socket\") pod \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\" (UID: \"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0\") "
Sep 06 01:16:49.010905 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:49.010783    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2ef62bfa-0af8-47de-8fb2-62c7c41cccf0" (UID: "2ef62bfa-0af8-47de-8fb2-62c7c41cccf0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:16:49.010905 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:49.010870    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-istio-data" (OuterVolumeSpecName: "istio-data") pod "2ef62bfa-0af8-47de-8fb2-62c7c41cccf0" (UID: "2ef62bfa-0af8-47de-8fb2-62c7c41cccf0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:16:49.010905 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:49.010884    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2ef62bfa-0af8-47de-8fb2-62c7c41cccf0" (UID: "2ef62bfa-0af8-47de-8fb2-62c7c41cccf0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:16:49.011167 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:49.011063    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2ef62bfa-0af8-47de-8fb2-62c7c41cccf0" (UID: "2ef62bfa-0af8-47de-8fb2-62c7c41cccf0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:16:49.011228 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:49.011204    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-credential-socket\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:16:49.011276 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:49.011230    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-workload-certs\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:16:49.011338 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:49.011263    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-workload-socket\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:16:49.011427 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:49.011361    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-istiod-ca-cert\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:16:49.011476 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:49.011450    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-istio-data\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:16:49.012862 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:49.012836    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-kube-api-access-4v5xm" (OuterVolumeSpecName: "kube-api-access-4v5xm") pod "2ef62bfa-0af8-47de-8fb2-62c7c41cccf0" (UID: "2ef62bfa-0af8-47de-8fb2-62c7c41cccf0"). InnerVolumeSpecName "kube-api-access-4v5xm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:16:49.012956 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:49.012926    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-istio-token" (OuterVolumeSpecName: "istio-token") pod "2ef62bfa-0af8-47de-8fb2-62c7c41cccf0" (UID: "2ef62bfa-0af8-47de-8fb2-62c7c41cccf0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:16:49.013291 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:49.013259    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2ef62bfa-0af8-47de-8fb2-62c7c41cccf0" (UID: "2ef62bfa-0af8-47de-8fb2-62c7c41cccf0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:16:49.013428 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:49.013364    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2ef62bfa-0af8-47de-8fb2-62c7c41cccf0" (UID: "2ef62bfa-0af8-47de-8fb2-62c7c41cccf0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 01:16:49.112654 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:49.112621    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4v5xm\" (UniqueName: \"kubernetes.io/projected/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-kube-api-access-4v5xm\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:16:49.112654 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:49.112649    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-istio-token\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:16:49.112654 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:49.112658    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-istio-envoy\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:16:49.112654 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:49.112666    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0-istio-podinfo\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:16:49.878697 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:49.878669    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"
Sep 06 01:16:49.879101 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:49.878708    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz" event={"ID":"2ef62bfa-0af8-47de-8fb2-62c7c41cccf0","Type":"ContainerDied","Data":"9c4b115cb0503aa3424a8cb103fcaceef37f159cc4a8d19cf781472710372687"}
Sep 06 01:16:49.879101 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:49.878770    2577 scope.go:117] "RemoveContainer" containerID="57c70eb5176f865905aca3fbceb389848103f2d947069d0a2b281d4b5a8eb5ca"
Sep 06 01:16:49.902184 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:49.902159    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"]
Sep 06 01:16:49.906453 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:49.906429    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-812148-openshift-default-5f66786c96-298hz"]
Sep 06 01:16:50.410984 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:16:50.410952    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ef62bfa-0af8-47de-8fb2-62c7c41cccf0" path="/var/lib/kubelet/pods/2ef62bfa-0af8-47de-8fb2-62c7c41cccf0/volumes"
Sep 06 01:17:01.477441 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:01.477401    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:17:17.274932 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:17.274893    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:17:25.081650 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.081601    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"]
Sep 06 01:17:25.082308 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.082287    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ef62bfa-0af8-47de-8fb2-62c7c41cccf0" containerName="istio-proxy"
Sep 06 01:17:25.082389 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.082313    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ef62bfa-0af8-47de-8fb2-62c7c41cccf0" containerName="istio-proxy"
Sep 06 01:17:25.082389 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.082348    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6312025-b220-4433-9469-a98b45c070ad" containerName="payload-processing"
Sep 06 01:17:25.082389 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.082357    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6312025-b220-4433-9469-a98b45c070ad" containerName="payload-processing"
Sep 06 01:17:25.082389 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.082366    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49641640-12bd-4360-b539-5f15d3574d40" containerName="main"
Sep 06 01:17:25.082389 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.082375    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="49641640-12bd-4360-b539-5f15d3574d40" containerName="main"
Sep 06 01:17:25.082592 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.082532    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ef62bfa-0af8-47de-8fb2-62c7c41cccf0" containerName="istio-proxy"
Sep 06 01:17:25.082592 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.082594    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="49641640-12bd-4360-b539-5f15d3574d40" containerName="main"
Sep 06 01:17:25.082793 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.082626    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6312025-b220-4433-9469-a98b45c070ad" containerName="payload-processing"
Sep 06 01:17:25.082793 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.082635    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa99e966-b218-499d-8aa5-75da31cdc5f8" containerName="istio-proxy"
Sep 06 01:17:25.086564 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.086548    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"
Sep 06 01:17:25.089219 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.089197    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-3032be-openshift-default-dockercfg-dqfdj\""
Sep 06 01:17:25.097148 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.097127    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"]
Sep 06 01:17:25.171906 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.171865    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b18bbf01-5733-4a75-bd20-723aa696840f-istio-envoy\") pod \"e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw\" (UID: \"b18bbf01-5733-4a75-bd20-723aa696840f\") " pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"
Sep 06 01:17:25.172110 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.171973    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b18bbf01-5733-4a75-bd20-723aa696840f-credential-socket\") pod \"e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw\" (UID: \"b18bbf01-5733-4a75-bd20-723aa696840f\") " pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"
Sep 06 01:17:25.172110 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.172003    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b18bbf01-5733-4a75-bd20-723aa696840f-istio-podinfo\") pod \"e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw\" (UID: \"b18bbf01-5733-4a75-bd20-723aa696840f\") " pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"
Sep 06 01:17:25.172110 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.172041    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b18bbf01-5733-4a75-bd20-723aa696840f-workload-certs\") pod \"e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw\" (UID: \"b18bbf01-5733-4a75-bd20-723aa696840f\") " pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"
Sep 06 01:17:25.172110 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.172064    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b18bbf01-5733-4a75-bd20-723aa696840f-istio-data\") pod \"e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw\" (UID: \"b18bbf01-5733-4a75-bd20-723aa696840f\") " pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"
Sep 06 01:17:25.172278 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.172165    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b18bbf01-5733-4a75-bd20-723aa696840f-workload-socket\") pod \"e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw\" (UID: \"b18bbf01-5733-4a75-bd20-723aa696840f\") " pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"
Sep 06 01:17:25.172278 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.172222    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b18bbf01-5733-4a75-bd20-723aa696840f-istiod-ca-cert\") pod \"e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw\" (UID: \"b18bbf01-5733-4a75-bd20-723aa696840f\") " pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"
Sep 06 01:17:25.172382 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.172280    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b18bbf01-5733-4a75-bd20-723aa696840f-istio-token\") pod \"e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw\" (UID: \"b18bbf01-5733-4a75-bd20-723aa696840f\") " pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"
Sep 06 01:17:25.172382 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.172368    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbdmq\" (UniqueName: \"kubernetes.io/projected/b18bbf01-5733-4a75-bd20-723aa696840f-kube-api-access-bbdmq\") pod \"e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw\" (UID: \"b18bbf01-5733-4a75-bd20-723aa696840f\") " pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"
Sep 06 01:17:25.273618 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.273586    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b18bbf01-5733-4a75-bd20-723aa696840f-istio-envoy\") pod \"e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw\" (UID: \"b18bbf01-5733-4a75-bd20-723aa696840f\") " pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"
Sep 06 01:17:25.273794 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.273635    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b18bbf01-5733-4a75-bd20-723aa696840f-credential-socket\") pod \"e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw\" (UID: \"b18bbf01-5733-4a75-bd20-723aa696840f\") " pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"
Sep 06 01:17:25.273794 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.273652    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b18bbf01-5733-4a75-bd20-723aa696840f-istio-podinfo\") pod \"e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw\" (UID: \"b18bbf01-5733-4a75-bd20-723aa696840f\") " pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"
Sep 06 01:17:25.273794 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.273708    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b18bbf01-5733-4a75-bd20-723aa696840f-workload-certs\") pod \"e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw\" (UID: \"b18bbf01-5733-4a75-bd20-723aa696840f\") " pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"
Sep 06 01:17:25.273794 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.273726    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b18bbf01-5733-4a75-bd20-723aa696840f-istio-data\") pod \"e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw\" (UID: \"b18bbf01-5733-4a75-bd20-723aa696840f\") " pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"
Sep 06 01:17:25.273794 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.273774    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b18bbf01-5733-4a75-bd20-723aa696840f-workload-socket\") pod \"e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw\" (UID: \"b18bbf01-5733-4a75-bd20-723aa696840f\") " pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"
Sep 06 01:17:25.274043 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.273814    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b18bbf01-5733-4a75-bd20-723aa696840f-istiod-ca-cert\") pod \"e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw\" (UID: \"b18bbf01-5733-4a75-bd20-723aa696840f\") " pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"
Sep 06 01:17:25.274043 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.273862    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b18bbf01-5733-4a75-bd20-723aa696840f-istio-token\") pod \"e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw\" (UID: \"b18bbf01-5733-4a75-bd20-723aa696840f\") " pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"
Sep 06 01:17:25.274043 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.273901    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbdmq\" (UniqueName: \"kubernetes.io/projected/b18bbf01-5733-4a75-bd20-723aa696840f-kube-api-access-bbdmq\") pod \"e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw\" (UID: \"b18bbf01-5733-4a75-bd20-723aa696840f\") " pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"
Sep 06 01:17:25.274208 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.274082    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b18bbf01-5733-4a75-bd20-723aa696840f-credential-socket\") pod \"e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw\" (UID: \"b18bbf01-5733-4a75-bd20-723aa696840f\") " pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"
Sep 06 01:17:25.274271 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.274208    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b18bbf01-5733-4a75-bd20-723aa696840f-workload-certs\") pod \"e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw\" (UID: \"b18bbf01-5733-4a75-bd20-723aa696840f\") " pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"
Sep 06 01:17:25.274373 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.274262    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b18bbf01-5733-4a75-bd20-723aa696840f-istio-data\") pod \"e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw\" (UID: \"b18bbf01-5733-4a75-bd20-723aa696840f\") " pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"
Sep 06 01:17:25.274465 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.274446    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b18bbf01-5733-4a75-bd20-723aa696840f-workload-socket\") pod \"e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw\" (UID: \"b18bbf01-5733-4a75-bd20-723aa696840f\") " pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"
Sep 06 01:17:25.274648 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.274626    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b18bbf01-5733-4a75-bd20-723aa696840f-istiod-ca-cert\") pod \"e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw\" (UID: \"b18bbf01-5733-4a75-bd20-723aa696840f\") " pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"
Sep 06 01:17:25.276037 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.276022    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b18bbf01-5733-4a75-bd20-723aa696840f-istio-envoy\") pod \"e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw\" (UID: \"b18bbf01-5733-4a75-bd20-723aa696840f\") " pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"
Sep 06 01:17:25.276478 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.276461    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b18bbf01-5733-4a75-bd20-723aa696840f-istio-podinfo\") pod \"e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw\" (UID: \"b18bbf01-5733-4a75-bd20-723aa696840f\") " pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"
Sep 06 01:17:25.282836 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.282801    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbdmq\" (UniqueName: \"kubernetes.io/projected/b18bbf01-5733-4a75-bd20-723aa696840f-kube-api-access-bbdmq\") pod \"e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw\" (UID: \"b18bbf01-5733-4a75-bd20-723aa696840f\") " pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"
Sep 06 01:17:25.283107 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.283071    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b18bbf01-5733-4a75-bd20-723aa696840f-istio-token\") pod \"e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw\" (UID: \"b18bbf01-5733-4a75-bd20-723aa696840f\") " pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"
Sep 06 01:17:25.397051 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.396962    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"
Sep 06 01:17:25.677597 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.677471    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"]
Sep 06 01:17:25.679883 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:17:25.679855    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb18bbf01_5733_4a75_bd20_723aa696840f.slice/crio-db863bab59ba70a5379c750698bdcd0d01ca4630621f2fcb3d2b236c66240656 WatchSource:0}: Error finding container db863bab59ba70a5379c750698bdcd0d01ca4630621f2fcb3d2b236c66240656: Status 404 returned error can't find the container with id db863bab59ba70a5379c750698bdcd0d01ca4630621f2fcb3d2b236c66240656
Sep 06 01:17:25.682222 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.682194    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:17:25.682299 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.682259    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:17:25.682299 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:25.682286    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:17:26.094923 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:26.094830    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw" event={"ID":"b18bbf01-5733-4a75-bd20-723aa696840f","Type":"ContainerStarted","Data":"11687cc36b04a5f8c4c58c90c677134eec2aafc50e9935300f2a1b743fe4af0b"}
Sep 06 01:17:26.094923 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:26.094884    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw" event={"ID":"b18bbf01-5733-4a75-bd20-723aa696840f","Type":"ContainerStarted","Data":"db863bab59ba70a5379c750698bdcd0d01ca4630621f2fcb3d2b236c66240656"}
Sep 06 01:17:26.115684 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:26.115636    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw" podStartSLOduration=1.115620142 podStartE2EDuration="1.115620142s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:17:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:17:26.114552729 +0000 UTC m=+1604.150695687" watchObservedRunningTime="2026-09-06 01:17:26.115620142 +0000 UTC m=+1604.151763098"
Sep 06 01:17:26.397728 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:26.397651    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"
Sep 06 01:17:26.410289 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:26.410261    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"
Sep 06 01:17:27.100698 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:27.100669    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"
Sep 06 01:17:27.101834 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:27.101816    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"
Sep 06 01:17:37.069707 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:37.069629    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:17:48.230849 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:48.230811    2577 generic.go:356] "Generic (PLEG): container finished" podID="b18bbf01-5733-4a75-bd20-723aa696840f" containerID="11687cc36b04a5f8c4c58c90c677134eec2aafc50e9935300f2a1b743fe4af0b" exitCode=0
Sep 06 01:17:48.231359 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:48.230884    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw" event={"ID":"b18bbf01-5733-4a75-bd20-723aa696840f","Type":"ContainerDied","Data":"11687cc36b04a5f8c4c58c90c677134eec2aafc50e9935300f2a1b743fe4af0b"}
Sep 06 01:17:48.231359 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:48.231260    2577 scope.go:117] "RemoveContainer" containerID="11687cc36b04a5f8c4c58c90c677134eec2aafc50e9935300f2a1b743fe4af0b"
Sep 06 01:17:48.232440 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:48.232411    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:17:48.232552 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:48.232487    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:17:48.232552 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:48.232541    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 06 01:17:49.240284 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:49.240249    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw" event={"ID":"b18bbf01-5733-4a75-bd20-723aa696840f","Type":"ContainerStarted","Data":"7df5152c3a11edb2084a3a5c9fa5c9261d30e64ea17fcf02dad1f0cbd913934e"}
Sep 06 01:17:49.397986 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:49.397949    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"
Sep 06 01:17:49.398159 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:49.398130    2577 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Sep 06 01:17:49.398209 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:49.398182    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw" podUID="b18bbf01-5733-4a75-bd20-723aa696840f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Sep 06 01:17:50.397708 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:50.397673    2577 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Sep 06 01:17:50.398108 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:50.397728    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw" podUID="b18bbf01-5733-4a75-bd20-723aa696840f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Sep 06 01:17:51.397976 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:51.397938    2577 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Sep 06 01:17:51.398423 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:51.397997    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw" podUID="b18bbf01-5733-4a75-bd20-723aa696840f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Sep 06 01:17:52.398272 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:52.398237    2577 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Sep 06 01:17:52.398651 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:52.398294    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw" podUID="b18bbf01-5733-4a75-bd20-723aa696840f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Sep 06 01:17:53.398191 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:53.398152    2577 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Sep 06 01:17:53.398398 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:53.398224    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw" podUID="b18bbf01-5733-4a75-bd20-723aa696840f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Sep 06 01:17:53.924028 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:53.923982    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3032be-wjghr"]
Sep 06 01:17:53.924790 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:53.924759    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ef62bfa-0af8-47de-8fb2-62c7c41cccf0" containerName="istio-proxy"
Sep 06 01:17:53.924790 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:53.924790    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ef62bfa-0af8-47de-8fb2-62c7c41cccf0" containerName="istio-proxy"
Sep 06 01:17:53.924977 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:53.924923    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ef62bfa-0af8-47de-8fb2-62c7c41cccf0" containerName="istio-proxy"
Sep 06 01:17:53.928895 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:53.928866    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3032be-wjghr"
Sep 06 01:17:53.933626 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:53.933600    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xjq68\""
Sep 06 01:17:53.938002 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:53.937981    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3032be-wjghr"]
Sep 06 01:17:53.983060 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:53.983031    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e553d9c-cd03-40c4-9010-5f5e49d2e337-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-3032be-wjghr\" (UID: \"4e553d9c-cd03-40c4-9010-5f5e49d2e337\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3032be-wjghr"
Sep 06 01:17:54.084443 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:54.084408    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e553d9c-cd03-40c4-9010-5f5e49d2e337-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-3032be-wjghr\" (UID: \"4e553d9c-cd03-40c4-9010-5f5e49d2e337\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3032be-wjghr"
Sep 06 01:17:54.085093 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:54.085073    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e553d9c-cd03-40c4-9010-5f5e49d2e337-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-3032be-wjghr\" (UID: \"4e553d9c-cd03-40c4-9010-5f5e49d2e337\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3032be-wjghr"
Sep 06 01:17:54.244280 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:54.244179    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3032be-wjghr"
Sep 06 01:17:54.526184 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:54.526156    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3032be-wjghr"]
Sep 06 01:17:54.529925 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:17:54.529897    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e553d9c_cd03_40c4_9010_5f5e49d2e337.slice/crio-a4d47395b32b67784c9b4d8d0f26d7148e958868c3c93f1dc907e641a8f230da WatchSource:0}: Error finding container a4d47395b32b67784c9b4d8d0f26d7148e958868c3c93f1dc907e641a8f230da: Status 404 returned error can't find the container with id a4d47395b32b67784c9b4d8d0f26d7148e958868c3c93f1dc907e641a8f230da
Sep 06 01:17:54.545804 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:54.545768    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"
Sep 06 01:17:54.546198 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:54.546173    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"
Sep 06 01:17:54.546981 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:54.546961    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"
Sep 06 01:17:55.283118 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:55.283075    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3032be-wjghr" event={"ID":"4e553d9c-cd03-40c4-9010-5f5e49d2e337","Type":"ContainerStarted","Data":"8fdb8dc2017fe720c6a181daa84366289b28bbf5396c2ace4569c2504cddc799"}
Sep 06 01:17:55.283374 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:55.283164    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3032be-wjghr" event={"ID":"4e553d9c-cd03-40c4-9010-5f5e49d2e337","Type":"ContainerStarted","Data":"a4d47395b32b67784c9b4d8d0f26d7148e958868c3c93f1dc907e641a8f230da"}
Sep 06 01:17:55.298577 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:55.298533    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3032be-wjghr" podStartSLOduration=2.298518015 podStartE2EDuration="2.298518015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:17:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:17:55.297603419 +0000 UTC m=+1633.333746378" watchObservedRunningTime="2026-09-06 01:17:55.298518015 +0000 UTC m=+1633.334660971"
Sep 06 01:17:56.292702 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:56.292666    2577 generic.go:356] "Generic (PLEG): container finished" podID="4e553d9c-cd03-40c4-9010-5f5e49d2e337" containerID="8fdb8dc2017fe720c6a181daa84366289b28bbf5396c2ace4569c2504cddc799" exitCode=0
Sep 06 01:17:56.293096 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:56.292751    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3032be-wjghr" event={"ID":"4e553d9c-cd03-40c4-9010-5f5e49d2e337","Type":"ContainerDied","Data":"8fdb8dc2017fe720c6a181daa84366289b28bbf5396c2ace4569c2504cddc799"}
Sep 06 01:17:57.445574 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:57.445549    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3032be-wjghr"
Sep 06 01:17:57.521709 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:57.521672    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e553d9c-cd03-40c4-9010-5f5e49d2e337-maas-api-service-ca\") pod \"4e553d9c-cd03-40c4-9010-5f5e49d2e337\" (UID: \"4e553d9c-cd03-40c4-9010-5f5e49d2e337\") "
Sep 06 01:17:57.522044 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:57.522022    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e553d9c-cd03-40c4-9010-5f5e49d2e337-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4e553d9c-cd03-40c4-9010-5f5e49d2e337" (UID: "4e553d9c-cd03-40c4-9010-5f5e49d2e337"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:17:57.623011 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:57.622921    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e553d9c-cd03-40c4-9010-5f5e49d2e337-maas-api-service-ca\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:17:58.306870 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:58.306839    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3032be-wjghr"
Sep 06 01:17:58.307074 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:58.306872    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3032be-wjghr" event={"ID":"4e553d9c-cd03-40c4-9010-5f5e49d2e337","Type":"ContainerDied","Data":"a4d47395b32b67784c9b4d8d0f26d7148e958868c3c93f1dc907e641a8f230da"}
Sep 06 01:17:58.307074 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:17:58.306927    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4d47395b32b67784c9b4d8d0f26d7148e958868c3c93f1dc907e641a8f230da"
Sep 06 01:18:00.161061 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:00.161020    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3032be-wjghr"]
Sep 06 01:18:00.164063 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:00.164042    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3032be-wjghr"]
Sep 06 01:18:00.414252 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:00.414143    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e553d9c-cd03-40c4-9010-5f5e49d2e337" path="/var/lib/kubelet/pods/4e553d9c-cd03-40c4-9010-5f5e49d2e337/volumes"
Sep 06 01:18:04.861526 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:04.861493    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:18:06.555307 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:06.555267    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"]
Sep 06 01:18:06.555825 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:06.555493    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw" podUID="b18bbf01-5733-4a75-bd20-723aa696840f" containerName="istio-proxy" containerID="cri-o://7df5152c3a11edb2084a3a5c9fa5c9261d30e64ea17fcf02dad1f0cbd913934e" gracePeriod=30
Sep 06 01:18:09.548061 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:09.548022    2577 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Sep 06 01:18:09.548533 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:09.548100    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw" podUID="b18bbf01-5733-4a75-bd20-723aa696840f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 06 01:18:11.813842 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:11.813817    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"
Sep 06 01:18:11.974129 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:11.974092    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b18bbf01-5733-4a75-bd20-723aa696840f-istio-envoy\") pod \"b18bbf01-5733-4a75-bd20-723aa696840f\" (UID: \"b18bbf01-5733-4a75-bd20-723aa696840f\") "
Sep 06 01:18:11.974355 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:11.974139    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b18bbf01-5733-4a75-bd20-723aa696840f-workload-socket\") pod \"b18bbf01-5733-4a75-bd20-723aa696840f\" (UID: \"b18bbf01-5733-4a75-bd20-723aa696840f\") "
Sep 06 01:18:11.974355 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:11.974160    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b18bbf01-5733-4a75-bd20-723aa696840f-istiod-ca-cert\") pod \"b18bbf01-5733-4a75-bd20-723aa696840f\" (UID: \"b18bbf01-5733-4a75-bd20-723aa696840f\") "
Sep 06 01:18:11.974355 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:11.974182    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b18bbf01-5733-4a75-bd20-723aa696840f-istio-token\") pod \"b18bbf01-5733-4a75-bd20-723aa696840f\" (UID: \"b18bbf01-5733-4a75-bd20-723aa696840f\") "
Sep 06 01:18:11.974546 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:11.974367    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b18bbf01-5733-4a75-bd20-723aa696840f-workload-certs\") pod \"b18bbf01-5733-4a75-bd20-723aa696840f\" (UID: \"b18bbf01-5733-4a75-bd20-723aa696840f\") "
Sep 06 01:18:11.974546 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:11.974439    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bbdmq\" (UniqueName: \"kubernetes.io/projected/b18bbf01-5733-4a75-bd20-723aa696840f-kube-api-access-bbdmq\") pod \"b18bbf01-5733-4a75-bd20-723aa696840f\" (UID: \"b18bbf01-5733-4a75-bd20-723aa696840f\") "
Sep 06 01:18:11.974546 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:11.974459    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b18bbf01-5733-4a75-bd20-723aa696840f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b18bbf01-5733-4a75-bd20-723aa696840f" (UID: "b18bbf01-5733-4a75-bd20-723aa696840f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:18:11.974546 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:11.974487    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b18bbf01-5733-4a75-bd20-723aa696840f-istio-podinfo\") pod \"b18bbf01-5733-4a75-bd20-723aa696840f\" (UID: \"b18bbf01-5733-4a75-bd20-723aa696840f\") "
Sep 06 01:18:11.974546 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:11.974541    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b18bbf01-5733-4a75-bd20-723aa696840f-istio-data\") pod \"b18bbf01-5733-4a75-bd20-723aa696840f\" (UID: \"b18bbf01-5733-4a75-bd20-723aa696840f\") "
Sep 06 01:18:11.974805 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:11.974600    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b18bbf01-5733-4a75-bd20-723aa696840f-credential-socket\") pod \"b18bbf01-5733-4a75-bd20-723aa696840f\" (UID: \"b18bbf01-5733-4a75-bd20-723aa696840f\") "
Sep 06 01:18:11.974805 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:11.974640    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b18bbf01-5733-4a75-bd20-723aa696840f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b18bbf01-5733-4a75-bd20-723aa696840f" (UID: "b18bbf01-5733-4a75-bd20-723aa696840f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:18:11.974805 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:11.974649    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b18bbf01-5733-4a75-bd20-723aa696840f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b18bbf01-5733-4a75-bd20-723aa696840f" (UID: "b18bbf01-5733-4a75-bd20-723aa696840f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:18:11.974966 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:11.974841    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b18bbf01-5733-4a75-bd20-723aa696840f-istio-data" (OuterVolumeSpecName: "istio-data") pod "b18bbf01-5733-4a75-bd20-723aa696840f" (UID: "b18bbf01-5733-4a75-bd20-723aa696840f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:18:11.974966 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:11.974900    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b18bbf01-5733-4a75-bd20-723aa696840f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b18bbf01-5733-4a75-bd20-723aa696840f" (UID: "b18bbf01-5733-4a75-bd20-723aa696840f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:18:11.975074 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:11.975006    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b18bbf01-5733-4a75-bd20-723aa696840f-workload-socket\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:18:11.975074 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:11.975024    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b18bbf01-5733-4a75-bd20-723aa696840f-istiod-ca-cert\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:18:11.975074 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:11.975038    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b18bbf01-5733-4a75-bd20-723aa696840f-workload-certs\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:18:11.975074 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:11.975049    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b18bbf01-5733-4a75-bd20-723aa696840f-istio-data\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:18:11.975074 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:11.975062    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b18bbf01-5733-4a75-bd20-723aa696840f-credential-socket\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:18:11.976525 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:11.976500    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b18bbf01-5733-4a75-bd20-723aa696840f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b18bbf01-5733-4a75-bd20-723aa696840f" (UID: "b18bbf01-5733-4a75-bd20-723aa696840f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:18:11.976856 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:11.976838    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b18bbf01-5733-4a75-bd20-723aa696840f-istio-token" (OuterVolumeSpecName: "istio-token") pod "b18bbf01-5733-4a75-bd20-723aa696840f" (UID: "b18bbf01-5733-4a75-bd20-723aa696840f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:18:11.977143 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:11.977118    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b18bbf01-5733-4a75-bd20-723aa696840f-kube-api-access-bbdmq" (OuterVolumeSpecName: "kube-api-access-bbdmq") pod "b18bbf01-5733-4a75-bd20-723aa696840f" (UID: "b18bbf01-5733-4a75-bd20-723aa696840f"). InnerVolumeSpecName "kube-api-access-bbdmq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:18:11.977143 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:11.977120    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b18bbf01-5733-4a75-bd20-723aa696840f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b18bbf01-5733-4a75-bd20-723aa696840f" (UID: "b18bbf01-5733-4a75-bd20-723aa696840f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 01:18:12.075936 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:12.075864    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b18bbf01-5733-4a75-bd20-723aa696840f-istio-token\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:18:12.075936 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:12.075934    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bbdmq\" (UniqueName: \"kubernetes.io/projected/b18bbf01-5733-4a75-bd20-723aa696840f-kube-api-access-bbdmq\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:18:12.075936 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:12.075946    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b18bbf01-5733-4a75-bd20-723aa696840f-istio-podinfo\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:18:12.075936 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:12.075954    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b18bbf01-5733-4a75-bd20-723aa696840f-istio-envoy\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:18:12.390840 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:12.390754    2577 generic.go:356] "Generic (PLEG): container finished" podID="b18bbf01-5733-4a75-bd20-723aa696840f" containerID="7df5152c3a11edb2084a3a5c9fa5c9261d30e64ea17fcf02dad1f0cbd913934e" exitCode=0
Sep 06 01:18:12.390840 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:12.390803    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"
Sep 06 01:18:12.391004 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:12.390838    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw" event={"ID":"b18bbf01-5733-4a75-bd20-723aa696840f","Type":"ContainerDied","Data":"7df5152c3a11edb2084a3a5c9fa5c9261d30e64ea17fcf02dad1f0cbd913934e"}
Sep 06 01:18:12.391004 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:12.390893    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw" event={"ID":"b18bbf01-5733-4a75-bd20-723aa696840f","Type":"ContainerDied","Data":"db863bab59ba70a5379c750698bdcd0d01ca4630621f2fcb3d2b236c66240656"}
Sep 06 01:18:12.391004 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:12.390918    2577 scope.go:117] "RemoveContainer" containerID="7df5152c3a11edb2084a3a5c9fa5c9261d30e64ea17fcf02dad1f0cbd913934e"
Sep 06 01:18:12.400378 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:12.400360    2577 scope.go:117] "RemoveContainer" containerID="11687cc36b04a5f8c4c58c90c677134eec2aafc50e9935300f2a1b743fe4af0b"
Sep 06 01:18:12.419255 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:12.419230    2577 scope.go:117] "RemoveContainer" containerID="7df5152c3a11edb2084a3a5c9fa5c9261d30e64ea17fcf02dad1f0cbd913934e"
Sep 06 01:18:12.419599 ip-10-0-140-57 kubenswrapper[2577]: E0906 01:18:12.419581    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7df5152c3a11edb2084a3a5c9fa5c9261d30e64ea17fcf02dad1f0cbd913934e\": container with ID starting with 7df5152c3a11edb2084a3a5c9fa5c9261d30e64ea17fcf02dad1f0cbd913934e not found: ID does not exist" containerID="7df5152c3a11edb2084a3a5c9fa5c9261d30e64ea17fcf02dad1f0cbd913934e"
Sep 06 01:18:12.419680 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:12.419606    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7df5152c3a11edb2084a3a5c9fa5c9261d30e64ea17fcf02dad1f0cbd913934e"} err="failed to get container status \"7df5152c3a11edb2084a3a5c9fa5c9261d30e64ea17fcf02dad1f0cbd913934e\": rpc error: code = NotFound desc = could not find container \"7df5152c3a11edb2084a3a5c9fa5c9261d30e64ea17fcf02dad1f0cbd913934e\": container with ID starting with 7df5152c3a11edb2084a3a5c9fa5c9261d30e64ea17fcf02dad1f0cbd913934e not found: ID does not exist"
Sep 06 01:18:12.419680 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:12.419622    2577 scope.go:117] "RemoveContainer" containerID="11687cc36b04a5f8c4c58c90c677134eec2aafc50e9935300f2a1b743fe4af0b"
Sep 06 01:18:12.419968 ip-10-0-140-57 kubenswrapper[2577]: E0906 01:18:12.419935    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11687cc36b04a5f8c4c58c90c677134eec2aafc50e9935300f2a1b743fe4af0b\": container with ID starting with 11687cc36b04a5f8c4c58c90c677134eec2aafc50e9935300f2a1b743fe4af0b not found: ID does not exist" containerID="11687cc36b04a5f8c4c58c90c677134eec2aafc50e9935300f2a1b743fe4af0b"
Sep 06 01:18:12.420073 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:12.419973    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11687cc36b04a5f8c4c58c90c677134eec2aafc50e9935300f2a1b743fe4af0b"} err="failed to get container status \"11687cc36b04a5f8c4c58c90c677134eec2aafc50e9935300f2a1b743fe4af0b\": rpc error: code = NotFound desc = could not find container \"11687cc36b04a5f8c4c58c90c677134eec2aafc50e9935300f2a1b743fe4af0b\": container with ID starting with 11687cc36b04a5f8c4c58c90c677134eec2aafc50e9935300f2a1b743fe4af0b not found: ID does not exist"
Sep 06 01:18:12.420623 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:12.420602    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"]
Sep 06 01:18:12.422083 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:12.422062    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3032be-openshift-default-bcbfd657d-sxmdw"]
Sep 06 01:18:14.410118 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:14.410085    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b18bbf01-5733-4a75-bd20-723aa696840f" path="/var/lib/kubelet/pods/b18bbf01-5733-4a75-bd20-723aa696840f/volumes"
Sep 06 01:18:24.474867 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:24.474831    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:18:26.022516 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:26.022477    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b2e4f6-54fb4fcbd6-dk652"]
Sep 06 01:18:26.023499 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:26.023452    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b2e4f6-54fb4fcbd6-dk652" podUID="2feb306e-a0c3-45bb-aad2-d67e232316d3" containerName="payload-pre-processing" containerID="cri-o://92122a4e4a60c44009096952e736690ce931540772f888961b029a08aa2bdf16" gracePeriod=30
Sep 06 01:18:26.283583 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:26.283520    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b2e4f6-54fb4fcbd6-dk652"
Sep 06 01:18:26.319880 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:26.319847    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2feb306e-a0c3-45bb-aad2-d67e232316d3-plugins-config-volume\") pod \"2feb306e-a0c3-45bb-aad2-d67e232316d3\" (UID: \"2feb306e-a0c3-45bb-aad2-d67e232316d3\") "
Sep 06 01:18:26.320043 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:26.319966    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vvc7\" (UniqueName: \"kubernetes.io/projected/2feb306e-a0c3-45bb-aad2-d67e232316d3-kube-api-access-2vvc7\") pod \"2feb306e-a0c3-45bb-aad2-d67e232316d3\" (UID: \"2feb306e-a0c3-45bb-aad2-d67e232316d3\") "
Sep 06 01:18:26.320932 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:26.320882    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2feb306e-a0c3-45bb-aad2-d67e232316d3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2feb306e-a0c3-45bb-aad2-d67e232316d3" (UID: "2feb306e-a0c3-45bb-aad2-d67e232316d3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:18:26.323129 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:26.323096    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2feb306e-a0c3-45bb-aad2-d67e232316d3-kube-api-access-2vvc7" (OuterVolumeSpecName: "kube-api-access-2vvc7") pod "2feb306e-a0c3-45bb-aad2-d67e232316d3" (UID: "2feb306e-a0c3-45bb-aad2-d67e232316d3"). InnerVolumeSpecName "kube-api-access-2vvc7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:18:26.421699 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:26.421674    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vvc7\" (UniqueName: \"kubernetes.io/projected/2feb306e-a0c3-45bb-aad2-d67e232316d3-kube-api-access-2vvc7\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:18:26.421699 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:26.421698    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2feb306e-a0c3-45bb-aad2-d67e232316d3-plugins-config-volume\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:18:26.471778 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:26.471746    2577 generic.go:356] "Generic (PLEG): container finished" podID="2feb306e-a0c3-45bb-aad2-d67e232316d3" containerID="92122a4e4a60c44009096952e736690ce931540772f888961b029a08aa2bdf16" exitCode=0
Sep 06 01:18:26.471926 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:26.471790    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b2e4f6-54fb4fcbd6-dk652"
Sep 06 01:18:26.471926 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:26.471788    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b2e4f6-54fb4fcbd6-dk652" event={"ID":"2feb306e-a0c3-45bb-aad2-d67e232316d3","Type":"ContainerDied","Data":"92122a4e4a60c44009096952e736690ce931540772f888961b029a08aa2bdf16"}
Sep 06 01:18:26.471926 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:26.471898    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b2e4f6-54fb4fcbd6-dk652" event={"ID":"2feb306e-a0c3-45bb-aad2-d67e232316d3","Type":"ContainerDied","Data":"19f96f5b0a5d853e7e9a1c0b2ec5cb7724b7a3d2e862ff25ef518dd6e103ae41"}
Sep 06 01:18:26.472048 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:26.471927    2577 scope.go:117] "RemoveContainer" containerID="92122a4e4a60c44009096952e736690ce931540772f888961b029a08aa2bdf16"
Sep 06 01:18:26.481077 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:26.481057    2577 scope.go:117] "RemoveContainer" containerID="92122a4e4a60c44009096952e736690ce931540772f888961b029a08aa2bdf16"
Sep 06 01:18:26.481397 ip-10-0-140-57 kubenswrapper[2577]: E0906 01:18:26.481376    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92122a4e4a60c44009096952e736690ce931540772f888961b029a08aa2bdf16\": container with ID starting with 92122a4e4a60c44009096952e736690ce931540772f888961b029a08aa2bdf16 not found: ID does not exist" containerID="92122a4e4a60c44009096952e736690ce931540772f888961b029a08aa2bdf16"
Sep 06 01:18:26.481470 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:26.481406    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92122a4e4a60c44009096952e736690ce931540772f888961b029a08aa2bdf16"} err="failed to get container status \"92122a4e4a60c44009096952e736690ce931540772f888961b029a08aa2bdf16\": rpc error: code = NotFound desc = could not find container \"92122a4e4a60c44009096952e736690ce931540772f888961b029a08aa2bdf16\": container with ID starting with 92122a4e4a60c44009096952e736690ce931540772f888961b029a08aa2bdf16 not found: ID does not exist"
Sep 06 01:18:26.488717 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:26.488697    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b2e4f6-54fb4fcbd6-dk652"]
Sep 06 01:18:26.492422 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:26.492399    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b2e4f6-54fb4fcbd6-dk652"]
Sep 06 01:18:28.409502 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:28.409469    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2feb306e-a0c3-45bb-aad2-d67e232316d3" path="/var/lib/kubelet/pods/2feb306e-a0c3-45bb-aad2-d67e232316d3/volumes"
Sep 06 01:18:36.657130 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:36.657097    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:18:42.686176 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:18:42.686144    2577 scope.go:117] "RemoveContainer" containerID="d831abc532d27eecec0644910e69b3c686690a46d24ab6c35baa526a14386a42"
Sep 06 01:19:20.054426 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:20.054384    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"]
Sep 06 01:19:20.055029 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:20.054624    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h" podUID="ed7b10fd-46c2-4be0-91db-6e756dc33c9d" containerName="istio-proxy" containerID="cri-o://43121bb676c0f79e6202e8cc28603446b9f2721761a8b5366a43e91dfed5a157" gracePeriod=30
Sep 06 01:19:25.325230 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:25.325169    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"
Sep 06 01:19:25.405101 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:25.405072    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-credential-socket\") pod \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\" (UID: \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\") "
Sep 06 01:19:25.405299 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:25.405118    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-istio-data\") pod \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\" (UID: \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\") "
Sep 06 01:19:25.405299 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:25.405157    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-workload-socket\") pod \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\" (UID: \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\") "
Sep 06 01:19:25.405299 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:25.405209    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-istio-envoy\") pod \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\" (UID: \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\") "
Sep 06 01:19:25.405299 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:25.405256    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2zr5\" (UniqueName: \"kubernetes.io/projected/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-kube-api-access-m2zr5\") pod \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\" (UID: \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\") "
Sep 06 01:19:25.405559 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:25.405355    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-istiod-ca-cert\") pod \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\" (UID: \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\") "
Sep 06 01:19:25.405559 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:25.405399    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-workload-certs\") pod \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\" (UID: \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\") "
Sep 06 01:19:25.405559 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:25.405401    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ed7b10fd-46c2-4be0-91db-6e756dc33c9d" (UID: "ed7b10fd-46c2-4be0-91db-6e756dc33c9d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:19:25.405559 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:25.405438    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-istio-token\") pod \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\" (UID: \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\") "
Sep 06 01:19:25.405559 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:25.405459    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-istio-data" (OuterVolumeSpecName: "istio-data") pod "ed7b10fd-46c2-4be0-91db-6e756dc33c9d" (UID: "ed7b10fd-46c2-4be0-91db-6e756dc33c9d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:19:25.405559 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:25.405477    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-istio-podinfo\") pod \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\" (UID: \"ed7b10fd-46c2-4be0-91db-6e756dc33c9d\") "
Sep 06 01:19:25.405559 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:25.405528    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ed7b10fd-46c2-4be0-91db-6e756dc33c9d" (UID: "ed7b10fd-46c2-4be0-91db-6e756dc33c9d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:19:25.405970 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:25.405738    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ed7b10fd-46c2-4be0-91db-6e756dc33c9d" (UID: "ed7b10fd-46c2-4be0-91db-6e756dc33c9d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:19:25.405970 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:25.405789    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ed7b10fd-46c2-4be0-91db-6e756dc33c9d" (UID: "ed7b10fd-46c2-4be0-91db-6e756dc33c9d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:19:25.405970 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:25.405910    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-workload-certs\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:19:25.405970 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:25.405927    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-credential-socket\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:19:25.405970 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:25.405940    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-istio-data\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:19:25.405970 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:25.405952    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-workload-socket\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:19:25.405970 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:25.405963    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-istiod-ca-cert\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:19:25.407879 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:25.407853    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-istio-token" (OuterVolumeSpecName: "istio-token") pod "ed7b10fd-46c2-4be0-91db-6e756dc33c9d" (UID: "ed7b10fd-46c2-4be0-91db-6e756dc33c9d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:19:25.407879 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:25.407861    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ed7b10fd-46c2-4be0-91db-6e756dc33c9d" (UID: "ed7b10fd-46c2-4be0-91db-6e756dc33c9d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:19:25.408163 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:25.408143    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ed7b10fd-46c2-4be0-91db-6e756dc33c9d" (UID: "ed7b10fd-46c2-4be0-91db-6e756dc33c9d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 01:19:25.408163 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:25.408151    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-kube-api-access-m2zr5" (OuterVolumeSpecName: "kube-api-access-m2zr5") pod "ed7b10fd-46c2-4be0-91db-6e756dc33c9d" (UID: "ed7b10fd-46c2-4be0-91db-6e756dc33c9d"). InnerVolumeSpecName "kube-api-access-m2zr5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:19:25.506639 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:25.506607    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-istio-envoy\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:19:25.506639 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:25.506635    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2zr5\" (UniqueName: \"kubernetes.io/projected/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-kube-api-access-m2zr5\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:19:25.506830 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:25.506646    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-istio-token\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:19:25.506830 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:25.506655    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed7b10fd-46c2-4be0-91db-6e756dc33c9d-istio-podinfo\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:19:25.820597 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:25.820557    2577 generic.go:356] "Generic (PLEG): container finished" podID="ed7b10fd-46c2-4be0-91db-6e756dc33c9d" containerID="43121bb676c0f79e6202e8cc28603446b9f2721761a8b5366a43e91dfed5a157" exitCode=0
Sep 06 01:19:25.820773 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:25.820618    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"
Sep 06 01:19:25.820773 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:25.820650    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h" event={"ID":"ed7b10fd-46c2-4be0-91db-6e756dc33c9d","Type":"ContainerDied","Data":"43121bb676c0f79e6202e8cc28603446b9f2721761a8b5366a43e91dfed5a157"}
Sep 06 01:19:25.820773 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:25.820708    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h" event={"ID":"ed7b10fd-46c2-4be0-91db-6e756dc33c9d","Type":"ContainerDied","Data":"7b07224762e931dd2fd76cc2f79f32f7575184f320fd2c975e9452966e137d63"}
Sep 06 01:19:25.820773 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:25.820734    2577 scope.go:117] "RemoveContainer" containerID="43121bb676c0f79e6202e8cc28603446b9f2721761a8b5366a43e91dfed5a157"
Sep 06 01:19:25.830962 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:25.830940    2577 scope.go:117] "RemoveContainer" containerID="d0158d8551db05d67d2041b05a5bc9f0ad116f1d4ff73314bd7b0af94a7a4cd2"
Sep 06 01:19:25.839973 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:25.839956    2577 scope.go:117] "RemoveContainer" containerID="43121bb676c0f79e6202e8cc28603446b9f2721761a8b5366a43e91dfed5a157"
Sep 06 01:19:25.840486 ip-10-0-140-57 kubenswrapper[2577]: E0906 01:19:25.840452    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43121bb676c0f79e6202e8cc28603446b9f2721761a8b5366a43e91dfed5a157\": container with ID starting with 43121bb676c0f79e6202e8cc28603446b9f2721761a8b5366a43e91dfed5a157 not found: ID does not exist" containerID="43121bb676c0f79e6202e8cc28603446b9f2721761a8b5366a43e91dfed5a157"
Sep 06 01:19:25.840583 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:25.840499    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43121bb676c0f79e6202e8cc28603446b9f2721761a8b5366a43e91dfed5a157"} err="failed to get container status \"43121bb676c0f79e6202e8cc28603446b9f2721761a8b5366a43e91dfed5a157\": rpc error: code = NotFound desc = could not find container \"43121bb676c0f79e6202e8cc28603446b9f2721761a8b5366a43e91dfed5a157\": container with ID starting with 43121bb676c0f79e6202e8cc28603446b9f2721761a8b5366a43e91dfed5a157 not found: ID does not exist"
Sep 06 01:19:25.840583 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:25.840523    2577 scope.go:117] "RemoveContainer" containerID="d0158d8551db05d67d2041b05a5bc9f0ad116f1d4ff73314bd7b0af94a7a4cd2"
Sep 06 01:19:25.840841 ip-10-0-140-57 kubenswrapper[2577]: E0906 01:19:25.840823    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0158d8551db05d67d2041b05a5bc9f0ad116f1d4ff73314bd7b0af94a7a4cd2\": container with ID starting with d0158d8551db05d67d2041b05a5bc9f0ad116f1d4ff73314bd7b0af94a7a4cd2 not found: ID does not exist" containerID="d0158d8551db05d67d2041b05a5bc9f0ad116f1d4ff73314bd7b0af94a7a4cd2"
Sep 06 01:19:25.840892 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:25.840848    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0158d8551db05d67d2041b05a5bc9f0ad116f1d4ff73314bd7b0af94a7a4cd2"} err="failed to get container status \"d0158d8551db05d67d2041b05a5bc9f0ad116f1d4ff73314bd7b0af94a7a4cd2\": rpc error: code = NotFound desc = could not find container \"d0158d8551db05d67d2041b05a5bc9f0ad116f1d4ff73314bd7b0af94a7a4cd2\": container with ID starting with d0158d8551db05d67d2041b05a5bc9f0ad116f1d4ff73314bd7b0af94a7a4cd2 not found: ID does not exist"
Sep 06 01:19:25.842822 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:25.842804    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"]
Sep 06 01:19:25.846254 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:25.846234    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-b2e4f6-openshift-default-f998664b8-hwf7h"]
Sep 06 01:19:26.409589 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:26.409560    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed7b10fd-46c2-4be0-91db-6e756dc33c9d" path="/var/lib/kubelet/pods/ed7b10fd-46c2-4be0-91db-6e756dc33c9d/volumes"
Sep 06 01:19:33.469430 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:33.469395    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:19:48.419795 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:48.419763    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-5844a8-29810955-7rt78"]
Sep 06 01:19:48.423691 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:48.423668    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-5844a8-29810955-7rt78"]
Sep 06 01:19:48.448380 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:48.448351    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-5844a8-855bd94cf-7rdst"]
Sep 06 01:19:48.448601 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:48.448574    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-5844a8-855bd94cf-7rdst" podUID="a21771ae-a2c0-4d7f-8f4c-cfce9eb1a474" containerName="payload-processing" containerID="cri-o://9892c08cf9cdd593c7f641d7f0f2aecc6d3db5489dce47977a9c38cbd06e0f3b" gracePeriod=30
Sep 06 01:19:48.454718 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:48.454690    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5844a8-f4c7954cd-njpxh"]
Sep 06 01:19:48.455008 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:48.454958    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5844a8-f4c7954cd-njpxh" podUID="f326d5de-4074-4535-9d36-846f3e2c0561" containerName="payload-pre-processing" containerID="cri-o://a810024a057d0f2fae538ea5610fcb7cf648af86f5c4b61705c7e40c7b2a771f" gracePeriod=30
Sep 06 01:19:48.503076 ip-10-0-140-57 kubenswrapper[2577]: E0906 01:19:48.503037    2577 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda21771ae_a2c0_4d7f_8f4c_cfce9eb1a474.slice/crio-conmon-9892c08cf9cdd593c7f641d7f0f2aecc6d3db5489dce47977a9c38cbd06e0f3b.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf326d5de_4074_4535_9d36_846f3e2c0561.slice/crio-conmon-a810024a057d0f2fae538ea5610fcb7cf648af86f5c4b61705c7e40c7b2a771f.scope\": RecentStats: unable to find data in memory cache]"
Sep 06 01:19:48.503307 ip-10-0-140-57 kubenswrapper[2577]: E0906 01:19:48.503129    2577 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf326d5de_4074_4535_9d36_846f3e2c0561.slice/crio-conmon-a810024a057d0f2fae538ea5610fcb7cf648af86f5c4b61705c7e40c7b2a771f.scope\": RecentStats: unable to find data in memory cache]"
Sep 06 01:19:48.707496 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:48.707464    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-5844a8-855bd94cf-7rdst"
Sep 06 01:19:48.745931 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:48.745907    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5844a8-f4c7954cd-njpxh"
Sep 06 01:19:48.817774 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:48.817730    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a21771ae-a2c0-4d7f-8f4c-cfce9eb1a474-plugins-config-volume\") pod \"a21771ae-a2c0-4d7f-8f4c-cfce9eb1a474\" (UID: \"a21771ae-a2c0-4d7f-8f4c-cfce9eb1a474\") "
Sep 06 01:19:48.817993 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:48.817862    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bx6p7\" (UniqueName: \"kubernetes.io/projected/f326d5de-4074-4535-9d36-846f3e2c0561-kube-api-access-bx6p7\") pod \"f326d5de-4074-4535-9d36-846f3e2c0561\" (UID: \"f326d5de-4074-4535-9d36-846f3e2c0561\") "
Sep 06 01:19:48.817993 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:48.817908    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f326d5de-4074-4535-9d36-846f3e2c0561-plugins-config-volume\") pod \"f326d5de-4074-4535-9d36-846f3e2c0561\" (UID: \"f326d5de-4074-4535-9d36-846f3e2c0561\") "
Sep 06 01:19:48.817993 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:48.817967    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cgfx\" (UniqueName: \"kubernetes.io/projected/a21771ae-a2c0-4d7f-8f4c-cfce9eb1a474-kube-api-access-2cgfx\") pod \"a21771ae-a2c0-4d7f-8f4c-cfce9eb1a474\" (UID: \"a21771ae-a2c0-4d7f-8f4c-cfce9eb1a474\") "
Sep 06 01:19:48.818146 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:48.818124    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a21771ae-a2c0-4d7f-8f4c-cfce9eb1a474-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a21771ae-a2c0-4d7f-8f4c-cfce9eb1a474" (UID: "a21771ae-a2c0-4d7f-8f4c-cfce9eb1a474"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:19:48.818374 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:48.818335    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a21771ae-a2c0-4d7f-8f4c-cfce9eb1a474-plugins-config-volume\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:19:48.818885 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:48.818794    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f326d5de-4074-4535-9d36-846f3e2c0561-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f326d5de-4074-4535-9d36-846f3e2c0561" (UID: "f326d5de-4074-4535-9d36-846f3e2c0561"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:19:48.820243 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:48.820208    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f326d5de-4074-4535-9d36-846f3e2c0561-kube-api-access-bx6p7" (OuterVolumeSpecName: "kube-api-access-bx6p7") pod "f326d5de-4074-4535-9d36-846f3e2c0561" (UID: "f326d5de-4074-4535-9d36-846f3e2c0561"). InnerVolumeSpecName "kube-api-access-bx6p7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:19:48.820343 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:48.820287    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a21771ae-a2c0-4d7f-8f4c-cfce9eb1a474-kube-api-access-2cgfx" (OuterVolumeSpecName: "kube-api-access-2cgfx") pod "a21771ae-a2c0-4d7f-8f4c-cfce9eb1a474" (UID: "a21771ae-a2c0-4d7f-8f4c-cfce9eb1a474"). InnerVolumeSpecName "kube-api-access-2cgfx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:19:48.919222 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:48.919175    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bx6p7\" (UniqueName: \"kubernetes.io/projected/f326d5de-4074-4535-9d36-846f3e2c0561-kube-api-access-bx6p7\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:19:48.919222 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:48.919217    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f326d5de-4074-4535-9d36-846f3e2c0561-plugins-config-volume\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:19:48.919510 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:48.919237    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cgfx\" (UniqueName: \"kubernetes.io/projected/a21771ae-a2c0-4d7f-8f4c-cfce9eb1a474-kube-api-access-2cgfx\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:19:48.955571 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:48.955487    2577 generic.go:356] "Generic (PLEG): container finished" podID="a21771ae-a2c0-4d7f-8f4c-cfce9eb1a474" containerID="9892c08cf9cdd593c7f641d7f0f2aecc6d3db5489dce47977a9c38cbd06e0f3b" exitCode=0
Sep 06 01:19:48.955571 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:48.955537    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-5844a8-855bd94cf-7rdst"
Sep 06 01:19:48.955774 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:48.955582    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-5844a8-855bd94cf-7rdst" event={"ID":"a21771ae-a2c0-4d7f-8f4c-cfce9eb1a474","Type":"ContainerDied","Data":"9892c08cf9cdd593c7f641d7f0f2aecc6d3db5489dce47977a9c38cbd06e0f3b"}
Sep 06 01:19:48.955774 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:48.955650    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-5844a8-855bd94cf-7rdst" event={"ID":"a21771ae-a2c0-4d7f-8f4c-cfce9eb1a474","Type":"ContainerDied","Data":"3532bc644080bafc73dae431d9a7a6eeeea34058f2d9f0f5d3806382a380f567"}
Sep 06 01:19:48.955774 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:48.955677    2577 scope.go:117] "RemoveContainer" containerID="9892c08cf9cdd593c7f641d7f0f2aecc6d3db5489dce47977a9c38cbd06e0f3b"
Sep 06 01:19:48.957299 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:48.957273    2577 generic.go:356] "Generic (PLEG): container finished" podID="f326d5de-4074-4535-9d36-846f3e2c0561" containerID="a810024a057d0f2fae538ea5610fcb7cf648af86f5c4b61705c7e40c7b2a771f" exitCode=0
Sep 06 01:19:48.957426 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:48.957310    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5844a8-f4c7954cd-njpxh" event={"ID":"f326d5de-4074-4535-9d36-846f3e2c0561","Type":"ContainerDied","Data":"a810024a057d0f2fae538ea5610fcb7cf648af86f5c4b61705c7e40c7b2a771f"}
Sep 06 01:19:48.957426 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:48.957354    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5844a8-f4c7954cd-njpxh"
Sep 06 01:19:48.957426 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:48.957378    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5844a8-f4c7954cd-njpxh" event={"ID":"f326d5de-4074-4535-9d36-846f3e2c0561","Type":"ContainerDied","Data":"370185a63242bbdfe718dc58290ffb966e2dd69bd95a02c9424565c14f16c34a"}
Sep 06 01:19:48.967075 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:48.967053    2577 scope.go:117] "RemoveContainer" containerID="9892c08cf9cdd593c7f641d7f0f2aecc6d3db5489dce47977a9c38cbd06e0f3b"
Sep 06 01:19:48.967509 ip-10-0-140-57 kubenswrapper[2577]: E0906 01:19:48.967482    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9892c08cf9cdd593c7f641d7f0f2aecc6d3db5489dce47977a9c38cbd06e0f3b\": container with ID starting with 9892c08cf9cdd593c7f641d7f0f2aecc6d3db5489dce47977a9c38cbd06e0f3b not found: ID does not exist" containerID="9892c08cf9cdd593c7f641d7f0f2aecc6d3db5489dce47977a9c38cbd06e0f3b"
Sep 06 01:19:48.967613 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:48.967517    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9892c08cf9cdd593c7f641d7f0f2aecc6d3db5489dce47977a9c38cbd06e0f3b"} err="failed to get container status \"9892c08cf9cdd593c7f641d7f0f2aecc6d3db5489dce47977a9c38cbd06e0f3b\": rpc error: code = NotFound desc = could not find container \"9892c08cf9cdd593c7f641d7f0f2aecc6d3db5489dce47977a9c38cbd06e0f3b\": container with ID starting with 9892c08cf9cdd593c7f641d7f0f2aecc6d3db5489dce47977a9c38cbd06e0f3b not found: ID does not exist"
Sep 06 01:19:48.967613 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:48.967539    2577 scope.go:117] "RemoveContainer" containerID="a810024a057d0f2fae538ea5610fcb7cf648af86f5c4b61705c7e40c7b2a771f"
Sep 06 01:19:48.976386 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:48.976368    2577 scope.go:117] "RemoveContainer" containerID="a810024a057d0f2fae538ea5610fcb7cf648af86f5c4b61705c7e40c7b2a771f"
Sep 06 01:19:48.976664 ip-10-0-140-57 kubenswrapper[2577]: E0906 01:19:48.976646    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a810024a057d0f2fae538ea5610fcb7cf648af86f5c4b61705c7e40c7b2a771f\": container with ID starting with a810024a057d0f2fae538ea5610fcb7cf648af86f5c4b61705c7e40c7b2a771f not found: ID does not exist" containerID="a810024a057d0f2fae538ea5610fcb7cf648af86f5c4b61705c7e40c7b2a771f"
Sep 06 01:19:48.976728 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:48.976671    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a810024a057d0f2fae538ea5610fcb7cf648af86f5c4b61705c7e40c7b2a771f"} err="failed to get container status \"a810024a057d0f2fae538ea5610fcb7cf648af86f5c4b61705c7e40c7b2a771f\": rpc error: code = NotFound desc = could not find container \"a810024a057d0f2fae538ea5610fcb7cf648af86f5c4b61705c7e40c7b2a771f\": container with ID starting with a810024a057d0f2fae538ea5610fcb7cf648af86f5c4b61705c7e40c7b2a771f not found: ID does not exist"
Sep 06 01:19:48.980954 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:48.980932    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-5844a8-855bd94cf-7rdst"]
Sep 06 01:19:48.986115 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:48.986085    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-5844a8-855bd94cf-7rdst"]
Sep 06 01:19:49.002650 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:49.002624    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5844a8-f4c7954cd-njpxh"]
Sep 06 01:19:49.007281 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:49.007257    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5844a8-f4c7954cd-njpxh"]
Sep 06 01:19:50.410250 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:50.410217    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b80965c-a90a-480b-b3ff-28fe34696faa" path="/var/lib/kubelet/pods/1b80965c-a90a-480b-b3ff-28fe34696faa/volumes"
Sep 06 01:19:50.410746 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:50.410728    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a21771ae-a2c0-4d7f-8f4c-cfce9eb1a474" path="/var/lib/kubelet/pods/a21771ae-a2c0-4d7f-8f4c-cfce9eb1a474/volumes"
Sep 06 01:19:50.411079 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:50.411067    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f326d5de-4074-4535-9d36-846f3e2c0561" path="/var/lib/kubelet/pods/f326d5de-4074-4535-9d36-846f3e2c0561/volumes"
Sep 06 01:19:52.171037 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:52.171002    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:19:55.617583 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:55.617546    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"]
Sep 06 01:19:55.618072 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:19:55.617824    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs" podUID="fb10f642-efa8-4864-bd6c-f2f610c6e3f2" containerName="istio-proxy" containerID="cri-o://1920a8c9d5d073963a939fea4e88f3149092a48f39fb6a708e32b35389e71e2b" gracePeriod=30
Sep 06 01:20:00.879454 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:00.879428    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"
Sep 06 01:20:00.933367 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:00.933310    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-istio-envoy\") pod \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\" (UID: \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\") "
Sep 06 01:20:00.933558 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:00.933390    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-workload-certs\") pod \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\" (UID: \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\") "
Sep 06 01:20:00.933558 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:00.933437    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-istiod-ca-cert\") pod \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\" (UID: \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\") "
Sep 06 01:20:00.933558 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:00.933471    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-workload-socket\") pod \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\" (UID: \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\") "
Sep 06 01:20:00.933728 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:00.933598    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-istio-podinfo\") pod \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\" (UID: \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\") "
Sep 06 01:20:00.933728 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:00.933692    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-istio-data\") pod \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\" (UID: \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\") "
Sep 06 01:20:00.933832 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:00.933722    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-credential-socket\") pod \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\" (UID: \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\") "
Sep 06 01:20:00.933832 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:00.933739    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fb10f642-efa8-4864-bd6c-f2f610c6e3f2" (UID: "fb10f642-efa8-4864-bd6c-f2f610c6e3f2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:20:00.933832 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:00.933752    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fb10f642-efa8-4864-bd6c-f2f610c6e3f2" (UID: "fb10f642-efa8-4864-bd6c-f2f610c6e3f2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:20:00.933832 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:00.933766    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-istio-token\") pod \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\" (UID: \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\") "
Sep 06 01:20:00.933832 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:00.933792    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9lv6\" (UniqueName: \"kubernetes.io/projected/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-kube-api-access-f9lv6\") pod \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\" (UID: \"fb10f642-efa8-4864-bd6c-f2f610c6e3f2\") "
Sep 06 01:20:00.933832 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:00.933820    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fb10f642-efa8-4864-bd6c-f2f610c6e3f2" (UID: "fb10f642-efa8-4864-bd6c-f2f610c6e3f2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:20:00.934134 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:00.933953    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-istio-data" (OuterVolumeSpecName: "istio-data") pod "fb10f642-efa8-4864-bd6c-f2f610c6e3f2" (UID: "fb10f642-efa8-4864-bd6c-f2f610c6e3f2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:20:00.934134 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:00.933971    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fb10f642-efa8-4864-bd6c-f2f610c6e3f2" (UID: "fb10f642-efa8-4864-bd6c-f2f610c6e3f2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:20:00.934244 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:00.934192    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-workload-socket\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:20:00.934244 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:00.934210    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-istio-data\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:20:00.934244 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:00.934224    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-credential-socket\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:20:00.934244 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:00.934238    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-workload-certs\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:20:00.934489 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:00.934251    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-istiod-ca-cert\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:20:00.935610 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:00.935584    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fb10f642-efa8-4864-bd6c-f2f610c6e3f2" (UID: "fb10f642-efa8-4864-bd6c-f2f610c6e3f2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:20:00.935917 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:00.935899    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fb10f642-efa8-4864-bd6c-f2f610c6e3f2" (UID: "fb10f642-efa8-4864-bd6c-f2f610c6e3f2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 01:20:00.936303 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:00.936287    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-kube-api-access-f9lv6" (OuterVolumeSpecName: "kube-api-access-f9lv6") pod "fb10f642-efa8-4864-bd6c-f2f610c6e3f2" (UID: "fb10f642-efa8-4864-bd6c-f2f610c6e3f2"). InnerVolumeSpecName "kube-api-access-f9lv6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:20:00.936409 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:00.936313    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-istio-token" (OuterVolumeSpecName: "istio-token") pod "fb10f642-efa8-4864-bd6c-f2f610c6e3f2" (UID: "fb10f642-efa8-4864-bd6c-f2f610c6e3f2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:20:01.028144 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:01.028115    2577 generic.go:356] "Generic (PLEG): container finished" podID="fb10f642-efa8-4864-bd6c-f2f610c6e3f2" containerID="1920a8c9d5d073963a939fea4e88f3149092a48f39fb6a708e32b35389e71e2b" exitCode=0
Sep 06 01:20:01.028315 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:01.028156    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"
Sep 06 01:20:01.028315 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:01.028203    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs" event={"ID":"fb10f642-efa8-4864-bd6c-f2f610c6e3f2","Type":"ContainerDied","Data":"1920a8c9d5d073963a939fea4e88f3149092a48f39fb6a708e32b35389e71e2b"}
Sep 06 01:20:01.028315 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:01.028260    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs" event={"ID":"fb10f642-efa8-4864-bd6c-f2f610c6e3f2","Type":"ContainerDied","Data":"18b973f823c3b6b9dc3f5460496f6bb79cc8dcbe7f105d92e353c5c4aca2aa43"}
Sep 06 01:20:01.028315 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:01.028284    2577 scope.go:117] "RemoveContainer" containerID="1920a8c9d5d073963a939fea4e88f3149092a48f39fb6a708e32b35389e71e2b"
Sep 06 01:20:01.034811 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:01.034791    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-istio-podinfo\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:20:01.034811 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:01.034811    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-istio-token\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:20:01.034944 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:01.034819    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9lv6\" (UniqueName: \"kubernetes.io/projected/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-kube-api-access-f9lv6\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:20:01.034944 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:01.034828    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb10f642-efa8-4864-bd6c-f2f610c6e3f2-istio-envoy\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:20:01.038172 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:01.038155    2577 scope.go:117] "RemoveContainer" containerID="74587a33526910265e843312057374a86e63470dbc4138b054d4c9944dbcb14d"
Sep 06 01:20:01.046781 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:01.046764    2577 scope.go:117] "RemoveContainer" containerID="1920a8c9d5d073963a939fea4e88f3149092a48f39fb6a708e32b35389e71e2b"
Sep 06 01:20:01.047059 ip-10-0-140-57 kubenswrapper[2577]: E0906 01:20:01.047040    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1920a8c9d5d073963a939fea4e88f3149092a48f39fb6a708e32b35389e71e2b\": container with ID starting with 1920a8c9d5d073963a939fea4e88f3149092a48f39fb6a708e32b35389e71e2b not found: ID does not exist" containerID="1920a8c9d5d073963a939fea4e88f3149092a48f39fb6a708e32b35389e71e2b"
Sep 06 01:20:01.047106 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:01.047068    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1920a8c9d5d073963a939fea4e88f3149092a48f39fb6a708e32b35389e71e2b"} err="failed to get container status \"1920a8c9d5d073963a939fea4e88f3149092a48f39fb6a708e32b35389e71e2b\": rpc error: code = NotFound desc = could not find container \"1920a8c9d5d073963a939fea4e88f3149092a48f39fb6a708e32b35389e71e2b\": container with ID starting with 1920a8c9d5d073963a939fea4e88f3149092a48f39fb6a708e32b35389e71e2b not found: ID does not exist"
Sep 06 01:20:01.047106 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:01.047084    2577 scope.go:117] "RemoveContainer" containerID="74587a33526910265e843312057374a86e63470dbc4138b054d4c9944dbcb14d"
Sep 06 01:20:01.047355 ip-10-0-140-57 kubenswrapper[2577]: E0906 01:20:01.047311    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74587a33526910265e843312057374a86e63470dbc4138b054d4c9944dbcb14d\": container with ID starting with 74587a33526910265e843312057374a86e63470dbc4138b054d4c9944dbcb14d not found: ID does not exist" containerID="74587a33526910265e843312057374a86e63470dbc4138b054d4c9944dbcb14d"
Sep 06 01:20:01.047405 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:01.047362    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74587a33526910265e843312057374a86e63470dbc4138b054d4c9944dbcb14d"} err="failed to get container status \"74587a33526910265e843312057374a86e63470dbc4138b054d4c9944dbcb14d\": rpc error: code = NotFound desc = could not find container \"74587a33526910265e843312057374a86e63470dbc4138b054d4c9944dbcb14d\": container with ID starting with 74587a33526910265e843312057374a86e63470dbc4138b054d4c9944dbcb14d not found: ID does not exist"
Sep 06 01:20:01.052006 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:01.051984    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"]
Sep 06 01:20:01.058050 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:01.058029    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-5844a8-openshift-default-5d7c9f5496-zpsfs"]
Sep 06 01:20:02.410148 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:02.410115    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb10f642-efa8-4864-bd6c-f2f610c6e3f2" path="/var/lib/kubelet/pods/fb10f642-efa8-4864-bd6c-f2f610c6e3f2/volumes"
Sep 06 01:20:06.469868 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:06.469836    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-470346-8658668d5-w4pvx"]
Sep 06 01:20:06.470432 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:06.470049    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-470346-8658668d5-w4pvx" podUID="1aaea844-35f5-4688-8536-8f5cc1b76319" containerName="payload-processing" containerID="cri-o://ad01e875983b018d9c3eeb6c811bb52a37014c523b34077844229181622d46a8" gracePeriod=30
Sep 06 01:20:06.481287 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:06.479773    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-470346-994b579d6-khxnn"]
Sep 06 01:20:06.481287 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:06.480046    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-470346-994b579d6-khxnn" podUID="b763764d-d8a7-447e-bab8-df1a1ad591d0" containerName="payload-pre-processing" containerID="cri-o://3fe3a6dc4359352c51c61228e149a025abddc42ab327d833f0a3fc8e1af704a0" gracePeriod=30
Sep 06 01:20:06.751958 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:06.751935    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-470346-8658668d5-w4pvx"
Sep 06 01:20:06.754795 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:06.754769    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-470346-994b579d6-khxnn"
Sep 06 01:20:06.890520 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:06.890479    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b763764d-d8a7-447e-bab8-df1a1ad591d0-plugins-config-volume\") pod \"b763764d-d8a7-447e-bab8-df1a1ad591d0\" (UID: \"b763764d-d8a7-447e-bab8-df1a1ad591d0\") "
Sep 06 01:20:06.890723 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:06.890536    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wq2n\" (UniqueName: \"kubernetes.io/projected/b763764d-d8a7-447e-bab8-df1a1ad591d0-kube-api-access-7wq2n\") pod \"b763764d-d8a7-447e-bab8-df1a1ad591d0\" (UID: \"b763764d-d8a7-447e-bab8-df1a1ad591d0\") "
Sep 06 01:20:06.890723 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:06.890571    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7r6cs\" (UniqueName: \"kubernetes.io/projected/1aaea844-35f5-4688-8536-8f5cc1b76319-kube-api-access-7r6cs\") pod \"1aaea844-35f5-4688-8536-8f5cc1b76319\" (UID: \"1aaea844-35f5-4688-8536-8f5cc1b76319\") "
Sep 06 01:20:06.890723 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:06.890648    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1aaea844-35f5-4688-8536-8f5cc1b76319-plugins-config-volume\") pod \"1aaea844-35f5-4688-8536-8f5cc1b76319\" (UID: \"1aaea844-35f5-4688-8536-8f5cc1b76319\") "
Sep 06 01:20:06.890965 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:06.890932    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b763764d-d8a7-447e-bab8-df1a1ad591d0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b763764d-d8a7-447e-bab8-df1a1ad591d0" (UID: "b763764d-d8a7-447e-bab8-df1a1ad591d0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:20:06.891075 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:06.891040    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1aaea844-35f5-4688-8536-8f5cc1b76319-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1aaea844-35f5-4688-8536-8f5cc1b76319" (UID: "1aaea844-35f5-4688-8536-8f5cc1b76319"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:20:06.892846 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:06.892822    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b763764d-d8a7-447e-bab8-df1a1ad591d0-kube-api-access-7wq2n" (OuterVolumeSpecName: "kube-api-access-7wq2n") pod "b763764d-d8a7-447e-bab8-df1a1ad591d0" (UID: "b763764d-d8a7-447e-bab8-df1a1ad591d0"). InnerVolumeSpecName "kube-api-access-7wq2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:20:06.893059 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:06.893039    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1aaea844-35f5-4688-8536-8f5cc1b76319-kube-api-access-7r6cs" (OuterVolumeSpecName: "kube-api-access-7r6cs") pod "1aaea844-35f5-4688-8536-8f5cc1b76319" (UID: "1aaea844-35f5-4688-8536-8f5cc1b76319"). InnerVolumeSpecName "kube-api-access-7r6cs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:20:06.991679 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:06.991598    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7r6cs\" (UniqueName: \"kubernetes.io/projected/1aaea844-35f5-4688-8536-8f5cc1b76319-kube-api-access-7r6cs\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:20:06.991679 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:06.991626    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1aaea844-35f5-4688-8536-8f5cc1b76319-plugins-config-volume\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:20:06.991679 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:06.991636    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b763764d-d8a7-447e-bab8-df1a1ad591d0-plugins-config-volume\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:20:06.991679 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:06.991645    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wq2n\" (UniqueName: \"kubernetes.io/projected/b763764d-d8a7-447e-bab8-df1a1ad591d0-kube-api-access-7wq2n\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:20:07.063639 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:07.063607    2577 generic.go:356] "Generic (PLEG): container finished" podID="b763764d-d8a7-447e-bab8-df1a1ad591d0" containerID="3fe3a6dc4359352c51c61228e149a025abddc42ab327d833f0a3fc8e1af704a0" exitCode=0
Sep 06 01:20:07.063813 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:07.063649    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-470346-994b579d6-khxnn"
Sep 06 01:20:07.063813 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:07.063691    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-470346-994b579d6-khxnn" event={"ID":"b763764d-d8a7-447e-bab8-df1a1ad591d0","Type":"ContainerDied","Data":"3fe3a6dc4359352c51c61228e149a025abddc42ab327d833f0a3fc8e1af704a0"}
Sep 06 01:20:07.063813 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:07.063747    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-470346-994b579d6-khxnn" event={"ID":"b763764d-d8a7-447e-bab8-df1a1ad591d0","Type":"ContainerDied","Data":"f583e6c93d5324ba056b61315b2300abb6d029c95ffa3222ce776ac744046560"}
Sep 06 01:20:07.063813 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:07.063776    2577 scope.go:117] "RemoveContainer" containerID="3fe3a6dc4359352c51c61228e149a025abddc42ab327d833f0a3fc8e1af704a0"
Sep 06 01:20:07.065138 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:07.065072    2577 generic.go:356] "Generic (PLEG): container finished" podID="1aaea844-35f5-4688-8536-8f5cc1b76319" containerID="ad01e875983b018d9c3eeb6c811bb52a37014c523b34077844229181622d46a8" exitCode=0
Sep 06 01:20:07.065138 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:07.065123    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-470346-8658668d5-w4pvx"
Sep 06 01:20:07.065281 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:07.065161    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-470346-8658668d5-w4pvx" event={"ID":"1aaea844-35f5-4688-8536-8f5cc1b76319","Type":"ContainerDied","Data":"ad01e875983b018d9c3eeb6c811bb52a37014c523b34077844229181622d46a8"}
Sep 06 01:20:07.065281 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:07.065207    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-470346-8658668d5-w4pvx" event={"ID":"1aaea844-35f5-4688-8536-8f5cc1b76319","Type":"ContainerDied","Data":"de4f36fe476701a725cfe66308434963a71223409760ce292eeb02f7239770bf"}
Sep 06 01:20:07.081122 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:07.081099    2577 scope.go:117] "RemoveContainer" containerID="3fe3a6dc4359352c51c61228e149a025abddc42ab327d833f0a3fc8e1af704a0"
Sep 06 01:20:07.081447 ip-10-0-140-57 kubenswrapper[2577]: E0906 01:20:07.081422    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fe3a6dc4359352c51c61228e149a025abddc42ab327d833f0a3fc8e1af704a0\": container with ID starting with 3fe3a6dc4359352c51c61228e149a025abddc42ab327d833f0a3fc8e1af704a0 not found: ID does not exist" containerID="3fe3a6dc4359352c51c61228e149a025abddc42ab327d833f0a3fc8e1af704a0"
Sep 06 01:20:07.081501 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:07.081457    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fe3a6dc4359352c51c61228e149a025abddc42ab327d833f0a3fc8e1af704a0"} err="failed to get container status \"3fe3a6dc4359352c51c61228e149a025abddc42ab327d833f0a3fc8e1af704a0\": rpc error: code = NotFound desc = could not find container \"3fe3a6dc4359352c51c61228e149a025abddc42ab327d833f0a3fc8e1af704a0\": container with ID starting with 3fe3a6dc4359352c51c61228e149a025abddc42ab327d833f0a3fc8e1af704a0 not found: ID does not exist"
Sep 06 01:20:07.081501 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:07.081474    2577 scope.go:117] "RemoveContainer" containerID="ad01e875983b018d9c3eeb6c811bb52a37014c523b34077844229181622d46a8"
Sep 06 01:20:07.089510 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:07.089491    2577 scope.go:117] "RemoveContainer" containerID="ad01e875983b018d9c3eeb6c811bb52a37014c523b34077844229181622d46a8"
Sep 06 01:20:07.089792 ip-10-0-140-57 kubenswrapper[2577]: E0906 01:20:07.089774    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad01e875983b018d9c3eeb6c811bb52a37014c523b34077844229181622d46a8\": container with ID starting with ad01e875983b018d9c3eeb6c811bb52a37014c523b34077844229181622d46a8 not found: ID does not exist" containerID="ad01e875983b018d9c3eeb6c811bb52a37014c523b34077844229181622d46a8"
Sep 06 01:20:07.089842 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:07.089800    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad01e875983b018d9c3eeb6c811bb52a37014c523b34077844229181622d46a8"} err="failed to get container status \"ad01e875983b018d9c3eeb6c811bb52a37014c523b34077844229181622d46a8\": rpc error: code = NotFound desc = could not find container \"ad01e875983b018d9c3eeb6c811bb52a37014c523b34077844229181622d46a8\": container with ID starting with ad01e875983b018d9c3eeb6c811bb52a37014c523b34077844229181622d46a8 not found: ID does not exist"
Sep 06 01:20:07.094194 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:07.094172    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-470346-994b579d6-khxnn"]
Sep 06 01:20:07.098291 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:07.098272    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-470346-994b579d6-khxnn"]
Sep 06 01:20:07.108757 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:07.108733    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-470346-8658668d5-w4pvx"]
Sep 06 01:20:07.112686 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:07.112661    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-470346-8658668d5-w4pvx"]
Sep 06 01:20:08.409610 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:08.409578    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1aaea844-35f5-4688-8536-8f5cc1b76319" path="/var/lib/kubelet/pods/1aaea844-35f5-4688-8536-8f5cc1b76319/volumes"
Sep 06 01:20:08.410096 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:08.410073    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b763764d-d8a7-447e-bab8-df1a1ad591d0" path="/var/lib/kubelet/pods/b763764d-d8a7-447e-bab8-df1a1ad591d0/volumes"
Sep 06 01:20:09.269969 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:09.269937    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:20:18.869229 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:18.869192    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:20:42.551113 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:42.551076    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2z66_e100e633-d18a-4d68-9c81-0ff379c12d2f/ovn-acl-logging/0.log"
Sep 06 01:20:42.553465 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:20:42.553437    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2z66_e100e633-d18a-4d68-9c81-0ff379c12d2f/ovn-acl-logging/0.log"
Sep 06 01:21:36.670337 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:21:36.670284    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:21:42.757107 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:21:42.757075    2577 scope.go:117] "RemoveContainer" containerID="d1f50c2b005a7970539184139fc48b2926c1638ee94fe209a4fdc32ad6dd553c"
Sep 06 01:21:42.765549 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:21:42.765531    2577 scope.go:117] "RemoveContainer" containerID="8688457d021f373b071188dba3484c0ce25a320e331d8a620d0107c96f77409d"
Sep 06 01:21:42.773285 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:21:42.773255    2577 scope.go:117] "RemoveContainer" containerID="853ca15ff38f35c86344026054216debc6663bd24f90ac2d40d2545f458734a4"
Sep 06 01:21:42.780475 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:21:42.780457    2577 scope.go:117] "RemoveContainer" containerID="142b71229b8cb6a7a7655c51b3045eaea8717c02c2ee7fd9151ae1e563125832"
Sep 06 01:21:42.787860 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:21:42.787843    2577 scope.go:117] "RemoveContainer" containerID="756b29768fc0b03f91d3f0bcbb2f2de92002de44dbb031647f4d1b793acce2ee"
Sep 06 01:22:02.458134 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:22:02.458103    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:22:09.162763 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:22:09.162727    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:22:16.763061 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:22:16.763030    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:22:25.670876 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:22:25.670836    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:22:39.764382 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:22:39.764345    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:22:42.819105 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:22:42.819073    2577 scope.go:117] "RemoveContainer" containerID="ed805ca987eb137d674c4a371ef69966408a19dbb6ca5ebc1702e3fd5c772dcc"
Sep 06 01:22:46.278877 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:22:46.278843    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:22:47.609777 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:22:47.609740    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-4gwsp"]
Sep 06 01:22:47.612205 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:22:47.609985    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-4gwsp" podUID="31f405f6-e24b-4de0-93b0-8984e3c931dc" containerName="manager" containerID="cri-o://2cd370be517fc09dc68768ef4354fdcaf067b787581ceedf52f449e23726a03f" gracePeriod=10
Sep 06 01:22:49.861581 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:22:49.861555    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-4gwsp"
Sep 06 01:22:49.879738 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:22:49.879717    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zz28\" (UniqueName: \"kubernetes.io/projected/31f405f6-e24b-4de0-93b0-8984e3c931dc-kube-api-access-7zz28\") pod \"31f405f6-e24b-4de0-93b0-8984e3c931dc\" (UID: \"31f405f6-e24b-4de0-93b0-8984e3c931dc\") "
Sep 06 01:22:49.879830 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:22:49.879753    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31f405f6-e24b-4de0-93b0-8984e3c931dc-extensions-socket-volume\") pod \"31f405f6-e24b-4de0-93b0-8984e3c931dc\" (UID: \"31f405f6-e24b-4de0-93b0-8984e3c931dc\") "
Sep 06 01:22:49.880122 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:22:49.880095    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31f405f6-e24b-4de0-93b0-8984e3c931dc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "31f405f6-e24b-4de0-93b0-8984e3c931dc" (UID: "31f405f6-e24b-4de0-93b0-8984e3c931dc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:22:49.882306 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:22:49.882274    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31f405f6-e24b-4de0-93b0-8984e3c931dc-kube-api-access-7zz28" (OuterVolumeSpecName: "kube-api-access-7zz28") pod "31f405f6-e24b-4de0-93b0-8984e3c931dc" (UID: "31f405f6-e24b-4de0-93b0-8984e3c931dc"). InnerVolumeSpecName "kube-api-access-7zz28". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:22:49.947047 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:22:49.947015    2577 generic.go:356] "Generic (PLEG): container finished" podID="31f405f6-e24b-4de0-93b0-8984e3c931dc" containerID="2cd370be517fc09dc68768ef4354fdcaf067b787581ceedf52f449e23726a03f" exitCode=0
Sep 06 01:22:49.947201 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:22:49.947059    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-4gwsp"
Sep 06 01:22:49.947201 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:22:49.947093    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-4gwsp" event={"ID":"31f405f6-e24b-4de0-93b0-8984e3c931dc","Type":"ContainerDied","Data":"2cd370be517fc09dc68768ef4354fdcaf067b787581ceedf52f449e23726a03f"}
Sep 06 01:22:49.947201 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:22:49.947150    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-4gwsp" event={"ID":"31f405f6-e24b-4de0-93b0-8984e3c931dc","Type":"ContainerDied","Data":"9b543cc279d0f7013866a1bd0784580ce033c3f179c877af9c8f4d4dfbdd8898"}
Sep 06 01:22:49.947201 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:22:49.947173    2577 scope.go:117] "RemoveContainer" containerID="2cd370be517fc09dc68768ef4354fdcaf067b787581ceedf52f449e23726a03f"
Sep 06 01:22:49.957061 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:22:49.957044    2577 scope.go:117] "RemoveContainer" containerID="2cd370be517fc09dc68768ef4354fdcaf067b787581ceedf52f449e23726a03f"
Sep 06 01:22:49.957426 ip-10-0-140-57 kubenswrapper[2577]: E0906 01:22:49.957310    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cd370be517fc09dc68768ef4354fdcaf067b787581ceedf52f449e23726a03f\": container with ID starting with 2cd370be517fc09dc68768ef4354fdcaf067b787581ceedf52f449e23726a03f not found: ID does not exist" containerID="2cd370be517fc09dc68768ef4354fdcaf067b787581ceedf52f449e23726a03f"
Sep 06 01:22:49.957492 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:22:49.957420    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cd370be517fc09dc68768ef4354fdcaf067b787581ceedf52f449e23726a03f"} err="failed to get container status \"2cd370be517fc09dc68768ef4354fdcaf067b787581ceedf52f449e23726a03f\": rpc error: code = NotFound desc = could not find container \"2cd370be517fc09dc68768ef4354fdcaf067b787581ceedf52f449e23726a03f\": container with ID starting with 2cd370be517fc09dc68768ef4354fdcaf067b787581ceedf52f449e23726a03f not found: ID does not exist"
Sep 06 01:22:49.972018 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:22:49.971996    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-4gwsp"]
Sep 06 01:22:49.975861 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:22:49.975840    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-4gwsp"]
Sep 06 01:22:49.981251 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:22:49.981229    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zz28\" (UniqueName: \"kubernetes.io/projected/31f405f6-e24b-4de0-93b0-8984e3c931dc-kube-api-access-7zz28\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:22:49.981347 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:22:49.981254    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31f405f6-e24b-4de0-93b0-8984e3c931dc-extensions-socket-volume\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:22:50.410135 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:22:50.410106    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31f405f6-e24b-4de0-93b0-8984e3c931dc" path="/var/lib/kubelet/pods/31f405f6-e24b-4de0-93b0-8984e3c931dc/volumes"
Sep 06 01:23:48.334586 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.334554    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rsvw2"]
Sep 06 01:23:48.335014 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.334935    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b18bbf01-5733-4a75-bd20-723aa696840f" containerName="istio-proxy"
Sep 06 01:23:48.335014 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.334946    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b18bbf01-5733-4a75-bd20-723aa696840f" containerName="istio-proxy"
Sep 06 01:23:48.335014 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.334960    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb10f642-efa8-4864-bd6c-f2f610c6e3f2" containerName="istio-proxy"
Sep 06 01:23:48.335014 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.334966    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb10f642-efa8-4864-bd6c-f2f610c6e3f2" containerName="istio-proxy"
Sep 06 01:23:48.335014 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.334976    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1aaea844-35f5-4688-8536-8f5cc1b76319" containerName="payload-processing"
Sep 06 01:23:48.335014 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.334981    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1aaea844-35f5-4688-8536-8f5cc1b76319" containerName="payload-processing"
Sep 06 01:23:48.335014 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.334987    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed7b10fd-46c2-4be0-91db-6e756dc33c9d" containerName="istio-proxy"
Sep 06 01:23:48.335014 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.334992    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed7b10fd-46c2-4be0-91db-6e756dc33c9d" containerName="istio-proxy"
Sep 06 01:23:48.335014 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.335000    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e553d9c-cd03-40c4-9010-5f5e49d2e337" containerName="revoke-keys"
Sep 06 01:23:48.335014 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.335005    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e553d9c-cd03-40c4-9010-5f5e49d2e337" containerName="revoke-keys"
Sep 06 01:23:48.335014 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.335011    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed7b10fd-46c2-4be0-91db-6e756dc33c9d" containerName="istio-proxy"
Sep 06 01:23:48.335014 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.335016    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed7b10fd-46c2-4be0-91db-6e756dc33c9d" containerName="istio-proxy"
Sep 06 01:23:48.335484 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.335026    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f326d5de-4074-4535-9d36-846f3e2c0561" containerName="payload-pre-processing"
Sep 06 01:23:48.335484 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.335031    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f326d5de-4074-4535-9d36-846f3e2c0561" containerName="payload-pre-processing"
Sep 06 01:23:48.335484 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.335038    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a21771ae-a2c0-4d7f-8f4c-cfce9eb1a474" containerName="payload-processing"
Sep 06 01:23:48.335484 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.335043    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a21771ae-a2c0-4d7f-8f4c-cfce9eb1a474" containerName="payload-processing"
Sep 06 01:23:48.335484 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.335048    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2feb306e-a0c3-45bb-aad2-d67e232316d3" containerName="payload-pre-processing"
Sep 06 01:23:48.335484 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.335053    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2feb306e-a0c3-45bb-aad2-d67e232316d3" containerName="payload-pre-processing"
Sep 06 01:23:48.335484 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.335062    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b763764d-d8a7-447e-bab8-df1a1ad591d0" containerName="payload-pre-processing"
Sep 06 01:23:48.335484 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.335067    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b763764d-d8a7-447e-bab8-df1a1ad591d0" containerName="payload-pre-processing"
Sep 06 01:23:48.335484 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.335077    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31f405f6-e24b-4de0-93b0-8984e3c931dc" containerName="manager"
Sep 06 01:23:48.335484 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.335082    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="31f405f6-e24b-4de0-93b0-8984e3c931dc" containerName="manager"
Sep 06 01:23:48.335484 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.335137    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b18bbf01-5733-4a75-bd20-723aa696840f" containerName="istio-proxy"
Sep 06 01:23:48.335484 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.335144    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb10f642-efa8-4864-bd6c-f2f610c6e3f2" containerName="istio-proxy"
Sep 06 01:23:48.335484 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.335151    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e553d9c-cd03-40c4-9010-5f5e49d2e337" containerName="revoke-keys"
Sep 06 01:23:48.335484 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.335159    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f326d5de-4074-4535-9d36-846f3e2c0561" containerName="payload-pre-processing"
Sep 06 01:23:48.335484 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.335165    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1aaea844-35f5-4688-8536-8f5cc1b76319" containerName="payload-processing"
Sep 06 01:23:48.335484 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.335171    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed7b10fd-46c2-4be0-91db-6e756dc33c9d" containerName="istio-proxy"
Sep 06 01:23:48.335484 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.335177    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2feb306e-a0c3-45bb-aad2-d67e232316d3" containerName="payload-pre-processing"
Sep 06 01:23:48.335484 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.335181    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="31f405f6-e24b-4de0-93b0-8984e3c931dc" containerName="manager"
Sep 06 01:23:48.335484 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.335186    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a21771ae-a2c0-4d7f-8f4c-cfce9eb1a474" containerName="payload-processing"
Sep 06 01:23:48.335484 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.335191    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b763764d-d8a7-447e-bab8-df1a1ad591d0" containerName="payload-pre-processing"
Sep 06 01:23:48.335484 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.335196    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed7b10fd-46c2-4be0-91db-6e756dc33c9d" containerName="istio-proxy"
Sep 06 01:23:48.338176 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.338158    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rsvw2"
Sep 06 01:23:48.340863 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.340845    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wk55k\""
Sep 06 01:23:48.353695 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.353669    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rsvw2"]
Sep 06 01:23:48.415853 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.415812    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvwzz\" (UniqueName: \"kubernetes.io/projected/0a8f1119-7aa3-41aa-b741-336304c5e12b-kube-api-access-tvwzz\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-rsvw2\" (UID: \"0a8f1119-7aa3-41aa-b741-336304c5e12b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rsvw2"
Sep 06 01:23:48.416016 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.415871    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a8f1119-7aa3-41aa-b741-336304c5e12b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-rsvw2\" (UID: \"0a8f1119-7aa3-41aa-b741-336304c5e12b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rsvw2"
Sep 06 01:23:48.517111 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.517073    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvwzz\" (UniqueName: \"kubernetes.io/projected/0a8f1119-7aa3-41aa-b741-336304c5e12b-kube-api-access-tvwzz\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-rsvw2\" (UID: \"0a8f1119-7aa3-41aa-b741-336304c5e12b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rsvw2"
Sep 06 01:23:48.517271 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.517131    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a8f1119-7aa3-41aa-b741-336304c5e12b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-rsvw2\" (UID: \"0a8f1119-7aa3-41aa-b741-336304c5e12b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rsvw2"
Sep 06 01:23:48.517540 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.517522    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a8f1119-7aa3-41aa-b741-336304c5e12b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-rsvw2\" (UID: \"0a8f1119-7aa3-41aa-b741-336304c5e12b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rsvw2"
Sep 06 01:23:48.525472 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.525440    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvwzz\" (UniqueName: \"kubernetes.io/projected/0a8f1119-7aa3-41aa-b741-336304c5e12b-kube-api-access-tvwzz\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-rsvw2\" (UID: \"0a8f1119-7aa3-41aa-b741-336304c5e12b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rsvw2"
Sep 06 01:23:48.648366 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.648256    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rsvw2"
Sep 06 01:23:48.930911 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:48.930888    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rsvw2"]
Sep 06 01:23:48.933330 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:23:48.933281    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a8f1119_7aa3_41aa_b741_336304c5e12b.slice/crio-23ea3e7c1430bdd65f77b3da7996a5581c39bcc97adc5a11e91b4bed465a594d WatchSource:0}: Error finding container 23ea3e7c1430bdd65f77b3da7996a5581c39bcc97adc5a11e91b4bed465a594d: Status 404 returned error can't find the container with id 23ea3e7c1430bdd65f77b3da7996a5581c39bcc97adc5a11e91b4bed465a594d
Sep 06 01:23:49.248834 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:49.248744    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rsvw2" event={"ID":"0a8f1119-7aa3-41aa-b741-336304c5e12b","Type":"ContainerStarted","Data":"a3ab10b118465517fa9a70c59839a321a5b6e14daf3a8f30f67387c225fb4ffc"}
Sep 06 01:23:49.248834 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:49.248797    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rsvw2" event={"ID":"0a8f1119-7aa3-41aa-b741-336304c5e12b","Type":"ContainerStarted","Data":"23ea3e7c1430bdd65f77b3da7996a5581c39bcc97adc5a11e91b4bed465a594d"}
Sep 06 01:23:49.249048 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:49.248835    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rsvw2"
Sep 06 01:23:49.269885 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:23:49.269828    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rsvw2" podStartSLOduration=1.269810546 podStartE2EDuration="1.269810546s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:23:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:23:49.267484483 +0000 UTC m=+1987.303627441" watchObservedRunningTime="2026-09-06 01:23:49.269810546 +0000 UTC m=+1987.305953499"
Sep 06 01:24:00.257576 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:24:00.257540    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rsvw2"
Sep 06 01:24:11.870431 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:24:11.870388    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:24:20.364850 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:24:20.364813    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:24:33.064197 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:24:33.064162    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f"]
Sep 06 01:24:33.064801 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:24:33.064776    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b18bbf01-5733-4a75-bd20-723aa696840f" containerName="istio-proxy"
Sep 06 01:24:33.064801 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:24:33.064797    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b18bbf01-5733-4a75-bd20-723aa696840f" containerName="istio-proxy"
Sep 06 01:24:33.064937 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:24:33.064815    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb10f642-efa8-4864-bd6c-f2f610c6e3f2" containerName="istio-proxy"
Sep 06 01:24:33.064937 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:24:33.064821    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb10f642-efa8-4864-bd6c-f2f610c6e3f2" containerName="istio-proxy"
Sep 06 01:24:33.065011 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:24:33.064935    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b18bbf01-5733-4a75-bd20-723aa696840f" containerName="istio-proxy"
Sep 06 01:24:33.065011 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:24:33.064954    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb10f642-efa8-4864-bd6c-f2f610c6e3f2" containerName="istio-proxy"
Sep 06 01:24:33.068509 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:24:33.068491    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f"
Sep 06 01:24:33.070825 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:24:33.070806    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-9938c132-kserve-self-signed-certs\""
Sep 06 01:24:33.077560 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:24:33.077537    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f"]
Sep 06 01:24:33.142123 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:24:33.142087    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4586038-7069-492b-bf86-111a2b77a38f-model-cache\") pod \"e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f\" (UID: \"c4586038-7069-492b-bf86-111a2b77a38f\") " pod="llm/e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f"
Sep 06 01:24:33.142282 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:24:33.142133    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lqps\" (UniqueName: \"kubernetes.io/projected/c4586038-7069-492b-bf86-111a2b77a38f-kube-api-access-6lqps\") pod \"e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f\" (UID: \"c4586038-7069-492b-bf86-111a2b77a38f\") " pod="llm/e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f"
Sep 06 01:24:33.142282 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:24:33.142197    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4586038-7069-492b-bf86-111a2b77a38f-tls-certs\") pod \"e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f\" (UID: \"c4586038-7069-492b-bf86-111a2b77a38f\") " pod="llm/e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f"
Sep 06 01:24:33.142282 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:24:33.142245    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4586038-7069-492b-bf86-111a2b77a38f-tmp-dir\") pod \"e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f\" (UID: \"c4586038-7069-492b-bf86-111a2b77a38f\") " pod="llm/e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f"
Sep 06 01:24:33.142282 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:24:33.142274    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4586038-7069-492b-bf86-111a2b77a38f-home\") pod \"e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f\" (UID: \"c4586038-7069-492b-bf86-111a2b77a38f\") " pod="llm/e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f"
Sep 06 01:24:33.142460 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:24:33.142346    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4586038-7069-492b-bf86-111a2b77a38f-dshm\") pod \"e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f\" (UID: \"c4586038-7069-492b-bf86-111a2b77a38f\") " pod="llm/e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f"
Sep 06 01:24:33.243137 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:24:33.243099    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4586038-7069-492b-bf86-111a2b77a38f-tmp-dir\") pod \"e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f\" (UID: \"c4586038-7069-492b-bf86-111a2b77a38f\") " pod="llm/e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f"
Sep 06 01:24:33.243383 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:24:33.243151    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4586038-7069-492b-bf86-111a2b77a38f-home\") pod \"e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f\" (UID: \"c4586038-7069-492b-bf86-111a2b77a38f\") " pod="llm/e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f"
Sep 06 01:24:33.243383 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:24:33.243205    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4586038-7069-492b-bf86-111a2b77a38f-dshm\") pod \"e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f\" (UID: \"c4586038-7069-492b-bf86-111a2b77a38f\") " pod="llm/e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f"
Sep 06 01:24:33.243383 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:24:33.243287    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4586038-7069-492b-bf86-111a2b77a38f-model-cache\") pod \"e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f\" (UID: \"c4586038-7069-492b-bf86-111a2b77a38f\") " pod="llm/e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f"
Sep 06 01:24:33.243383 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:24:33.243360    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lqps\" (UniqueName: \"kubernetes.io/projected/c4586038-7069-492b-bf86-111a2b77a38f-kube-api-access-6lqps\") pod \"e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f\" (UID: \"c4586038-7069-492b-bf86-111a2b77a38f\") " pod="llm/e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f"
Sep 06 01:24:33.243636 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:24:33.243390    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4586038-7069-492b-bf86-111a2b77a38f-tls-certs\") pod \"e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f\" (UID: \"c4586038-7069-492b-bf86-111a2b77a38f\") " pod="llm/e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f"
Sep 06 01:24:33.243636 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:24:33.243557    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4586038-7069-492b-bf86-111a2b77a38f-tmp-dir\") pod \"e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f\" (UID: \"c4586038-7069-492b-bf86-111a2b77a38f\") " pod="llm/e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f"
Sep 06 01:24:33.243636 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:24:33.243599    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4586038-7069-492b-bf86-111a2b77a38f-home\") pod \"e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f\" (UID: \"c4586038-7069-492b-bf86-111a2b77a38f\") " pod="llm/e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f"
Sep 06 01:24:33.243801 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:24:33.243657    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4586038-7069-492b-bf86-111a2b77a38f-model-cache\") pod \"e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f\" (UID: \"c4586038-7069-492b-bf86-111a2b77a38f\") " pod="llm/e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f"
Sep 06 01:24:33.245763 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:24:33.245732    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4586038-7069-492b-bf86-111a2b77a38f-dshm\") pod \"e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f\" (UID: \"c4586038-7069-492b-bf86-111a2b77a38f\") " pod="llm/e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f"
Sep 06 01:24:33.245917 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:24:33.245900    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4586038-7069-492b-bf86-111a2b77a38f-tls-certs\") pod \"e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f\" (UID: \"c4586038-7069-492b-bf86-111a2b77a38f\") " pod="llm/e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f"
Sep 06 01:24:33.251257 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:24:33.251234    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lqps\" (UniqueName: \"kubernetes.io/projected/c4586038-7069-492b-bf86-111a2b77a38f-kube-api-access-6lqps\") pod \"e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f\" (UID: \"c4586038-7069-492b-bf86-111a2b77a38f\") " pod="llm/e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f"
Sep 06 01:24:33.378575 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:24:33.378485    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f"
Sep 06 01:24:33.652925 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:24:33.652902    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f"]
Sep 06 01:24:33.654821 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:24:33.654792    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc4586038_7069_492b_bf86_111a2b77a38f.slice/crio-1ec3c6299394d6e250a59d253fde1870b1ab030ea409a0021167f89580628fe9 WatchSource:0}: Error finding container 1ec3c6299394d6e250a59d253fde1870b1ab030ea409a0021167f89580628fe9: Status 404 returned error can't find the container with id 1ec3c6299394d6e250a59d253fde1870b1ab030ea409a0021167f89580628fe9
Sep 06 01:24:34.484603 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:24:34.484566    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f" event={"ID":"c4586038-7069-492b-bf86-111a2b77a38f","Type":"ContainerStarted","Data":"70079f2e00bdf58c1aa09f91ca541b4c314e83bfe68877318a1ef324e8951fb1"}
Sep 06 01:24:34.484603 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:24:34.484605    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f" event={"ID":"c4586038-7069-492b-bf86-111a2b77a38f","Type":"ContainerStarted","Data":"1ec3c6299394d6e250a59d253fde1870b1ab030ea409a0021167f89580628fe9"}
Sep 06 01:24:34.504106 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:24:34.504059    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f" podStartSLOduration=1.504043177 podStartE2EDuration="1.504043177s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:24:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:24:34.501987349 +0000 UTC m=+2032.538130307" watchObservedRunningTime="2026-09-06 01:24:34.504043177 +0000 UTC m=+2032.540186135"
Sep 06 01:24:35.664190 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:24:35.664154    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:24:42.849819 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:24:42.849790    2577 scope.go:117] "RemoveContainer" containerID="8fdb8dc2017fe720c6a181daa84366289b28bbf5396c2ace4569c2504cddc799"
Sep 06 01:24:43.378967 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:24:43.378930    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f"
Sep 06 01:24:43.379199 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:24:43.378981    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f"
Sep 06 01:24:43.392048 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:24:43.392024    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f"
Sep 06 01:24:43.543343 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:24:43.543291    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f"
Sep 06 01:24:59.866666 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:24:59.866624    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:25:14.071690 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:14.071652    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f"]
Sep 06 01:25:16.067984 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:16.067944    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:25:25.463686 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:25.463648    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:25:29.092750 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:29.092703    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f" podUID="c4586038-7069-492b-bf86-111a2b77a38f" containerName="main" containerID="cri-o://70079f2e00bdf58c1aa09f91ca541b4c314e83bfe68877318a1ef324e8951fb1" gracePeriod=45
Sep 06 01:25:29.353697 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:29.353633    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f"
Sep 06 01:25:29.391068 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:29.391038    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4586038-7069-492b-bf86-111a2b77a38f-model-cache\") pod \"c4586038-7069-492b-bf86-111a2b77a38f\" (UID: \"c4586038-7069-492b-bf86-111a2b77a38f\") "
Sep 06 01:25:29.391240 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:29.391104    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4586038-7069-492b-bf86-111a2b77a38f-dshm\") pod \"c4586038-7069-492b-bf86-111a2b77a38f\" (UID: \"c4586038-7069-492b-bf86-111a2b77a38f\") "
Sep 06 01:25:29.391240 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:29.391130    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4586038-7069-492b-bf86-111a2b77a38f-home\") pod \"c4586038-7069-492b-bf86-111a2b77a38f\" (UID: \"c4586038-7069-492b-bf86-111a2b77a38f\") "
Sep 06 01:25:29.391240 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:29.391217    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4586038-7069-492b-bf86-111a2b77a38f-tmp-dir\") pod \"c4586038-7069-492b-bf86-111a2b77a38f\" (UID: \"c4586038-7069-492b-bf86-111a2b77a38f\") "
Sep 06 01:25:29.391444 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:29.391246    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6lqps\" (UniqueName: \"kubernetes.io/projected/c4586038-7069-492b-bf86-111a2b77a38f-kube-api-access-6lqps\") pod \"c4586038-7069-492b-bf86-111a2b77a38f\" (UID: \"c4586038-7069-492b-bf86-111a2b77a38f\") "
Sep 06 01:25:29.391444 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:29.391276    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4586038-7069-492b-bf86-111a2b77a38f-tls-certs\") pod \"c4586038-7069-492b-bf86-111a2b77a38f\" (UID: \"c4586038-7069-492b-bf86-111a2b77a38f\") "
Sep 06 01:25:29.391444 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:29.391370    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4586038-7069-492b-bf86-111a2b77a38f-model-cache" (OuterVolumeSpecName: "model-cache") pod "c4586038-7069-492b-bf86-111a2b77a38f" (UID: "c4586038-7069-492b-bf86-111a2b77a38f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:25:29.391604 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:29.391511    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4586038-7069-492b-bf86-111a2b77a38f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c4586038-7069-492b-bf86-111a2b77a38f" (UID: "c4586038-7069-492b-bf86-111a2b77a38f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:25:29.391604 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:29.391524    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4586038-7069-492b-bf86-111a2b77a38f-home" (OuterVolumeSpecName: "home") pod "c4586038-7069-492b-bf86-111a2b77a38f" (UID: "c4586038-7069-492b-bf86-111a2b77a38f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:25:29.391713 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:29.391653    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4586038-7069-492b-bf86-111a2b77a38f-home\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:25:29.391713 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:29.391672    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4586038-7069-492b-bf86-111a2b77a38f-tmp-dir\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:25:29.391713 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:29.391685    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4586038-7069-492b-bf86-111a2b77a38f-model-cache\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:25:29.393611 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:29.393570    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4586038-7069-492b-bf86-111a2b77a38f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c4586038-7069-492b-bf86-111a2b77a38f" (UID: "c4586038-7069-492b-bf86-111a2b77a38f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:25:29.393739 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:29.393612    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4586038-7069-492b-bf86-111a2b77a38f-kube-api-access-6lqps" (OuterVolumeSpecName: "kube-api-access-6lqps") pod "c4586038-7069-492b-bf86-111a2b77a38f" (UID: "c4586038-7069-492b-bf86-111a2b77a38f"). InnerVolumeSpecName "kube-api-access-6lqps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:25:29.393739 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:29.393728    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4586038-7069-492b-bf86-111a2b77a38f-dshm" (OuterVolumeSpecName: "dshm") pod "c4586038-7069-492b-bf86-111a2b77a38f" (UID: "c4586038-7069-492b-bf86-111a2b77a38f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:25:29.492250 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:29.492191    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4586038-7069-492b-bf86-111a2b77a38f-tls-certs\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:25:29.492250 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:29.492238    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4586038-7069-492b-bf86-111a2b77a38f-dshm\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:25:29.492250 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:29.492252    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6lqps\" (UniqueName: \"kubernetes.io/projected/c4586038-7069-492b-bf86-111a2b77a38f-kube-api-access-6lqps\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:25:29.778830 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:29.778796    2577 generic.go:356] "Generic (PLEG): container finished" podID="c4586038-7069-492b-bf86-111a2b77a38f" containerID="70079f2e00bdf58c1aa09f91ca541b4c314e83bfe68877318a1ef324e8951fb1" exitCode=0
Sep 06 01:25:29.779038 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:29.778839    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f"
Sep 06 01:25:29.779038 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:29.778886    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f" event={"ID":"c4586038-7069-492b-bf86-111a2b77a38f","Type":"ContainerDied","Data":"70079f2e00bdf58c1aa09f91ca541b4c314e83bfe68877318a1ef324e8951fb1"}
Sep 06 01:25:29.779038 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:29.778931    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f" event={"ID":"c4586038-7069-492b-bf86-111a2b77a38f","Type":"ContainerDied","Data":"1ec3c6299394d6e250a59d253fde1870b1ab030ea409a0021167f89580628fe9"}
Sep 06 01:25:29.779038 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:29.778953    2577 scope.go:117] "RemoveContainer" containerID="70079f2e00bdf58c1aa09f91ca541b4c314e83bfe68877318a1ef324e8951fb1"
Sep 06 01:25:29.788479 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:29.788463    2577 scope.go:117] "RemoveContainer" containerID="70079f2e00bdf58c1aa09f91ca541b4c314e83bfe68877318a1ef324e8951fb1"
Sep 06 01:25:29.788760 ip-10-0-140-57 kubenswrapper[2577]: E0906 01:25:29.788740    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70079f2e00bdf58c1aa09f91ca541b4c314e83bfe68877318a1ef324e8951fb1\": container with ID starting with 70079f2e00bdf58c1aa09f91ca541b4c314e83bfe68877318a1ef324e8951fb1 not found: ID does not exist" containerID="70079f2e00bdf58c1aa09f91ca541b4c314e83bfe68877318a1ef324e8951fb1"
Sep 06 01:25:29.788830 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:29.788771    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70079f2e00bdf58c1aa09f91ca541b4c314e83bfe68877318a1ef324e8951fb1"} err="failed to get container status \"70079f2e00bdf58c1aa09f91ca541b4c314e83bfe68877318a1ef324e8951fb1\": rpc error: code = NotFound desc = could not find container \"70079f2e00bdf58c1aa09f91ca541b4c314e83bfe68877318a1ef324e8951fb1\": container with ID starting with 70079f2e00bdf58c1aa09f91ca541b4c314e83bfe68877318a1ef324e8951fb1 not found: ID does not exist"
Sep 06 01:25:29.803227 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:29.802736    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f"]
Sep 06 01:25:29.807799 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:29.807768    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-9938c132-kserve-5d449ccdbc-pvh6f"]
Sep 06 01:25:30.409682 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:30.409649    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4586038-7069-492b-bf86-111a2b77a38f" path="/var/lib/kubelet/pods/c4586038-7069-492b-bf86-111a2b77a38f/volumes"
Sep 06 01:25:35.004869 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:35.004836    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7b97c6dbfb-rwwq9"]
Sep 06 01:25:35.005359 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:35.005256    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4586038-7069-492b-bf86-111a2b77a38f" containerName="main"
Sep 06 01:25:35.005359 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:35.005269    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4586038-7069-492b-bf86-111a2b77a38f" containerName="main"
Sep 06 01:25:35.005359 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:35.005348    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4586038-7069-492b-bf86-111a2b77a38f" containerName="main"
Sep 06 01:25:35.010129 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:35.010108    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-rwwq9"
Sep 06 01:25:35.013759 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:35.013731    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vb24r\""
Sep 06 01:25:35.013759 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:35.013750    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 06 01:25:35.013970 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:35.013779    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 06 01:25:35.018857 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:35.018832    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b97c6dbfb-rwwq9"]
Sep 06 01:25:35.044283 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:35.044251    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgbhv\" (UniqueName: \"kubernetes.io/projected/cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365-kube-api-access-zgbhv\") pod \"maas-api-7b97c6dbfb-rwwq9\" (UID: \"cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365\") " pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-rwwq9"
Sep 06 01:25:35.044504 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:35.044313    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365-maas-api-tls\") pod \"maas-api-7b97c6dbfb-rwwq9\" (UID: \"cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365\") " pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-rwwq9"
Sep 06 01:25:35.044504 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:35.044357    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365-openshift-service-ca\") pod \"maas-api-7b97c6dbfb-rwwq9\" (UID: \"cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365\") " pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-rwwq9"
Sep 06 01:25:35.044504 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:35.044377    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365-metrics-certs\") pod \"maas-api-7b97c6dbfb-rwwq9\" (UID: \"cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365\") " pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-rwwq9"
Sep 06 01:25:35.145208 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:35.145169    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365-maas-api-tls\") pod \"maas-api-7b97c6dbfb-rwwq9\" (UID: \"cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365\") " pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-rwwq9"
Sep 06 01:25:35.145208 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:35.145214    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365-openshift-service-ca\") pod \"maas-api-7b97c6dbfb-rwwq9\" (UID: \"cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365\") " pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-rwwq9"
Sep 06 01:25:35.145493 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:35.145244    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365-metrics-certs\") pod \"maas-api-7b97c6dbfb-rwwq9\" (UID: \"cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365\") " pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-rwwq9"
Sep 06 01:25:35.145493 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:35.145339    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgbhv\" (UniqueName: \"kubernetes.io/projected/cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365-kube-api-access-zgbhv\") pod \"maas-api-7b97c6dbfb-rwwq9\" (UID: \"cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365\") " pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-rwwq9"
Sep 06 01:25:35.145995 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:35.145971    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365-openshift-service-ca\") pod \"maas-api-7b97c6dbfb-rwwq9\" (UID: \"cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365\") " pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-rwwq9"
Sep 06 01:25:35.147873 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:35.147842    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365-maas-api-tls\") pod \"maas-api-7b97c6dbfb-rwwq9\" (UID: \"cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365\") " pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-rwwq9"
Sep 06 01:25:35.147955 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:35.147842    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365-metrics-certs\") pod \"maas-api-7b97c6dbfb-rwwq9\" (UID: \"cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365\") " pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-rwwq9"
Sep 06 01:25:35.152659 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:35.152635    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgbhv\" (UniqueName: \"kubernetes.io/projected/cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365-kube-api-access-zgbhv\") pod \"maas-api-7b97c6dbfb-rwwq9\" (UID: \"cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365\") " pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-rwwq9"
Sep 06 01:25:35.322818 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:35.322723    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-rwwq9"
Sep 06 01:25:35.607808 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:35.606498    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b97c6dbfb-rwwq9"]
Sep 06 01:25:35.610292 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:25:35.610268    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdb9fd4d_dd18_4723_ac4d_3f1b56c8e365.slice/crio-e70038c0f11ae3c180f5ed399e761e377218f5363881236ae809a35a3b800a3b WatchSource:0}: Error finding container e70038c0f11ae3c180f5ed399e761e377218f5363881236ae809a35a3b800a3b: Status 404 returned error can't find the container with id e70038c0f11ae3c180f5ed399e761e377218f5363881236ae809a35a3b800a3b
Sep 06 01:25:35.612272 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:35.612250    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 01:25:35.811286 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:35.811248    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-rwwq9" event={"ID":"cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365","Type":"ContainerStarted","Data":"e70038c0f11ae3c180f5ed399e761e377218f5363881236ae809a35a3b800a3b"}
Sep 06 01:25:36.055710 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:36.055675    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:25:38.828555 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:38.828522    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-rwwq9" event={"ID":"cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365","Type":"ContainerStarted","Data":"fcde8efa1100f5149f6c69c80cafa395f00e9aecb97e042611b5fb3e695d818b"}
Sep 06 01:25:38.828954 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:38.828631    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-rwwq9"
Sep 06 01:25:38.844997 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:38.844936    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-rwwq9" podStartSLOduration=2.504473417 podStartE2EDuration="4.844919999s" totalImagesPullingTime="2.340446582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:25:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:25:38.844091832 +0000 UTC m=+2096.880234790" watchObservedRunningTime="2026-09-06 01:25:38.844919999 +0000 UTC m=+2096.881062991"
Sep 06 01:25:42.589226 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:42.589194    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2z66_e100e633-d18a-4d68-9c81-0ff379c12d2f/ovn-acl-logging/0.log"
Sep 06 01:25:42.593032 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:42.593011    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2z66_e100e633-d18a-4d68-9c81-0ff379c12d2f/ovn-acl-logging/0.log"
Sep 06 01:25:42.600752 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:42.600725    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b97c6dbfb-rwwq9"]
Sep 06 01:25:42.600994 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:42.600943    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-rwwq9" podUID="cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365" containerName="maas-api" containerID="cri-o://fcde8efa1100f5149f6c69c80cafa395f00e9aecb97e042611b5fb3e695d818b" gracePeriod=30
Sep 06 01:25:42.853641 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:42.853611    2577 generic.go:356] "Generic (PLEG): container finished" podID="cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365" containerID="fcde8efa1100f5149f6c69c80cafa395f00e9aecb97e042611b5fb3e695d818b" exitCode=0
Sep 06 01:25:42.853789 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:42.853682    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-rwwq9" event={"ID":"cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365","Type":"ContainerDied","Data":"fcde8efa1100f5149f6c69c80cafa395f00e9aecb97e042611b5fb3e695d818b"}
Sep 06 01:25:42.853789 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:42.853736    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-rwwq9" event={"ID":"cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365","Type":"ContainerDied","Data":"e70038c0f11ae3c180f5ed399e761e377218f5363881236ae809a35a3b800a3b"}
Sep 06 01:25:42.853789 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:42.853754    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e70038c0f11ae3c180f5ed399e761e377218f5363881236ae809a35a3b800a3b"
Sep 06 01:25:42.857975 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:42.857955    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-rwwq9"
Sep 06 01:25:42.925458 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:42.925418    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365-metrics-certs\") pod \"cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365\" (UID: \"cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365\") "
Sep 06 01:25:42.925458 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:42.925459    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365-openshift-service-ca\") pod \"cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365\" (UID: \"cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365\") "
Sep 06 01:25:42.925679 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:42.925529    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zgbhv\" (UniqueName: \"kubernetes.io/projected/cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365-kube-api-access-zgbhv\") pod \"cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365\" (UID: \"cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365\") "
Sep 06 01:25:42.925679 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:42.925587    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365-maas-api-tls\") pod \"cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365\" (UID: \"cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365\") "
Sep 06 01:25:42.925904 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:42.925881    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365" (UID: "cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:25:42.927825 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:42.927792    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365" (UID: "cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:25:42.927965 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:42.927831    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365" (UID: "cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:25:42.927965 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:42.927844    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365-kube-api-access-zgbhv" (OuterVolumeSpecName: "kube-api-access-zgbhv") pod "cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365" (UID: "cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365"). InnerVolumeSpecName "kube-api-access-zgbhv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:25:43.026308 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:43.026279    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365-metrics-certs\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:25:43.026308 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:43.026304    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365-openshift-service-ca\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:25:43.026308 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:43.026331    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgbhv\" (UniqueName: \"kubernetes.io/projected/cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365-kube-api-access-zgbhv\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:25:43.026645 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:43.026344    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365-maas-api-tls\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Sep 06 01:25:43.271842 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:43.271807    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:25:43.858936 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:43.858907    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7b97c6dbfb-rwwq9"
Sep 06 01:25:43.882257 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:43.882226    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b97c6dbfb-rwwq9"]
Sep 06 01:25:43.885827 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:43.885800    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b97c6dbfb-rwwq9"]
Sep 06 01:25:44.412186 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:44.412139    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365" path="/var/lib/kubelet/pods/cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365/volumes"
Sep 06 01:25:52.763454 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:25:52.763423    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:26:00.791492 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:00.791455    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:26:06.963611 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:06.963571    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-pq2zk"]
Sep 06 01:26:15.930297 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:15.930267    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-w9sjm_111f4bc9-8160-459c-b8c5-c1edbecfda2c/manager/0.log"
Sep 06 01:26:16.067248 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:16.067219    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-75x5s_cc52dd8b-6f2f-4ad2-b172-b8494ede1e61/manager/0.log"
Sep 06 01:26:16.586354 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:16.586289    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79dff7ddb6-g2fhq_bed80868-695e-4962-ae19-9497a12168e0/copy-manifests/0.log"
Sep 06 01:26:16.598581 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:16.598546    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79dff7ddb6-g2fhq_bed80868-695e-4962-ae19-9497a12168e0/manager/0.log"
Sep 06 01:26:17.583262 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:17.583227    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-mrtrr_3698e84d-ad0a-4e99-a0df-6c87f8c47f93/postgres/0.log"
Sep 06 01:26:18.533333 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:18.533295    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-7prsb_a5ee4e84-8409-4762-aa12-f9a241bd75c0/manager/0.log"
Sep 06 01:26:18.655030 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:18.655005    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-ktbqp_a8e69bfe-bb43-4293-899b-72fcf6fa1cea/manager/0.log"
Sep 06 01:26:18.768691 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:18.768661    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-pcpxx_1c71d770-85cc-4826-bb1c-959ff63842a1/kuadrant-console-plugin/0.log"
Sep 06 01:26:18.896348 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:18.896254    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-rsvw2_0a8f1119-7aa3-41aa-b741-336304c5e12b/manager/0.log"
Sep 06 01:26:19.033339 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:19.033305    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-pq2zk_9fc17157-d507-49de-af37-6b54f834e58d/limitador/0.log"
Sep 06 01:26:19.173191 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:19.173156    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-5wph6_91b7bfee-2147-41dd-967a-3758ab796e8b/manager/0.log"
Sep 06 01:26:19.793793 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:19.793762    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5cb67ffb98-nq844_0795e942-befb-4b46-bece-2cf28ea1566e/kube-auth-proxy/0.log"
Sep 06 01:26:20.040485 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:20.040454    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4gqt9_008a77a0-2765-4ab1-ac54-70ba224c7ad2/istio-proxy/1.log"
Sep 06 01:26:20.167611 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:20.167579    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-zt47h_b04e7bbd-93f4-4e03-a4c4-734ae28721c4/payload-pre-processing/0.log"
Sep 06 01:26:20.897772 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:20.897739    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-54mtt_f9ae5185-76f3-433b-9a1e-d3916d71d025/main/0.log"
Sep 06 01:26:21.257695 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:21.257665    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6gfv2_c2b63864-a518-4d3f-9936-8d815c876ff2/main/0.log"
Sep 06 01:26:21.381496 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:21.381467    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-hvtc5_150005cd-9a0c-42e3-a8c9-7b2d1f3aecaa/main/0.log"
Sep 06 01:26:27.074661 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:27.074628    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4r8dp/must-gather-9dzsr"]
Sep 06 01:26:27.075055 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:27.075022    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365" containerName="maas-api"
Sep 06 01:26:27.075055 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:27.075033    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365" containerName="maas-api"
Sep 06 01:26:27.075134 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:27.075112    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdb9fd4d-dd18-4723-ac4d-3f1b56c8e365" containerName="maas-api"
Sep 06 01:26:27.077403 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:27.077386    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4r8dp/must-gather-9dzsr"
Sep 06 01:26:27.080116 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:27.080094    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4r8dp\"/\"kube-root-ca.crt\""
Sep 06 01:26:27.080292 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:27.080124    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4r8dp\"/\"default-dockercfg-9s6px\""
Sep 06 01:26:27.080292 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:27.080261    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4r8dp\"/\"openshift-service-ca.crt\""
Sep 06 01:26:27.090532 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:27.090510    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4r8dp/must-gather-9dzsr"]
Sep 06 01:26:27.147925 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:27.147897    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrn9d\" (UniqueName: \"kubernetes.io/projected/5f9d0d02-d78d-4dea-ad7b-43dafdd459ba-kube-api-access-nrn9d\") pod \"must-gather-9dzsr\" (UID: \"5f9d0d02-d78d-4dea-ad7b-43dafdd459ba\") " pod="openshift-must-gather-4r8dp/must-gather-9dzsr"
Sep 06 01:26:27.148109 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:27.147953    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5f9d0d02-d78d-4dea-ad7b-43dafdd459ba-must-gather-output\") pod \"must-gather-9dzsr\" (UID: \"5f9d0d02-d78d-4dea-ad7b-43dafdd459ba\") " pod="openshift-must-gather-4r8dp/must-gather-9dzsr"
Sep 06 01:26:27.248603 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:27.248560    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5f9d0d02-d78d-4dea-ad7b-43dafdd459ba-must-gather-output\") pod \"must-gather-9dzsr\" (UID: \"5f9d0d02-d78d-4dea-ad7b-43dafdd459ba\") " pod="openshift-must-gather-4r8dp/must-gather-9dzsr"
Sep 06 01:26:27.248796 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:27.248670    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrn9d\" (UniqueName: \"kubernetes.io/projected/5f9d0d02-d78d-4dea-ad7b-43dafdd459ba-kube-api-access-nrn9d\") pod \"must-gather-9dzsr\" (UID: \"5f9d0d02-d78d-4dea-ad7b-43dafdd459ba\") " pod="openshift-must-gather-4r8dp/must-gather-9dzsr"
Sep 06 01:26:27.248921 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:27.248901    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5f9d0d02-d78d-4dea-ad7b-43dafdd459ba-must-gather-output\") pod \"must-gather-9dzsr\" (UID: \"5f9d0d02-d78d-4dea-ad7b-43dafdd459ba\") " pod="openshift-must-gather-4r8dp/must-gather-9dzsr"
Sep 06 01:26:27.257409 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:27.257383    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrn9d\" (UniqueName: \"kubernetes.io/projected/5f9d0d02-d78d-4dea-ad7b-43dafdd459ba-kube-api-access-nrn9d\") pod \"must-gather-9dzsr\" (UID: \"5f9d0d02-d78d-4dea-ad7b-43dafdd459ba\") " pod="openshift-must-gather-4r8dp/must-gather-9dzsr"
Sep 06 01:26:27.387566 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:27.387489    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4r8dp/must-gather-9dzsr"
Sep 06 01:26:27.673501 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:27.673479    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4r8dp/must-gather-9dzsr"]
Sep 06 01:26:27.675126 ip-10-0-140-57 kubenswrapper[2577]: W0906 01:26:27.675100    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f9d0d02_d78d_4dea_ad7b_43dafdd459ba.slice/crio-8e6d3d6630229f4892617e48b188f9b0b5424274b6e1e7cd51f98bbefe9b9ee6 WatchSource:0}: Error finding container 8e6d3d6630229f4892617e48b188f9b0b5424274b6e1e7cd51f98bbefe9b9ee6: Status 404 returned error can't find the container with id 8e6d3d6630229f4892617e48b188f9b0b5424274b6e1e7cd51f98bbefe9b9ee6
Sep 06 01:26:28.099392 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:28.099277    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4r8dp/must-gather-9dzsr" event={"ID":"5f9d0d02-d78d-4dea-ad7b-43dafdd459ba","Type":"ContainerStarted","Data":"8e6d3d6630229f4892617e48b188f9b0b5424274b6e1e7cd51f98bbefe9b9ee6"}
Sep 06 01:26:29.109901 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:29.109021    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4r8dp/must-gather-9dzsr" event={"ID":"5f9d0d02-d78d-4dea-ad7b-43dafdd459ba","Type":"ContainerStarted","Data":"441c424e43bcc1f141f3059016ef5280ee4484be595ce460a883e6e393deb16f"}
Sep 06 01:26:29.109901 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:29.109077    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4r8dp/must-gather-9dzsr" event={"ID":"5f9d0d02-d78d-4dea-ad7b-43dafdd459ba","Type":"ContainerStarted","Data":"65597354a25eaabf1b39dd938cd0e927779aaa592c09e822dd3ba660f8ba6c7a"}
Sep 06 01:26:30.019309 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:30.019280    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tc782_7270e6a0-6c6a-410a-b615-5cb276ebf879/global-pull-secret-syncer/0.log"
Sep 06 01:26:30.180463 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:30.180432    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ks4rt_500d4399-6afb-424e-8cc2-b17de185462c/konnectivity-agent/0.log"
Sep 06 01:26:30.250358 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:30.250303    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-57.ec2.internal_6098c4696f62080d6b73924491e58881/haproxy/0.log"
Sep 06 01:26:35.515597 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:35.515541    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-7prsb_a5ee4e84-8409-4762-aa12-f9a241bd75c0/manager/0.log"
Sep 06 01:26:35.541257 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:35.541230    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-ktbqp_a8e69bfe-bb43-4293-899b-72fcf6fa1cea/manager/0.log"
Sep 06 01:26:35.567892 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:35.567790    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-pcpxx_1c71d770-85cc-4826-bb1c-959ff63842a1/kuadrant-console-plugin/0.log"
Sep 06 01:26:35.615347 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:35.615302    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-rsvw2_0a8f1119-7aa3-41aa-b741-336304c5e12b/manager/0.log"
Sep 06 01:26:35.638705 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:35.638675    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-pq2zk_9fc17157-d507-49de-af37-6b54f834e58d/limitador/0.log"
Sep 06 01:26:35.725297 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:35.724618    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-5wph6_91b7bfee-2147-41dd-967a-3758ab796e8b/manager/0.log"
Sep 06 01:26:37.156001 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:37.155977    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fdc32a23-fc37-42f2-96cc-519b50ea8dae/alertmanager/0.log"
Sep 06 01:26:37.184446 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:37.184418    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fdc32a23-fc37-42f2-96cc-519b50ea8dae/config-reloader/0.log"
Sep 06 01:26:37.215648 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:37.215621    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fdc32a23-fc37-42f2-96cc-519b50ea8dae/kube-rbac-proxy-web/0.log"
Sep 06 01:26:37.247808 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:37.247778    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fdc32a23-fc37-42f2-96cc-519b50ea8dae/kube-rbac-proxy/0.log"
Sep 06 01:26:37.273002 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:37.272973    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fdc32a23-fc37-42f2-96cc-519b50ea8dae/kube-rbac-proxy-metric/0.log"
Sep 06 01:26:37.302904 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:37.302875    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fdc32a23-fc37-42f2-96cc-519b50ea8dae/prom-label-proxy/0.log"
Sep 06 01:26:37.338960 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:37.338927    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fdc32a23-fc37-42f2-96cc-519b50ea8dae/init-config-reloader/0.log"
Sep 06 01:26:37.434559 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:37.434474    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-nrpln_8cdcead8-4416-4323-971b-20646f62c7a5/kube-state-metrics/0.log"
Sep 06 01:26:37.456436 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:37.456405    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-nrpln_8cdcead8-4416-4323-971b-20646f62c7a5/kube-rbac-proxy-main/0.log"
Sep 06 01:26:37.480208 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:37.480176    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-nrpln_8cdcead8-4416-4323-971b-20646f62c7a5/kube-rbac-proxy-self/0.log"
Sep 06 01:26:37.511909 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:37.511876    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-74d9d6f984-gkc8n_84341857-7ef5-4bb7-b5e4-06c6a2da54fc/metrics-server/0.log"
Sep 06 01:26:37.540388 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:37.540363    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-8sqks_8e0550f3-3722-412d-be53-7c79eec50332/monitoring-plugin/0.log"
Sep 06 01:26:37.793874 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:37.793846    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kg4k7_d5e48864-f938-4895-aef0-048d525b925a/node-exporter/0.log"
Sep 06 01:26:37.818534 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:37.818505    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kg4k7_d5e48864-f938-4895-aef0-048d525b925a/kube-rbac-proxy/0.log"
Sep 06 01:26:37.845067 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:37.845042    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kg4k7_d5e48864-f938-4895-aef0-048d525b925a/init-textfile/0.log"
Sep 06 01:26:37.874517 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:37.874490    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-jlr5g_e81fcce4-a1c4-4769-853f-5d60b65bd6bb/kube-rbac-proxy-main/0.log"
Sep 06 01:26:37.898944 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:37.898915    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-jlr5g_e81fcce4-a1c4-4769-853f-5d60b65bd6bb/kube-rbac-proxy-self/0.log"
Sep 06 01:26:37.924370 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:37.924281    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-jlr5g_e81fcce4-a1c4-4769-853f-5d60b65bd6bb/openshift-state-metrics/0.log"
Sep 06 01:26:37.989837 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:37.989762    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8bbf6f0d-4885-45bd-9522-c6ce6b97028b/prometheus/0.log"
Sep 06 01:26:38.013249 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:38.013222    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8bbf6f0d-4885-45bd-9522-c6ce6b97028b/config-reloader/0.log"
Sep 06 01:26:38.037183 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:38.037136    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8bbf6f0d-4885-45bd-9522-c6ce6b97028b/thanos-sidecar/0.log"
Sep 06 01:26:38.060135 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:38.060077    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8bbf6f0d-4885-45bd-9522-c6ce6b97028b/kube-rbac-proxy-web/0.log"
Sep 06 01:26:38.086852 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:38.086803    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8bbf6f0d-4885-45bd-9522-c6ce6b97028b/kube-rbac-proxy/0.log"
Sep 06 01:26:38.110684 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:38.110657    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8bbf6f0d-4885-45bd-9522-c6ce6b97028b/kube-rbac-proxy-thanos/0.log"
Sep 06 01:26:38.134605 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:38.134582    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8bbf6f0d-4885-45bd-9522-c6ce6b97028b/init-config-reloader/0.log"
Sep 06 01:26:38.174781 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:38.174732    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-wgfxr_c4b36ccf-e5a3-48ba-8a6d-11f74dad96af/prometheus-operator/0.log"
Sep 06 01:26:38.197034 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:38.197007    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-wgfxr_c4b36ccf-e5a3-48ba-8a6d-11f74dad96af/kube-rbac-proxy/0.log"
Sep 06 01:26:40.420537 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:40.420472    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4r8dp/must-gather-9dzsr" podStartSLOduration=12.709516284 podStartE2EDuration="13.420450819s" totalImagesPullingTime="710.934535ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:26:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:26:29.128047727 +0000 UTC m=+2147.164190687" watchObservedRunningTime="2026-09-06 01:26:40.420450819 +0000 UTC m=+2158.456593776"
Sep 06 01:26:40.422733 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:40.422696    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4r8dp/perf-node-gather-daemonset-bjc99"]
Sep 06 01:26:40.430574 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:40.430544    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-bjc99"
Sep 06 01:26:40.436175 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:40.436117    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4r8dp/perf-node-gather-daemonset-bjc99"]
Sep 06 01:26:40.510166 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:40.510132    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/818beaa6-69a7-4172-899d-a22cfe00c95f-podres\") pod \"perf-node-gather-daemonset-bjc99\" (UID: \"818beaa6-69a7-4172-899d-a22cfe00c95f\") " pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-bjc99"
Sep 06 01:26:40.510455 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:40.510435    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/818beaa6-69a7-4172-899d-a22cfe00c95f-lib-modules\") pod \"perf-node-gather-daemonset-bjc99\" (UID: \"818beaa6-69a7-4172-899d-a22cfe00c95f\") " pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-bjc99"
Sep 06 01:26:40.510636 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:40.510622    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/818beaa6-69a7-4172-899d-a22cfe00c95f-proc\") pod \"perf-node-gather-daemonset-bjc99\" (UID: \"818beaa6-69a7-4172-899d-a22cfe00c95f\") " pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-bjc99"
Sep 06 01:26:40.510821 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:40.510808    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvjqg\" (UniqueName: \"kubernetes.io/projected/818beaa6-69a7-4172-899d-a22cfe00c95f-kube-api-access-tvjqg\") pod \"perf-node-gather-daemonset-bjc99\" (UID: \"818beaa6-69a7-4172-899d-a22cfe00c95f\") " pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-bjc99"
Sep 06 01:26:40.510980 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:40.510967    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/818beaa6-69a7-4172-899d-a22cfe00c95f-sys\") pod \"perf-node-gather-daemonset-bjc99\" (UID: \"818beaa6-69a7-4172-899d-a22cfe00c95f\") " pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-bjc99"
Sep 06 01:26:40.611849 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:40.611808    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/818beaa6-69a7-4172-899d-a22cfe00c95f-sys\") pod \"perf-node-gather-daemonset-bjc99\" (UID: \"818beaa6-69a7-4172-899d-a22cfe00c95f\") " pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-bjc99"
Sep 06 01:26:40.612177 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:40.612156    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/818beaa6-69a7-4172-899d-a22cfe00c95f-podres\") pod \"perf-node-gather-daemonset-bjc99\" (UID: \"818beaa6-69a7-4172-899d-a22cfe00c95f\") " pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-bjc99"
Sep 06 01:26:40.612341 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:40.612297    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/818beaa6-69a7-4172-899d-a22cfe00c95f-lib-modules\") pod \"perf-node-gather-daemonset-bjc99\" (UID: \"818beaa6-69a7-4172-899d-a22cfe00c95f\") " pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-bjc99"
Sep 06 01:26:40.612507 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:40.612488    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/818beaa6-69a7-4172-899d-a22cfe00c95f-proc\") pod \"perf-node-gather-daemonset-bjc99\" (UID: \"818beaa6-69a7-4172-899d-a22cfe00c95f\") " pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-bjc99"
Sep 06 01:26:40.612687 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:40.612670    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvjqg\" (UniqueName: \"kubernetes.io/projected/818beaa6-69a7-4172-899d-a22cfe00c95f-kube-api-access-tvjqg\") pod \"perf-node-gather-daemonset-bjc99\" (UID: \"818beaa6-69a7-4172-899d-a22cfe00c95f\") " pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-bjc99"
Sep 06 01:26:40.613239 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:40.613215    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/818beaa6-69a7-4172-899d-a22cfe00c95f-podres\") pod \"perf-node-gather-daemonset-bjc99\" (UID: \"818beaa6-69a7-4172-899d-a22cfe00c95f\") " pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-bjc99"
Sep 06 01:26:40.613586 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:40.613479    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/818beaa6-69a7-4172-899d-a22cfe00c95f-lib-modules\") pod \"perf-node-gather-daemonset-bjc99\" (UID: \"818beaa6-69a7-4172-899d-a22cfe00c95f\") " pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-bjc99"
Sep 06 01:26:40.613719 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:40.613523    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/818beaa6-69a7-4172-899d-a22cfe00c95f-sys\") pod \"perf-node-gather-daemonset-bjc99\" (UID: \"818beaa6-69a7-4172-899d-a22cfe00c95f\") " pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-bjc99"
Sep 06 01:26:40.613719 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:40.613525    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/818beaa6-69a7-4172-899d-a22cfe00c95f-proc\") pod \"perf-node-gather-daemonset-bjc99\" (UID: \"818beaa6-69a7-4172-899d-a22cfe00c95f\") " pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-bjc99"
Sep 06 01:26:40.623102 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:40.623076    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvjqg\" (UniqueName: \"kubernetes.io/projected/818beaa6-69a7-4172-899d-a22cfe00c95f-kube-api-access-tvjqg\") pod \"perf-node-gather-daemonset-bjc99\" (UID: \"818beaa6-69a7-4172-899d-a22cfe00c95f\") " pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-bjc99"
Sep 06 01:26:40.749198 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:40.749100    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-bjc99"
Sep 06 01:26:41.044247 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:41.044216    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4r8dp/perf-node-gather-daemonset-bjc99"]
Sep 06 01:26:41.205303 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:41.205255    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-bjc99" event={"ID":"818beaa6-69a7-4172-899d-a22cfe00c95f","Type":"ContainerStarted","Data":"6d2e7b24ce09cf9570b488fd8f302736d8f5e18277c7b93eb533e6a00ea4d876"}
Sep 06 01:26:41.205530 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:41.205353    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-bjc99" event={"ID":"818beaa6-69a7-4172-899d-a22cfe00c95f","Type":"ContainerStarted","Data":"23babfb5fd454051fe741019b70f01ab764c18099abb1b4a993f02524e2ac226"}
Sep 06 01:26:41.205530 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:41.205476    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-bjc99"
Sep 06 01:26:41.222052 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:41.221986    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-bjc99" podStartSLOduration=1.221965067 podStartE2EDuration="1.221965067s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 01:26:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:26:41.220989056 +0000 UTC m=+2159.257132015" watchObservedRunningTime="2026-09-06 01:26:41.221965067 +0000 UTC m=+2159.258108023"
Sep 06 01:26:42.846494 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:42.846468    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gcdgv_8aeab2aa-85be-432a-9cb7-bf89a08bf962/dns/0.log"
Sep 06 01:26:42.866597 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:42.866537    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gcdgv_8aeab2aa-85be-432a-9cb7-bf89a08bf962/kube-rbac-proxy/0.log"
Sep 06 01:26:42.985198 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:42.985167    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w9xwb_07e0007b-c474-48f7-9bdc-91218d4e681e/dns-node-resolver/0.log"
Sep 06 01:26:43.536882 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:43.536855    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gk6l5_bcd87c76-22e5-4905-bb95-d1acd077ceff/node-ca/0.log"
Sep 06 01:26:45.051690 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:45.051659    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5cb67ffb98-nq844_0795e942-befb-4b46-bece-2cf28ea1566e/kube-auth-proxy/0.log"
Sep 06 01:26:45.109609 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:45.109576    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4gqt9_008a77a0-2765-4ab1-ac54-70ba224c7ad2/istio-proxy/0.log"
Sep 06 01:26:45.122876 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:45.122845    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4gqt9_008a77a0-2765-4ab1-ac54-70ba224c7ad2/istio-proxy/1.log"
Sep 06 01:26:45.161961 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:45.161924    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-zt47h_b04e7bbd-93f4-4e03-a4c4-734ae28721c4/payload-pre-processing/0.log"
Sep 06 01:26:46.120248 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:46.120219    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hfvkl_e898d551-a885-4d1c-bf4b-f2632137dcb8/serve-healthcheck-canary/0.log"
Sep 06 01:26:46.645898 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:46.645871    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7pllw_2478bdcf-6cca-4dd9-9e4c-9d21405860ed/kube-rbac-proxy/0.log"
Sep 06 01:26:46.669056 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:46.669023    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7pllw_2478bdcf-6cca-4dd9-9e4c-9d21405860ed/exporter/0.log"
Sep 06 01:26:46.690435 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:46.690403    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7pllw_2478bdcf-6cca-4dd9-9e4c-9d21405860ed/extractor/0.log"
Sep 06 01:26:47.225359 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:47.225299    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4r8dp/perf-node-gather-daemonset-bjc99"
Sep 06 01:26:49.019867 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:49.019811    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-w9sjm_111f4bc9-8160-459c-b8c5-c1edbecfda2c/manager/0.log"
Sep 06 01:26:49.261412 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:49.261384    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-75x5s_cc52dd8b-6f2f-4ad2-b172-b8494ede1e61/manager/0.log"
Sep 06 01:26:49.516614 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:49.516564    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79dff7ddb6-g2fhq_bed80868-695e-4962-ae19-9497a12168e0/manager/0.log"
Sep 06 01:26:49.537491 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:49.537459    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79dff7ddb6-g2fhq_bed80868-695e-4962-ae19-9497a12168e0/copy-manifests/0.log"
Sep 06 01:26:51.252286 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:51.252259    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5cb67ffb98-nq844_0795e942-befb-4b46-bece-2cf28ea1566e/kube-auth-proxy/0.log"
Sep 06 01:26:51.288628 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:51.288598    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4gqt9_008a77a0-2765-4ab1-ac54-70ba224c7ad2/istio-proxy/0.log"
Sep 06 01:26:51.301352 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:51.301284    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4gqt9_008a77a0-2765-4ab1-ac54-70ba224c7ad2/istio-proxy/1.log"
Sep 06 01:26:51.331464 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:51.331427    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-zt47h_b04e7bbd-93f4-4e03-a4c4-734ae28721c4/payload-pre-processing/0.log"
Sep 06 01:26:53.410603 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:53.410572    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5cb67ffb98-nq844_0795e942-befb-4b46-bece-2cf28ea1566e/kube-auth-proxy/0.log"
Sep 06 01:26:53.448494 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:53.448436    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4gqt9_008a77a0-2765-4ab1-ac54-70ba224c7ad2/istio-proxy/0.log"
Sep 06 01:26:53.462705 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:53.462671    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4gqt9_008a77a0-2765-4ab1-ac54-70ba224c7ad2/istio-proxy/1.log"
Sep 06 01:26:53.491440 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:53.491397    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-zt47h_b04e7bbd-93f4-4e03-a4c4-734ae28721c4/payload-pre-processing/0.log"
Sep 06 01:26:57.763468 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:57.763437    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jv24f_2c9e3cd8-83aa-40b9-a844-65a7a157c377/kube-multus-additional-cni-plugins/0.log"
Sep 06 01:26:57.785233 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:57.785207    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jv24f_2c9e3cd8-83aa-40b9-a844-65a7a157c377/egress-router-binary-copy/0.log"
Sep 06 01:26:57.807089 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:57.807065    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jv24f_2c9e3cd8-83aa-40b9-a844-65a7a157c377/cni-plugins/0.log"
Sep 06 01:26:57.829746 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:57.829716    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jv24f_2c9e3cd8-83aa-40b9-a844-65a7a157c377/bond-cni-plugin/0.log"
Sep 06 01:26:57.852628 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:57.852585    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jv24f_2c9e3cd8-83aa-40b9-a844-65a7a157c377/routeoverride-cni/0.log"
Sep 06 01:26:57.877826 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:57.877749    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jv24f_2c9e3cd8-83aa-40b9-a844-65a7a157c377/whereabouts-cni-bincopy/0.log"
Sep 06 01:26:57.898631 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:57.898603    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jv24f_2c9e3cd8-83aa-40b9-a844-65a7a157c377/whereabouts-cni/0.log"
Sep 06 01:26:57.996485 ip-10-0-140-57 kubenswrapper[2577]: I0906 01:26:57.996447    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-ww88t_079a153a-9b55-4225-8928-cd8a28906fd3/kube-multus/0.log"