Jul 28 01:15:47.724667 ip-10-0-131-213 systemd[1]: Starting Kubernetes Kubelet...
Jul 28 01:15:49.252440 ip-10-0-131-213 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 01:15:49.252440 ip-10-0-131-213 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 28 01:15:49.252440 ip-10-0-131-213 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 01:15:49.252440 ip-10-0-131-213 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 28 01:15:49.252440 ip-10-0-131-213 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 01:15:49.253280 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.253190    2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 28 01:15:49.258210 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258190    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 01:15:49.258210 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258210    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 01:15:49.258294 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258215    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 01:15:49.258294 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258218    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 01:15:49.258294 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258222    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 01:15:49.258294 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258225    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 01:15:49.258294 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258227    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 01:15:49.258294 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258230    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 01:15:49.258294 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258234    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 01:15:49.258294 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258236    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 01:15:49.258294 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258239    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 01:15:49.258294 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258242    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 01:15:49.258294 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258245    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 01:15:49.258294 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258253    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 01:15:49.258294 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258256    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 01:15:49.258294 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258260    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 01:15:49.258294 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258263    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 01:15:49.258294 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258266    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 01:15:49.258294 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258268    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 01:15:49.258294 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258271    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 01:15:49.258294 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258275    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 01:15:49.258294 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258277    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 01:15:49.258833 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258280    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 01:15:49.258833 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258282    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 01:15:49.258833 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258285    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 01:15:49.258833 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258288    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 01:15:49.258833 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258291    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 01:15:49.258833 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258293    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 01:15:49.258833 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258296    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 01:15:49.258833 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258301    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 01:15:49.258833 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258304    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 01:15:49.258833 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258307    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 01:15:49.258833 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258309    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 01:15:49.258833 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258312    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 01:15:49.258833 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258315    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 01:15:49.258833 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258317    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 01:15:49.258833 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258320    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 01:15:49.258833 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258322    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 01:15:49.258833 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258325    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 01:15:49.258833 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258327    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 01:15:49.258833 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258330    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 01:15:49.258833 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258332    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 01:15:49.259308 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258335    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 01:15:49.259308 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258337    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 01:15:49.259308 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258340    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 01:15:49.259308 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258343    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 01:15:49.259308 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258347    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 01:15:49.259308 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258361    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 01:15:49.259308 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258364    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 01:15:49.259308 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258367    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 01:15:49.259308 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258372    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 01:15:49.259308 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258376    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 01:15:49.259308 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258379    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 01:15:49.259308 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258381    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 01:15:49.259308 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258385    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 01:15:49.259308 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258388    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 01:15:49.259308 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258393    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 01:15:49.259308 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258395    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 01:15:49.259308 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258398    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 01:15:49.259308 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258401    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 01:15:49.259761 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258404    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 01:15:49.259761 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258406    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 01:15:49.259761 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258409    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 01:15:49.259761 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258412    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 01:15:49.259761 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258414    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 01:15:49.259761 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258417    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 01:15:49.259761 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258420    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 01:15:49.259761 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258422    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 01:15:49.259761 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258425    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 01:15:49.259761 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258427    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 01:15:49.259761 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258430    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 01:15:49.259761 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258434    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 01:15:49.259761 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258438    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 01:15:49.259761 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258440    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 01:15:49.259761 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258443    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 01:15:49.259761 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258445    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 01:15:49.259761 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258448    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 01:15:49.259761 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258450    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 01:15:49.259761 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258453    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 01:15:49.259761 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258456    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 01:15:49.260234 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258459    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 01:15:49.260234 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258461    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 01:15:49.260234 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258464    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 01:15:49.260234 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258466    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 01:15:49.260234 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258469    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 01:15:49.260234 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258471    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 01:15:49.260234 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258474    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 01:15:49.260234 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258478    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 01:15:49.260234 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258480    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 01:15:49.260234 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258483    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 01:15:49.260234 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258486    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 01:15:49.260234 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258488    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 01:15:49.260234 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258493    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 01:15:49.260234 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258496    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 01:15:49.260234 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258501    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 01:15:49.260234 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258506    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 01:15:49.260234 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258511    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 01:15:49.260234 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258515    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 01:15:49.260234 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.258520    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 01:15:49.260234 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259470    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 01:15:49.260748 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259479    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 01:15:49.260748 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259482    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 01:15:49.260748 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259486    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 01:15:49.260748 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259489    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 01:15:49.260748 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259492    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 01:15:49.260748 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259495    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 01:15:49.260748 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259499    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 01:15:49.260748 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259502    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 01:15:49.260748 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259505    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 01:15:49.260748 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259508    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 01:15:49.260748 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259511    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 01:15:49.260748 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259514    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 01:15:49.260748 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259525    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 01:15:49.260748 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259530    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 01:15:49.260748 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259534    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 01:15:49.260748 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259544    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 01:15:49.260748 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259548    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 01:15:49.260748 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259551    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 01:15:49.260748 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259555    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 01:15:49.260748 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259559    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 01:15:49.261271 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259561    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 01:15:49.261271 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259564    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 01:15:49.261271 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259567    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 01:15:49.261271 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259569    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 01:15:49.261271 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259572    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 01:15:49.261271 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259575    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 01:15:49.261271 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259578    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 01:15:49.261271 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259581    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 01:15:49.261271 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259583    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 01:15:49.261271 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259587    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 01:15:49.261271 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259591    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 01:15:49.261271 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259595    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 01:15:49.261271 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259598    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 01:15:49.261271 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259603    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 01:15:49.261271 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259607    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 01:15:49.261271 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259612    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 01:15:49.261271 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259616    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 01:15:49.261271 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259620    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 01:15:49.261271 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259623    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 01:15:49.261271 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259625    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 01:15:49.261892 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259629    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 01:15:49.261892 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259631    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 01:15:49.261892 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259634    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 01:15:49.261892 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259637    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 01:15:49.261892 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259640    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 01:15:49.261892 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259649    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 01:15:49.261892 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259652    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 01:15:49.261892 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259654    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 01:15:49.261892 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259657    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 01:15:49.261892 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259659    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 01:15:49.261892 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259662    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 01:15:49.261892 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259666    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 01:15:49.261892 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259668    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 01:15:49.261892 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259671    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 01:15:49.261892 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259674    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 01:15:49.261892 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259676    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 01:15:49.261892 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259678    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 01:15:49.261892 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259682    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 01:15:49.261892 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259686    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 01:15:49.261892 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259690    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 01:15:49.262619 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259694    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 01:15:49.262619 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259699    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 01:15:49.262619 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259703    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 01:15:49.262619 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259706    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 01:15:49.262619 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259711    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 01:15:49.262619 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259713    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 01:15:49.262619 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259716    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 01:15:49.262619 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259720    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 01:15:49.262619 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259723    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 01:15:49.262619 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259726    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 01:15:49.262619 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259729    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 01:15:49.262619 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259732    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 01:15:49.262619 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259735    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 01:15:49.262619 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259738    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 01:15:49.262619 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259741    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 01:15:49.262619 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259743    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 01:15:49.262619 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259746    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 01:15:49.262619 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259748    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 01:15:49.262619 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259757    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 01:15:49.263226 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259760    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 01:15:49.263226 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259766    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 01:15:49.263226 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259770    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 01:15:49.263226 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259774    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 01:15:49.263226 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259779    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 01:15:49.263226 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259782    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 01:15:49.263226 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259785    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 01:15:49.263226 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259788    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 01:15:49.263226 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259790    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 01:15:49.263226 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259792    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 01:15:49.263226 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259795    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 01:15:49.263226 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259798    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 01:15:49.263226 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259801    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 01:15:49.263226 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259803    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 01:15:49.263226 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259806    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 01:15:49.263226 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259808    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 01:15:49.263226 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259810    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 01:15:49.263226 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259813    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 01:15:49.263226 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.259816    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 01:15:49.263226 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260289    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 01:15:49.263836 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260295    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 01:15:49.263836 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260298    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 01:15:49.263836 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260301    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 01:15:49.263836 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260304    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 01:15:49.263836 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260307    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 01:15:49.263836 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260310    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 01:15:49.263836 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260313    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 01:15:49.263836 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260316    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 01:15:49.263836 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260319    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 01:15:49.263836 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260322    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 01:15:49.263836 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260324    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 01:15:49.263836 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260328    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 01:15:49.263836 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260331    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 01:15:49.263836 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260336    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 01:15:49.263836 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260340    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 01:15:49.263836 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260345    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 01:15:49.263836 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260362    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 01:15:49.263836 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260365    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 01:15:49.263836 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260368    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 01:15:49.263836 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260370    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 01:15:49.264513 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260373    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 01:15:49.264513 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260376    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 01:15:49.264513 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260379    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 01:15:49.264513 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260382    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 01:15:49.264513 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260385    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 01:15:49.264513 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260387    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 01:15:49.264513 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260391    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 01:15:49.264513 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260395    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 01:15:49.264513 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260399    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 01:15:49.264513 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260403    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 01:15:49.264513 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260406    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 01:15:49.264513 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260409    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 01:15:49.264513 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260413    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 01:15:49.264513 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260417    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 01:15:49.264513 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260422    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 01:15:49.264513 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260426    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 01:15:49.264513 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260431    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 01:15:49.264513 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260433    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 01:15:49.264513 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260436    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 01:15:49.264970 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260439    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 01:15:49.264970 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260441    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 01:15:49.264970 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260444    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 01:15:49.264970 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260446    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 01:15:49.264970 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260449    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 01:15:49.264970 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260452    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 01:15:49.264970 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260456    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 01:15:49.264970 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260459    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 01:15:49.264970 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260461    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 01:15:49.264970 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260464    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 01:15:49.264970 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260467    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 01:15:49.264970 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260470    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 01:15:49.264970 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260472    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 01:15:49.264970 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260474    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 01:15:49.264970 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260477    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 01:15:49.264970 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260480    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 01:15:49.264970 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260483    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 01:15:49.264970 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260485    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 01:15:49.264970 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260488    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 01:15:49.264970 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260490    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 01:15:49.265556 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260494    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 01:15:49.265556 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260499    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 01:15:49.265556 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260503    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 01:15:49.265556 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260507    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 01:15:49.265556 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260511    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 01:15:49.265556 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260515    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 01:15:49.265556 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260519    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 01:15:49.265556 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260522    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 01:15:49.265556 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260526    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 01:15:49.265556 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260529    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 01:15:49.265556 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260531    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 01:15:49.265556 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260534    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 01:15:49.265556 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260537    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 01:15:49.265556 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260539    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 01:15:49.265556 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260541    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 01:15:49.265556 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260544    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 01:15:49.265556 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260546    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 01:15:49.265556 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260549    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 01:15:49.265556 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260553    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 01:15:49.265556 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260555    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 01:15:49.266062 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260558    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 01:15:49.266062 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260561    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 01:15:49.266062 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260564    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 01:15:49.266062 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260567    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 01:15:49.266062 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260569    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 01:15:49.266062 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260572    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 01:15:49.266062 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260575    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 01:15:49.266062 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260579    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 01:15:49.266062 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260583    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 01:15:49.266062 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260588    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 01:15:49.266062 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260592    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 01:15:49.266062 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260595    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 01:15:49.266062 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260597    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 01:15:49.266062 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260600    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 01:15:49.266062 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260602    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 01:15:49.266062 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260605    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 01:15:49.266062 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260607    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 01:15:49.266062 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260610    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 01:15:49.266062 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.260613    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 01:15:49.266062 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260695    2560 flags.go:64] FLAG: --address="0.0.0.0"
Jul 28 01:15:49.266834 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260703    2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 28 01:15:49.266834 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260713    2560 flags.go:64] FLAG: --anonymous-auth="true"
Jul 28 01:15:49.266834 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260718    2560 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 28 01:15:49.266834 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260723    2560 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 28 01:15:49.266834 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260726    2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 28 01:15:49.266834 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260730    2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 28 01:15:49.266834 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260734    2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 28 01:15:49.266834 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260739    2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 28 01:15:49.266834 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260744    2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 28 01:15:49.266834 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260750    2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 28 01:15:49.266834 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260756    2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 28 01:15:49.266834 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260761    2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 28 01:15:49.266834 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260764    2560 flags.go:64] FLAG: --cgroup-root=""
Jul 28 01:15:49.266834 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260768    2560 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 28 01:15:49.266834 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260771    2560 flags.go:64] FLAG: --client-ca-file=""
Jul 28 01:15:49.266834 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260774    2560 flags.go:64] FLAG: --cloud-provider="external"
Jul 28 01:15:49.266834 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260777    2560 flags.go:64] FLAG: --cluster-dns="[]"
Jul 28 01:15:49.266834 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260781    2560 flags.go:64] FLAG: --cluster-domain=""
Jul 28 01:15:49.266834 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260784    2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 28 01:15:49.266834 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260787    2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 28 01:15:49.266834 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260791    2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 28 01:15:49.266834 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260794    2560 flags.go:64] FLAG: --container-log-max-files="5"
Jul 28 01:15:49.266834 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260798    2560 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 28 01:15:49.266834 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260801    2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 28 01:15:49.267829 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260804    2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 28 01:15:49.267829 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260808    2560 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 28 01:15:49.267829 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260811    2560 flags.go:64] FLAG: --contention-profiling="false"
Jul 28 01:15:49.267829 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260814    2560 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 28 01:15:49.267829 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260818    2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 28 01:15:49.267829 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260823    2560 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 28 01:15:49.267829 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260827    2560 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 28 01:15:49.267829 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260834    2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 28 01:15:49.267829 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260838    2560 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 28 01:15:49.267829 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260844    2560 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 28 01:15:49.267829 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260847    2560 flags.go:64] FLAG: --enable-load-reader="false"
Jul 28 01:15:49.267829 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260850    2560 flags.go:64] FLAG: --enable-server="true"
Jul 28 01:15:49.267829 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260853    2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 28 01:15:49.267829 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260858    2560 flags.go:64] FLAG: --event-burst="100"
Jul 28 01:15:49.267829 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260861    2560 flags.go:64] FLAG: --event-qps="50"
Jul 28 01:15:49.267829 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260864    2560 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 28 01:15:49.267829 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260868    2560 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 28 01:15:49.267829 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260870    2560 flags.go:64] FLAG: --eviction-hard=""
Jul 28 01:15:49.267829 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260874    2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 28 01:15:49.267829 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260877    2560 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 28 01:15:49.267829 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260884    2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 28 01:15:49.267829 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260888    2560 flags.go:64] FLAG: --eviction-soft=""
Jul 28 01:15:49.267829 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260891    2560 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 28 01:15:49.267829 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260894    2560 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 28 01:15:49.267829 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260898    2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 28 01:15:49.268969 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260903    2560 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 28 01:15:49.268969 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260907    2560 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 28 01:15:49.268969 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260912    2560 flags.go:64] FLAG: --fail-swap-on="true"
Jul 28 01:15:49.268969 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260916    2560 flags.go:64] FLAG: --feature-gates=""
Jul 28 01:15:49.268969 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260920    2560 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 28 01:15:49.268969 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260924    2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 28 01:15:49.268969 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260927    2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 28 01:15:49.268969 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260930    2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 28 01:15:49.268969 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260933    2560 flags.go:64] FLAG: --healthz-port="10248"
Jul 28 01:15:49.268969 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260936    2560 flags.go:64] FLAG: --help="false"
Jul 28 01:15:49.268969 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260939    2560 flags.go:64] FLAG: --hostname-override="ip-10-0-131-213.ec2.internal"
Jul 28 01:15:49.268969 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260942    2560 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 28 01:15:49.268969 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260945    2560 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 28 01:15:49.268969 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260948    2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 28 01:15:49.268969 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260951    2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 28 01:15:49.268969 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260955    2560 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 28 01:15:49.268969 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260959    2560 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 28 01:15:49.268969 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260962    2560 flags.go:64] FLAG: --image-service-endpoint=""
Jul 28 01:15:49.268969 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260965    2560 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 28 01:15:49.268969 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260967    2560 flags.go:64] FLAG: --kube-api-burst="100"
Jul 28 01:15:49.268969 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260970    2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 28 01:15:49.268969 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260973    2560 flags.go:64] FLAG: --kube-api-qps="50"
Jul 28 01:15:49.268969 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260976    2560 flags.go:64] FLAG: --kube-reserved=""
Jul 28 01:15:49.268969 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260981    2560 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 28 01:15:49.269603 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260986    2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 28 01:15:49.269603 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260991    2560 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 28 01:15:49.269603 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.260996    2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 28 01:15:49.269603 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261000    2560 flags.go:64] FLAG: --lock-file=""
Jul 28 01:15:49.269603 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261004    2560 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 28 01:15:49.269603 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261007    2560 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 28 01:15:49.269603 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261011    2560 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 28 01:15:49.269603 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261016    2560 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 28 01:15:49.269603 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261020    2560 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 28 01:15:49.269603 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261022    2560 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 28 01:15:49.269603 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261025    2560 flags.go:64] FLAG: --logging-format="text"
Jul 28 01:15:49.269603 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261028    2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 28 01:15:49.269603 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261031    2560 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 28 01:15:49.269603 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261034    2560 flags.go:64] FLAG: --manifest-url=""
Jul 28 01:15:49.269603 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261037    2560 flags.go:64] FLAG: --manifest-url-header=""
Jul 28 01:15:49.269603 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261042    2560 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 28 01:15:49.269603 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261045    2560 flags.go:64] FLAG: --max-open-files="1000000"
Jul 28 01:15:49.269603 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261049    2560 flags.go:64] FLAG: --max-pods="110"
Jul 28 01:15:49.269603 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261052    2560 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 28 01:15:49.269603 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261056    2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 28 01:15:49.269603 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261059    2560 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 28 01:15:49.269603 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261064    2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 28 01:15:49.269603 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261069    2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 28 01:15:49.269603 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261074    2560 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 28 01:15:49.269603 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261080    2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 28 01:15:49.270217 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261089    2560 flags.go:64] FLAG: --node-status-max-images="50"
Jul 28 01:15:49.270217 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261092    2560 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 28 01:15:49.270217 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261095    2560 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 28 01:15:49.270217 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261098    2560 flags.go:64] FLAG: --pod-cidr=""
Jul 28 01:15:49.270217 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261101    2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 28 01:15:49.270217 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261107    2560 flags.go:64] FLAG: --pod-manifest-path=""
Jul 28 01:15:49.270217 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261110    2560 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 28 01:15:49.270217 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261113    2560 flags.go:64] FLAG: --pods-per-core="0"
Jul 28 01:15:49.270217 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261116    2560 flags.go:64] FLAG: --port="10250"
Jul 28 01:15:49.270217 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261120    2560 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 28 01:15:49.270217 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261123    2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05329cf131b5cf7de"
Jul 28 01:15:49.270217 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261126    2560 flags.go:64] FLAG: --qos-reserved=""
Jul 28 01:15:49.270217 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261130    2560 flags.go:64] FLAG: --read-only-port="10255"
Jul 28 01:15:49.270217 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261133    2560 flags.go:64] FLAG: --register-node="true"
Jul 28 01:15:49.270217 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261136    2560 flags.go:64] FLAG: --register-with-taints=""
Jul 28 01:15:49.270217 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261140    2560 flags.go:64] FLAG: --registry-burst="10"
Jul 28 01:15:49.270217 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261144    2560 flags.go:64] FLAG: --registry-qps="5"
Jul 28 01:15:49.270217 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261149    2560 flags.go:64] FLAG: --reserved-cpus=""
Jul 28 01:15:49.270217 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261154    2560 flags.go:64] FLAG: --reserved-memory=""
Jul 28 01:15:49.270217 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261160    2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 28 01:15:49.270217 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261164    2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 28 01:15:49.270217 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261167    2560 flags.go:64] FLAG: --rotate-certificates="false"
Jul 28 01:15:49.270217 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261169    2560 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 28 01:15:49.270217 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261172    2560 flags.go:64] FLAG: --runonce="false"
Jul 28 01:15:49.270217 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261175    2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 28 01:15:49.270830 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261178    2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 28 01:15:49.270830 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261181    2560 flags.go:64] FLAG: --seccomp-default="false"
Jul 28 01:15:49.270830 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261184    2560 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 28 01:15:49.270830 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261187    2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 28 01:15:49.270830 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261190    2560 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 28 01:15:49.270830 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261193    2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 28 01:15:49.270830 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261197    2560 flags.go:64] FLAG: --storage-driver-password="root"
Jul 28 01:15:49.270830 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261200    2560 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 28 01:15:49.270830 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261203    2560 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 28 01:15:49.270830 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261206    2560 flags.go:64] FLAG: --storage-driver-user="root"
Jul 28 01:15:49.270830 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261209    2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 28 01:15:49.270830 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261212    2560 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 28 01:15:49.270830 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261215    2560 flags.go:64] FLAG: --system-cgroups=""
Jul 28 01:15:49.270830 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261218    2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 28 01:15:49.270830 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261224    2560 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 28 01:15:49.270830 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261228    2560 flags.go:64] FLAG: --tls-cert-file=""
Jul 28 01:15:49.270830 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261233    2560 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 28 01:15:49.270830 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261239    2560 flags.go:64] FLAG: --tls-min-version=""
Jul 28 01:15:49.270830 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261243    2560 flags.go:64] FLAG: --tls-private-key-file=""
Jul 28 01:15:49.270830 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261247    2560 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 28 01:15:49.270830 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261251    2560 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 28 01:15:49.270830 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261254    2560 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 28 01:15:49.270830 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261257    2560 flags.go:64] FLAG: --v="2"
Jul 28 01:15:49.270830 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261261    2560 flags.go:64] FLAG: --version="false"
Jul 28 01:15:49.270830 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261265    2560 flags.go:64] FLAG: --vmodule=""
Jul 28 01:15:49.271455 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261269    2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 28 01:15:49.271455 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.261272    2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 28 01:15:49.271455 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261418    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 01:15:49.271455 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261423    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 01:15:49.271455 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261427    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 01:15:49.271455 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261430    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 01:15:49.271455 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261433    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 01:15:49.271455 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261435    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 01:15:49.271455 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261438    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 01:15:49.271455 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261441    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 01:15:49.271455 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261444    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 01:15:49.271455 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261447    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 01:15:49.271455 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261449    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 01:15:49.271455 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261454    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 01:15:49.271455 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261456    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 01:15:49.271455 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261459    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 01:15:49.271455 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261462    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 01:15:49.271455 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261466    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 01:15:49.271455 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261470    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 01:15:49.271455 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261477    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 01:15:49.271966 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261482    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 01:15:49.271966 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261486    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 01:15:49.271966 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261489    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 01:15:49.271966 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261492    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 01:15:49.271966 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261495    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 01:15:49.271966 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261588    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 01:15:49.271966 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261598    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 01:15:49.271966 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261602    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 01:15:49.271966 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261696    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 01:15:49.271966 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261702    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 01:15:49.271966 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261707    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 01:15:49.271966 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261712    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 01:15:49.271966 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261717    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 01:15:49.271966 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261722    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 01:15:49.271966 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261727    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 01:15:49.271966 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261731    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 01:15:49.271966 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261736    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 01:15:49.271966 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261740    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 01:15:49.271966 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261752    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 01:15:49.271966 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261757    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 01:15:49.272487 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261761    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 01:15:49.272487 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261766    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 01:15:49.272487 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261770    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 01:15:49.272487 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261775    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 01:15:49.272487 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261779    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 01:15:49.272487 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261786    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 01:15:49.272487 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261790    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 01:15:49.272487 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261795    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 01:15:49.272487 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261799    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 01:15:49.272487 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261803    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 01:15:49.272487 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261812    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 01:15:49.272487 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261817    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 01:15:49.272487 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261821    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 01:15:49.272487 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261825    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 01:15:49.272487 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261830    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 01:15:49.272487 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261834    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 01:15:49.272487 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261839    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 01:15:49.272487 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261843    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 01:15:49.272487 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261849    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 01:15:49.272487 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261854    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 01:15:49.272967 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261858    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 01:15:49.272967 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261864    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 01:15:49.272967 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261873    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 01:15:49.272967 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261878    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 01:15:49.272967 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261881    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 01:15:49.272967 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261886    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 01:15:49.272967 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261890    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 01:15:49.272967 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261895    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 01:15:49.272967 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261899    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 01:15:49.272967 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261903    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 01:15:49.272967 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261908    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 01:15:49.272967 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261912    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 01:15:49.272967 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261916    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 01:15:49.272967 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261921    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 01:15:49.272967 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261925    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 01:15:49.272967 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261933    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 01:15:49.272967 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261938    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 01:15:49.272967 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261943    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 01:15:49.272967 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261948    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 01:15:49.273442 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261955    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 01:15:49.273442 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261962    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 01:15:49.273442 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261969    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 01:15:49.273442 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261981    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 01:15:49.273442 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261986    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 01:15:49.273442 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261990    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 01:15:49.273442 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.261995    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 01:15:49.273442 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.262000    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 01:15:49.273442 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.262009    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 01:15:49.273442 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.262013    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 01:15:49.273442 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.262026    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 01:15:49.273442 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.262034    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 01:15:49.273442 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.262039    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 01:15:49.273442 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.262043    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 01:15:49.273442 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.262047    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 01:15:49.273442 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.262052    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 01:15:49.273442 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.262057    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 01:15:49.273442 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.262061    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 01:15:49.273442 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.262066    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 01:15:49.273902 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.262070    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 01:15:49.273902 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.262078    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 01:15:49.273902 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.262082    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 01:15:49.273902 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.262733    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 01:15:49.273902 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.270646    2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 28 01:15:49.273902 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.270665    2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 28 01:15:49.273902 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.270679    2560 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 28 01:15:49.273902 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.270685    2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 28 01:15:49.273902 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270745    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 01:15:49.273902 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270751    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 01:15:49.273902 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270756    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 01:15:49.273902 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270759    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 01:15:49.273902 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270763    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 01:15:49.273902 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270766    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 01:15:49.274272 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270769    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 01:15:49.274272 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270771    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 01:15:49.274272 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270774    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 01:15:49.274272 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270777    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 01:15:49.274272 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270780    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 01:15:49.274272 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270782    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 01:15:49.274272 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270785    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 01:15:49.274272 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270788    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 01:15:49.274272 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270791    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 01:15:49.274272 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270793    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 01:15:49.274272 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270796    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 01:15:49.274272 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270800    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 01:15:49.274272 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270803    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 01:15:49.274272 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270806    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 01:15:49.274272 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270809    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 01:15:49.274272 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270812    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 01:15:49.274272 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270814    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 01:15:49.274272 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270817    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 01:15:49.274272 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270820    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 01:15:49.274272 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270822    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 01:15:49.274775 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270825    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 01:15:49.274775 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270828    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 01:15:49.274775 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270831    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 01:15:49.274775 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270834    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 01:15:49.274775 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270837    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 01:15:49.274775 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270841    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 01:15:49.274775 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270843    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 01:15:49.274775 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270846    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 01:15:49.274775 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270849    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 01:15:49.274775 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270852    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 01:15:49.274775 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270854    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 01:15:49.274775 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270857    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 01:15:49.274775 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270860    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 01:15:49.274775 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270862    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 01:15:49.274775 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270865    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 01:15:49.274775 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270868    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 01:15:49.274775 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270870    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 01:15:49.274775 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270873    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 01:15:49.274775 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270876    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 01:15:49.274775 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270878    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 01:15:49.275260 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270881    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 01:15:49.275260 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270883    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 01:15:49.275260 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270886    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 01:15:49.275260 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270888    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 01:15:49.275260 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270891    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 01:15:49.275260 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270893    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 01:15:49.275260 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270896    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 01:15:49.275260 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270899    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 01:15:49.275260 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270902    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 01:15:49.275260 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270904    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 01:15:49.275260 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270907    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 01:15:49.275260 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270910    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 01:15:49.275260 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270912    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 01:15:49.275260 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270915    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 01:15:49.275260 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270917    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 01:15:49.275260 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270921    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 01:15:49.275260 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270924    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 01:15:49.275260 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270927    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 01:15:49.275260 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270929    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 01:15:49.275260 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270932    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 01:15:49.275784 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270935    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 01:15:49.275784 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270937    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 01:15:49.275784 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270940    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 01:15:49.275784 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270943    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 01:15:49.275784 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270946    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 01:15:49.275784 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270948    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 01:15:49.275784 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270951    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 01:15:49.275784 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270953    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 01:15:49.275784 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270956    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 01:15:49.275784 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270958    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 01:15:49.275784 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270961    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 01:15:49.275784 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270965    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 01:15:49.275784 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270969    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 01:15:49.275784 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270971    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 01:15:49.275784 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270975    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 01:15:49.275784 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270977    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 01:15:49.275784 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270980    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 01:15:49.275784 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270983    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 01:15:49.275784 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270986    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 01:15:49.275784 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270988    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 01:15:49.276279 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270991    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 01:15:49.276279 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270993    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 01:15:49.276279 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270996    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 01:15:49.276279 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.270999    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 01:15:49.276279 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271002    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 01:15:49.276279 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271005    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 01:15:49.276279 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271007    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 01:15:49.276279 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271010    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 01:15:49.276279 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271013    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 01:15:49.276279 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271016    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 01:15:49.276279 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271018    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 01:15:49.276279 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271021    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 01:15:49.276279 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271023    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 01:15:49.276279 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.271028    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 01:15:49.276279 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271143    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 01:15:49.276662 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271147    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 01:15:49.276662 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271151    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 01:15:49.276662 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271153    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 01:15:49.276662 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271156    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 01:15:49.276662 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271159    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 01:15:49.276662 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271162    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 01:15:49.276662 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271165    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 01:15:49.276662 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271168    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 01:15:49.276662 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271170    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 01:15:49.276662 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271173    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 01:15:49.276662 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271176    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 01:15:49.276662 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271178    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 01:15:49.276662 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271181    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 01:15:49.276662 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271183    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 01:15:49.276662 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271186    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 01:15:49.276662 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271189    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 01:15:49.276662 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271191    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 01:15:49.276662 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271194    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 01:15:49.276662 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271196    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 01:15:49.276662 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271199    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 01:15:49.277133 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271202    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 01:15:49.277133 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271205    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 01:15:49.277133 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271208    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 01:15:49.277133 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271211    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 01:15:49.277133 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271213    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 01:15:49.277133 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271216    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 01:15:49.277133 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271219    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 01:15:49.277133 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271221    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 01:15:49.277133 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271224    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 01:15:49.277133 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271226    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 01:15:49.277133 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271229    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 01:15:49.277133 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271231    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 01:15:49.277133 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271234    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 01:15:49.277133 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271236    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 01:15:49.277133 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271240    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 01:15:49.277133 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271244    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 01:15:49.277133 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271247    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 01:15:49.277133 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271250    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 01:15:49.277133 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271253    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 01:15:49.277133 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271256    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 01:15:49.277638 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271259    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 01:15:49.277638 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271261    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 01:15:49.277638 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271264    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 01:15:49.277638 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271267    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 01:15:49.277638 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271269    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 01:15:49.277638 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271272    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 01:15:49.277638 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271274    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 01:15:49.277638 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271277    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 01:15:49.277638 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271279    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 01:15:49.277638 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271282    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 01:15:49.277638 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271285    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 01:15:49.277638 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271287    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 01:15:49.277638 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271290    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 01:15:49.277638 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271293    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 01:15:49.277638 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271296    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 01:15:49.277638 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271299    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 01:15:49.277638 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271301    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 01:15:49.277638 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271304    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 01:15:49.277638 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271307    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 01:15:49.277638 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271309    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 01:15:49.278124 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271312    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 01:15:49.278124 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271316    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 01:15:49.278124 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271319    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 01:15:49.278124 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271322    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 01:15:49.278124 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271325    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 01:15:49.278124 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271328    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 01:15:49.278124 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271330    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 01:15:49.278124 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271333    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 01:15:49.278124 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271336    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 01:15:49.278124 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271339    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 01:15:49.278124 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271341    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 01:15:49.278124 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271344    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 01:15:49.278124 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271346    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 01:15:49.278124 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271365    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 01:15:49.278124 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271369    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 01:15:49.278124 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271372    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 01:15:49.278124 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271376    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 01:15:49.278124 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271378    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 01:15:49.278124 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271381    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 01:15:49.278605 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271384    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 01:15:49.278605 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271387    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 01:15:49.278605 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271389    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 01:15:49.278605 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271392    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 01:15:49.278605 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271395    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 01:15:49.278605 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271397    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 01:15:49.278605 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271400    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 01:15:49.278605 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271403    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 01:15:49.278605 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271406    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 01:15:49.278605 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271409    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 01:15:49.278605 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271412    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 01:15:49.278605 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271415    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 01:15:49.278605 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271417    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 01:15:49.278605 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271420    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 01:15:49.278605 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271423    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 01:15:49.278605 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271425    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 01:15:49.278605 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271428    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 01:15:49.278605 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271431    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 01:15:49.278605 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:49.271433    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 01:15:49.279067 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.271438    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 01:15:49.279067 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.271582    2560 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 28 01:15:49.279067 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.273547    2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 28 01:15:49.279067 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.274839    2560 server.go:1019] "Starting client certificate rotation"
Jul 28 01:15:49.279067 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.274940    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 01:15:49.279067 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.274977    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 01:15:49.279067 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.277795    2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 01:15:49.279246 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.279083    2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 01:15:49.291025 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.291001    2560 log.go:25] "Validated CRI v1 runtime API"
Jul 28 01:15:49.292996 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.292979    2560 log.go:25] "Validated CRI v1 image API"
Jul 28 01:15:49.293760 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.293745    2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 28 01:15:49.296072 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.296043    2560 fs.go:135] Filesystem UUIDs: map[0af97de7-98d3-41b8-8e4a-a90e3eefa23a:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 8ef69795-f1fc-4c5c-af1c-feaf1c8d0a8f:/dev/nvme0n1p4]
Jul 28 01:15:49.296138 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.296071    2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 28 01:15:49.300180 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.300159    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 01:15:49.302847 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.302726    2560 manager.go:216] Machine: {Timestamp:2026-07-28 01:15:49.301294427 +0000 UTC m=+0.335337812 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098142 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cd4dcc95bae58ad4128af053b3f7f SystemUUID:ec2cd4dc-c95b-ae58-ad41-28af053b3f7f BootID:89eee317-0e9d-4569-aed3-706b87db0051 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:94:74:9b:76:17 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:94:74:9b:76:17 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:86:a1:e1:a2:d5:d2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 28 01:15:49.302847 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.302842    2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 28 01:15:49.302970 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.302928    2560 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 28 01:15:49.305695 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.305668    2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 28 01:15:49.305835 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.305699    2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-213.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 28 01:15:49.306878 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.306867    2560 topology_manager.go:138] "Creating topology manager with none policy"
Jul 28 01:15:49.306914 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.306881    2560 container_manager_linux.go:309] "Creating device plugin manager"
Jul 28 01:15:49.306914 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.306889    2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 01:15:49.307545 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.307534    2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 01:15:49.308286 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.308276    2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 28 01:15:49.310989 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.310976    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 01:15:49.311154 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.311144    2560 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 28 01:15:49.311199 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.311175    2560 kubelet.go:486] "Attempting to sync node with API server"
Jul 28 01:15:49.311199 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.311185    2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 28 01:15:49.311268 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.311200    2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 28 01:15:49.311268 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.311209    2560 kubelet.go:398] "Adding apiserver pod source"
Jul 28 01:15:49.311268 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.311218    2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 28 01:15:49.311602 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.311589    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 01:15:49.311640 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.311614    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 01:15:49.313460 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.313445    2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 28 01:15:49.315228 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.315212    2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 28 01:15:49.315287 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.315242    2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 28 01:15:49.316871 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.316859    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 28 01:15:49.316929 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.316876    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 28 01:15:49.316929 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.316882    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 28 01:15:49.316929 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.316889    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 28 01:15:49.316929 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.316897    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 28 01:15:49.316929 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.316903    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 28 01:15:49.316929 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.316911    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 28 01:15:49.316929 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.316916    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 28 01:15:49.316929 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.316925    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 28 01:15:49.316929 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.316930    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 28 01:15:49.317157 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.316949    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 28 01:15:49.317157 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.316954    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 28 01:15:49.317662 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.317653    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 28 01:15:49.317662 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.317662    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 28 01:15:49.320819 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.320801    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-whwvq"
Jul 28 01:15:49.320915 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.320838    2560 server.go:1268] "Started kubelet"
Jul 28 01:15:49.320994 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.320939    2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 28 01:15:49.321087 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.321050    2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 28 01:15:49.321138 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.321104    2560 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 28 01:15:49.321746 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.321725    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-213.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 28 01:15:49.321823 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:49.321753    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-213.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 28 01:15:49.321893 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:49.321831    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 28 01:15:49.323001 ip-10-0-131-213 systemd[1]: Started Kubernetes Kubelet.
Jul 28 01:15:49.323155 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.323054    2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 28 01:15:49.323538 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.323519    2560 server.go:310] "Adding debug handlers to kubelet server"
Jul 28 01:15:49.326255 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:49.326233    2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 28 01:15:49.328930 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:49.328117    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-213.ec2.internal.18c64f2b36d0b143  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-213.ec2.internal,UID:ip-10-0-131-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-213.ec2.internal,},FirstTimestamp:2026-07-28 01:15:49.320814915 +0000 UTC m=+0.354858298,LastTimestamp:2026-07-28 01:15:49.320814915 +0000 UTC m=+0.354858298,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-213.ec2.internal,}"
Jul 28 01:15:49.330825 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.330802    2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 28 01:15:49.330936 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.330824    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 28 01:15:49.331058 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.331036    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-whwvq"
Jul 28 01:15:49.331390 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:49.331253    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-213.ec2.internal\" not found"
Jul 28 01:15:49.331480 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.331413    2560 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 28 01:15:49.331480 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.331427    2560 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 28 01:15:49.331583 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.331497    2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 28 01:15:49.331627 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.331604    2560 reconstruct.go:97] "Volume reconstruction finished"
Jul 28 01:15:49.331627 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.331613    2560 reconciler.go:29] "Reconciler: start to sync state"
Jul 28 01:15:49.331782 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.331764    2560 factory.go:55] Registering systemd factory
Jul 28 01:15:49.331875 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.331787    2560 factory.go:223] Registration of the systemd container factory successfully
Jul 28 01:15:49.332011 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.331995    2560 factory.go:153] Registering CRI-O factory
Jul 28 01:15:49.332011 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.332013    2560 factory.go:223] Registration of the crio container factory successfully
Jul 28 01:15:49.332151 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.332060    2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 28 01:15:49.332151 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.332082    2560 factory.go:103] Registering Raw factory
Jul 28 01:15:49.332151 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.332100    2560 manager.go:1196] Started watching for new ooms in manager
Jul 28 01:15:49.332586 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.332573    2560 manager.go:349] Starting recovery of all containers
Jul 28 01:15:49.334061 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:49.334035    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 28 01:15:49.334157 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:49.334123    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-213.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 28 01:15:49.342663 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.342643    2560 manager.go:354] Recovery completed
Jul 28 01:15:49.347418 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.347398    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 01:15:49.349629 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.349612    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 01:15:49.349682 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.349645    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 01:15:49.349682 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.349658    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeHasSufficientPID"
Jul 28 01:15:49.350204 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.350188    2560 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 28 01:15:49.350204 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.350195    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 01:15:49.350296 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.350203    2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 28 01:15:49.350334 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.350311    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 01:15:49.351067 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.351051    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 01:15:49.351142 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.351078    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 01:15:49.351142 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.351087    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeHasSufficientPID"
Jul 28 01:15:49.353387 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.353375    2560 policy_none.go:49] "None policy: Start"
Jul 28 01:15:49.353423 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.353391    2560 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 28 01:15:49.353423 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.353401    2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 28 01:15:49.355451 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.355438    2560 policy_none.go:47] "Start"
Jul 28 01:15:49.389162 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.388959    2560 manager.go:337] "Starting Device Plugin manager"
Jul 28 01:15:49.389243 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:49.389185    2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 28 01:15:49.389243 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.389197    2560 server.go:87] "Starting device plugin registration server"
Jul 28 01:15:49.389454 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.389443    2560 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 28 01:15:49.389488 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.389458    2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 28 01:15:49.389571 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.389555    2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 28 01:15:49.389661 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.389645    2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 28 01:15:49.389661 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.389658    2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 28 01:15:49.390200 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:49.390185    2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 28 01:15:49.390271 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:49.390227    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-213.ec2.internal\" not found"
Jul 28 01:15:49.452783 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.452741    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 28 01:15:49.454842 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.454020    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 28 01:15:49.454842 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.454052    2560 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 28 01:15:49.454842 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.454073    2560 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 28 01:15:49.454842 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:49.454115    2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 28 01:15:49.456719 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.456700    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 01:15:49.490619 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.490590    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 01:15:49.491581 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.491565    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 01:15:49.491654 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.491602    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 01:15:49.491654 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.491613    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeHasSufficientPID"
Jul 28 01:15:49.491654 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.491634    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-213.ec2.internal"
Jul 28 01:15:49.497432 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.497416    2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-213.ec2.internal"
Jul 28 01:15:49.497481 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:49.497440    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-213.ec2.internal\": node \"ip-10-0-131-213.ec2.internal\" not found"
Jul 28 01:15:49.510606 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:49.510576    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-213.ec2.internal\" not found"
Jul 28 01:15:49.554436 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.554407    2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-213.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-213.ec2.internal"]
Jul 28 01:15:49.554510 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.554474    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 01:15:49.556137 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.556119    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 01:15:49.556210 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.556151    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 01:15:49.556210 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.556165    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeHasSufficientPID"
Jul 28 01:15:49.558416 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.558401    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 01:15:49.558459 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.558451    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-213.ec2.internal"
Jul 28 01:15:49.558494 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.558481    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 01:15:49.560146 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.560124    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 01:15:49.560244 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.560161    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 01:15:49.560244 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.560172    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeHasSufficientPID"
Jul 28 01:15:49.561139 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.561121    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 01:15:49.561244 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.561152    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 01:15:49.561244 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.561166    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeHasSufficientPID"
Jul 28 01:15:49.563325 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.563307    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-213.ec2.internal"
Jul 28 01:15:49.563431 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.563339    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 01:15:49.564393 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.564377    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 01:15:49.564469 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.564402    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 01:15:49.564469 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.564415    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeHasSufficientPID"
Jul 28 01:15:49.595317 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:49.595291    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-213.ec2.internal\" not found" node="ip-10-0-131-213.ec2.internal"
Jul 28 01:15:49.599955 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:49.599939    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-213.ec2.internal\" not found" node="ip-10-0-131-213.ec2.internal"
Jul 28 01:15:49.611620 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:49.611603    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-213.ec2.internal\" not found"
Jul 28 01:15:49.634192 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.634160    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0cf281d765e629b116f53ab05cca74df-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-213.ec2.internal\" (UID: \"0cf281d765e629b116f53ab05cca74df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-213.ec2.internal"
Jul 28 01:15:49.634192 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.634191    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0cf281d765e629b116f53ab05cca74df-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-213.ec2.internal\" (UID: \"0cf281d765e629b116f53ab05cca74df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-213.ec2.internal"
Jul 28 01:15:49.634377 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.634208    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c993073e538500ccbf54eb02b12e7dc3-config\") pod \"kube-apiserver-proxy-ip-10-0-131-213.ec2.internal\" (UID: \"c993073e538500ccbf54eb02b12e7dc3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-213.ec2.internal"
Jul 28 01:15:49.712370 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:49.712284    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-213.ec2.internal\" not found"
Jul 28 01:15:49.734723 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.734696    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0cf281d765e629b116f53ab05cca74df-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-213.ec2.internal\" (UID: \"0cf281d765e629b116f53ab05cca74df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-213.ec2.internal"
Jul 28 01:15:49.734801 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.734731    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0cf281d765e629b116f53ab05cca74df-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-213.ec2.internal\" (UID: \"0cf281d765e629b116f53ab05cca74df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-213.ec2.internal"
Jul 28 01:15:49.734801 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.734755    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c993073e538500ccbf54eb02b12e7dc3-config\") pod \"kube-apiserver-proxy-ip-10-0-131-213.ec2.internal\" (UID: \"c993073e538500ccbf54eb02b12e7dc3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-213.ec2.internal"
Jul 28 01:15:49.734885 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.734821    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0cf281d765e629b116f53ab05cca74df-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-213.ec2.internal\" (UID: \"0cf281d765e629b116f53ab05cca74df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-213.ec2.internal"
Jul 28 01:15:49.734885 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.734874    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0cf281d765e629b116f53ab05cca74df-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-213.ec2.internal\" (UID: \"0cf281d765e629b116f53ab05cca74df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-213.ec2.internal"
Jul 28 01:15:49.734954 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.734911    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c993073e538500ccbf54eb02b12e7dc3-config\") pod \"kube-apiserver-proxy-ip-10-0-131-213.ec2.internal\" (UID: \"c993073e538500ccbf54eb02b12e7dc3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-213.ec2.internal"
Jul 28 01:15:49.813103 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:49.813061    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-213.ec2.internal\" not found"
Jul 28 01:15:49.898628 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.898602    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-213.ec2.internal"
Jul 28 01:15:49.903192 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:49.903173    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-213.ec2.internal"
Jul 28 01:15:49.913481 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:49.913461    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-213.ec2.internal\" not found"
Jul 28 01:15:50.014070 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:50.013978    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-213.ec2.internal\" not found"
Jul 28 01:15:50.114524 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:50.114495    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-213.ec2.internal\" not found"
Jul 28 01:15:50.188344 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:50.188313    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 01:15:50.215261 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:50.215231    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-213.ec2.internal\" not found"
Jul 28 01:15:50.274863 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:50.274785    2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 28 01:15:50.275290 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:50.274944    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 01:15:50.275290 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:50.274987    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 01:15:50.315931 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:50.315874    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-213.ec2.internal\" not found"
Jul 28 01:15:50.320168 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:50.320148    2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 01:15:50.336417 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:50.336382    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 01:10:49 +0000 UTC" deadline="2028-01-11 10:16:51.704543357 +0000 UTC"
Jul 28 01:15:50.336417 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:50.336410    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12777h1m1.368136602s"
Jul 28 01:15:50.416849 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:50.416819    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-213.ec2.internal\" not found"
Jul 28 01:15:50.448265 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:50.448232    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cf281d765e629b116f53ab05cca74df.slice/crio-0488180deaddb63afb7e10960a964a26d32509cd47e881b07d7af2e728c27e4a WatchSource:0}: Error finding container 0488180deaddb63afb7e10960a964a26d32509cd47e881b07d7af2e728c27e4a: Status 404 returned error can't find the container with id 0488180deaddb63afb7e10960a964a26d32509cd47e881b07d7af2e728c27e4a
Jul 28 01:15:50.448634 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:50.448617    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc993073e538500ccbf54eb02b12e7dc3.slice/crio-631183b8bd484a638333ea363cda7e41d8b9f547ef9d1985103703d52f3c9d84 WatchSource:0}: Error finding container 631183b8bd484a638333ea363cda7e41d8b9f547ef9d1985103703d52f3c9d84: Status 404 returned error can't find the container with id 631183b8bd484a638333ea363cda7e41d8b9f547ef9d1985103703d52f3c9d84
Jul 28 01:15:50.452603 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:50.452584    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 01:15:50.457422 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:50.457381    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-213.ec2.internal" event={"ID":"0cf281d765e629b116f53ab05cca74df","Type":"ContainerStarted","Data":"0488180deaddb63afb7e10960a964a26d32509cd47e881b07d7af2e728c27e4a"}
Jul 28 01:15:50.458415 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:50.458371    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-213.ec2.internal" event={"ID":"c993073e538500ccbf54eb02b12e7dc3","Type":"ContainerStarted","Data":"631183b8bd484a638333ea363cda7e41d8b9f547ef9d1985103703d52f3c9d84"}
Jul 28 01:15:50.517922 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:50.517886    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-213.ec2.internal\" not found"
Jul 28 01:15:50.618483 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:50.618408    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-213.ec2.internal\" not found"
Jul 28 01:15:50.718893 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:50.718861    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-213.ec2.internal\" not found"
Jul 28 01:15:50.819700 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:50.819667    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-213.ec2.internal\" not found"
Jul 28 01:15:50.871066 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:50.870990    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 01:15:50.931487 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:50.931458    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-213.ec2.internal"
Jul 28 01:15:50.940467 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:50.940436    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 01:15:50.941467 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:50.941451    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-213.ec2.internal"
Jul 28 01:15:50.949781 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:50.949758    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 01:15:51.312232 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.312148    2560 apiserver.go:52] "Watching apiserver"
Jul 28 01:15:51.318237 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.318210    2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 28 01:15:51.318701 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.318672    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-213.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-213.ec2.internal","openshift-network-diagnostics/network-check-target-kc7hz","openshift-network-operator/iptables-alerter-tfbnv","openshift-ovn-kubernetes/ovnkube-node-5f2zn","kube-system/konnectivity-agent-8qwdd","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqggt","openshift-cluster-node-tuning-operator/tuned-v7r6w","openshift-dns/node-resolver-q6x4f","openshift-image-registry/node-ca-l6jcf","openshift-multus/multus-additional-cni-plugins-bjmmc","openshift-multus/multus-t568g","openshift-multus/network-metrics-daemon-55qx2","kube-system/global-pull-secret-syncer-6zht5"]
Jul 28 01:15:51.321410 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.321388    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqggt"
Jul 28 01:15:51.323225 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.323205    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 28 01:15:51.323525 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.323510    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 28 01:15:51.323623 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.323607    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pbrmg\""
Jul 28 01:15:51.323797 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.323779    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55qx2"
Jul 28 01:15:51.323878 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:51.323850    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55qx2" podUID="fd76bb39-bfb5-4511-a66d-fd55bda460f6"
Jul 28 01:15:51.323936 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.323887    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 28 01:15:51.325917 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.325900    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc7hz"
Jul 28 01:15:51.326021 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:51.325957    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kc7hz" podUID="7b958baa-25e6-45e5-82bd-a1d314a4bbad"
Jul 28 01:15:51.328250 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.328230    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tfbnv"
Jul 28 01:15:51.330006 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.329986    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9l7l6\""
Jul 28 01:15:51.330186 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.330169    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 28 01:15:51.330251 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.330219    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 28 01:15:51.330302 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.330179    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 28 01:15:51.330778 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.330727    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.331619 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.331601    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 28 01:15:51.334096 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.332691    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kct8j\""
Jul 28 01:15:51.334096 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.332978    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 28 01:15:51.334096 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.333161    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 28 01:15:51.334096 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.333270    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 28 01:15:51.334096 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.333339    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 28 01:15:51.334096 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.333570    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 28 01:15:51.334096 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.333621    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8qwdd"
Jul 28 01:15:51.334096 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.333780    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 28 01:15:51.336551 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.335490    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 28 01:15:51.336551 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.335742    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 28 01:15:51.336551 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.335978    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qzh6m\""
Jul 28 01:15:51.336551 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.336477    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q6x4f"
Jul 28 01:15:51.339397 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.338237    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zht5"
Jul 28 01:15:51.339397 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:51.338317    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zht5" podUID="4ce4b7c0-28ad-45a2-9fac-0f0704533f48"
Jul 28 01:15:51.343919 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.343683    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.347080 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.345425    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 28 01:15:51.347080 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.345712    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 28 01:15:51.347080 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.345985    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 28 01:15:51.347080 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.346006    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5b2mx\""
Jul 28 01:15:51.347080 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.346165    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tfh7p\""
Jul 28 01:15:51.347080 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.346196    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 28 01:15:51.347080 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.346380    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/03576f5d-415e-4117-a66a-f5818f8e45c7-host-slash\") pod \"iptables-alerter-tfbnv\" (UID: \"03576f5d-415e-4117-a66a-f5818f8e45c7\") " pod="openshift-network-operator/iptables-alerter-tfbnv"
Jul 28 01:15:51.347080 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.346410    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-run-systemd\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.347080 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.346436    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/33acf01f-ff2d-4208-8bf6-44ebbb38b408-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tqggt\" (UID: \"33acf01f-ff2d-4208-8bf6-44ebbb38b408\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqggt"
Jul 28 01:15:51.347080 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.346460    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/33acf01f-ff2d-4208-8bf6-44ebbb38b408-registration-dir\") pod \"aws-ebs-csi-driver-node-tqggt\" (UID: \"33acf01f-ff2d-4208-8bf6-44ebbb38b408\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqggt"
Jul 28 01:15:51.347080 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.346485    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvdsk\" (UniqueName: \"kubernetes.io/projected/fd76bb39-bfb5-4511-a66d-fd55bda460f6-kube-api-access-vvdsk\") pod \"network-metrics-daemon-55qx2\" (UID: \"fd76bb39-bfb5-4511-a66d-fd55bda460f6\") " pod="openshift-multus/network-metrics-daemon-55qx2"
Jul 28 01:15:51.347080 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.346508    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/130e33f6-0aa5-4931-9754-8cbfef50cd05-konnectivity-ca\") pod \"konnectivity-agent-8qwdd\" (UID: \"130e33f6-0aa5-4931-9754-8cbfef50cd05\") " pod="kube-system/konnectivity-agent-8qwdd"
Jul 28 01:15:51.347080 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.346532    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-host-run-ovn-kubernetes\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.347080 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.346554    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-env-overrides\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.347080 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.346578    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/130e33f6-0aa5-4931-9754-8cbfef50cd05-agent-certs\") pod \"konnectivity-agent-8qwdd\" (UID: \"130e33f6-0aa5-4931-9754-8cbfef50cd05\") " pod="kube-system/konnectivity-agent-8qwdd"
Jul 28 01:15:51.347080 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.346612    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/33acf01f-ff2d-4208-8bf6-44ebbb38b408-etc-selinux\") pod \"aws-ebs-csi-driver-node-tqggt\" (UID: \"33acf01f-ff2d-4208-8bf6-44ebbb38b408\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqggt"
Jul 28 01:15:51.347080 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.346635    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/33acf01f-ff2d-4208-8bf6-44ebbb38b408-sys-fs\") pod \"aws-ebs-csi-driver-node-tqggt\" (UID: \"33acf01f-ff2d-4208-8bf6-44ebbb38b408\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqggt"
Jul 28 01:15:51.347080 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.346657    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-ovnkube-script-lib\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.347080 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.346683    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/03576f5d-415e-4117-a66a-f5818f8e45c7-iptables-alerter-script\") pod \"iptables-alerter-tfbnv\" (UID: \"03576f5d-415e-4117-a66a-f5818f8e45c7\") " pod="openshift-network-operator/iptables-alerter-tfbnv"
Jul 28 01:15:51.348165 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.346704    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-log-socket\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.348165 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.346725    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-host-cni-bin\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.348165 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.346746    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-host-cni-netd\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.348165 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.346769    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.348165 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.346797    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-host-slash\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.348165 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.346821    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-host-run-netns\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.348165 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.346843    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-node-log\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.348165 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.346865    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd76bb39-bfb5-4511-a66d-fd55bda460f6-metrics-certs\") pod \"network-metrics-daemon-55qx2\" (UID: \"fd76bb39-bfb5-4511-a66d-fd55bda460f6\") " pod="openshift-multus/network-metrics-daemon-55qx2"
Jul 28 01:15:51.348165 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.346896    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqsqh\" (UniqueName: \"kubernetes.io/projected/03576f5d-415e-4117-a66a-f5818f8e45c7-kube-api-access-gqsqh\") pod \"iptables-alerter-tfbnv\" (UID: \"03576f5d-415e-4117-a66a-f5818f8e45c7\") " pod="openshift-network-operator/iptables-alerter-tfbnv"
Jul 28 01:15:51.348165 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.346918    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-etc-openvswitch\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.348165 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.346940    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-run-openvswitch\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.348165 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.346969    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-ovnkube-config\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.348165 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.346997    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-ovn-node-metrics-cert\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.348165 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.347020    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrlcs\" (UniqueName: \"kubernetes.io/projected/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-kube-api-access-zrlcs\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.348165 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.347045    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/33acf01f-ff2d-4208-8bf6-44ebbb38b408-socket-dir\") pod \"aws-ebs-csi-driver-node-tqggt\" (UID: \"33acf01f-ff2d-4208-8bf6-44ebbb38b408\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqggt"
Jul 28 01:15:51.348165 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.347067    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/33acf01f-ff2d-4208-8bf6-44ebbb38b408-device-dir\") pod \"aws-ebs-csi-driver-node-tqggt\" (UID: \"33acf01f-ff2d-4208-8bf6-44ebbb38b408\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqggt"
Jul 28 01:15:51.348929 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.347088    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-host-kubelet\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.348929 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.347111    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jls5r\" (UniqueName: \"kubernetes.io/projected/7b958baa-25e6-45e5-82bd-a1d314a4bbad-kube-api-access-jls5r\") pod \"network-check-target-kc7hz\" (UID: \"7b958baa-25e6-45e5-82bd-a1d314a4bbad\") " pod="openshift-network-diagnostics/network-check-target-kc7hz"
Jul 28 01:15:51.348929 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.347126    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 01:15:51.348929 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.347133    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-systemd-units\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.348929 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.347329    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-var-lib-openvswitch\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.348929 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.347376    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-run-ovn\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.348929 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.347415    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp6vx\" (UniqueName: \"kubernetes.io/projected/33acf01f-ff2d-4208-8bf6-44ebbb38b408-kube-api-access-sp6vx\") pod \"aws-ebs-csi-driver-node-tqggt\" (UID: \"33acf01f-ff2d-4208-8bf6-44ebbb38b408\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqggt"
Jul 28 01:15:51.348929 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.347490    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l6jcf"
Jul 28 01:15:51.349533 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.349512    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 28 01:15:51.349740 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.349723    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-55544\""
Jul 28 01:15:51.349815 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.349796    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 28 01:15:51.349953 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.349937    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 28 01:15:51.350125 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.350102    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bjmmc"
Jul 28 01:15:51.351992 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.351974    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 28 01:15:51.352139 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.352098    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-skb55\""
Jul 28 01:15:51.352433 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.352416    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 28 01:15:51.352518 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.352439    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 28 01:15:51.352581 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.352524    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.353223 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.353055    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 28 01:15:51.353223 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.353084    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 28 01:15:51.354484 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.354467    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-nrm52\""
Jul 28 01:15:51.355045 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.354667    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 28 01:15:51.360001 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.359964    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cc6c5"
Jul 28 01:15:51.367431 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.367380    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cc6c5"
Jul 28 01:15:51.377604 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.377582    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 01:15:51.433945 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.433913    2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 28 01:15:51.448035 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.448002    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-host-run-netns\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.448035 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.448035    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee785053-e88b-44ef-a5cb-659eaa15ed7b-host\") pod \"node-ca-l6jcf\" (UID: \"ee785053-e88b-44ef-a5cb-659eaa15ed7b\") " pod="openshift-image-registry/node-ca-l6jcf"
Jul 28 01:15:51.448253 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.448056    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-multus-cni-dir\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.448253 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.448079    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-host-run-k8s-cni-cncf-io\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.448253 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.448130    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-host-run-multus-certs\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.448253 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.448172    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/33acf01f-ff2d-4208-8bf6-44ebbb38b408-device-dir\") pod \"aws-ebs-csi-driver-node-tqggt\" (UID: \"33acf01f-ff2d-4208-8bf6-44ebbb38b408\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqggt"
Jul 28 01:15:51.448253 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.448201    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-cni-binary-copy\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.448253 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.448229    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jls5r\" (UniqueName: \"kubernetes.io/projected/7b958baa-25e6-45e5-82bd-a1d314a4bbad-kube-api-access-jls5r\") pod \"network-check-target-kc7hz\" (UID: \"7b958baa-25e6-45e5-82bd-a1d314a4bbad\") " pod="openshift-network-diagnostics/network-check-target-kc7hz"
Jul 28 01:15:51.448253 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.448251    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0-etc-kubernetes\") pod \"tuned-v7r6w\" (UID: \"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0\") " pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.448562 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.448262    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/33acf01f-ff2d-4208-8bf6-44ebbb38b408-device-dir\") pod \"aws-ebs-csi-driver-node-tqggt\" (UID: \"33acf01f-ff2d-4208-8bf6-44ebbb38b408\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqggt"
Jul 28 01:15:51.448562 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.448273    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0-host\") pod \"tuned-v7r6w\" (UID: \"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0\") " pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.448562 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.448295    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ee785053-e88b-44ef-a5cb-659eaa15ed7b-serviceca\") pod \"node-ca-l6jcf\" (UID: \"ee785053-e88b-44ef-a5cb-659eaa15ed7b\") " pod="openshift-image-registry/node-ca-l6jcf"
Jul 28 01:15:51.448562 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.448320    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-systemd-units\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.448562 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.448367    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0-etc-sysconfig\") pod \"tuned-v7r6w\" (UID: \"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0\") " pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.448562 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.448391    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-system-cni-dir\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.448562 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.448413    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/03576f5d-415e-4117-a66a-f5818f8e45c7-host-slash\") pod \"iptables-alerter-tfbnv\" (UID: \"03576f5d-415e-4117-a66a-f5818f8e45c7\") " pod="openshift-network-operator/iptables-alerter-tfbnv"
Jul 28 01:15:51.448562 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.448437    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/33acf01f-ff2d-4208-8bf6-44ebbb38b408-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tqggt\" (UID: \"33acf01f-ff2d-4208-8bf6-44ebbb38b408\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqggt"
Jul 28 01:15:51.448562 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.448461    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/33acf01f-ff2d-4208-8bf6-44ebbb38b408-registration-dir\") pod \"aws-ebs-csi-driver-node-tqggt\" (UID: \"33acf01f-ff2d-4208-8bf6-44ebbb38b408\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqggt"
Jul 28 01:15:51.448562 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.448484    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvdsk\" (UniqueName: \"kubernetes.io/projected/fd76bb39-bfb5-4511-a66d-fd55bda460f6-kube-api-access-vvdsk\") pod \"network-metrics-daemon-55qx2\" (UID: \"fd76bb39-bfb5-4511-a66d-fd55bda460f6\") " pod="openshift-multus/network-metrics-daemon-55qx2"
Jul 28 01:15:51.448562 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.448507    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92gkz\" (UniqueName: \"kubernetes.io/projected/0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0-kube-api-access-92gkz\") pod \"tuned-v7r6w\" (UID: \"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0\") " pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.448562 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.448545    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79b7t\" (UniqueName: \"kubernetes.io/projected/4543a9b5-cb95-4e16-8239-6dac004c306d-kube-api-access-79b7t\") pod \"multus-additional-cni-plugins-bjmmc\" (UID: \"4543a9b5-cb95-4e16-8239-6dac004c306d\") " pod="openshift-multus/multus-additional-cni-plugins-bjmmc"
Jul 28 01:15:51.449269 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.448578    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-etc-kubernetes\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.449269 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.448631    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/33acf01f-ff2d-4208-8bf6-44ebbb38b408-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tqggt\" (UID: \"33acf01f-ff2d-4208-8bf6-44ebbb38b408\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqggt"
Jul 28 01:15:51.449269 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.448657    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-systemd-units\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.449269 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.448701    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/03576f5d-415e-4117-a66a-f5818f8e45c7-host-slash\") pod \"iptables-alerter-tfbnv\" (UID: \"03576f5d-415e-4117-a66a-f5818f8e45c7\") " pod="openshift-network-operator/iptables-alerter-tfbnv"
Jul 28 01:15:51.449269 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.448729    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0-lib-modules\") pod \"tuned-v7r6w\" (UID: \"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0\") " pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.449269 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.448766    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/33acf01f-ff2d-4208-8bf6-44ebbb38b408-registration-dir\") pod \"aws-ebs-csi-driver-node-tqggt\" (UID: \"33acf01f-ff2d-4208-8bf6-44ebbb38b408\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqggt"
Jul 28 01:15:51.449269 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.448815    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0-var-lib-kubelet\") pod \"tuned-v7r6w\" (UID: \"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0\") " pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.449269 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.448852    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4543a9b5-cb95-4e16-8239-6dac004c306d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bjmmc\" (UID: \"4543a9b5-cb95-4e16-8239-6dac004c306d\") " pod="openshift-multus/multus-additional-cni-plugins-bjmmc"
Jul 28 01:15:51.449269 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.448886    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-cnibin\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.449269 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.448912    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/33acf01f-ff2d-4208-8bf6-44ebbb38b408-etc-selinux\") pod \"aws-ebs-csi-driver-node-tqggt\" (UID: \"33acf01f-ff2d-4208-8bf6-44ebbb38b408\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqggt"
Jul 28 01:15:51.449269 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.448935    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0-etc-tuned\") pod \"tuned-v7r6w\" (UID: \"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0\") " pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.449269 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.448960    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-hostroot\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.449269 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.448996    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-ovnkube-script-lib\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.449269 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.449076    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/33acf01f-ff2d-4208-8bf6-44ebbb38b408-etc-selinux\") pod \"aws-ebs-csi-driver-node-tqggt\" (UID: \"33acf01f-ff2d-4208-8bf6-44ebbb38b408\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqggt"
Jul 28 01:15:51.449269 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.449136    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-host-cni-bin\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.449269 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.449174    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-host-cni-bin\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.449269 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.449205    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjj64\" (UniqueName: \"kubernetes.io/projected/ee785053-e88b-44ef-a5cb-659eaa15ed7b-kube-api-access-gjj64\") pod \"node-ca-l6jcf\" (UID: \"ee785053-e88b-44ef-a5cb-659eaa15ed7b\") " pod="openshift-image-registry/node-ca-l6jcf"
Jul 28 01:15:51.450080 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.449243    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-host-slash\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.450080 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.449267    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-host-run-netns\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.450080 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.449307    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-host-slash\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.450080 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.449334    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-node-log\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.450080 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.449375    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd76bb39-bfb5-4511-a66d-fd55bda460f6-metrics-certs\") pod \"network-metrics-daemon-55qx2\" (UID: \"fd76bb39-bfb5-4511-a66d-fd55bda460f6\") " pod="openshift-multus/network-metrics-daemon-55qx2"
Jul 28 01:15:51.450080 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.449404    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0-sys\") pod \"tuned-v7r6w\" (UID: \"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0\") " pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.450080 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:51.449493    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:15:51.450080 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:51.449562    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd76bb39-bfb5-4511-a66d-fd55bda460f6-metrics-certs podName:fd76bb39-bfb5-4511-a66d-fd55bda460f6 nodeName:}" failed. No retries permitted until 2026-07-28 01:15:51.949530897 +0000 UTC m=+2.983574272 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fd76bb39-bfb5-4511-a66d-fd55bda460f6-metrics-certs") pod "network-metrics-daemon-55qx2" (UID: "fd76bb39-bfb5-4511-a66d-fd55bda460f6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:15:51.450080 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.449619    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-ovnkube-script-lib\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.450080 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.449675    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-host-run-netns\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.450080 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.449713    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4543a9b5-cb95-4e16-8239-6dac004c306d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bjmmc\" (UID: \"4543a9b5-cb95-4e16-8239-6dac004c306d\") " pod="openshift-multus/multus-additional-cni-plugins-bjmmc"
Jul 28 01:15:51.450080 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.449716    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-node-log\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.450080 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.449762    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4ce4b7c0-28ad-45a2-9fac-0f0704533f48-kubelet-config\") pod \"global-pull-secret-syncer-6zht5\" (UID: \"4ce4b7c0-28ad-45a2-9fac-0f0704533f48\") " pod="kube-system/global-pull-secret-syncer-6zht5"
Jul 28 01:15:51.450080 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.449801    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-multus-conf-dir\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.450080 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.449834    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqsqh\" (UniqueName: \"kubernetes.io/projected/03576f5d-415e-4117-a66a-f5818f8e45c7-kube-api-access-gqsqh\") pod \"iptables-alerter-tfbnv\" (UID: \"03576f5d-415e-4117-a66a-f5818f8e45c7\") " pod="openshift-network-operator/iptables-alerter-tfbnv"
Jul 28 01:15:51.450080 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.449871    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-etc-openvswitch\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.450080 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.449897    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-run-openvswitch\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.450898 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.449920    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-etc-openvswitch\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.450898 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.449921    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-ovnkube-config\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.450898 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.449961    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-ovn-node-metrics-cert\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.450898 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.449970    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-run-openvswitch\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.450898 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.450071    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrlcs\" (UniqueName: \"kubernetes.io/projected/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-kube-api-access-zrlcs\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.450898 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.450224    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/33acf01f-ff2d-4208-8bf6-44ebbb38b408-socket-dir\") pod \"aws-ebs-csi-driver-node-tqggt\" (UID: \"33acf01f-ff2d-4208-8bf6-44ebbb38b408\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqggt"
Jul 28 01:15:51.450898 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.450257    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4543a9b5-cb95-4e16-8239-6dac004c306d-cni-binary-copy\") pod \"multus-additional-cni-plugins-bjmmc\" (UID: \"4543a9b5-cb95-4e16-8239-6dac004c306d\") " pod="openshift-multus/multus-additional-cni-plugins-bjmmc"
Jul 28 01:15:51.450898 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.450282    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-host-kubelet\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.450898 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.450304    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acb1d898-a0fc-45e9-a715-67dc3301b622-tmp-dir\") pod \"node-resolver-q6x4f\" (UID: \"acb1d898-a0fc-45e9-a715-67dc3301b622\") " pod="openshift-dns/node-resolver-q6x4f"
Jul 28 01:15:51.450898 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.450326    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0-etc-systemd\") pod \"tuned-v7r6w\" (UID: \"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0\") " pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.450898 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.450347    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0-run\") pod \"tuned-v7r6w\" (UID: \"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0\") " pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.450898 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.450370    2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 28 01:15:51.450898 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.450392    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-multus-socket-dir-parent\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.450898 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.450416    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-host-var-lib-kubelet\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.450898 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.450430    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-host-kubelet\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.450898 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.450440    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-multus-daemon-config\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.450898 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.450492    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-ovnkube-config\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.451622 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.450507    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-var-lib-openvswitch\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.451622 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.450530    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-run-ovn\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.451622 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.450536    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/33acf01f-ff2d-4208-8bf6-44ebbb38b408-socket-dir\") pod \"aws-ebs-csi-driver-node-tqggt\" (UID: \"33acf01f-ff2d-4208-8bf6-44ebbb38b408\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqggt"
Jul 28 01:15:51.451622 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.450549    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp6vx\" (UniqueName: \"kubernetes.io/projected/33acf01f-ff2d-4208-8bf6-44ebbb38b408-kube-api-access-sp6vx\") pod \"aws-ebs-csi-driver-node-tqggt\" (UID: \"33acf01f-ff2d-4208-8bf6-44ebbb38b408\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqggt"
Jul 28 01:15:51.451622 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.450563    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0-etc-modprobe-d\") pod \"tuned-v7r6w\" (UID: \"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0\") " pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.451622 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.450578    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-var-lib-openvswitch\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.451622 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.450580    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4543a9b5-cb95-4e16-8239-6dac004c306d-os-release\") pod \"multus-additional-cni-plugins-bjmmc\" (UID: \"4543a9b5-cb95-4e16-8239-6dac004c306d\") " pod="openshift-multus/multus-additional-cni-plugins-bjmmc"
Jul 28 01:15:51.451622 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.450611    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-host-var-lib-cni-bin\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.451622 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.450620    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-run-ovn\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.451622 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.450638    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-run-systemd\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.451622 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.450667    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4543a9b5-cb95-4e16-8239-6dac004c306d-cnibin\") pod \"multus-additional-cni-plugins-bjmmc\" (UID: \"4543a9b5-cb95-4e16-8239-6dac004c306d\") " pod="openshift-multus/multus-additional-cni-plugins-bjmmc"
Jul 28 01:15:51.451622 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.450690    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-os-release\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.451622 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.450713    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-host-var-lib-cni-multus\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.451622 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.450728    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-run-systemd\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.451622 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.450746    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/130e33f6-0aa5-4931-9754-8cbfef50cd05-konnectivity-ca\") pod \"konnectivity-agent-8qwdd\" (UID: \"130e33f6-0aa5-4931-9754-8cbfef50cd05\") " pod="kube-system/konnectivity-agent-8qwdd"
Jul 28 01:15:51.451622 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.450773    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4543a9b5-cb95-4e16-8239-6dac004c306d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bjmmc\" (UID: \"4543a9b5-cb95-4e16-8239-6dac004c306d\") " pod="openshift-multus/multus-additional-cni-plugins-bjmmc"
Jul 28 01:15:51.451622 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.450796    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ce4b7c0-28ad-45a2-9fac-0f0704533f48-original-pull-secret\") pod \"global-pull-secret-syncer-6zht5\" (UID: \"4ce4b7c0-28ad-45a2-9fac-0f0704533f48\") " pod="kube-system/global-pull-secret-syncer-6zht5"
Jul 28 01:15:51.452338 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.450823    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcb74\" (UniqueName: \"kubernetes.io/projected/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-kube-api-access-vcb74\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.452338 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.450849    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-host-run-ovn-kubernetes\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.452338 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.450874    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-env-overrides\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.452338 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.450897    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/130e33f6-0aa5-4931-9754-8cbfef50cd05-agent-certs\") pod \"konnectivity-agent-8qwdd\" (UID: \"130e33f6-0aa5-4931-9754-8cbfef50cd05\") " pod="kube-system/konnectivity-agent-8qwdd"
Jul 28 01:15:51.452338 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.450920    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/33acf01f-ff2d-4208-8bf6-44ebbb38b408-sys-fs\") pod \"aws-ebs-csi-driver-node-tqggt\" (UID: \"33acf01f-ff2d-4208-8bf6-44ebbb38b408\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqggt"
Jul 28 01:15:51.452338 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.450944    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwmps\" (UniqueName: \"kubernetes.io/projected/acb1d898-a0fc-45e9-a715-67dc3301b622-kube-api-access-cwmps\") pod \"node-resolver-q6x4f\" (UID: \"acb1d898-a0fc-45e9-a715-67dc3301b622\") " pod="openshift-dns/node-resolver-q6x4f"
Jul 28 01:15:51.452338 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.450968    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0-etc-sysctl-d\") pod \"tuned-v7r6w\" (UID: \"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0\") " pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.452338 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.450989    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0-etc-sysctl-conf\") pod \"tuned-v7r6w\" (UID: \"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0\") " pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.452338 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.451010    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0-tmp\") pod \"tuned-v7r6w\" (UID: \"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0\") " pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.452338 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.451034    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/03576f5d-415e-4117-a66a-f5818f8e45c7-iptables-alerter-script\") pod \"iptables-alerter-tfbnv\" (UID: \"03576f5d-415e-4117-a66a-f5818f8e45c7\") " pod="openshift-network-operator/iptables-alerter-tfbnv"
Jul 28 01:15:51.452338 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.451058    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-log-socket\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.452338 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.451082    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-host-cni-netd\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.452338 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.451106    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.452338 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.451144    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/acb1d898-a0fc-45e9-a715-67dc3301b622-hosts-file\") pod \"node-resolver-q6x4f\" (UID: \"acb1d898-a0fc-45e9-a715-67dc3301b622\") " pod="openshift-dns/node-resolver-q6x4f"
Jul 28 01:15:51.452338 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.451184    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4543a9b5-cb95-4e16-8239-6dac004c306d-system-cni-dir\") pod \"multus-additional-cni-plugins-bjmmc\" (UID: \"4543a9b5-cb95-4e16-8239-6dac004c306d\") " pod="openshift-multus/multus-additional-cni-plugins-bjmmc"
Jul 28 01:15:51.452338 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.451199    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/130e33f6-0aa5-4931-9754-8cbfef50cd05-konnectivity-ca\") pod \"konnectivity-agent-8qwdd\" (UID: \"130e33f6-0aa5-4931-9754-8cbfef50cd05\") " pod="kube-system/konnectivity-agent-8qwdd"
Jul 28 01:15:51.452338 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.451211    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4ce4b7c0-28ad-45a2-9fac-0f0704533f48-dbus\") pod \"global-pull-secret-syncer-6zht5\" (UID: \"4ce4b7c0-28ad-45a2-9fac-0f0704533f48\") " pod="kube-system/global-pull-secret-syncer-6zht5"
Jul 28 01:15:51.453207 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.451146    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.453207 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.451308    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-host-run-ovn-kubernetes\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.453207 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.451301    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-log-socket\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.453207 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.451383    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/33acf01f-ff2d-4208-8bf6-44ebbb38b408-sys-fs\") pod \"aws-ebs-csi-driver-node-tqggt\" (UID: \"33acf01f-ff2d-4208-8bf6-44ebbb38b408\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqggt"
Jul 28 01:15:51.453207 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.451387    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-host-cni-netd\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.453207 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.451657    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/03576f5d-415e-4117-a66a-f5818f8e45c7-iptables-alerter-script\") pod \"iptables-alerter-tfbnv\" (UID: \"03576f5d-415e-4117-a66a-f5818f8e45c7\") " pod="openshift-network-operator/iptables-alerter-tfbnv"
Jul 28 01:15:51.453207 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.451679    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-env-overrides\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.453207 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:51.453094    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 01:15:51.453207 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:51.453117    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 01:15:51.453207 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:51.453132    2560 projected.go:196] Error preparing data for projected volume kube-api-access-jls5r for pod openshift-network-diagnostics/network-check-target-kc7hz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:15:51.453207 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:51.453203    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7b958baa-25e6-45e5-82bd-a1d314a4bbad-kube-api-access-jls5r podName:7b958baa-25e6-45e5-82bd-a1d314a4bbad nodeName:}" failed. No retries permitted until 2026-07-28 01:15:51.953186806 +0000 UTC m=+2.987230182 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jls5r" (UniqueName: "kubernetes.io/projected/7b958baa-25e6-45e5-82bd-a1d314a4bbad-kube-api-access-jls5r") pod "network-check-target-kc7hz" (UID: "7b958baa-25e6-45e5-82bd-a1d314a4bbad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:15:51.454088 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.454020    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-ovn-node-metrics-cert\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.454578 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.454460    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/130e33f6-0aa5-4931-9754-8cbfef50cd05-agent-certs\") pod \"konnectivity-agent-8qwdd\" (UID: \"130e33f6-0aa5-4931-9754-8cbfef50cd05\") " pod="kube-system/konnectivity-agent-8qwdd"
Jul 28 01:15:51.455846 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.455781    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvdsk\" (UniqueName: \"kubernetes.io/projected/fd76bb39-bfb5-4511-a66d-fd55bda460f6-kube-api-access-vvdsk\") pod \"network-metrics-daemon-55qx2\" (UID: \"fd76bb39-bfb5-4511-a66d-fd55bda460f6\") " pod="openshift-multus/network-metrics-daemon-55qx2"
Jul 28 01:15:51.457960 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.457699    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqsqh\" (UniqueName: \"kubernetes.io/projected/03576f5d-415e-4117-a66a-f5818f8e45c7-kube-api-access-gqsqh\") pod \"iptables-alerter-tfbnv\" (UID: \"03576f5d-415e-4117-a66a-f5818f8e45c7\") " pod="openshift-network-operator/iptables-alerter-tfbnv"
Jul 28 01:15:51.458574 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.458546    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrlcs\" (UniqueName: \"kubernetes.io/projected/5311b0bc-9ad2-4e2f-bdde-81510c6d6b19-kube-api-access-zrlcs\") pod \"ovnkube-node-5f2zn\" (UID: \"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.458856 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.458814    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp6vx\" (UniqueName: \"kubernetes.io/projected/33acf01f-ff2d-4208-8bf6-44ebbb38b408-kube-api-access-sp6vx\") pod \"aws-ebs-csi-driver-node-tqggt\" (UID: \"33acf01f-ff2d-4208-8bf6-44ebbb38b408\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqggt"
Jul 28 01:15:51.551671 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.551641    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/acb1d898-a0fc-45e9-a715-67dc3301b622-hosts-file\") pod \"node-resolver-q6x4f\" (UID: \"acb1d898-a0fc-45e9-a715-67dc3301b622\") " pod="openshift-dns/node-resolver-q6x4f"
Jul 28 01:15:51.551829 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.551679    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4543a9b5-cb95-4e16-8239-6dac004c306d-system-cni-dir\") pod \"multus-additional-cni-plugins-bjmmc\" (UID: \"4543a9b5-cb95-4e16-8239-6dac004c306d\") " pod="openshift-multus/multus-additional-cni-plugins-bjmmc"
Jul 28 01:15:51.551829 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.551696    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4ce4b7c0-28ad-45a2-9fac-0f0704533f48-dbus\") pod \"global-pull-secret-syncer-6zht5\" (UID: \"4ce4b7c0-28ad-45a2-9fac-0f0704533f48\") " pod="kube-system/global-pull-secret-syncer-6zht5"
Jul 28 01:15:51.551829 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.551712    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-host-run-netns\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.551829 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.551729    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee785053-e88b-44ef-a5cb-659eaa15ed7b-host\") pod \"node-ca-l6jcf\" (UID: \"ee785053-e88b-44ef-a5cb-659eaa15ed7b\") " pod="openshift-image-registry/node-ca-l6jcf"
Jul 28 01:15:51.551829 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.551760    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4543a9b5-cb95-4e16-8239-6dac004c306d-system-cni-dir\") pod \"multus-additional-cni-plugins-bjmmc\" (UID: \"4543a9b5-cb95-4e16-8239-6dac004c306d\") " pod="openshift-multus/multus-additional-cni-plugins-bjmmc"
Jul 28 01:15:51.551829 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.551777    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-host-run-netns\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.551829 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.551786    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-multus-cni-dir\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.551829 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.551769    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee785053-e88b-44ef-a5cb-659eaa15ed7b-host\") pod \"node-ca-l6jcf\" (UID: \"ee785053-e88b-44ef-a5cb-659eaa15ed7b\") " pod="openshift-image-registry/node-ca-l6jcf"
Jul 28 01:15:51.551829 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.551761    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/acb1d898-a0fc-45e9-a715-67dc3301b622-hosts-file\") pod \"node-resolver-q6x4f\" (UID: \"acb1d898-a0fc-45e9-a715-67dc3301b622\") " pod="openshift-dns/node-resolver-q6x4f"
Jul 28 01:15:51.551829 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.551816    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-host-run-k8s-cni-cncf-io\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.552192 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.551850    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-host-run-multus-certs\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.552192 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.551856    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-host-run-k8s-cni-cncf-io\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.552192 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.551862    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4ce4b7c0-28ad-45a2-9fac-0f0704533f48-dbus\") pod \"global-pull-secret-syncer-6zht5\" (UID: \"4ce4b7c0-28ad-45a2-9fac-0f0704533f48\") " pod="kube-system/global-pull-secret-syncer-6zht5"
Jul 28 01:15:51.552192 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.551878    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-cni-binary-copy\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.552192 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.551885    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-multus-cni-dir\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.552192 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.551895    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-host-run-multus-certs\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.552192 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.551918    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0-etc-kubernetes\") pod \"tuned-v7r6w\" (UID: \"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0\") " pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.552192 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.551933    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0-host\") pod \"tuned-v7r6w\" (UID: \"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0\") " pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.552192 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552035    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ee785053-e88b-44ef-a5cb-659eaa15ed7b-serviceca\") pod \"node-ca-l6jcf\" (UID: \"ee785053-e88b-44ef-a5cb-659eaa15ed7b\") " pod="openshift-image-registry/node-ca-l6jcf"
Jul 28 01:15:51.552192 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552068    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0-host\") pod \"tuned-v7r6w\" (UID: \"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0\") " pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.552192 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552071    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0-etc-sysconfig\") pod \"tuned-v7r6w\" (UID: \"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0\") " pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.552192 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552090    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-system-cni-dir\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.552192 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552102    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0-etc-sysconfig\") pod \"tuned-v7r6w\" (UID: \"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0\") " pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.552192 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552109    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92gkz\" (UniqueName: \"kubernetes.io/projected/0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0-kube-api-access-92gkz\") pod \"tuned-v7r6w\" (UID: \"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0\") " pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.552192 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552142    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79b7t\" (UniqueName: \"kubernetes.io/projected/4543a9b5-cb95-4e16-8239-6dac004c306d-kube-api-access-79b7t\") pod \"multus-additional-cni-plugins-bjmmc\" (UID: \"4543a9b5-cb95-4e16-8239-6dac004c306d\") " pod="openshift-multus/multus-additional-cni-plugins-bjmmc"
Jul 28 01:15:51.552192 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552167    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-etc-kubernetes\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.552192 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552192    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0-lib-modules\") pod \"tuned-v7r6w\" (UID: \"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0\") " pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.553015 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552222    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0-var-lib-kubelet\") pod \"tuned-v7r6w\" (UID: \"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0\") " pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.553015 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552235    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0-etc-kubernetes\") pod \"tuned-v7r6w\" (UID: \"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0\") " pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.553015 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552250    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4543a9b5-cb95-4e16-8239-6dac004c306d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bjmmc\" (UID: \"4543a9b5-cb95-4e16-8239-6dac004c306d\") " pod="openshift-multus/multus-additional-cni-plugins-bjmmc"
Jul 28 01:15:51.553015 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552271    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-system-cni-dir\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.553015 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552279    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-cnibin\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.553015 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552296    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-etc-kubernetes\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.553015 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552302    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0-etc-tuned\") pod \"tuned-v7r6w\" (UID: \"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0\") " pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.553015 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552322    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0-var-lib-kubelet\") pod \"tuned-v7r6w\" (UID: \"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0\") " pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.553015 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552323    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-hostroot\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.553015 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552394    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjj64\" (UniqueName: \"kubernetes.io/projected/ee785053-e88b-44ef-a5cb-659eaa15ed7b-kube-api-access-gjj64\") pod \"node-ca-l6jcf\" (UID: \"ee785053-e88b-44ef-a5cb-659eaa15ed7b\") " pod="openshift-image-registry/node-ca-l6jcf"
Jul 28 01:15:51.553015 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552433    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0-sys\") pod \"tuned-v7r6w\" (UID: \"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0\") " pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.553015 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552438    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0-lib-modules\") pod \"tuned-v7r6w\" (UID: \"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0\") " pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.553015 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552457    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4543a9b5-cb95-4e16-8239-6dac004c306d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bjmmc\" (UID: \"4543a9b5-cb95-4e16-8239-6dac004c306d\") " pod="openshift-multus/multus-additional-cni-plugins-bjmmc"
Jul 28 01:15:51.553015 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552520    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4ce4b7c0-28ad-45a2-9fac-0f0704533f48-kubelet-config\") pod \"global-pull-secret-syncer-6zht5\" (UID: \"4ce4b7c0-28ad-45a2-9fac-0f0704533f48\") " pod="kube-system/global-pull-secret-syncer-6zht5"
Jul 28 01:15:51.553015 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552522    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-cni-binary-copy\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.553015 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552545    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-multus-conf-dir\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.553015 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552556    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ee785053-e88b-44ef-a5cb-659eaa15ed7b-serviceca\") pod \"node-ca-l6jcf\" (UID: \"ee785053-e88b-44ef-a5cb-659eaa15ed7b\") " pod="openshift-image-registry/node-ca-l6jcf"
Jul 28 01:15:51.553015 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552579    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4543a9b5-cb95-4e16-8239-6dac004c306d-cni-binary-copy\") pod \"multus-additional-cni-plugins-bjmmc\" (UID: \"4543a9b5-cb95-4e16-8239-6dac004c306d\") " pod="openshift-multus/multus-additional-cni-plugins-bjmmc"
Jul 28 01:15:51.553784 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552585    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-hostroot\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.553784 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552611    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4ce4b7c0-28ad-45a2-9fac-0f0704533f48-kubelet-config\") pod \"global-pull-secret-syncer-6zht5\" (UID: \"4ce4b7c0-28ad-45a2-9fac-0f0704533f48\") " pod="kube-system/global-pull-secret-syncer-6zht5"
Jul 28 01:15:51.553784 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552610    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acb1d898-a0fc-45e9-a715-67dc3301b622-tmp-dir\") pod \"node-resolver-q6x4f\" (UID: \"acb1d898-a0fc-45e9-a715-67dc3301b622\") " pod="openshift-dns/node-resolver-q6x4f"
Jul 28 01:15:51.553784 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552643    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0-etc-systemd\") pod \"tuned-v7r6w\" (UID: \"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0\") " pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.553784 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552658    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0-run\") pod \"tuned-v7r6w\" (UID: \"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0\") " pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.553784 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552658    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-multus-conf-dir\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.553784 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552674    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-multus-socket-dir-parent\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.553784 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552704    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-host-var-lib-kubelet\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.553784 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552720    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-multus-daemon-config\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.553784 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552728    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0-sys\") pod \"tuned-v7r6w\" (UID: \"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0\") " pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.553784 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552738    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0-etc-modprobe-d\") pod \"tuned-v7r6w\" (UID: \"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0\") " pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.553784 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552754    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4543a9b5-cb95-4e16-8239-6dac004c306d-os-release\") pod \"multus-additional-cni-plugins-bjmmc\" (UID: \"4543a9b5-cb95-4e16-8239-6dac004c306d\") " pod="openshift-multus/multus-additional-cni-plugins-bjmmc"
Jul 28 01:15:51.553784 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552770    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-host-var-lib-cni-bin\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.553784 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552787    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4543a9b5-cb95-4e16-8239-6dac004c306d-cnibin\") pod \"multus-additional-cni-plugins-bjmmc\" (UID: \"4543a9b5-cb95-4e16-8239-6dac004c306d\") " pod="openshift-multus/multus-additional-cni-plugins-bjmmc"
Jul 28 01:15:51.553784 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552802    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-os-release\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.553784 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552814    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-host-var-lib-kubelet\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.553784 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552818    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-host-var-lib-cni-multus\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.553784 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552839    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-host-var-lib-cni-multus\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.554324 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552865    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acb1d898-a0fc-45e9-a715-67dc3301b622-tmp-dir\") pod \"node-resolver-q6x4f\" (UID: \"acb1d898-a0fc-45e9-a715-67dc3301b622\") " pod="openshift-dns/node-resolver-q6x4f"
Jul 28 01:15:51.554324 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552880    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4543a9b5-cb95-4e16-8239-6dac004c306d-os-release\") pod \"multus-additional-cni-plugins-bjmmc\" (UID: \"4543a9b5-cb95-4e16-8239-6dac004c306d\") " pod="openshift-multus/multus-additional-cni-plugins-bjmmc"
Jul 28 01:15:51.554324 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552909    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0-etc-systemd\") pod \"tuned-v7r6w\" (UID: \"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0\") " pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.554324 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552916    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4543a9b5-cb95-4e16-8239-6dac004c306d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bjmmc\" (UID: \"4543a9b5-cb95-4e16-8239-6dac004c306d\") " pod="openshift-multus/multus-additional-cni-plugins-bjmmc"
Jul 28 01:15:51.554324 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552930    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-multus-socket-dir-parent\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.554324 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552968    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-cnibin\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.554324 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552982    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0-etc-modprobe-d\") pod \"tuned-v7r6w\" (UID: \"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0\") " pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.554324 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.553008    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4543a9b5-cb95-4e16-8239-6dac004c306d-cnibin\") pod \"multus-additional-cni-plugins-bjmmc\" (UID: \"4543a9b5-cb95-4e16-8239-6dac004c306d\") " pod="openshift-multus/multus-additional-cni-plugins-bjmmc"
Jul 28 01:15:51.554324 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.553021    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0-run\") pod \"tuned-v7r6w\" (UID: \"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0\") " pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.554324 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.553029    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4543a9b5-cb95-4e16-8239-6dac004c306d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bjmmc\" (UID: \"4543a9b5-cb95-4e16-8239-6dac004c306d\") " pod="openshift-multus/multus-additional-cni-plugins-bjmmc"
Jul 28 01:15:51.554324 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.552867    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4543a9b5-cb95-4e16-8239-6dac004c306d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bjmmc\" (UID: \"4543a9b5-cb95-4e16-8239-6dac004c306d\") " pod="openshift-multus/multus-additional-cni-plugins-bjmmc"
Jul 28 01:15:51.554324 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.553074    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-os-release\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.554324 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.553073    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ce4b7c0-28ad-45a2-9fac-0f0704533f48-original-pull-secret\") pod \"global-pull-secret-syncer-6zht5\" (UID: \"4ce4b7c0-28ad-45a2-9fac-0f0704533f48\") " pod="kube-system/global-pull-secret-syncer-6zht5"
Jul 28 01:15:51.554324 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.553108    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcb74\" (UniqueName: \"kubernetes.io/projected/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-kube-api-access-vcb74\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.554324 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.553136    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwmps\" (UniqueName: \"kubernetes.io/projected/acb1d898-a0fc-45e9-a715-67dc3301b622-kube-api-access-cwmps\") pod \"node-resolver-q6x4f\" (UID: \"acb1d898-a0fc-45e9-a715-67dc3301b622\") " pod="openshift-dns/node-resolver-q6x4f"
Jul 28 01:15:51.554324 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:51.553140    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 01:15:51.554324 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.553160    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0-etc-sysctl-d\") pod \"tuned-v7r6w\" (UID: \"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0\") " pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.554324 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.553183    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0-etc-sysctl-conf\") pod \"tuned-v7r6w\" (UID: \"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0\") " pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.554886 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:51.553199    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ce4b7c0-28ad-45a2-9fac-0f0704533f48-original-pull-secret podName:4ce4b7c0-28ad-45a2-9fac-0f0704533f48 nodeName:}" failed. No retries permitted until 2026-07-28 01:15:52.053182777 +0000 UTC m=+3.087226163 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ce4b7c0-28ad-45a2-9fac-0f0704533f48-original-pull-secret") pod "global-pull-secret-syncer-6zht5" (UID: "4ce4b7c0-28ad-45a2-9fac-0f0704533f48") : object "kube-system"/"original-pull-secret" not registered
Jul 28 01:15:51.554886 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.553220    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0-tmp\") pod \"tuned-v7r6w\" (UID: \"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0\") " pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.554886 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.553245    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4543a9b5-cb95-4e16-8239-6dac004c306d-cni-binary-copy\") pod \"multus-additional-cni-plugins-bjmmc\" (UID: \"4543a9b5-cb95-4e16-8239-6dac004c306d\") " pod="openshift-multus/multus-additional-cni-plugins-bjmmc"
Jul 28 01:15:51.554886 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.553046    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-host-var-lib-cni-bin\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.554886 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.553281    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0-etc-sysctl-conf\") pod \"tuned-v7r6w\" (UID: \"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0\") " pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.554886 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.553378    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0-etc-sysctl-d\") pod \"tuned-v7r6w\" (UID: \"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0\") " pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.554886 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.553409    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-multus-daemon-config\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.554886 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.553469    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4543a9b5-cb95-4e16-8239-6dac004c306d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bjmmc\" (UID: \"4543a9b5-cb95-4e16-8239-6dac004c306d\") " pod="openshift-multus/multus-additional-cni-plugins-bjmmc"
Jul 28 01:15:51.555244 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.555227    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0-etc-tuned\") pod \"tuned-v7r6w\" (UID: \"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0\") " pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.555592 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.555577    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0-tmp\") pod \"tuned-v7r6w\" (UID: \"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0\") " pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.560854 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.560833    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92gkz\" (UniqueName: \"kubernetes.io/projected/0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0-kube-api-access-92gkz\") pod \"tuned-v7r6w\" (UID: \"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0\") " pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.561070 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.561049    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79b7t\" (UniqueName: \"kubernetes.io/projected/4543a9b5-cb95-4e16-8239-6dac004c306d-kube-api-access-79b7t\") pod \"multus-additional-cni-plugins-bjmmc\" (UID: \"4543a9b5-cb95-4e16-8239-6dac004c306d\") " pod="openshift-multus/multus-additional-cni-plugins-bjmmc"
Jul 28 01:15:51.561190 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.561170    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcb74\" (UniqueName: \"kubernetes.io/projected/ff0415ef-08da-4681-8df8-b3b34b2b9a9e-kube-api-access-vcb74\") pod \"multus-t568g\" (UID: \"ff0415ef-08da-4681-8df8-b3b34b2b9a9e\") " pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.562089 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.562052    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjj64\" (UniqueName: \"kubernetes.io/projected/ee785053-e88b-44ef-a5cb-659eaa15ed7b-kube-api-access-gjj64\") pod \"node-ca-l6jcf\" (UID: \"ee785053-e88b-44ef-a5cb-659eaa15ed7b\") " pod="openshift-image-registry/node-ca-l6jcf"
Jul 28 01:15:51.562286 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.562156    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwmps\" (UniqueName: \"kubernetes.io/projected/acb1d898-a0fc-45e9-a715-67dc3301b622-kube-api-access-cwmps\") pod \"node-resolver-q6x4f\" (UID: \"acb1d898-a0fc-45e9-a715-67dc3301b622\") " pod="openshift-dns/node-resolver-q6x4f"
Jul 28 01:15:51.640234 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.640210    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqggt"
Jul 28 01:15:51.652169 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.652142    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tfbnv"
Jul 28 01:15:51.661817 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.661798    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:15:51.667454 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.667433    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8qwdd"
Jul 28 01:15:51.676098 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.676080    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q6x4f"
Jul 28 01:15:51.683687 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.683670    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v7r6w"
Jul 28 01:15:51.691185 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.691170    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l6jcf"
Jul 28 01:15:51.699663 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.699646    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bjmmc"
Jul 28 01:15:51.705330 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.705314    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t568g"
Jul 28 01:15:51.956731 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.956662    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jls5r\" (UniqueName: \"kubernetes.io/projected/7b958baa-25e6-45e5-82bd-a1d314a4bbad-kube-api-access-jls5r\") pod \"network-check-target-kc7hz\" (UID: \"7b958baa-25e6-45e5-82bd-a1d314a4bbad\") " pod="openshift-network-diagnostics/network-check-target-kc7hz"
Jul 28 01:15:51.956731 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:51.956714    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd76bb39-bfb5-4511-a66d-fd55bda460f6-metrics-certs\") pod \"network-metrics-daemon-55qx2\" (UID: \"fd76bb39-bfb5-4511-a66d-fd55bda460f6\") " pod="openshift-multus/network-metrics-daemon-55qx2"
Jul 28 01:15:51.956909 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:51.956835    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:15:51.956909 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:51.956852    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 01:15:51.956909 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:51.956872    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 01:15:51.956909 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:51.956882    2560 projected.go:196] Error preparing data for projected volume kube-api-access-jls5r for pod openshift-network-diagnostics/network-check-target-kc7hz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:15:51.956909 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:51.956890    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd76bb39-bfb5-4511-a66d-fd55bda460f6-metrics-certs podName:fd76bb39-bfb5-4511-a66d-fd55bda460f6 nodeName:}" failed. No retries permitted until 2026-07-28 01:15:52.956873589 +0000 UTC m=+3.990916959 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fd76bb39-bfb5-4511-a66d-fd55bda460f6-metrics-certs") pod "network-metrics-daemon-55qx2" (UID: "fd76bb39-bfb5-4511-a66d-fd55bda460f6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:15:51.957077 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:51.956925    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7b958baa-25e6-45e5-82bd-a1d314a4bbad-kube-api-access-jls5r podName:7b958baa-25e6-45e5-82bd-a1d314a4bbad nodeName:}" failed. No retries permitted until 2026-07-28 01:15:52.956909555 +0000 UTC m=+3.990952943 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jls5r" (UniqueName: "kubernetes.io/projected/7b958baa-25e6-45e5-82bd-a1d314a4bbad-kube-api-access-jls5r") pod "network-check-target-kc7hz" (UID: "7b958baa-25e6-45e5-82bd-a1d314a4bbad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:15:52.057056 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:52.057023    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ce4b7c0-28ad-45a2-9fac-0f0704533f48-original-pull-secret\") pod \"global-pull-secret-syncer-6zht5\" (UID: \"4ce4b7c0-28ad-45a2-9fac-0f0704533f48\") " pod="kube-system/global-pull-secret-syncer-6zht5"
Jul 28 01:15:52.057214 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:52.057142    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 01:15:52.057214 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:52.057197    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ce4b7c0-28ad-45a2-9fac-0f0704533f48-original-pull-secret podName:4ce4b7c0-28ad-45a2-9fac-0f0704533f48 nodeName:}" failed. No retries permitted until 2026-07-28 01:15:53.057179297 +0000 UTC m=+4.091222669 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ce4b7c0-28ad-45a2-9fac-0f0704533f48-original-pull-secret") pod "global-pull-secret-syncer-6zht5" (UID: "4ce4b7c0-28ad-45a2-9fac-0f0704533f48") : object "kube-system"/"original-pull-secret" not registered
Jul 28 01:15:52.212575 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:52.212546    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a125bf2_2d6d_4a4c_9e93_79350b1ce6b0.slice/crio-f5eb232039951b1ea4eb9964ac27572d6ba615d6c67f9f28cb0372921a1a2f84 WatchSource:0}: Error finding container f5eb232039951b1ea4eb9964ac27572d6ba615d6c67f9f28cb0372921a1a2f84: Status 404 returned error can't find the container with id f5eb232039951b1ea4eb9964ac27572d6ba615d6c67f9f28cb0372921a1a2f84
Jul 28 01:15:52.216140 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:52.216113    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03576f5d_415e_4117_a66a_f5818f8e45c7.slice/crio-f8d91b00f12b0e02201df7c33d03d844792e015b12d354113b3edebaf15598fa WatchSource:0}: Error finding container f8d91b00f12b0e02201df7c33d03d844792e015b12d354113b3edebaf15598fa: Status 404 returned error can't find the container with id f8d91b00f12b0e02201df7c33d03d844792e015b12d354113b3edebaf15598fa
Jul 28 01:15:52.217212 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:52.217191    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff0415ef_08da_4681_8df8_b3b34b2b9a9e.slice/crio-c4cd980437a0be5b8b1b12cb310e973f789fffb56cf8abea24f2162d404315bc WatchSource:0}: Error finding container c4cd980437a0be5b8b1b12cb310e973f789fffb56cf8abea24f2162d404315bc: Status 404 returned error can't find the container with id c4cd980437a0be5b8b1b12cb310e973f789fffb56cf8abea24f2162d404315bc
Jul 28 01:15:52.217924 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:52.217851    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod130e33f6_0aa5_4931_9754_8cbfef50cd05.slice/crio-01a6a3e792f5c180dc5c44af697edd778efd17951c1dd189b2eaf9871dbafe12 WatchSource:0}: Error finding container 01a6a3e792f5c180dc5c44af697edd778efd17951c1dd189b2eaf9871dbafe12: Status 404 returned error can't find the container with id 01a6a3e792f5c180dc5c44af697edd778efd17951c1dd189b2eaf9871dbafe12
Jul 28 01:15:52.242914 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:52.242846    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacb1d898_a0fc_45e9_a715_67dc3301b622.slice/crio-9db517a56d8cfdb01a094f2bc663349ed9f2e793cbe23b154e9213c8cf7efd14 WatchSource:0}: Error finding container 9db517a56d8cfdb01a094f2bc663349ed9f2e793cbe23b154e9213c8cf7efd14: Status 404 returned error can't find the container with id 9db517a56d8cfdb01a094f2bc663349ed9f2e793cbe23b154e9213c8cf7efd14
Jul 28 01:15:52.246455 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:52.246433    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee785053_e88b_44ef_a5cb_659eaa15ed7b.slice/crio-b6531221715b8ed3e317a835301c65c996b6ef721a9a1751338418279c285a8e WatchSource:0}: Error finding container b6531221715b8ed3e317a835301c65c996b6ef721a9a1751338418279c285a8e: Status 404 returned error can't find the container with id b6531221715b8ed3e317a835301c65c996b6ef721a9a1751338418279c285a8e
Jul 28 01:15:52.247281 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:15:52.247261    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33acf01f_ff2d_4208_8bf6_44ebbb38b408.slice/crio-ffe44eac79586c2cc58cbd88647edb99eb651eb17801a96a0747f3033921c123 WatchSource:0}: Error finding container ffe44eac79586c2cc58cbd88647edb99eb651eb17801a96a0747f3033921c123: Status 404 returned error can't find the container with id ffe44eac79586c2cc58cbd88647edb99eb651eb17801a96a0747f3033921c123
Jul 28 01:15:52.256118 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:52.256100    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 01:15:52.370590 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:52.370416    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 01:10:51 +0000 UTC" deadline="2028-01-04 09:58:10.395443862 +0000 UTC"
Jul 28 01:15:52.370590 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:52.370592    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12608h42m18.024856867s"
Jul 28 01:15:52.462051 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:52.462025    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t568g" event={"ID":"ff0415ef-08da-4681-8df8-b3b34b2b9a9e","Type":"ContainerStarted","Data":"c4cd980437a0be5b8b1b12cb310e973f789fffb56cf8abea24f2162d404315bc"}
Jul 28 01:15:52.463028 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:52.463005    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tfbnv" event={"ID":"03576f5d-415e-4117-a66a-f5818f8e45c7","Type":"ContainerStarted","Data":"f8d91b00f12b0e02201df7c33d03d844792e015b12d354113b3edebaf15598fa"}
Jul 28 01:15:52.463983 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:52.463961    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v7r6w" event={"ID":"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0","Type":"ContainerStarted","Data":"f5eb232039951b1ea4eb9964ac27572d6ba615d6c67f9f28cb0372921a1a2f84"}
Jul 28 01:15:52.465654 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:52.465634    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-213.ec2.internal" event={"ID":"c993073e538500ccbf54eb02b12e7dc3","Type":"ContainerStarted","Data":"e225bc65789108142a8f8b6ccbfec0b9eb89588fb31251e86bdfb5915001b86f"}
Jul 28 01:15:52.466661 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:52.466644    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqggt" event={"ID":"33acf01f-ff2d-4208-8bf6-44ebbb38b408","Type":"ContainerStarted","Data":"ffe44eac79586c2cc58cbd88647edb99eb651eb17801a96a0747f3033921c123"}
Jul 28 01:15:52.467593 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:52.467569    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn" event={"ID":"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19","Type":"ContainerStarted","Data":"7663c85de7919b5552ee62ac0a509f69414c3128564a14280b1a396cbf9f2723"}
Jul 28 01:15:52.468744 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:52.468725    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bjmmc" event={"ID":"4543a9b5-cb95-4e16-8239-6dac004c306d","Type":"ContainerStarted","Data":"ed216adbb6542da73b97ecf70ca4b40b28856879e707585c6fb3ffa2047f9713"}
Jul 28 01:15:52.470092 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:52.470070    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-213.ec2.internal" event={"ID":"0cf281d765e629b116f53ab05cca74df","Type":"ContainerStarted","Data":"dbb94187e728ef42b39cede67b77e2bd4b892237458be0df6135514296416ee0"}
Jul 28 01:15:52.471058 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:52.471039    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l6jcf" event={"ID":"ee785053-e88b-44ef-a5cb-659eaa15ed7b","Type":"ContainerStarted","Data":"b6531221715b8ed3e317a835301c65c996b6ef721a9a1751338418279c285a8e"}
Jul 28 01:15:52.471866 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:52.471848    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q6x4f" event={"ID":"acb1d898-a0fc-45e9-a715-67dc3301b622","Type":"ContainerStarted","Data":"9db517a56d8cfdb01a094f2bc663349ed9f2e793cbe23b154e9213c8cf7efd14"}
Jul 28 01:15:52.472642 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:52.472625    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8qwdd" event={"ID":"130e33f6-0aa5-4931-9754-8cbfef50cd05","Type":"ContainerStarted","Data":"01a6a3e792f5c180dc5c44af697edd778efd17951c1dd189b2eaf9871dbafe12"}
Jul 28 01:15:52.476622 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:52.476585    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-213.ec2.internal" podStartSLOduration=2.476574685 podStartE2EDuration="2.476574685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:15:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:15:52.476445712 +0000 UTC m=+3.510489108" watchObservedRunningTime="2026-07-28 01:15:52.476574685 +0000 UTC m=+3.510618080"
Jul 28 01:15:52.965025 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:52.964987    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jls5r\" (UniqueName: \"kubernetes.io/projected/7b958baa-25e6-45e5-82bd-a1d314a4bbad-kube-api-access-jls5r\") pod \"network-check-target-kc7hz\" (UID: \"7b958baa-25e6-45e5-82bd-a1d314a4bbad\") " pod="openshift-network-diagnostics/network-check-target-kc7hz"
Jul 28 01:15:52.965207 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:52.965060    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd76bb39-bfb5-4511-a66d-fd55bda460f6-metrics-certs\") pod \"network-metrics-daemon-55qx2\" (UID: \"fd76bb39-bfb5-4511-a66d-fd55bda460f6\") " pod="openshift-multus/network-metrics-daemon-55qx2"
Jul 28 01:15:52.965264 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:52.965220    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:15:52.965321 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:52.965283    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd76bb39-bfb5-4511-a66d-fd55bda460f6-metrics-certs podName:fd76bb39-bfb5-4511-a66d-fd55bda460f6 nodeName:}" failed. No retries permitted until 2026-07-28 01:15:54.965264726 +0000 UTC m=+5.999308100 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fd76bb39-bfb5-4511-a66d-fd55bda460f6-metrics-certs") pod "network-metrics-daemon-55qx2" (UID: "fd76bb39-bfb5-4511-a66d-fd55bda460f6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:15:52.965743 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:52.965725    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 01:15:52.965822 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:52.965749    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 01:15:52.965822 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:52.965762    2560 projected.go:196] Error preparing data for projected volume kube-api-access-jls5r for pod openshift-network-diagnostics/network-check-target-kc7hz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:15:52.965822 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:52.965819    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7b958baa-25e6-45e5-82bd-a1d314a4bbad-kube-api-access-jls5r podName:7b958baa-25e6-45e5-82bd-a1d314a4bbad nodeName:}" failed. No retries permitted until 2026-07-28 01:15:54.965803297 +0000 UTC m=+5.999846676 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jls5r" (UniqueName: "kubernetes.io/projected/7b958baa-25e6-45e5-82bd-a1d314a4bbad-kube-api-access-jls5r") pod "network-check-target-kc7hz" (UID: "7b958baa-25e6-45e5-82bd-a1d314a4bbad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:15:53.065696 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:53.065656    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ce4b7c0-28ad-45a2-9fac-0f0704533f48-original-pull-secret\") pod \"global-pull-secret-syncer-6zht5\" (UID: \"4ce4b7c0-28ad-45a2-9fac-0f0704533f48\") " pod="kube-system/global-pull-secret-syncer-6zht5"
Jul 28 01:15:53.065927 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:53.065882    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 01:15:53.066015 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:53.065954    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ce4b7c0-28ad-45a2-9fac-0f0704533f48-original-pull-secret podName:4ce4b7c0-28ad-45a2-9fac-0f0704533f48 nodeName:}" failed. No retries permitted until 2026-07-28 01:15:55.065934913 +0000 UTC m=+6.099978287 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ce4b7c0-28ad-45a2-9fac-0f0704533f48-original-pull-secret") pod "global-pull-secret-syncer-6zht5" (UID: "4ce4b7c0-28ad-45a2-9fac-0f0704533f48") : object "kube-system"/"original-pull-secret" not registered
Jul 28 01:15:53.371572 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:53.371529    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 01:10:51 +0000 UTC" deadline="2028-02-12 01:06:46.204049108 +0000 UTC"
Jul 28 01:15:53.371572 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:53.371572    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13535h50m52.832482343s"
Jul 28 01:15:53.457465 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:53.456654    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc7hz"
Jul 28 01:15:53.457465 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:53.456780    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kc7hz" podUID="7b958baa-25e6-45e5-82bd-a1d314a4bbad"
Jul 28 01:15:53.457465 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:53.457170    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zht5"
Jul 28 01:15:53.457465 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:53.457258    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zht5" podUID="4ce4b7c0-28ad-45a2-9fac-0f0704533f48"
Jul 28 01:15:53.457465 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:53.457324    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55qx2"
Jul 28 01:15:53.457465 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:53.457422    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55qx2" podUID="fd76bb39-bfb5-4511-a66d-fd55bda460f6"
Jul 28 01:15:53.491233 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:53.491192    2560 generic.go:356] "Generic (PLEG): container finished" podID="0cf281d765e629b116f53ab05cca74df" containerID="dbb94187e728ef42b39cede67b77e2bd4b892237458be0df6135514296416ee0" exitCode=0
Jul 28 01:15:53.491437 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:53.491417    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-213.ec2.internal" event={"ID":"0cf281d765e629b116f53ab05cca74df","Type":"ContainerDied","Data":"dbb94187e728ef42b39cede67b77e2bd4b892237458be0df6135514296416ee0"}
Jul 28 01:15:54.525757 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:54.525646    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-213.ec2.internal" event={"ID":"0cf281d765e629b116f53ab05cca74df","Type":"ContainerStarted","Data":"dd09ffda71763a9af5765d71e84bd6960b9b97aeb8058303bb7fc37cd5c1adf2"}
Jul 28 01:15:54.540249 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:54.539546    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-213.ec2.internal" podStartSLOduration=4.539526673 podStartE2EDuration="4.539526673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:15:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:15:54.53891654 +0000 UTC m=+5.572959934" watchObservedRunningTime="2026-07-28 01:15:54.539526673 +0000 UTC m=+5.573570067"
Jul 28 01:15:54.981286 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:54.981207    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jls5r\" (UniqueName: \"kubernetes.io/projected/7b958baa-25e6-45e5-82bd-a1d314a4bbad-kube-api-access-jls5r\") pod \"network-check-target-kc7hz\" (UID: \"7b958baa-25e6-45e5-82bd-a1d314a4bbad\") " pod="openshift-network-diagnostics/network-check-target-kc7hz"
Jul 28 01:15:54.981286 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:54.981266    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd76bb39-bfb5-4511-a66d-fd55bda460f6-metrics-certs\") pod \"network-metrics-daemon-55qx2\" (UID: \"fd76bb39-bfb5-4511-a66d-fd55bda460f6\") " pod="openshift-multus/network-metrics-daemon-55qx2"
Jul 28 01:15:54.981525 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:54.981427    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:15:54.981525 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:54.981488    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd76bb39-bfb5-4511-a66d-fd55bda460f6-metrics-certs podName:fd76bb39-bfb5-4511-a66d-fd55bda460f6 nodeName:}" failed. No retries permitted until 2026-07-28 01:15:58.98146951 +0000 UTC m=+10.015512885 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fd76bb39-bfb5-4511-a66d-fd55bda460f6-metrics-certs") pod "network-metrics-daemon-55qx2" (UID: "fd76bb39-bfb5-4511-a66d-fd55bda460f6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:15:54.981916 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:54.981895    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 01:15:54.981916 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:54.981917    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 01:15:54.982054 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:54.981930    2560 projected.go:196] Error preparing data for projected volume kube-api-access-jls5r for pod openshift-network-diagnostics/network-check-target-kc7hz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:15:54.982054 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:54.981980    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7b958baa-25e6-45e5-82bd-a1d314a4bbad-kube-api-access-jls5r podName:7b958baa-25e6-45e5-82bd-a1d314a4bbad nodeName:}" failed. No retries permitted until 2026-07-28 01:15:58.98195818 +0000 UTC m=+10.016001566 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jls5r" (UniqueName: "kubernetes.io/projected/7b958baa-25e6-45e5-82bd-a1d314a4bbad-kube-api-access-jls5r") pod "network-check-target-kc7hz" (UID: "7b958baa-25e6-45e5-82bd-a1d314a4bbad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:15:55.081717 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:55.081685    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ce4b7c0-28ad-45a2-9fac-0f0704533f48-original-pull-secret\") pod \"global-pull-secret-syncer-6zht5\" (UID: \"4ce4b7c0-28ad-45a2-9fac-0f0704533f48\") " pod="kube-system/global-pull-secret-syncer-6zht5"
Jul 28 01:15:55.081906 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:55.081845    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 01:15:55.081906 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:55.081902    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ce4b7c0-28ad-45a2-9fac-0f0704533f48-original-pull-secret podName:4ce4b7c0-28ad-45a2-9fac-0f0704533f48 nodeName:}" failed. No retries permitted until 2026-07-28 01:15:59.08188402 +0000 UTC m=+10.115927406 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ce4b7c0-28ad-45a2-9fac-0f0704533f48-original-pull-secret") pod "global-pull-secret-syncer-6zht5" (UID: "4ce4b7c0-28ad-45a2-9fac-0f0704533f48") : object "kube-system"/"original-pull-secret" not registered
Jul 28 01:15:55.455545 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:55.454779    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55qx2"
Jul 28 01:15:55.455545 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:55.454921    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55qx2" podUID="fd76bb39-bfb5-4511-a66d-fd55bda460f6"
Jul 28 01:15:55.455545 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:55.455295    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc7hz"
Jul 28 01:15:55.455545 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:55.455403    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kc7hz" podUID="7b958baa-25e6-45e5-82bd-a1d314a4bbad"
Jul 28 01:15:55.455545 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:55.455467    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zht5"
Jul 28 01:15:55.455545 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:55.455536    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zht5" podUID="4ce4b7c0-28ad-45a2-9fac-0f0704533f48"
Jul 28 01:15:57.456148 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:57.455445    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55qx2"
Jul 28 01:15:57.456148 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:57.455478    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zht5"
Jul 28 01:15:57.456148 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:57.455582    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55qx2" podUID="fd76bb39-bfb5-4511-a66d-fd55bda460f6"
Jul 28 01:15:57.456148 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:57.455940    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zht5" podUID="4ce4b7c0-28ad-45a2-9fac-0f0704533f48"
Jul 28 01:15:57.456148 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:57.455984    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc7hz"
Jul 28 01:15:57.456148 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:57.456065    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kc7hz" podUID="7b958baa-25e6-45e5-82bd-a1d314a4bbad"
Jul 28 01:15:59.014758 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:59.014717    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jls5r\" (UniqueName: \"kubernetes.io/projected/7b958baa-25e6-45e5-82bd-a1d314a4bbad-kube-api-access-jls5r\") pod \"network-check-target-kc7hz\" (UID: \"7b958baa-25e6-45e5-82bd-a1d314a4bbad\") " pod="openshift-network-diagnostics/network-check-target-kc7hz"
Jul 28 01:15:59.015238 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:59.014778    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd76bb39-bfb5-4511-a66d-fd55bda460f6-metrics-certs\") pod \"network-metrics-daemon-55qx2\" (UID: \"fd76bb39-bfb5-4511-a66d-fd55bda460f6\") " pod="openshift-multus/network-metrics-daemon-55qx2"
Jul 28 01:15:59.015238 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:59.014908    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:15:59.015238 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:59.014923    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 01:15:59.015238 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:59.014947    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 01:15:59.015238 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:59.014960    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd76bb39-bfb5-4511-a66d-fd55bda460f6-metrics-certs podName:fd76bb39-bfb5-4511-a66d-fd55bda460f6 nodeName:}" failed. No retries permitted until 2026-07-28 01:16:07.014947808 +0000 UTC m=+18.048991179 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fd76bb39-bfb5-4511-a66d-fd55bda460f6-metrics-certs") pod "network-metrics-daemon-55qx2" (UID: "fd76bb39-bfb5-4511-a66d-fd55bda460f6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:15:59.015238 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:59.014961    2560 projected.go:196] Error preparing data for projected volume kube-api-access-jls5r for pod openshift-network-diagnostics/network-check-target-kc7hz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:15:59.015238 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:59.015016    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7b958baa-25e6-45e5-82bd-a1d314a4bbad-kube-api-access-jls5r podName:7b958baa-25e6-45e5-82bd-a1d314a4bbad nodeName:}" failed. No retries permitted until 2026-07-28 01:16:07.015000565 +0000 UTC m=+18.049043939 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jls5r" (UniqueName: "kubernetes.io/projected/7b958baa-25e6-45e5-82bd-a1d314a4bbad-kube-api-access-jls5r") pod "network-check-target-kc7hz" (UID: "7b958baa-25e6-45e5-82bd-a1d314a4bbad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:15:59.115706 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:59.115667    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ce4b7c0-28ad-45a2-9fac-0f0704533f48-original-pull-secret\") pod \"global-pull-secret-syncer-6zht5\" (UID: \"4ce4b7c0-28ad-45a2-9fac-0f0704533f48\") " pod="kube-system/global-pull-secret-syncer-6zht5"
Jul 28 01:15:59.115878 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:59.115835    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 01:15:59.115958 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:59.115908    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ce4b7c0-28ad-45a2-9fac-0f0704533f48-original-pull-secret podName:4ce4b7c0-28ad-45a2-9fac-0f0704533f48 nodeName:}" failed. No retries permitted until 2026-07-28 01:16:07.11588901 +0000 UTC m=+18.149932394 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ce4b7c0-28ad-45a2-9fac-0f0704533f48-original-pull-secret") pod "global-pull-secret-syncer-6zht5" (UID: "4ce4b7c0-28ad-45a2-9fac-0f0704533f48") : object "kube-system"/"original-pull-secret" not registered
Jul 28 01:15:59.456425 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:59.455983    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc7hz"
Jul 28 01:15:59.456425 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:59.456098    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kc7hz" podUID="7b958baa-25e6-45e5-82bd-a1d314a4bbad"
Jul 28 01:15:59.456425 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:59.456209    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zht5"
Jul 28 01:15:59.456425 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:59.456321    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zht5" podUID="4ce4b7c0-28ad-45a2-9fac-0f0704533f48"
Jul 28 01:15:59.456425 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:15:59.456370    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55qx2"
Jul 28 01:15:59.456819 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:15:59.456454    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55qx2" podUID="fd76bb39-bfb5-4511-a66d-fd55bda460f6"
Jul 28 01:16:01.455302 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:01.455266    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc7hz"
Jul 28 01:16:01.455803 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:01.455273    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55qx2"
Jul 28 01:16:01.455803 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:01.455405    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kc7hz" podUID="7b958baa-25e6-45e5-82bd-a1d314a4bbad"
Jul 28 01:16:01.455803 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:01.455493    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55qx2" podUID="fd76bb39-bfb5-4511-a66d-fd55bda460f6"
Jul 28 01:16:01.455803 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:01.455276    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zht5"
Jul 28 01:16:01.455803 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:01.455592    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zht5" podUID="4ce4b7c0-28ad-45a2-9fac-0f0704533f48"
Jul 28 01:16:03.455378 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:03.455281    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zht5"
Jul 28 01:16:03.455378 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:03.455281    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc7hz"
Jul 28 01:16:03.455881 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:03.455423    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zht5" podUID="4ce4b7c0-28ad-45a2-9fac-0f0704533f48"
Jul 28 01:16:03.455881 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:03.455464    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55qx2"
Jul 28 01:16:03.455881 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:03.455565    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kc7hz" podUID="7b958baa-25e6-45e5-82bd-a1d314a4bbad"
Jul 28 01:16:03.455881 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:03.455655    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55qx2" podUID="fd76bb39-bfb5-4511-a66d-fd55bda460f6"
Jul 28 01:16:05.454554 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:05.454519    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zht5"
Jul 28 01:16:05.454554 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:05.454549    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc7hz"
Jul 28 01:16:05.455068 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:05.454519    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55qx2"
Jul 28 01:16:05.455068 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:05.454654    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zht5" podUID="4ce4b7c0-28ad-45a2-9fac-0f0704533f48"
Jul 28 01:16:05.455068 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:05.454736    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kc7hz" podUID="7b958baa-25e6-45e5-82bd-a1d314a4bbad"
Jul 28 01:16:05.455068 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:05.454840    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55qx2" podUID="fd76bb39-bfb5-4511-a66d-fd55bda460f6"
Jul 28 01:16:07.077602 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:07.077559    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jls5r\" (UniqueName: \"kubernetes.io/projected/7b958baa-25e6-45e5-82bd-a1d314a4bbad-kube-api-access-jls5r\") pod \"network-check-target-kc7hz\" (UID: \"7b958baa-25e6-45e5-82bd-a1d314a4bbad\") " pod="openshift-network-diagnostics/network-check-target-kc7hz"
Jul 28 01:16:07.078125 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:07.077615    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd76bb39-bfb5-4511-a66d-fd55bda460f6-metrics-certs\") pod \"network-metrics-daemon-55qx2\" (UID: \"fd76bb39-bfb5-4511-a66d-fd55bda460f6\") " pod="openshift-multus/network-metrics-daemon-55qx2"
Jul 28 01:16:07.078125 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:07.077734    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:16:07.078125 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:07.077788    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd76bb39-bfb5-4511-a66d-fd55bda460f6-metrics-certs podName:fd76bb39-bfb5-4511-a66d-fd55bda460f6 nodeName:}" failed. No retries permitted until 2026-07-28 01:16:23.077773951 +0000 UTC m=+34.111817326 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fd76bb39-bfb5-4511-a66d-fd55bda460f6-metrics-certs") pod "network-metrics-daemon-55qx2" (UID: "fd76bb39-bfb5-4511-a66d-fd55bda460f6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:16:07.078125 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:07.077737    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 01:16:07.078125 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:07.077833    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 01:16:07.078125 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:07.077845    2560 projected.go:196] Error preparing data for projected volume kube-api-access-jls5r for pod openshift-network-diagnostics/network-check-target-kc7hz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:16:07.078125 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:07.077889    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7b958baa-25e6-45e5-82bd-a1d314a4bbad-kube-api-access-jls5r podName:7b958baa-25e6-45e5-82bd-a1d314a4bbad nodeName:}" failed. No retries permitted until 2026-07-28 01:16:23.077877308 +0000 UTC m=+34.111920683 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jls5r" (UniqueName: "kubernetes.io/projected/7b958baa-25e6-45e5-82bd-a1d314a4bbad-kube-api-access-jls5r") pod "network-check-target-kc7hz" (UID: "7b958baa-25e6-45e5-82bd-a1d314a4bbad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:16:07.178694 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:07.178656    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ce4b7c0-28ad-45a2-9fac-0f0704533f48-original-pull-secret\") pod \"global-pull-secret-syncer-6zht5\" (UID: \"4ce4b7c0-28ad-45a2-9fac-0f0704533f48\") " pod="kube-system/global-pull-secret-syncer-6zht5"
Jul 28 01:16:07.178861 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:07.178813    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 01:16:07.178928 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:07.178888    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ce4b7c0-28ad-45a2-9fac-0f0704533f48-original-pull-secret podName:4ce4b7c0-28ad-45a2-9fac-0f0704533f48 nodeName:}" failed. No retries permitted until 2026-07-28 01:16:23.178870771 +0000 UTC m=+34.212914147 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ce4b7c0-28ad-45a2-9fac-0f0704533f48-original-pull-secret") pod "global-pull-secret-syncer-6zht5" (UID: "4ce4b7c0-28ad-45a2-9fac-0f0704533f48") : object "kube-system"/"original-pull-secret" not registered
Jul 28 01:16:07.455302 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:07.455180    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zht5"
Jul 28 01:16:07.455492 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:07.455314    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zht5" podUID="4ce4b7c0-28ad-45a2-9fac-0f0704533f48"
Jul 28 01:16:07.455492 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:07.455193    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55qx2"
Jul 28 01:16:07.455492 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:07.455431    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55qx2" podUID="fd76bb39-bfb5-4511-a66d-fd55bda460f6"
Jul 28 01:16:07.455492 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:07.455180    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc7hz"
Jul 28 01:16:07.455694 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:07.455502    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kc7hz" podUID="7b958baa-25e6-45e5-82bd-a1d314a4bbad"
Jul 28 01:16:09.455868 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:09.455837    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55qx2"
Jul 28 01:16:09.456304 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:09.455938    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55qx2" podUID="fd76bb39-bfb5-4511-a66d-fd55bda460f6"
Jul 28 01:16:09.456304 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:09.455973    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc7hz"
Jul 28 01:16:09.456304 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:09.456019    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kc7hz" podUID="7b958baa-25e6-45e5-82bd-a1d314a4bbad"
Jul 28 01:16:09.456304 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:09.456042    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zht5"
Jul 28 01:16:09.456304 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:09.456096    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zht5" podUID="4ce4b7c0-28ad-45a2-9fac-0f0704533f48"
Jul 28 01:16:11.454759 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:11.454386    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55qx2"
Jul 28 01:16:11.455644 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:11.454386    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc7hz"
Jul 28 01:16:11.455644 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:11.454880    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55qx2" podUID="fd76bb39-bfb5-4511-a66d-fd55bda460f6"
Jul 28 01:16:11.455644 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:11.454959    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kc7hz" podUID="7b958baa-25e6-45e5-82bd-a1d314a4bbad"
Jul 28 01:16:11.455644 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:11.454408    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zht5"
Jul 28 01:16:11.455644 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:11.455053    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zht5" podUID="4ce4b7c0-28ad-45a2-9fac-0f0704533f48"
Jul 28 01:16:11.560243 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:11.560204    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l6jcf" event={"ID":"ee785053-e88b-44ef-a5cb-659eaa15ed7b","Type":"ContainerStarted","Data":"600bb2b1d0841395bee4d7715a6647272348738dc99357fd01391d3218127d52"}
Jul 28 01:16:11.561625 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:11.561598    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q6x4f" event={"ID":"acb1d898-a0fc-45e9-a715-67dc3301b622","Type":"ContainerStarted","Data":"4de4ac196499940dcdf119019e54f708c5349732a300e3d34c82eeefee456065"}
Jul 28 01:16:11.562966 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:11.562943    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8qwdd" event={"ID":"130e33f6-0aa5-4931-9754-8cbfef50cd05","Type":"ContainerStarted","Data":"c9648ab99f1fb4b16eb50a1d0acd85dce92a8c842d426bfef9aacf5a5303a2ea"}
Jul 28 01:16:11.564377 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:11.564338    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t568g" event={"ID":"ff0415ef-08da-4681-8df8-b3b34b2b9a9e","Type":"ContainerStarted","Data":"6d21312acdbb293fbadcd81d91b775f8fce3cdccdcf7cd300822a317a0c0c77e"}
Jul 28 01:16:11.565610 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:11.565588    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v7r6w" event={"ID":"0a125bf2-2d6d-4a4c-9e93-79350b1ce6b0","Type":"ContainerStarted","Data":"b393333fe9a708de66356b4f3ea31df90e73386e61a07016624d719647570dcc"}
Jul 28 01:16:11.566987 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:11.566969    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqggt" event={"ID":"33acf01f-ff2d-4208-8bf6-44ebbb38b408","Type":"ContainerStarted","Data":"43151eebca02f3f3450524bc372f98606e929d6ea603078218e0bbb1de726ae2"}
Jul 28 01:16:11.569186 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:11.569169    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5f2zn_5311b0bc-9ad2-4e2f-bdde-81510c6d6b19/ovn-acl-logging/0.log"
Jul 28 01:16:11.569474 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:11.569454    2560 generic.go:356] "Generic (PLEG): container finished" podID="5311b0bc-9ad2-4e2f-bdde-81510c6d6b19" containerID="15f4f40e2bf1cb19ff3c055e6967694885bf4c75e0b151d95b9419d5e2783c08" exitCode=1
Jul 28 01:16:11.569560 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:11.569514    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn" event={"ID":"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19","Type":"ContainerStarted","Data":"bb1de0ffde2e2c6dd6b1ed74afa0a76c8c206bf0fe4452b3ca185e57be30dd9d"}
Jul 28 01:16:11.569612 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:11.569573    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn" event={"ID":"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19","Type":"ContainerStarted","Data":"61d59653a3e8050e1b7728c856b0508bb85964a695b86c4273db4e36b9429c9d"}
Jul 28 01:16:11.569649 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:11.569619    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn" event={"ID":"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19","Type":"ContainerStarted","Data":"8eb1a5b23202a514909f072841b738acfc308f13eaf51b5b8a35710e9266cc52"}
Jul 28 01:16:11.569697 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:11.569648    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn" event={"ID":"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19","Type":"ContainerStarted","Data":"b1007179b89904554263e8025766c56e3a06ac9e9913079ed45e1e016a8c7f13"}
Jul 28 01:16:11.569697 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:11.569682    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn" event={"ID":"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19","Type":"ContainerDied","Data":"15f4f40e2bf1cb19ff3c055e6967694885bf4c75e0b151d95b9419d5e2783c08"}
Jul 28 01:16:11.569786 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:11.569729    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn" event={"ID":"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19","Type":"ContainerStarted","Data":"b1a2c514730140166c0d2dab8baa337f5f6f5afb2ca8fb68df3b3369b70537a9"}
Jul 28 01:16:11.570922 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:11.570905    2560 generic.go:356] "Generic (PLEG): container finished" podID="4543a9b5-cb95-4e16-8239-6dac004c306d" containerID="ea0c0bf9b766399410ecea6d2f50899695b5cb38f151e76ebe0a756be062d547" exitCode=0
Jul 28 01:16:11.570989 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:11.570931    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bjmmc" event={"ID":"4543a9b5-cb95-4e16-8239-6dac004c306d","Type":"ContainerDied","Data":"ea0c0bf9b766399410ecea6d2f50899695b5cb38f151e76ebe0a756be062d547"}
Jul 28 01:16:11.573894 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:11.573863    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-l6jcf" podStartSLOduration=4.486370264 podStartE2EDuration="22.573850916s" totalImagesPullingTime="18.087480652s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:16:11.573476622 +0000 UTC m=+22.607520015" watchObservedRunningTime="2026-07-28 01:16:11.573850916 +0000 UTC m=+22.607894343"
Jul 28 01:16:11.603017 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:11.602974    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8qwdd" podStartSLOduration=4.48594966 podStartE2EDuration="22.602957767s" totalImagesPullingTime="18.117008107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:16:11.588816435 +0000 UTC m=+22.622859828" watchObservedRunningTime="2026-07-28 01:16:11.602957767 +0000 UTC m=+22.637001154"
Jul 28 01:16:11.622057 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:11.622003    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-v7r6w" podStartSLOduration=4.407924262 podStartE2EDuration="22.621987195s" totalImagesPullingTime="18.214062933s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:16:11.603262586 +0000 UTC m=+22.637305979" watchObservedRunningTime="2026-07-28 01:16:11.621987195 +0000 UTC m=+22.656030587"
Jul 28 01:16:11.649932 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:11.649888    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-q6x4f" podStartSLOduration=4.467188989 podStartE2EDuration="22.649871569s" totalImagesPullingTime="18.18268258s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:16:11.633844187 +0000 UTC m=+22.667887579" watchObservedRunningTime="2026-07-28 01:16:11.649871569 +0000 UTC m=+22.683914959"
Jul 28 01:16:11.650101 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:11.650052    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-t568g" podStartSLOduration=3.924385307 podStartE2EDuration="22.650046673s" totalImagesPullingTime="18.725661366s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:16:11.649790755 +0000 UTC m=+22.683834148" watchObservedRunningTime="2026-07-28 01:16:11.650046673 +0000 UTC m=+22.684090066"
Jul 28 01:16:11.664048 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:11.664016    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:11.739892 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:11.739859    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:11.841452 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:11.841426    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:11.939556 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:11.939524    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:12.066267 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:12.066220    2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 28 01:16:12.402547 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:12.402291    2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T01:16:12.06624202Z","UUID":"ca81a450-e646-467f-8ffc-5713b7a7442f","Handler":null,"Name":"","Endpoint":""}
Jul 28 01:16:12.404018 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:12.403997    2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 28 01:16:12.404148 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:12.404046    2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 28 01:16:12.575164 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:12.575133    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqggt" event={"ID":"33acf01f-ff2d-4208-8bf6-44ebbb38b408","Type":"ContainerStarted","Data":"9ea44ed61b09cc367f2e1dea71238632f0c98921db01f2b11f6af50ceb8ea4fc"}
Jul 28 01:16:12.576942 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:12.576911    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tfbnv" event={"ID":"03576f5d-415e-4117-a66a-f5818f8e45c7","Type":"ContainerStarted","Data":"5dcdf8dd60e2c0c33e03936e252d813da8b3f6a3a9e966ccb8e06e17730ba032"}
Jul 28 01:16:12.773982 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:12.773875    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:12.835690 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:12.835653    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:13.413448 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:13.413179    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:13.455346 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:13.455315    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55qx2"
Jul 28 01:16:13.455346 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:13.455340    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zht5"
Jul 28 01:16:13.455563 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:13.455315    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc7hz"
Jul 28 01:16:13.455563 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:13.455467    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55qx2" podUID="fd76bb39-bfb5-4511-a66d-fd55bda460f6"
Jul 28 01:16:13.455670 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:13.455568    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kc7hz" podUID="7b958baa-25e6-45e5-82bd-a1d314a4bbad"
Jul 28 01:16:13.455670 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:13.455642    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zht5" podUID="4ce4b7c0-28ad-45a2-9fac-0f0704533f48"
Jul 28 01:16:13.581420 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:13.581383    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqggt" event={"ID":"33acf01f-ff2d-4208-8bf6-44ebbb38b408","Type":"ContainerStarted","Data":"1276b9202ee023c1fe1a046a0ce89efb58a0cd927f23db43863bb5d43b1158d0"}
Jul 28 01:16:13.584975 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:13.584943    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5f2zn_5311b0bc-9ad2-4e2f-bdde-81510c6d6b19/ovn-acl-logging/0.log"
Jul 28 01:16:13.585327 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:13.585305    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn" event={"ID":"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19","Type":"ContainerStarted","Data":"8c1089d64c46a2f0754605fb5f7fda59623775925ca19e7f60648e4891c4a739"}
Jul 28 01:16:13.597055 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:13.597005    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tfbnv" podStartSLOduration=6.382312794 podStartE2EDuration="24.596987376s" totalImagesPullingTime="18.214674582s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:16:12.589846939 +0000 UTC m=+23.623890333" watchObservedRunningTime="2026-07-28 01:16:13.596987376 +0000 UTC m=+24.631030771"
Jul 28 01:16:13.597311 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:13.597284    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqggt" podStartSLOduration=3.974460868 podStartE2EDuration="24.597277546s" totalImagesPullingTime="20.622816678s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:15:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:16:13.596467292 +0000 UTC m=+24.630510686" watchObservedRunningTime="2026-07-28 01:16:13.597277546 +0000 UTC m=+24.631320938"
Jul 28 01:16:13.692812 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:13.692746    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8qwdd"
Jul 28 01:16:13.693370 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:13.693331    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8qwdd"
Jul 28 01:16:13.849661 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:13.849631    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:13.950977 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:13.950913    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:14.062777 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:14.062741    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:14.163364 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:14.163317    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:14.264006 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:14.263914    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:14.588158 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:14.588067    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8qwdd"
Jul 28 01:16:14.588704 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:14.588426    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8qwdd"
Jul 28 01:16:14.645149 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:14.645120    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:15.455161 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:15.455130    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc7hz"
Jul 28 01:16:15.455346 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:15.455130    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55qx2"
Jul 28 01:16:15.455346 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:15.455258    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kc7hz" podUID="7b958baa-25e6-45e5-82bd-a1d314a4bbad"
Jul 28 01:16:15.455346 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:15.455271    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zht5"
Jul 28 01:16:15.455530 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:15.455363    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55qx2" podUID="fd76bb39-bfb5-4511-a66d-fd55bda460f6"
Jul 28 01:16:15.455530 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:15.455452    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zht5" podUID="4ce4b7c0-28ad-45a2-9fac-0f0704533f48"
Jul 28 01:16:15.594648 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:15.594243    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5f2zn_5311b0bc-9ad2-4e2f-bdde-81510c6d6b19/ovn-acl-logging/0.log"
Jul 28 01:16:15.596294 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:15.594655    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn" event={"ID":"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19","Type":"ContainerStarted","Data":"85e24e5e155eae5848c5d38988f307351a95e67fcc9ada36516b88ebfb7959fc"}
Jul 28 01:16:15.596294 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:15.595127    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:16:15.596294 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:15.595152    2560 scope.go:117] "RemoveContainer" containerID="15f4f40e2bf1cb19ff3c055e6967694885bf4c75e0b151d95b9419d5e2783c08"
Jul 28 01:16:15.616719 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:15.616692    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:16:15.755539 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:15.755372    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:16.576123 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:16.576086    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:16.599952 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:16.599928    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5f2zn_5311b0bc-9ad2-4e2f-bdde-81510c6d6b19/ovn-acl-logging/0.log"
Jul 28 01:16:16.600322 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:16.600273    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn" event={"ID":"5311b0bc-9ad2-4e2f-bdde-81510c6d6b19","Type":"ContainerStarted","Data":"e8e9235095cfdcf72b5a7b578f8c32cf96440568fd13dee1baabf190885c2603"}
Jul 28 01:16:16.600423 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:16.600409    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:16:16.600519 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:16.600502    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:16:16.602734 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:16.602711    2560 generic.go:356] "Generic (PLEG): container finished" podID="4543a9b5-cb95-4e16-8239-6dac004c306d" containerID="75ff73378d4b30b07977dabba2e2a6d8bf0f2b918d5b651a8cbe52848fdc3abd" exitCode=0
Jul 28 01:16:16.602829 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:16.602786    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bjmmc" event={"ID":"4543a9b5-cb95-4e16-8239-6dac004c306d","Type":"ContainerDied","Data":"75ff73378d4b30b07977dabba2e2a6d8bf0f2b918d5b651a8cbe52848fdc3abd"}
Jul 28 01:16:16.617447 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:16.617430    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:16:16.639287 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:16.639244    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn" podStartSLOduration=9.449561854 podStartE2EDuration="27.639231124s" totalImagesPullingTime="18.18966927s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:16:16.63872757 +0000 UTC m=+27.672770964" watchObservedRunningTime="2026-07-28 01:16:16.639231124 +0000 UTC m=+27.673274521"
Jul 28 01:16:17.455268 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:17.455203    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55qx2"
Jul 28 01:16:17.455456 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:17.455203    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc7hz"
Jul 28 01:16:17.455456 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:17.455314    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55qx2" podUID="fd76bb39-bfb5-4511-a66d-fd55bda460f6"
Jul 28 01:16:17.455456 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:17.455393    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kc7hz" podUID="7b958baa-25e6-45e5-82bd-a1d314a4bbad"
Jul 28 01:16:17.455456 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:17.455209    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zht5"
Jul 28 01:16:17.455612 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:17.455494    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zht5" podUID="4ce4b7c0-28ad-45a2-9fac-0f0704533f48"
Jul 28 01:16:17.607756 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:17.607723    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bjmmc" event={"ID":"4543a9b5-cb95-4e16-8239-6dac004c306d","Type":"ContainerStarted","Data":"6b870722422ef6391451510025f8add4542c8e4b1ea86948d08d808796de2b20"}
Jul 28 01:16:17.788516 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:17.788438    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-55qx2"]
Jul 28 01:16:17.788685 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:17.788601    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55qx2"
Jul 28 01:16:17.788741 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:17.788710    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55qx2" podUID="fd76bb39-bfb5-4511-a66d-fd55bda460f6"
Jul 28 01:16:17.791457 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:17.791411    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kc7hz"]
Jul 28 01:16:17.791593 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:17.791529    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc7hz"
Jul 28 01:16:17.791672 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:17.791632    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kc7hz" podUID="7b958baa-25e6-45e5-82bd-a1d314a4bbad"
Jul 28 01:16:17.792131 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:17.792104    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6zht5"]
Jul 28 01:16:17.792248 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:17.792204    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zht5"
Jul 28 01:16:17.792319 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:17.792296    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zht5" podUID="4ce4b7c0-28ad-45a2-9fac-0f0704533f48"
Jul 28 01:16:18.454644 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:18.454586    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:18.597988 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:18.597947    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:18.611497 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:18.611467    2560 generic.go:356] "Generic (PLEG): container finished" podID="4543a9b5-cb95-4e16-8239-6dac004c306d" containerID="6b870722422ef6391451510025f8add4542c8e4b1ea86948d08d808796de2b20" exitCode=0
Jul 28 01:16:18.611852 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:18.611545    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bjmmc" event={"ID":"4543a9b5-cb95-4e16-8239-6dac004c306d","Type":"ContainerDied","Data":"6b870722422ef6391451510025f8add4542c8e4b1ea86948d08d808796de2b20"}
Jul 28 01:16:18.707343 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:18.707261    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:18.830446 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:18.830406    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:18.966014 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:18.965893    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:19.066115 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:19.066077    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:19.167852 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:19.167818    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:19.455808 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:19.455557    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55qx2"
Jul 28 01:16:19.455808 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:19.455709    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55qx2" podUID="fd76bb39-bfb5-4511-a66d-fd55bda460f6"
Jul 28 01:16:19.455808 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:19.455770    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc7hz"
Jul 28 01:16:19.456037 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:19.455864    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kc7hz" podUID="7b958baa-25e6-45e5-82bd-a1d314a4bbad"
Jul 28 01:16:19.457858 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:19.456329    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zht5"
Jul 28 01:16:19.457858 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:19.456468    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zht5" podUID="4ce4b7c0-28ad-45a2-9fac-0f0704533f48"
Jul 28 01:16:19.538483 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:19.538457    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:19.678635 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:19.678603    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:19.779890 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:19.779862    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:20.159056 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:20.159022    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:20.562199 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:20.562115    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:20.619173 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:20.619120    2560 generic.go:356] "Generic (PLEG): container finished" podID="4543a9b5-cb95-4e16-8239-6dac004c306d" containerID="62b09faca5b0f125cc94717baddafbbc142d997b2514013674df331c7d292962" exitCode=0
Jul 28 01:16:20.619331 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:20.619179    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bjmmc" event={"ID":"4543a9b5-cb95-4e16-8239-6dac004c306d","Type":"ContainerDied","Data":"62b09faca5b0f125cc94717baddafbbc142d997b2514013674df331c7d292962"}
Jul 28 01:16:20.752529 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:20.752504    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:20.951137 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:20.951061    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:21.158134 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:21.158107    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:21.454681 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:21.454646    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zht5"
Jul 28 01:16:21.454845 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:21.454645    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55qx2"
Jul 28 01:16:21.454845 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:21.454783    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zht5" podUID="4ce4b7c0-28ad-45a2-9fac-0f0704533f48"
Jul 28 01:16:21.454977 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:21.454645    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc7hz"
Jul 28 01:16:21.454977 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:21.454882    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55qx2" podUID="fd76bb39-bfb5-4511-a66d-fd55bda460f6"
Jul 28 01:16:21.454977 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:21.454952    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kc7hz" podUID="7b958baa-25e6-45e5-82bd-a1d314a4bbad"
Jul 28 01:16:22.153681 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:22.153644    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:22.205252 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:22.205212    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:22.478877 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:22.478794    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:22.579219 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:22.579190    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:22.680504 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:22.680463    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:22.781931 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:22.781844    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:22.830138 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:22.830102    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:22.954177 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:22.954148    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:23.098549 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:23.098457    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jls5r\" (UniqueName: \"kubernetes.io/projected/7b958baa-25e6-45e5-82bd-a1d314a4bbad-kube-api-access-jls5r\") pod \"network-check-target-kc7hz\" (UID: \"7b958baa-25e6-45e5-82bd-a1d314a4bbad\") " pod="openshift-network-diagnostics/network-check-target-kc7hz"
Jul 28 01:16:23.098549 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:23.098518    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd76bb39-bfb5-4511-a66d-fd55bda460f6-metrics-certs\") pod \"network-metrics-daemon-55qx2\" (UID: \"fd76bb39-bfb5-4511-a66d-fd55bda460f6\") " pod="openshift-multus/network-metrics-daemon-55qx2"
Jul 28 01:16:23.098735 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:23.098650    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:16:23.098735 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:23.098664    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 01:16:23.098735 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:23.098689    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 01:16:23.098735 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:23.098705    2560 projected.go:196] Error preparing data for projected volume kube-api-access-jls5r for pod openshift-network-diagnostics/network-check-target-kc7hz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:16:23.098735 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:23.098721    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd76bb39-bfb5-4511-a66d-fd55bda460f6-metrics-certs podName:fd76bb39-bfb5-4511-a66d-fd55bda460f6 nodeName:}" failed. No retries permitted until 2026-07-28 01:16:55.098703125 +0000 UTC m=+66.132746498 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fd76bb39-bfb5-4511-a66d-fd55bda460f6-metrics-certs") pod "network-metrics-daemon-55qx2" (UID: "fd76bb39-bfb5-4511-a66d-fd55bda460f6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:16:23.098979 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:23.098756    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7b958baa-25e6-45e5-82bd-a1d314a4bbad-kube-api-access-jls5r podName:7b958baa-25e6-45e5-82bd-a1d314a4bbad nodeName:}" failed. No retries permitted until 2026-07-28 01:16:55.098740506 +0000 UTC m=+66.132783898 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jls5r" (UniqueName: "kubernetes.io/projected/7b958baa-25e6-45e5-82bd-a1d314a4bbad-kube-api-access-jls5r") pod "network-check-target-kc7hz" (UID: "7b958baa-25e6-45e5-82bd-a1d314a4bbad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:16:23.155788 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:23.155751    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:23.199805 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:23.199759    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ce4b7c0-28ad-45a2-9fac-0f0704533f48-original-pull-secret\") pod \"global-pull-secret-syncer-6zht5\" (UID: \"4ce4b7c0-28ad-45a2-9fac-0f0704533f48\") " pod="kube-system/global-pull-secret-syncer-6zht5"
Jul 28 01:16:23.199973 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:23.199929    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 01:16:23.200017 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:23.200008    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ce4b7c0-28ad-45a2-9fac-0f0704533f48-original-pull-secret podName:4ce4b7c0-28ad-45a2-9fac-0f0704533f48 nodeName:}" failed. No retries permitted until 2026-07-28 01:16:55.199989497 +0000 UTC m=+66.234032870 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ce4b7c0-28ad-45a2-9fac-0f0704533f48-original-pull-secret") pod "global-pull-secret-syncer-6zht5" (UID: "4ce4b7c0-28ad-45a2-9fac-0f0704533f48") : object "kube-system"/"original-pull-secret" not registered
Jul 28 01:16:23.208028 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:23.207996    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:23.455133 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:23.455055    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc7hz"
Jul 28 01:16:23.455288 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:23.455056    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55qx2"
Jul 28 01:16:23.455288 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:23.455177    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kc7hz" podUID="7b958baa-25e6-45e5-82bd-a1d314a4bbad"
Jul 28 01:16:23.455440 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:23.455308    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55qx2" podUID="fd76bb39-bfb5-4511-a66d-fd55bda460f6"
Jul 28 01:16:23.455440 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:23.455338    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zht5"
Jul 28 01:16:23.455440 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:23.455427    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zht5" podUID="4ce4b7c0-28ad-45a2-9fac-0f0704533f48"
Jul 28 01:16:24.161180 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:24.161147    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:24.354446 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:24.354411    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:24.700496 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:24.700459    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:24.798419 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:24.798381    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:24.957080 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:24.957049    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:25.356961 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:25.356930    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:25.454622 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:25.454585    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc7hz"
Jul 28 01:16:25.454814 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:25.454604    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zht5"
Jul 28 01:16:25.454814 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:25.454699    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55qx2"
Jul 28 01:16:25.454814 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:25.454701    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kc7hz" podUID="7b958baa-25e6-45e5-82bd-a1d314a4bbad"
Jul 28 01:16:25.454814 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:25.454769    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zht5" podUID="4ce4b7c0-28ad-45a2-9fac-0f0704533f48"
Jul 28 01:16:25.454970 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:25.454870    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55qx2" podUID="fd76bb39-bfb5-4511-a66d-fd55bda460f6"
Jul 28 01:16:25.634753 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:25.634664    2560 generic.go:356] "Generic (PLEG): container finished" podID="4543a9b5-cb95-4e16-8239-6dac004c306d" containerID="782631666ff259193e5b1d3f7422c061058dc07264b8884dcf81f30ef8c51fa7" exitCode=0
Jul 28 01:16:25.634753 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:25.634699    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bjmmc" event={"ID":"4543a9b5-cb95-4e16-8239-6dac004c306d","Type":"ContainerDied","Data":"782631666ff259193e5b1d3f7422c061058dc07264b8884dcf81f30ef8c51fa7"}
Jul 28 01:16:25.952315 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:25.952230    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:26.352580 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:26.352496    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:26.640384 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:26.640165    2560 generic.go:356] "Generic (PLEG): container finished" podID="4543a9b5-cb95-4e16-8239-6dac004c306d" containerID="b8a692496a895148eef2f065826a82df6f640fb684c684ef8b6e347d54b3eb2f" exitCode=0
Jul 28 01:16:26.640384 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:26.640247    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bjmmc" event={"ID":"4543a9b5-cb95-4e16-8239-6dac004c306d","Type":"ContainerDied","Data":"b8a692496a895148eef2f065826a82df6f640fb684c684ef8b6e347d54b3eb2f"}
Jul 28 01:16:26.758454 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:26.758426    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:27.165083 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:27.165050    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:27.357893 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:27.357862    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:27.455335 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:27.455263    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc7hz"
Jul 28 01:16:27.455513 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:27.455263    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zht5"
Jul 28 01:16:27.455513 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:27.455368    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kc7hz" podUID="7b958baa-25e6-45e5-82bd-a1d314a4bbad"
Jul 28 01:16:27.455513 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:27.455389    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55qx2"
Jul 28 01:16:27.455513 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:27.455457    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zht5" podUID="4ce4b7c0-28ad-45a2-9fac-0f0704533f48"
Jul 28 01:16:27.455654 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:27.455530    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55qx2" podUID="fd76bb39-bfb5-4511-a66d-fd55bda460f6"
Jul 28 01:16:27.645114 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:27.645073    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bjmmc" event={"ID":"4543a9b5-cb95-4e16-8239-6dac004c306d","Type":"ContainerStarted","Data":"aba3b5ec1fecf166537486e26e9d594c07732cc1e2e1412d6b9d31974bfdf69a"}
Jul 28 01:16:27.665754 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:27.665713    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bjmmc" podStartSLOduration=10.355832195 podStartE2EDuration="38.665699558s" totalImagesPullingTime="28.309867363s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:15:49 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:16:27.665252394 +0000 UTC m=+38.699295809" watchObservedRunningTime="2026-07-28 01:16:27.665699558 +0000 UTC m=+38.699742962"
Jul 28 01:16:27.872604 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:27.872573    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:27.973273 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:27.973242    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:28.079724 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:28.079688    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:28.181336 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:28.181241    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:28.379150 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:28.379119    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:28.554076 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:28.553986    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:28.758988 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:28.758954    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:29.455677 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:29.455648    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc7hz"
Jul 28 01:16:29.455848 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:29.455725    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kc7hz" podUID="7b958baa-25e6-45e5-82bd-a1d314a4bbad"
Jul 28 01:16:29.455848 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:29.455761    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zht5"
Jul 28 01:16:29.455848 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:29.455805    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zht5" podUID="4ce4b7c0-28ad-45a2-9fac-0f0704533f48"
Jul 28 01:16:29.455848 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:29.455829    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55qx2"
Jul 28 01:16:29.456062 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:29.455902    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55qx2" podUID="fd76bb39-bfb5-4511-a66d-fd55bda460f6"
Jul 28 01:16:31.455118 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:31.455079    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55qx2"
Jul 28 01:16:31.455542 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:31.455080    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zht5"
Jul 28 01:16:31.455542 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:31.455198    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55qx2" podUID="fd76bb39-bfb5-4511-a66d-fd55bda460f6"
Jul 28 01:16:31.455542 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:31.455079    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc7hz"
Jul 28 01:16:31.455542 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:31.455264    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zht5" podUID="4ce4b7c0-28ad-45a2-9fac-0f0704533f48"
Jul 28 01:16:31.455542 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:31.455381    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kc7hz" podUID="7b958baa-25e6-45e5-82bd-a1d314a4bbad"
Jul 28 01:16:33.455028 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:33.454985    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zht5"
Jul 28 01:16:33.455028 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:33.455017    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc7hz"
Jul 28 01:16:33.455589 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:33.454989    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55qx2"
Jul 28 01:16:33.455589 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:33.455118    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zht5" podUID="4ce4b7c0-28ad-45a2-9fac-0f0704533f48"
Jul 28 01:16:33.455589 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:33.455175    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55qx2" podUID="fd76bb39-bfb5-4511-a66d-fd55bda460f6"
Jul 28 01:16:33.455589 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:33.455241    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kc7hz" podUID="7b958baa-25e6-45e5-82bd-a1d314a4bbad"
Jul 28 01:16:35.454698 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:35.454665    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zht5"
Jul 28 01:16:35.455059 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:35.454668    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55qx2"
Jul 28 01:16:35.455059 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:35.454769    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zht5" podUID="4ce4b7c0-28ad-45a2-9fac-0f0704533f48"
Jul 28 01:16:35.455059 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:35.454889    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55qx2" podUID="fd76bb39-bfb5-4511-a66d-fd55bda460f6"
Jul 28 01:16:35.455059 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:35.454950    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc7hz"
Jul 28 01:16:35.455059 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:35.455025    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kc7hz" podUID="7b958baa-25e6-45e5-82bd-a1d314a4bbad"
Jul 28 01:16:35.499430 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:35.499397    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:35.595429 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:35.595384    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:35.681501 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:35.681468    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:35.747512 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:35.747427    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:35.819854 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:35.819821    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:36.834678 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:36.834652    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-213.ec2.internal" event="NodeReady"
Jul 28 01:16:36.835132 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:36.834779    2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 28 01:16:36.879407 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:36.879380    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4c79m"]
Jul 28 01:16:36.907316 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:36.907297    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-d4gsq"]
Jul 28 01:16:36.907465 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:36.907446    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4c79m"
Jul 28 01:16:36.909471 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:36.909452    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 28 01:16:36.909574 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:36.909452    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 28 01:16:36.909574 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:36.909515    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-h7mrw\""
Jul 28 01:16:36.931499 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:36.931479    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4c79m"]
Jul 28 01:16:36.931575 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:36.931506    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d4gsq"]
Jul 28 01:16:36.931615 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:36.931578    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d4gsq"
Jul 28 01:16:36.933328 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:36.933307    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 28 01:16:36.933538 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:36.933522    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 28 01:16:36.933613 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:36.933557    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 28 01:16:36.933680 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:36.933616    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zm2x9\""
Jul 28 01:16:36.998162 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:36.998136    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:37.000082 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:37.000066    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/42b07623-989a-4062-b97d-17321ae05e82-config-volume\") pod \"dns-default-4c79m\" (UID: \"42b07623-989a-4062-b97d-17321ae05e82\") " pod="openshift-dns/dns-default-4c79m"
Jul 28 01:16:37.000153 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:37.000104    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s5rh\" (UniqueName: \"kubernetes.io/projected/42b07623-989a-4062-b97d-17321ae05e82-kube-api-access-7s5rh\") pod \"dns-default-4c79m\" (UID: \"42b07623-989a-4062-b97d-17321ae05e82\") " pod="openshift-dns/dns-default-4c79m"
Jul 28 01:16:37.000153 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:37.000128    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42b07623-989a-4062-b97d-17321ae05e82-tmp-dir\") pod \"dns-default-4c79m\" (UID: \"42b07623-989a-4062-b97d-17321ae05e82\") " pod="openshift-dns/dns-default-4c79m"
Jul 28 01:16:37.000243 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:37.000167    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42b07623-989a-4062-b97d-17321ae05e82-metrics-tls\") pod \"dns-default-4c79m\" (UID: \"42b07623-989a-4062-b97d-17321ae05e82\") " pod="openshift-dns/dns-default-4c79m"
Jul 28 01:16:37.000243 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:37.000194    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a5a1bd68-3c13-4064-88cd-176ad3ef9e5f-cert\") pod \"ingress-canary-d4gsq\" (UID: \"a5a1bd68-3c13-4064-88cd-176ad3ef9e5f\") " pod="openshift-ingress-canary/ingress-canary-d4gsq"
Jul 28 01:16:37.000243 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:37.000223    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lb57d\" (UniqueName: \"kubernetes.io/projected/a5a1bd68-3c13-4064-88cd-176ad3ef9e5f-kube-api-access-lb57d\") pod \"ingress-canary-d4gsq\" (UID: \"a5a1bd68-3c13-4064-88cd-176ad3ef9e5f\") " pod="openshift-ingress-canary/ingress-canary-d4gsq"
Jul 28 01:16:37.094091 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:37.094011    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:37.101020 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:37.100996    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/42b07623-989a-4062-b97d-17321ae05e82-config-volume\") pod \"dns-default-4c79m\" (UID: \"42b07623-989a-4062-b97d-17321ae05e82\") " pod="openshift-dns/dns-default-4c79m"
Jul 28 01:16:37.101113 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:37.101039    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7s5rh\" (UniqueName: \"kubernetes.io/projected/42b07623-989a-4062-b97d-17321ae05e82-kube-api-access-7s5rh\") pod \"dns-default-4c79m\" (UID: \"42b07623-989a-4062-b97d-17321ae05e82\") " pod="openshift-dns/dns-default-4c79m"
Jul 28 01:16:37.101113 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:37.101060    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42b07623-989a-4062-b97d-17321ae05e82-tmp-dir\") pod \"dns-default-4c79m\" (UID: \"42b07623-989a-4062-b97d-17321ae05e82\") " pod="openshift-dns/dns-default-4c79m"
Jul 28 01:16:37.101113 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:37.101081    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42b07623-989a-4062-b97d-17321ae05e82-metrics-tls\") pod \"dns-default-4c79m\" (UID: \"42b07623-989a-4062-b97d-17321ae05e82\") " pod="openshift-dns/dns-default-4c79m"
Jul 28 01:16:37.101113 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:37.101109    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a5a1bd68-3c13-4064-88cd-176ad3ef9e5f-cert\") pod \"ingress-canary-d4gsq\" (UID: \"a5a1bd68-3c13-4064-88cd-176ad3ef9e5f\") " pod="openshift-ingress-canary/ingress-canary-d4gsq"
Jul 28 01:16:37.101301 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:37.101128    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lb57d\" (UniqueName: \"kubernetes.io/projected/a5a1bd68-3c13-4064-88cd-176ad3ef9e5f-kube-api-access-lb57d\") pod \"ingress-canary-d4gsq\" (UID: \"a5a1bd68-3c13-4064-88cd-176ad3ef9e5f\") " pod="openshift-ingress-canary/ingress-canary-d4gsq"
Jul 28 01:16:37.101465 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:37.101443    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42b07623-989a-4062-b97d-17321ae05e82-tmp-dir\") pod \"dns-default-4c79m\" (UID: \"42b07623-989a-4062-b97d-17321ae05e82\") " pod="openshift-dns/dns-default-4c79m"
Jul 28 01:16:37.101642 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:37.101627    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/42b07623-989a-4062-b97d-17321ae05e82-config-volume\") pod \"dns-default-4c79m\" (UID: \"42b07623-989a-4062-b97d-17321ae05e82\") " pod="openshift-dns/dns-default-4c79m"
Jul 28 01:16:37.104987 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:37.104962    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a5a1bd68-3c13-4064-88cd-176ad3ef9e5f-cert\") pod \"ingress-canary-d4gsq\" (UID: \"a5a1bd68-3c13-4064-88cd-176ad3ef9e5f\") " pod="openshift-ingress-canary/ingress-canary-d4gsq"
Jul 28 01:16:37.104987 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:37.104980    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42b07623-989a-4062-b97d-17321ae05e82-metrics-tls\") pod \"dns-default-4c79m\" (UID: \"42b07623-989a-4062-b97d-17321ae05e82\") " pod="openshift-dns/dns-default-4c79m"
Jul 28 01:16:37.108397 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:37.108371    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s5rh\" (UniqueName: \"kubernetes.io/projected/42b07623-989a-4062-b97d-17321ae05e82-kube-api-access-7s5rh\") pod \"dns-default-4c79m\" (UID: \"42b07623-989a-4062-b97d-17321ae05e82\") " pod="openshift-dns/dns-default-4c79m"
Jul 28 01:16:37.108484 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:37.108404    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lb57d\" (UniqueName: \"kubernetes.io/projected/a5a1bd68-3c13-4064-88cd-176ad3ef9e5f-kube-api-access-lb57d\") pod \"ingress-canary-d4gsq\" (UID: \"a5a1bd68-3c13-4064-88cd-176ad3ef9e5f\") " pod="openshift-ingress-canary/ingress-canary-d4gsq"
Jul 28 01:16:37.216627 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:37.216593    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4c79m"
Jul 28 01:16:37.239340 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:37.239316    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d4gsq"
Jul 28 01:16:37.419627 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:37.419595    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d4gsq"]
Jul 28 01:16:37.422845 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:16:37.422819    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5a1bd68_3c13_4064_88cd_176ad3ef9e5f.slice/crio-1e78b31090f00fc058e06603b73417995bafc96a870f9bb2df59180a987a18aa WatchSource:0}: Error finding container 1e78b31090f00fc058e06603b73417995bafc96a870f9bb2df59180a987a18aa: Status 404 returned error can't find the container with id 1e78b31090f00fc058e06603b73417995bafc96a870f9bb2df59180a987a18aa
Jul 28 01:16:37.432883 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:37.432860    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4c79m"]
Jul 28 01:16:37.435647 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:16:37.435624    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42b07623_989a_4062_b97d_17321ae05e82.slice/crio-6ea8a6f6f9d42093f66f3d09307451ce639f05a2bdb5399d094cd3d75b47dfa4 WatchSource:0}: Error finding container 6ea8a6f6f9d42093f66f3d09307451ce639f05a2bdb5399d094cd3d75b47dfa4: Status 404 returned error can't find the container with id 6ea8a6f6f9d42093f66f3d09307451ce639f05a2bdb5399d094cd3d75b47dfa4
Jul 28 01:16:37.455328 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:37.455303    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc7hz"
Jul 28 01:16:37.455468 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:37.455336    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zht5"
Jul 28 01:16:37.455468 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:37.455312    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55qx2"
Jul 28 01:16:37.459374 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:37.459046    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 01:16:37.459374 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:37.459138    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 01:16:37.459374 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:37.459253    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 01:16:37.459374 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:37.459260    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j4n9n\""
Jul 28 01:16:37.459374 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:37.459261    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 01:16:37.460218 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:37.460200    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4m9v4\""
Jul 28 01:16:37.668050 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:37.667959    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d4gsq" event={"ID":"a5a1bd68-3c13-4064-88cd-176ad3ef9e5f","Type":"ContainerStarted","Data":"1e78b31090f00fc058e06603b73417995bafc96a870f9bb2df59180a987a18aa"}
Jul 28 01:16:37.668957 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:37.668932    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4c79m" event={"ID":"42b07623-989a-4062-b97d-17321ae05e82","Type":"ContainerStarted","Data":"6ea8a6f6f9d42093f66f3d09307451ce639f05a2bdb5399d094cd3d75b47dfa4"}
Jul 28 01:16:40.024778 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:40.024691    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-9w2lz"]
Jul 28 01:16:40.047042 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:40.047009    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:40.047390 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:40.047372    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-9w2lz"]
Jul 28 01:16:40.047456 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:40.047433    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-9w2lz"
Jul 28 01:16:40.049330 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:40.049309    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 28 01:16:40.049420 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:40.049333    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 28 01:16:40.049460 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:40.049420    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-72cf4\""
Jul 28 01:16:40.123702 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:40.123678    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxzn7\" (UniqueName: \"kubernetes.io/projected/6c595db5-126c-4167-b469-79b610bf05d6-kube-api-access-sxzn7\") pod \"downloads-7c97dc4555-9w2lz\" (UID: \"6c595db5-126c-4167-b469-79b610bf05d6\") " pod="openshift-console/downloads-7c97dc4555-9w2lz"
Jul 28 01:16:40.143687 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:40.143659    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:40.224238 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:40.224216    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxzn7\" (UniqueName: \"kubernetes.io/projected/6c595db5-126c-4167-b469-79b610bf05d6-kube-api-access-sxzn7\") pod \"downloads-7c97dc4555-9w2lz\" (UID: \"6c595db5-126c-4167-b469-79b610bf05d6\") " pod="openshift-console/downloads-7c97dc4555-9w2lz"
Jul 28 01:16:40.231560 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:40.231536    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxzn7\" (UniqueName: \"kubernetes.io/projected/6c595db5-126c-4167-b469-79b610bf05d6-kube-api-access-sxzn7\") pod \"downloads-7c97dc4555-9w2lz\" (UID: \"6c595db5-126c-4167-b469-79b610bf05d6\") " pod="openshift-console/downloads-7c97dc4555-9w2lz"
Jul 28 01:16:40.321908 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:40.321873    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:40.355915 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:40.355890    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-9w2lz"
Jul 28 01:16:40.511363 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:40.511322    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-9w2lz"]
Jul 28 01:16:40.519515 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:16:40.519486    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c595db5_126c_4167_b469_79b610bf05d6.slice/crio-eb715487679dce04392e373770e432f0ce4af2136f33cb90ed5dc19d45908507 WatchSource:0}: Error finding container eb715487679dce04392e373770e432f0ce4af2136f33cb90ed5dc19d45908507: Status 404 returned error can't find the container with id eb715487679dce04392e373770e432f0ce4af2136f33cb90ed5dc19d45908507
Jul 28 01:16:40.678192 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:40.678153    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4c79m" event={"ID":"42b07623-989a-4062-b97d-17321ae05e82","Type":"ContainerStarted","Data":"a7c0a6021136c2c0cbc3bc2e5e49dad3519336c3dfde746021ac4a6164b680b8"}
Jul 28 01:16:40.678443 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:40.678206    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4c79m" event={"ID":"42b07623-989a-4062-b97d-17321ae05e82","Type":"ContainerStarted","Data":"6e48310b4934420c497fe9c32937603ef2a4115eef8d04c0f7876cb652137495"}
Jul 28 01:16:40.678443 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:40.678285    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4c79m"
Jul 28 01:16:40.679383 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:40.679342    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-9w2lz" event={"ID":"6c595db5-126c-4167-b469-79b610bf05d6","Type":"ContainerStarted","Data":"eb715487679dce04392e373770e432f0ce4af2136f33cb90ed5dc19d45908507"}
Jul 28 01:16:40.680634 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:40.680613    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d4gsq" event={"ID":"a5a1bd68-3c13-4064-88cd-176ad3ef9e5f","Type":"ContainerStarted","Data":"4b300edd66d3528cddebb72067d7f01e23fcb5179a978ddb74bd4c373767a2dd"}
Jul 28 01:16:40.694473 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:40.694429    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4c79m" podStartSLOduration=1.862326881 podStartE2EDuration="4.694418046s" totalImagesPullingTime="2.832091165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:16:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:16:40.693584798 +0000 UTC m=+51.727628192" watchObservedRunningTime="2026-07-28 01:16:40.694418046 +0000 UTC m=+51.728461455"
Jul 28 01:16:40.700827 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:40.700805    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:40.706988 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:40.706953    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-d4gsq" podStartSLOduration=1.855382653 podStartE2EDuration="4.706941699s" totalImagesPullingTime="2.851559046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:16:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:16:40.706054359 +0000 UTC m=+51.740097751" watchObservedRunningTime="2026-07-28 01:16:40.706941699 +0000 UTC m=+51.740985091"
Jul 28 01:16:40.759056 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:40.759027    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:41.105863 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:41.105807    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:41.335278 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:41.335239    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:41.385301 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:41.385249    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:41.531673 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:41.531640    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:41.581765 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:41.581726    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:41.710012 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:41.709908    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:41.906904 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:41.906853    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:42.023122 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:42.023016    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:45.428518 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:45.428477    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:45.482779 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:45.482745    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:46.774021 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:46.773981    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:46.846264 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:46.846232    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:46.949411 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:46.949377    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:47.049281 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:47.049194    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:47.114041 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:47.113995    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:47.116052 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:47.116024    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-x5k2b"]
Jul 28 01:16:47.118059 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:47.118039    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-x5k2b"
Jul 28 01:16:47.119982 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:47.119958    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 28 01:16:47.120110 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:47.120086    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-6b9cj\""
Jul 28 01:16:47.127873 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:47.127850    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-x5k2b"]
Jul 28 01:16:47.176981 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:47.176953    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/943b150c-4c16-46d2-bd0c-bd1e4764f073-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-x5k2b\" (UID: \"943b150c-4c16-46d2-bd0c-bd1e4764f073\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-x5k2b"
Jul 28 01:16:47.277495 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:47.277455    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/943b150c-4c16-46d2-bd0c-bd1e4764f073-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-x5k2b\" (UID: \"943b150c-4c16-46d2-bd0c-bd1e4764f073\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-x5k2b"
Jul 28 01:16:47.277682 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:47.277574    2560 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 28 01:16:47.277682 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:47.277665    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/943b150c-4c16-46d2-bd0c-bd1e4764f073-tls-certificates podName:943b150c-4c16-46d2-bd0c-bd1e4764f073 nodeName:}" failed. No retries permitted until 2026-07-28 01:16:47.777642749 +0000 UTC m=+58.811686125 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/943b150c-4c16-46d2-bd0c-bd1e4764f073-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-x5k2b" (UID: "943b150c-4c16-46d2-bd0c-bd1e4764f073") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 28 01:16:47.709791 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:47.709761    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qth82"]
Jul 28 01:16:47.712010 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:47.711985    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qth82"
Jul 28 01:16:47.714064 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:47.714044    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 28 01:16:47.714210 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:47.714122    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 28 01:16:47.714318 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:47.714282    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 28 01:16:47.714449 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:47.714363    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gz7nz\""
Jul 28 01:16:47.714449 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:47.714383    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 28 01:16:47.725745 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:47.725718    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qth82"]
Jul 28 01:16:47.750732 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:47.750703    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:47.780922 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:47.780890    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/94293167-f740-4904-8546-ba172bfc26c9-crio-socket\") pod \"insights-runtime-extractor-qth82\" (UID: \"94293167-f740-4904-8546-ba172bfc26c9\") " pod="openshift-insights/insights-runtime-extractor-qth82"
Jul 28 01:16:47.781336 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:47.780928    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/94293167-f740-4904-8546-ba172bfc26c9-data-volume\") pod \"insights-runtime-extractor-qth82\" (UID: \"94293167-f740-4904-8546-ba172bfc26c9\") " pod="openshift-insights/insights-runtime-extractor-qth82"
Jul 28 01:16:47.781336 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:47.781008    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/943b150c-4c16-46d2-bd0c-bd1e4764f073-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-x5k2b\" (UID: \"943b150c-4c16-46d2-bd0c-bd1e4764f073\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-x5k2b"
Jul 28 01:16:47.781336 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:47.781029    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/94293167-f740-4904-8546-ba172bfc26c9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qth82\" (UID: \"94293167-f740-4904-8546-ba172bfc26c9\") " pod="openshift-insights/insights-runtime-extractor-qth82"
Jul 28 01:16:47.781336 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:47.781050    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgjb4\" (UniqueName: \"kubernetes.io/projected/94293167-f740-4904-8546-ba172bfc26c9-kube-api-access-lgjb4\") pod \"insights-runtime-extractor-qth82\" (UID: \"94293167-f740-4904-8546-ba172bfc26c9\") " pod="openshift-insights/insights-runtime-extractor-qth82"
Jul 28 01:16:47.781336 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:47.781106    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/94293167-f740-4904-8546-ba172bfc26c9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qth82\" (UID: \"94293167-f740-4904-8546-ba172bfc26c9\") " pod="openshift-insights/insights-runtime-extractor-qth82"
Jul 28 01:16:47.781336 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:47.781147    2560 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 28 01:16:47.781336 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:47.781212    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/943b150c-4c16-46d2-bd0c-bd1e4764f073-tls-certificates podName:943b150c-4c16-46d2-bd0c-bd1e4764f073 nodeName:}" failed. No retries permitted until 2026-07-28 01:16:48.781191702 +0000 UTC m=+59.815235077 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/943b150c-4c16-46d2-bd0c-bd1e4764f073-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-x5k2b" (UID: "943b150c-4c16-46d2-bd0c-bd1e4764f073") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 28 01:16:47.813408 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:47.813373    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:47.873436 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:47.873400    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:47.882399 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:47.882367    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/94293167-f740-4904-8546-ba172bfc26c9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qth82\" (UID: \"94293167-f740-4904-8546-ba172bfc26c9\") " pod="openshift-insights/insights-runtime-extractor-qth82"
Jul 28 01:16:47.882583 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:47.882417    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgjb4\" (UniqueName: \"kubernetes.io/projected/94293167-f740-4904-8546-ba172bfc26c9-kube-api-access-lgjb4\") pod \"insights-runtime-extractor-qth82\" (UID: \"94293167-f740-4904-8546-ba172bfc26c9\") " pod="openshift-insights/insights-runtime-extractor-qth82"
Jul 28 01:16:47.882583 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:47.882440    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 01:16:47.882583 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:47.882468    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/94293167-f740-4904-8546-ba172bfc26c9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qth82\" (UID: \"94293167-f740-4904-8546-ba172bfc26c9\") " pod="openshift-insights/insights-runtime-extractor-qth82"
Jul 28 01:16:47.882583 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:47.882527    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/94293167-f740-4904-8546-ba172bfc26c9-kube-rbac-proxy-cm podName:94293167-f740-4904-8546-ba172bfc26c9 nodeName:}" failed. No retries permitted until 2026-07-28 01:16:48.38250582 +0000 UTC m=+59.416549195 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/94293167-f740-4904-8546-ba172bfc26c9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qth82" (UID: "94293167-f740-4904-8546-ba172bfc26c9") : configmap "kube-rbac-proxy" not found
Jul 28 01:16:47.882583 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:47.882575    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/94293167-f740-4904-8546-ba172bfc26c9-crio-socket\") pod \"insights-runtime-extractor-qth82\" (UID: \"94293167-f740-4904-8546-ba172bfc26c9\") " pod="openshift-insights/insights-runtime-extractor-qth82"
Jul 28 01:16:47.882583 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:47.882585    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 01:16:47.882890 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:47.882599    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/94293167-f740-4904-8546-ba172bfc26c9-data-volume\") pod \"insights-runtime-extractor-qth82\" (UID: \"94293167-f740-4904-8546-ba172bfc26c9\") " pod="openshift-insights/insights-runtime-extractor-qth82"
Jul 28 01:16:47.882890 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:47.882634    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94293167-f740-4904-8546-ba172bfc26c9-insights-runtime-extractor-tls podName:94293167-f740-4904-8546-ba172bfc26c9 nodeName:}" failed. No retries permitted until 2026-07-28 01:16:48.38261835 +0000 UTC m=+59.416661720 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/94293167-f740-4904-8546-ba172bfc26c9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qth82" (UID: "94293167-f740-4904-8546-ba172bfc26c9") : secret "insights-runtime-extractor-tls" not found
Jul 28 01:16:47.883010 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:47.882903    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/94293167-f740-4904-8546-ba172bfc26c9-data-volume\") pod \"insights-runtime-extractor-qth82\" (UID: \"94293167-f740-4904-8546-ba172bfc26c9\") " pod="openshift-insights/insights-runtime-extractor-qth82"
Jul 28 01:16:47.883010 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:47.882973    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/94293167-f740-4904-8546-ba172bfc26c9-crio-socket\") pod \"insights-runtime-extractor-qth82\" (UID: \"94293167-f740-4904-8546-ba172bfc26c9\") " pod="openshift-insights/insights-runtime-extractor-qth82"
Jul 28 01:16:47.892571 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:47.892546    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgjb4\" (UniqueName: \"kubernetes.io/projected/94293167-f740-4904-8546-ba172bfc26c9-kube-api-access-lgjb4\") pod \"insights-runtime-extractor-qth82\" (UID: \"94293167-f740-4904-8546-ba172bfc26c9\") " pod="openshift-insights/insights-runtime-extractor-qth82"
Jul 28 01:16:47.974946 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:47.974858    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:48.386403 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:48.386344    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/94293167-f740-4904-8546-ba172bfc26c9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qth82\" (UID: \"94293167-f740-4904-8546-ba172bfc26c9\") " pod="openshift-insights/insights-runtime-extractor-qth82"
Jul 28 01:16:48.386573 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:48.386489    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 01:16:48.386573 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:48.386537    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 01:16:48.386573 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:48.386489    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/94293167-f740-4904-8546-ba172bfc26c9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qth82\" (UID: \"94293167-f740-4904-8546-ba172bfc26c9\") " pod="openshift-insights/insights-runtime-extractor-qth82"
Jul 28 01:16:48.386573 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:48.386555    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94293167-f740-4904-8546-ba172bfc26c9-insights-runtime-extractor-tls podName:94293167-f740-4904-8546-ba172bfc26c9 nodeName:}" failed. No retries permitted until 2026-07-28 01:16:49.386536321 +0000 UTC m=+60.420579714 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/94293167-f740-4904-8546-ba172bfc26c9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qth82" (UID: "94293167-f740-4904-8546-ba172bfc26c9") : secret "insights-runtime-extractor-tls" not found
Jul 28 01:16:48.386749 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:48.386649    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/94293167-f740-4904-8546-ba172bfc26c9-kube-rbac-proxy-cm podName:94293167-f740-4904-8546-ba172bfc26c9 nodeName:}" failed. No retries permitted until 2026-07-28 01:16:49.386613168 +0000 UTC m=+60.420656553 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/94293167-f740-4904-8546-ba172bfc26c9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qth82" (UID: "94293167-f740-4904-8546-ba172bfc26c9") : configmap "kube-rbac-proxy" not found
Jul 28 01:16:48.536677 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:48.536647    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5596876655-skb2w"]
Jul 28 01:16:48.538686 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:48.538666    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5596876655-skb2w"
Jul 28 01:16:48.540843 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:48.540823    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 28 01:16:48.541045 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:48.540945    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 28 01:16:48.541045 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:48.540998    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wnlt7\""
Jul 28 01:16:48.541045 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:48.541006    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 28 01:16:48.541406 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:48.541390    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 28 01:16:48.541507 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:48.541390    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 28 01:16:48.549690 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:48.549669    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5596876655-skb2w"]
Jul 28 01:16:48.588056 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:48.588031    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74ea767c-9b69-417f-aedd-f5dddad3c6ea-console-config\") pod \"console-5596876655-skb2w\" (UID: \"74ea767c-9b69-417f-aedd-f5dddad3c6ea\") " pod="openshift-console/console-5596876655-skb2w"
Jul 28 01:16:48.588192 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:48.588120    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74ea767c-9b69-417f-aedd-f5dddad3c6ea-console-oauth-config\") pod \"console-5596876655-skb2w\" (UID: \"74ea767c-9b69-417f-aedd-f5dddad3c6ea\") " pod="openshift-console/console-5596876655-skb2w"
Jul 28 01:16:48.588192 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:48.588177    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74ea767c-9b69-417f-aedd-f5dddad3c6ea-oauth-serving-cert\") pod \"console-5596876655-skb2w\" (UID: \"74ea767c-9b69-417f-aedd-f5dddad3c6ea\") " pod="openshift-console/console-5596876655-skb2w"
Jul 28 01:16:48.588301 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:48.588212    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74ea767c-9b69-417f-aedd-f5dddad3c6ea-console-serving-cert\") pod \"console-5596876655-skb2w\" (UID: \"74ea767c-9b69-417f-aedd-f5dddad3c6ea\") " pod="openshift-console/console-5596876655-skb2w"
Jul 28 01:16:48.588301 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:48.588228    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74ea767c-9b69-417f-aedd-f5dddad3c6ea-service-ca\") pod \"console-5596876655-skb2w\" (UID: \"74ea767c-9b69-417f-aedd-f5dddad3c6ea\") " pod="openshift-console/console-5596876655-skb2w"
Jul 28 01:16:48.588301 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:48.588244    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c45w9\" (UniqueName: \"kubernetes.io/projected/74ea767c-9b69-417f-aedd-f5dddad3c6ea-kube-api-access-c45w9\") pod \"console-5596876655-skb2w\" (UID: \"74ea767c-9b69-417f-aedd-f5dddad3c6ea\") " pod="openshift-console/console-5596876655-skb2w"
Jul 28 01:16:48.622770 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:48.622748    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5f2zn"
Jul 28 01:16:48.689631 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:48.689561    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74ea767c-9b69-417f-aedd-f5dddad3c6ea-console-oauth-config\") pod \"console-5596876655-skb2w\" (UID: \"74ea767c-9b69-417f-aedd-f5dddad3c6ea\") " pod="openshift-console/console-5596876655-skb2w"
Jul 28 01:16:48.690089 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:48.690058    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74ea767c-9b69-417f-aedd-f5dddad3c6ea-oauth-serving-cert\") pod \"console-5596876655-skb2w\" (UID: \"74ea767c-9b69-417f-aedd-f5dddad3c6ea\") " pod="openshift-console/console-5596876655-skb2w"
Jul 28 01:16:48.690233 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:48.690120    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74ea767c-9b69-417f-aedd-f5dddad3c6ea-console-serving-cert\") pod \"console-5596876655-skb2w\" (UID: \"74ea767c-9b69-417f-aedd-f5dddad3c6ea\") " pod="openshift-console/console-5596876655-skb2w"
Jul 28 01:16:48.690233 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:48.690146    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74ea767c-9b69-417f-aedd-f5dddad3c6ea-service-ca\") pod \"console-5596876655-skb2w\" (UID: \"74ea767c-9b69-417f-aedd-f5dddad3c6ea\") " pod="openshift-console/console-5596876655-skb2w"
Jul 28 01:16:48.690233 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:48.690172    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c45w9\" (UniqueName: \"kubernetes.io/projected/74ea767c-9b69-417f-aedd-f5dddad3c6ea-kube-api-access-c45w9\") pod \"console-5596876655-skb2w\" (UID: \"74ea767c-9b69-417f-aedd-f5dddad3c6ea\") " pod="openshift-console/console-5596876655-skb2w"
Jul 28 01:16:48.690233 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:48.690209    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74ea767c-9b69-417f-aedd-f5dddad3c6ea-console-config\") pod \"console-5596876655-skb2w\" (UID: \"74ea767c-9b69-417f-aedd-f5dddad3c6ea\") " pod="openshift-console/console-5596876655-skb2w"
Jul 28 01:16:48.690847 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:48.690824    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74ea767c-9b69-417f-aedd-f5dddad3c6ea-oauth-serving-cert\") pod \"console-5596876655-skb2w\" (UID: \"74ea767c-9b69-417f-aedd-f5dddad3c6ea\") " pod="openshift-console/console-5596876655-skb2w"
Jul 28 01:16:48.690948 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:48.690892    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74ea767c-9b69-417f-aedd-f5dddad3c6ea-service-ca\") pod \"console-5596876655-skb2w\" (UID: \"74ea767c-9b69-417f-aedd-f5dddad3c6ea\") " pod="openshift-console/console-5596876655-skb2w"
Jul 28 01:16:48.691127 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:48.691102    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74ea767c-9b69-417f-aedd-f5dddad3c6ea-console-config\") pod \"console-5596876655-skb2w\" (UID: \"74ea767c-9b69-417f-aedd-f5dddad3c6ea\") " pod="openshift-console/console-5596876655-skb2w"
Jul 28 01:16:48.692611 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:48.692589    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74ea767c-9b69-417f-aedd-f5dddad3c6ea-console-oauth-config\") pod \"console-5596876655-skb2w\" (UID: \"74ea767c-9b69-417f-aedd-f5dddad3c6ea\") " pod="openshift-console/console-5596876655-skb2w"
Jul 28 01:16:48.692824 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:48.692808    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74ea767c-9b69-417f-aedd-f5dddad3c6ea-console-serving-cert\") pod \"console-5596876655-skb2w\" (UID: \"74ea767c-9b69-417f-aedd-f5dddad3c6ea\") " pod="openshift-console/console-5596876655-skb2w"
Jul 28 01:16:48.698133 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:48.698092    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c45w9\" (UniqueName: \"kubernetes.io/projected/74ea767c-9b69-417f-aedd-f5dddad3c6ea-kube-api-access-c45w9\") pod \"console-5596876655-skb2w\" (UID: \"74ea767c-9b69-417f-aedd-f5dddad3c6ea\") " pod="openshift-console/console-5596876655-skb2w"
Jul 28 01:16:48.703470 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:48.703446    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4c79m_42b07623-989a-4062-b97d-17321ae05e82/dns/0.log"
Jul 28 01:16:48.728597 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:48.728563    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:48.785366 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:48.785309    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:48.791430 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:48.791400    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/943b150c-4c16-46d2-bd0c-bd1e4764f073-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-x5k2b\" (UID: \"943b150c-4c16-46d2-bd0c-bd1e4764f073\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-x5k2b"
Jul 28 01:16:48.793982 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:48.793958    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/943b150c-4c16-46d2-bd0c-bd1e4764f073-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-x5k2b\" (UID: \"943b150c-4c16-46d2-bd0c-bd1e4764f073\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-x5k2b"
Jul 28 01:16:48.834047 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:48.834004    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:48.849095 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:48.849072    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5596876655-skb2w"
Jul 28 01:16:48.904608 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:48.904575    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4c79m_42b07623-989a-4062-b97d-17321ae05e82/kube-rbac-proxy/0.log"
Jul 28 01:16:48.928886 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:48.928484    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-x5k2b"
Jul 28 01:16:48.978866 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:48.978531    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5596876655-skb2w"]
Jul 28 01:16:48.983162 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:16:48.983128    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74ea767c_9b69_417f_aedd_f5dddad3c6ea.slice/crio-f24a68292bd7c8187e4db51dc601dffcf28b76112a062ecc4d7a7888e77b48d2 WatchSource:0}: Error finding container f24a68292bd7c8187e4db51dc601dffcf28b76112a062ecc4d7a7888e77b48d2: Status 404 returned error can't find the container with id f24a68292bd7c8187e4db51dc601dffcf28b76112a062ecc4d7a7888e77b48d2
Jul 28 01:16:49.075002 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:49.074971    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-x5k2b"]
Jul 28 01:16:49.078472 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:16:49.078426    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod943b150c_4c16_46d2_bd0c_bd1e4764f073.slice/crio-1278f6e45cda3bbe6cf2a37a658e40c5195097b2351038911d32c5b47189061f WatchSource:0}: Error finding container 1278f6e45cda3bbe6cf2a37a658e40c5195097b2351038911d32c5b47189061f: Status 404 returned error can't find the container with id 1278f6e45cda3bbe6cf2a37a658e40c5195097b2351038911d32c5b47189061f
Jul 28 01:16:49.396608 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:49.396573    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/94293167-f740-4904-8546-ba172bfc26c9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qth82\" (UID: \"94293167-f740-4904-8546-ba172bfc26c9\") " pod="openshift-insights/insights-runtime-extractor-qth82"
Jul 28 01:16:49.396782 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:49.396648    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/94293167-f740-4904-8546-ba172bfc26c9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qth82\" (UID: \"94293167-f740-4904-8546-ba172bfc26c9\") " pod="openshift-insights/insights-runtime-extractor-qth82"
Jul 28 01:16:49.396846 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:49.396819    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 01:16:49.396899 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:49.396870    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94293167-f740-4904-8546-ba172bfc26c9-insights-runtime-extractor-tls podName:94293167-f740-4904-8546-ba172bfc26c9 nodeName:}" failed. No retries permitted until 2026-07-28 01:16:51.3968528 +0000 UTC m=+62.430896174 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/94293167-f740-4904-8546-ba172bfc26c9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qth82" (UID: "94293167-f740-4904-8546-ba172bfc26c9") : secret "insights-runtime-extractor-tls" not found
Jul 28 01:16:49.397121 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:49.397033    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 01:16:49.397121 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:49.397099    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/94293167-f740-4904-8546-ba172bfc26c9-kube-rbac-proxy-cm podName:94293167-f740-4904-8546-ba172bfc26c9 nodeName:}" failed. No retries permitted until 2026-07-28 01:16:51.397082235 +0000 UTC m=+62.431125627 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/94293167-f740-4904-8546-ba172bfc26c9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qth82" (UID: "94293167-f740-4904-8546-ba172bfc26c9") : configmap "kube-rbac-proxy" not found
Jul 28 01:16:49.672857 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:49.672758    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:49.703081 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:49.703053    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q6x4f_acb1d898-a0fc-45e9-a715-67dc3301b622/dns-node-resolver/0.log"
Jul 28 01:16:49.706412 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:49.706381    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5596876655-skb2w" event={"ID":"74ea767c-9b69-417f-aedd-f5dddad3c6ea","Type":"ContainerStarted","Data":"f24a68292bd7c8187e4db51dc601dffcf28b76112a062ecc4d7a7888e77b48d2"}
Jul 28 01:16:49.707732 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:49.707679    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-x5k2b" event={"ID":"943b150c-4c16-46d2-bd0c-bd1e4764f073","Type":"ContainerStarted","Data":"1278f6e45cda3bbe6cf2a37a658e40c5195097b2351038911d32c5b47189061f"}
Jul 28 01:16:49.727394 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:49.727364    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:50.686794 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:50.686766    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4c79m"
Jul 28 01:16:50.706376 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:50.706247    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l6jcf_ee785053-e88b-44ef-a5cb-659eaa15ed7b/node-ca/0.log"
Jul 28 01:16:51.304289 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:51.304247    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d4gsq_a5a1bd68-3c13-4064-88cd-176ad3ef9e5f/serve-healthcheck-canary/0.log"
Jul 28 01:16:51.415692 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:51.415653    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/94293167-f740-4904-8546-ba172bfc26c9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qth82\" (UID: \"94293167-f740-4904-8546-ba172bfc26c9\") " pod="openshift-insights/insights-runtime-extractor-qth82"
Jul 28 01:16:51.415867 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:51.415768    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/94293167-f740-4904-8546-ba172bfc26c9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qth82\" (UID: \"94293167-f740-4904-8546-ba172bfc26c9\") " pod="openshift-insights/insights-runtime-extractor-qth82"
Jul 28 01:16:51.415867 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:51.415822    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 01:16:51.415991 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:51.415868    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 01:16:51.415991 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:51.415901    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94293167-f740-4904-8546-ba172bfc26c9-insights-runtime-extractor-tls podName:94293167-f740-4904-8546-ba172bfc26c9 nodeName:}" failed. No retries permitted until 2026-07-28 01:16:55.415880308 +0000 UTC m=+66.449923678 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/94293167-f740-4904-8546-ba172bfc26c9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qth82" (UID: "94293167-f740-4904-8546-ba172bfc26c9") : secret "insights-runtime-extractor-tls" not found
Jul 28 01:16:51.415991 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:51.415919    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/94293167-f740-4904-8546-ba172bfc26c9-kube-rbac-proxy-cm podName:94293167-f740-4904-8546-ba172bfc26c9 nodeName:}" failed. No retries permitted until 2026-07-28 01:16:55.415910658 +0000 UTC m=+66.449954029 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/94293167-f740-4904-8546-ba172bfc26c9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qth82" (UID: "94293167-f740-4904-8546-ba172bfc26c9") : configmap "kube-rbac-proxy" not found
Jul 28 01:16:51.487144 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:51.487108    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:51.586598 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:51.586506    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:51.687025 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:51.686991    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:51.716011 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:51.715967    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-x5k2b" event={"ID":"943b150c-4c16-46d2-bd0c-bd1e4764f073","Type":"ContainerStarted","Data":"74d6031a7abd87050386d45ba17b191f08ff5ae3f7b17f10dd70279337278acc"}
Jul 28 01:16:51.716214 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:51.716193    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-x5k2b"
Jul 28 01:16:51.721646 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:51.721620    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-x5k2b"
Jul 28 01:16:51.728432 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:51.728379    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-x5k2b" podStartSLOduration=3.126210821 podStartE2EDuration="4.7283448s" totalImagesPullingTime="1.602133979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:16:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:16:51.727309038 +0000 UTC m=+62.761352432" watchObservedRunningTime="2026-07-28 01:16:51.7283448 +0000 UTC m=+62.762388194"
Jul 28 01:16:52.149321 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:52.149282    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:52.175237 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:52.175192    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-7f4dh"]
Jul 28 01:16:52.177235 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:52.177213    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-7f4dh"
Jul 28 01:16:52.179678 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:52.179647    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 28 01:16:52.179801 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:52.179685    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 28 01:16:52.179801 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:52.179658    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 28 01:16:52.179801 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:52.179709    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 28 01:16:52.179801 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:52.179651    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 28 01:16:52.179801 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:52.179658    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-chglz\""
Jul 28 01:16:52.188868 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:52.188842    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-7f4dh"]
Jul 28 01:16:52.210455 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:52.210393    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:52.222380 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:52.222334    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc1a76fa-db9a-4d4d-904c-e4b8bee35b5d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-7f4dh\" (UID: \"fc1a76fa-db9a-4d4d-904c-e4b8bee35b5d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7f4dh"
Jul 28 01:16:52.222527 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:52.222385    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqf99\" (UniqueName: \"kubernetes.io/projected/fc1a76fa-db9a-4d4d-904c-e4b8bee35b5d-kube-api-access-bqf99\") pod \"prometheus-operator-84d69f794d-7f4dh\" (UID: \"fc1a76fa-db9a-4d4d-904c-e4b8bee35b5d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7f4dh"
Jul 28 01:16:52.222527 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:52.222480    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc1a76fa-db9a-4d4d-904c-e4b8bee35b5d-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-7f4dh\" (UID: \"fc1a76fa-db9a-4d4d-904c-e4b8bee35b5d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7f4dh"
Jul 28 01:16:52.222634 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:52.222532    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc1a76fa-db9a-4d4d-904c-e4b8bee35b5d-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-7f4dh\" (UID: \"fc1a76fa-db9a-4d4d-904c-e4b8bee35b5d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7f4dh"
Jul 28 01:16:52.323215 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:52.323176    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc1a76fa-db9a-4d4d-904c-e4b8bee35b5d-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-7f4dh\" (UID: \"fc1a76fa-db9a-4d4d-904c-e4b8bee35b5d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7f4dh"
Jul 28 01:16:52.323421 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:52.323303    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc1a76fa-db9a-4d4d-904c-e4b8bee35b5d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-7f4dh\" (UID: \"fc1a76fa-db9a-4d4d-904c-e4b8bee35b5d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7f4dh"
Jul 28 01:16:52.323421 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:52.323335    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqf99\" (UniqueName: \"kubernetes.io/projected/fc1a76fa-db9a-4d4d-904c-e4b8bee35b5d-kube-api-access-bqf99\") pod \"prometheus-operator-84d69f794d-7f4dh\" (UID: \"fc1a76fa-db9a-4d4d-904c-e4b8bee35b5d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7f4dh"
Jul 28 01:16:52.323421 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:52.323369    2560 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 28 01:16:52.323562 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:52.323449    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc1a76fa-db9a-4d4d-904c-e4b8bee35b5d-prometheus-operator-tls podName:fc1a76fa-db9a-4d4d-904c-e4b8bee35b5d nodeName:}" failed. No retries permitted until 2026-07-28 01:16:52.823426634 +0000 UTC m=+63.857470009 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/fc1a76fa-db9a-4d4d-904c-e4b8bee35b5d-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-7f4dh" (UID: "fc1a76fa-db9a-4d4d-904c-e4b8bee35b5d") : secret "prometheus-operator-tls" not found
Jul 28 01:16:52.323562 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:52.323505    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc1a76fa-db9a-4d4d-904c-e4b8bee35b5d-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-7f4dh\" (UID: \"fc1a76fa-db9a-4d4d-904c-e4b8bee35b5d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7f4dh"
Jul 28 01:16:52.324200 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:52.324171    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc1a76fa-db9a-4d4d-904c-e4b8bee35b5d-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-7f4dh\" (UID: \"fc1a76fa-db9a-4d4d-904c-e4b8bee35b5d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7f4dh"
Jul 28 01:16:52.326176 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:52.326148    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc1a76fa-db9a-4d4d-904c-e4b8bee35b5d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-7f4dh\" (UID: \"fc1a76fa-db9a-4d4d-904c-e4b8bee35b5d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7f4dh"
Jul 28 01:16:52.333096 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:52.333070    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqf99\" (UniqueName: \"kubernetes.io/projected/fc1a76fa-db9a-4d4d-904c-e4b8bee35b5d-kube-api-access-bqf99\") pod \"prometheus-operator-84d69f794d-7f4dh\" (UID: \"fc1a76fa-db9a-4d4d-904c-e4b8bee35b5d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7f4dh"
Jul 28 01:16:52.565075 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:52.564988    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:52.665911 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:52.665858    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:52.827476 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:52.827388    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc1a76fa-db9a-4d4d-904c-e4b8bee35b5d-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-7f4dh\" (UID: \"fc1a76fa-db9a-4d4d-904c-e4b8bee35b5d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7f4dh"
Jul 28 01:16:52.827890 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:52.827554    2560 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 28 01:16:52.827890 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:16:52.827634    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc1a76fa-db9a-4d4d-904c-e4b8bee35b5d-prometheus-operator-tls podName:fc1a76fa-db9a-4d4d-904c-e4b8bee35b5d nodeName:}" failed. No retries permitted until 2026-07-28 01:16:53.827612965 +0000 UTC m=+64.861656339 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/fc1a76fa-db9a-4d4d-904c-e4b8bee35b5d-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-7f4dh" (UID: "fc1a76fa-db9a-4d4d-904c-e4b8bee35b5d") : secret "prometheus-operator-tls" not found
Jul 28 01:16:53.126727 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:53.126693    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:53.228768 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:53.228732    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:53.278984 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:53.278949    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:53.837446 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:53.837403    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc1a76fa-db9a-4d4d-904c-e4b8bee35b5d-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-7f4dh\" (UID: \"fc1a76fa-db9a-4d4d-904c-e4b8bee35b5d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7f4dh"
Jul 28 01:16:53.839972 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:53.839940    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc1a76fa-db9a-4d4d-904c-e4b8bee35b5d-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-7f4dh\" (UID: \"fc1a76fa-db9a-4d4d-904c-e4b8bee35b5d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-7f4dh"
Jul 28 01:16:53.988601 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:53.988564    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-7f4dh"
Jul 28 01:16:55.150279 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:55.150246    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd76bb39-bfb5-4511-a66d-fd55bda460f6-metrics-certs\") pod \"network-metrics-daemon-55qx2\" (UID: \"fd76bb39-bfb5-4511-a66d-fd55bda460f6\") " pod="openshift-multus/network-metrics-daemon-55qx2"
Jul 28 01:16:55.150724 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:55.150363    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jls5r\" (UniqueName: \"kubernetes.io/projected/7b958baa-25e6-45e5-82bd-a1d314a4bbad-kube-api-access-jls5r\") pod \"network-check-target-kc7hz\" (UID: \"7b958baa-25e6-45e5-82bd-a1d314a4bbad\") " pod="openshift-network-diagnostics/network-check-target-kc7hz"
Jul 28 01:16:55.152704 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:55.152679    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 01:16:55.153010 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:55.152990    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 01:16:55.163255 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:55.163237    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 01:16:55.163893 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:55.163871    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd76bb39-bfb5-4511-a66d-fd55bda460f6-metrics-certs\") pod \"network-metrics-daemon-55qx2\" (UID: \"fd76bb39-bfb5-4511-a66d-fd55bda460f6\") " pod="openshift-multus/network-metrics-daemon-55qx2"
Jul 28 01:16:55.174989 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:55.174963    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jls5r\" (UniqueName: \"kubernetes.io/projected/7b958baa-25e6-45e5-82bd-a1d314a4bbad-kube-api-access-jls5r\") pod \"network-check-target-kc7hz\" (UID: \"7b958baa-25e6-45e5-82bd-a1d314a4bbad\") " pod="openshift-network-diagnostics/network-check-target-kc7hz"
Jul 28 01:16:55.181023 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:55.181006    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j4n9n\""
Jul 28 01:16:55.189589 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:55.189571    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55qx2"
Jul 28 01:16:55.251497 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:55.251463    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ce4b7c0-28ad-45a2-9fac-0f0704533f48-original-pull-secret\") pod \"global-pull-secret-syncer-6zht5\" (UID: \"4ce4b7c0-28ad-45a2-9fac-0f0704533f48\") " pod="kube-system/global-pull-secret-syncer-6zht5"
Jul 28 01:16:55.253659 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:55.253641    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 01:16:55.264440 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:55.264420    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ce4b7c0-28ad-45a2-9fac-0f0704533f48-original-pull-secret\") pod \"global-pull-secret-syncer-6zht5\" (UID: \"4ce4b7c0-28ad-45a2-9fac-0f0704533f48\") " pod="kube-system/global-pull-secret-syncer-6zht5"
Jul 28 01:16:55.453120 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:55.453033    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/94293167-f740-4904-8546-ba172bfc26c9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qth82\" (UID: \"94293167-f740-4904-8546-ba172bfc26c9\") " pod="openshift-insights/insights-runtime-extractor-qth82"
Jul 28 01:16:55.453120 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:55.453087    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/94293167-f740-4904-8546-ba172bfc26c9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qth82\" (UID: \"94293167-f740-4904-8546-ba172bfc26c9\") " pod="openshift-insights/insights-runtime-extractor-qth82"
Jul 28 01:16:55.453701 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:55.453670    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/94293167-f740-4904-8546-ba172bfc26c9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qth82\" (UID: \"94293167-f740-4904-8546-ba172bfc26c9\") " pod="openshift-insights/insights-runtime-extractor-qth82"
Jul 28 01:16:55.455509 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:55.455489    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/94293167-f740-4904-8546-ba172bfc26c9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qth82\" (UID: \"94293167-f740-4904-8546-ba172bfc26c9\") " pod="openshift-insights/insights-runtime-extractor-qth82"
Jul 28 01:16:55.470901 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:55.470880    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4m9v4\""
Jul 28 01:16:55.474293 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:55.474275    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zht5"
Jul 28 01:16:55.480118 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:55.480100    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kc7hz"
Jul 28 01:16:55.526250 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:55.526222    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gz7nz\""
Jul 28 01:16:55.534723 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:55.534701    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qth82"
Jul 28 01:16:56.734172 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:56.734126    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:56.797338 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:56.797306    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:57.451538 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:57.451490    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:57.551995 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:57.551962    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:59.223529 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:59.223453    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-7f4dh"]
Jul 28 01:16:59.444832 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:59.444793    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6zht5"]
Jul 28 01:16:59.447630 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:59.447605    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qth82"]
Jul 28 01:16:59.450402 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:16:59.450370    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ce4b7c0_28ad_45a2_9fac_0f0704533f48.slice/crio-48cfe809886992fa9b85060b6f53e5bd3a3a237c20216ad62922efe1d31ec649 WatchSource:0}: Error finding container 48cfe809886992fa9b85060b6f53e5bd3a3a237c20216ad62922efe1d31ec649: Status 404 returned error can't find the container with id 48cfe809886992fa9b85060b6f53e5bd3a3a237c20216ad62922efe1d31ec649
Jul 28 01:16:59.451473 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:16:59.451247    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94293167_f740_4904_8546_ba172bfc26c9.slice/crio-2c4e7b5d44342be2c30f5e5466804c5323e89d22551517ba06deeb2cb028ed83 WatchSource:0}: Error finding container 2c4e7b5d44342be2c30f5e5466804c5323e89d22551517ba06deeb2cb028ed83: Status 404 returned error can't find the container with id 2c4e7b5d44342be2c30f5e5466804c5323e89d22551517ba06deeb2cb028ed83
Jul 28 01:16:59.488373 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:59.488333    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-55qx2"]
Jul 28 01:16:59.491939 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:16:59.491909    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd76bb39_bfb5_4511_a66d_fd55bda460f6.slice/crio-0243aa89d85f3bfee7273a253789b5677bc5de728c12a181e4227ddcb7cbca40 WatchSource:0}: Error finding container 0243aa89d85f3bfee7273a253789b5677bc5de728c12a181e4227ddcb7cbca40: Status 404 returned error can't find the container with id 0243aa89d85f3bfee7273a253789b5677bc5de728c12a181e4227ddcb7cbca40
Jul 28 01:16:59.496121 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:59.495725    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kc7hz"]
Jul 28 01:16:59.501890 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:16:59.501862    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b958baa_25e6_45e5_82bd_a1d314a4bbad.slice/crio-cb1c99311997c6cb10b2a1856e35b543ca407c05b0ec1f6524c47a9cd32c4e2b WatchSource:0}: Error finding container cb1c99311997c6cb10b2a1856e35b543ca407c05b0ec1f6524c47a9cd32c4e2b: Status 404 returned error can't find the container with id cb1c99311997c6cb10b2a1856e35b543ca407c05b0ec1f6524c47a9cd32c4e2b
Jul 28 01:16:59.744086 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:59.743997    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qth82" event={"ID":"94293167-f740-4904-8546-ba172bfc26c9","Type":"ContainerStarted","Data":"2c4e7b5d44342be2c30f5e5466804c5323e89d22551517ba06deeb2cb028ed83"}
Jul 28 01:16:59.745864 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:59.745830    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-9w2lz" event={"ID":"6c595db5-126c-4167-b469-79b610bf05d6","Type":"ContainerStarted","Data":"c0f56ee59695c0b0a9993e2a6b59f70945e3dc940caab7fd76a1658ef600ad83"}
Jul 28 01:16:59.746084 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:59.746063    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-9w2lz"
Jul 28 01:16:59.747983 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:59.747843    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5596876655-skb2w" event={"ID":"74ea767c-9b69-417f-aedd-f5dddad3c6ea","Type":"ContainerStarted","Data":"51ee3500f1bc6e87210b5c7404da8906742a1f94dc43d7574149bd87e5ee4966"}
Jul 28 01:16:59.749025 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:59.748994    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-7f4dh" event={"ID":"fc1a76fa-db9a-4d4d-904c-e4b8bee35b5d","Type":"ContainerStarted","Data":"bdb1334b1115a936b64a910f8a7d5b4a3dc924ff930245be47abe5fd04e96557"}
Jul 28 01:16:59.750405 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:59.750380    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-55qx2" event={"ID":"fd76bb39-bfb5-4511-a66d-fd55bda460f6","Type":"ContainerStarted","Data":"0243aa89d85f3bfee7273a253789b5677bc5de728c12a181e4227ddcb7cbca40"}
Jul 28 01:16:59.751721 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:59.751684    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kc7hz" event={"ID":"7b958baa-25e6-45e5-82bd-a1d314a4bbad","Type":"ContainerStarted","Data":"cb1c99311997c6cb10b2a1856e35b543ca407c05b0ec1f6524c47a9cd32c4e2b"}
Jul 28 01:16:59.752971 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:59.752951    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6zht5" event={"ID":"4ce4b7c0-28ad-45a2-9fac-0f0704533f48","Type":"ContainerStarted","Data":"48cfe809886992fa9b85060b6f53e5bd3a3a237c20216ad62922efe1d31ec649"}
Jul 28 01:16:59.754566 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:59.754545    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-9w2lz"
Jul 28 01:16:59.764289 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:59.764237    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-9w2lz" podStartSLOduration=1.20427289 podStartE2EDuration="19.764218243s" totalImagesPullingTime="18.559945353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:16:59.763247015 +0000 UTC m=+70.797290422" watchObservedRunningTime="2026-07-28 01:16:59.764218243 +0000 UTC m=+70.798261637"
Jul 28 01:16:59.805082 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:59.805049    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:59.860767 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:16:59.860724    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:03.802834 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:03.802796    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-7f4dh" event={"ID":"fc1a76fa-db9a-4d4d-904c-e4b8bee35b5d","Type":"ContainerStarted","Data":"f212e72ab6a3603846526be9d7633baba6de074eb8cb610c2f1ecdc243560001"}
Jul 28 01:17:03.803461 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:03.803432    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-7f4dh" event={"ID":"fc1a76fa-db9a-4d4d-904c-e4b8bee35b5d","Type":"ContainerStarted","Data":"623aa7151ad58ecc3728e5a72478778b6caec7b8a02edcf3d93424d526a96c36"}
Jul 28 01:17:03.807696 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:03.807633    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-55qx2" event={"ID":"fd76bb39-bfb5-4511-a66d-fd55bda460f6","Type":"ContainerStarted","Data":"126e6f5b9d7eda0a9cc85f7abdda9c4e8fca8c1a0bcd594e8870e7c951e86ad8"}
Jul 28 01:17:03.824907 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:03.823675    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5596876655-skb2w" podStartSLOduration=5.767488483 podStartE2EDuration="15.82365497s" totalImagesPullingTime="10.056166487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:16:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:16:59.798346147 +0000 UTC m=+70.832389540" watchObservedRunningTime="2026-07-28 01:17:03.82365497 +0000 UTC m=+74.857698365"
Jul 28 01:17:03.852410 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:03.852228    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:04.676365 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:04.676238    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:04.728469 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:04.728437    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:04.814738 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:04.814697    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-55qx2" event={"ID":"fd76bb39-bfb5-4511-a66d-fd55bda460f6","Type":"ContainerStarted","Data":"32f01f9b481b62eb7da7b1942b93b053acde262fbd977a3d4072e9d6c7fbea71"}
Jul 28 01:17:04.830600 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:04.830546    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-7f4dh" podStartSLOduration=8.697434421 podStartE2EDuration="12.830528944s" totalImagesPullingTime="4.133094523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:16:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:17:03.824006267 +0000 UTC m=+74.858049661" watchObservedRunningTime="2026-07-28 01:17:04.830528944 +0000 UTC m=+75.864572336"
Jul 28 01:17:04.831093 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:04.831053    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-55qx2" podStartSLOduration=71.963083356 podStartE2EDuration="1m15.831044404s" totalImagesPullingTime="3.867961048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:17:04.829291988 +0000 UTC m=+75.863335400" watchObservedRunningTime="2026-07-28 01:17:04.831044404 +0000 UTC m=+75.865087797"
Jul 28 01:17:04.932315 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:04.932115    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:04.993898 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:04.993858    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:05.289735 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.289644    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:05.518233 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.518194    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:05.536481 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.536372    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2ftgf"]
Jul 28 01:17:05.552540 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.552457    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjcxs"]
Jul 28 01:17:05.552825 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.552768    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2ftgf"
Jul 28 01:17:05.555990 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.555219    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7fx46\""
Jul 28 01:17:05.555990 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.555546    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 28 01:17:05.555990 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.555763    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 28 01:17:05.556548 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.556377    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 28 01:17:05.568699 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.568677    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjcxs"]
Jul 28 01:17:05.568810 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.568726    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-b6plq"]
Jul 28 01:17:05.568940 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.568920    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjcxs"
Jul 28 01:17:05.571273 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.570851    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 28 01:17:05.571273 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.571113    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 28 01:17:05.571464 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.571435    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-blxzs\""
Jul 28 01:17:05.586372 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.584976    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-b6plq"]
Jul 28 01:17:05.586372 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.585117    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b6plq"
Jul 28 01:17:05.589676 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.589275    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 28 01:17:05.589676 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.589298    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 28 01:17:05.589676 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.589501    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-cvb62\""
Jul 28 01:17:05.589676 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.589607    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 28 01:17:05.609152 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.609126    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:05.647790 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.647569    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/abc77241-2511-4272-9761-d7e5bd2e6280-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-b6plq\" (UID: \"abc77241-2511-4272-9761-d7e5bd2e6280\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b6plq"
Jul 28 01:17:05.647790 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.647626    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/75e27e38-737c-43d8-a1dc-2aec23e71b72-sys\") pod \"node-exporter-2ftgf\" (UID: \"75e27e38-737c-43d8-a1dc-2aec23e71b72\") " pod="openshift-monitoring/node-exporter-2ftgf"
Jul 28 01:17:05.647790 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.647657    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/abc77241-2511-4272-9761-d7e5bd2e6280-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-b6plq\" (UID: \"abc77241-2511-4272-9761-d7e5bd2e6280\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b6plq"
Jul 28 01:17:05.647790 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.647686    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75e27e38-737c-43d8-a1dc-2aec23e71b72-metrics-client-ca\") pod \"node-exporter-2ftgf\" (UID: \"75e27e38-737c-43d8-a1dc-2aec23e71b72\") " pod="openshift-monitoring/node-exporter-2ftgf"
Jul 28 01:17:05.647790 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.647714    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/abc77241-2511-4272-9761-d7e5bd2e6280-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-b6plq\" (UID: \"abc77241-2511-4272-9761-d7e5bd2e6280\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b6plq"
Jul 28 01:17:05.647790 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.647743    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/75e27e38-737c-43d8-a1dc-2aec23e71b72-node-exporter-tls\") pod \"node-exporter-2ftgf\" (UID: \"75e27e38-737c-43d8-a1dc-2aec23e71b72\") " pod="openshift-monitoring/node-exporter-2ftgf"
Jul 28 01:17:05.648227 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.647872    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqsmb\" (UniqueName: \"kubernetes.io/projected/75e27e38-737c-43d8-a1dc-2aec23e71b72-kube-api-access-cqsmb\") pod \"node-exporter-2ftgf\" (UID: \"75e27e38-737c-43d8-a1dc-2aec23e71b72\") " pod="openshift-monitoring/node-exporter-2ftgf"
Jul 28 01:17:05.648227 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.647925    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/abc77241-2511-4272-9761-d7e5bd2e6280-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-b6plq\" (UID: \"abc77241-2511-4272-9761-d7e5bd2e6280\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b6plq"
Jul 28 01:17:05.648227 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.647965    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b1f5138-d6e1-4185-8f07-4e9617e71e7c-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-kjcxs\" (UID: \"8b1f5138-d6e1-4185-8f07-4e9617e71e7c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjcxs"
Jul 28 01:17:05.648227 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.648003    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/75e27e38-737c-43d8-a1dc-2aec23e71b72-root\") pod \"node-exporter-2ftgf\" (UID: \"75e27e38-737c-43d8-a1dc-2aec23e71b72\") " pod="openshift-monitoring/node-exporter-2ftgf"
Jul 28 01:17:05.648227 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.648114    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b1f5138-d6e1-4185-8f07-4e9617e71e7c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-kjcxs\" (UID: \"8b1f5138-d6e1-4185-8f07-4e9617e71e7c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjcxs"
Jul 28 01:17:05.648227 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.648140    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/75e27e38-737c-43d8-a1dc-2aec23e71b72-node-exporter-textfile\") pod \"node-exporter-2ftgf\" (UID: \"75e27e38-737c-43d8-a1dc-2aec23e71b72\") " pod="openshift-monitoring/node-exporter-2ftgf"
Jul 28 01:17:05.648227 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.648173    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b1f5138-d6e1-4185-8f07-4e9617e71e7c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-kjcxs\" (UID: \"8b1f5138-d6e1-4185-8f07-4e9617e71e7c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjcxs"
Jul 28 01:17:05.648227 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.648209    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwqjc\" (UniqueName: \"kubernetes.io/projected/8b1f5138-d6e1-4185-8f07-4e9617e71e7c-kube-api-access-dwqjc\") pod \"openshift-state-metrics-b8f49f5c6-kjcxs\" (UID: \"8b1f5138-d6e1-4185-8f07-4e9617e71e7c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjcxs"
Jul 28 01:17:05.648596 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.648232    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s879s\" (UniqueName: \"kubernetes.io/projected/abc77241-2511-4272-9761-d7e5bd2e6280-kube-api-access-s879s\") pod \"kube-state-metrics-56d9f944b4-b6plq\" (UID: \"abc77241-2511-4272-9761-d7e5bd2e6280\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b6plq"
Jul 28 01:17:05.648596 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.648281    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/75e27e38-737c-43d8-a1dc-2aec23e71b72-node-exporter-wtmp\") pod \"node-exporter-2ftgf\" (UID: \"75e27e38-737c-43d8-a1dc-2aec23e71b72\") " pod="openshift-monitoring/node-exporter-2ftgf"
Jul 28 01:17:05.648596 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.648312    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/75e27e38-737c-43d8-a1dc-2aec23e71b72-node-exporter-accelerators-collector-config\") pod \"node-exporter-2ftgf\" (UID: \"75e27e38-737c-43d8-a1dc-2aec23e71b72\") " pod="openshift-monitoring/node-exporter-2ftgf"
Jul 28 01:17:05.648596 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.648341    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/abc77241-2511-4272-9761-d7e5bd2e6280-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-b6plq\" (UID: \"abc77241-2511-4272-9761-d7e5bd2e6280\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b6plq"
Jul 28 01:17:05.648596 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.648404    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/75e27e38-737c-43d8-a1dc-2aec23e71b72-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2ftgf\" (UID: \"75e27e38-737c-43d8-a1dc-2aec23e71b72\") " pod="openshift-monitoring/node-exporter-2ftgf"
Jul 28 01:17:05.670913 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.670821    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:05.751913 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.751801    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwqjc\" (UniqueName: \"kubernetes.io/projected/8b1f5138-d6e1-4185-8f07-4e9617e71e7c-kube-api-access-dwqjc\") pod \"openshift-state-metrics-b8f49f5c6-kjcxs\" (UID: \"8b1f5138-d6e1-4185-8f07-4e9617e71e7c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjcxs"
Jul 28 01:17:05.751913 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.751847    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s879s\" (UniqueName: \"kubernetes.io/projected/abc77241-2511-4272-9761-d7e5bd2e6280-kube-api-access-s879s\") pod \"kube-state-metrics-56d9f944b4-b6plq\" (UID: \"abc77241-2511-4272-9761-d7e5bd2e6280\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b6plq"
Jul 28 01:17:05.751913 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.751881    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/75e27e38-737c-43d8-a1dc-2aec23e71b72-node-exporter-wtmp\") pod \"node-exporter-2ftgf\" (UID: \"75e27e38-737c-43d8-a1dc-2aec23e71b72\") " pod="openshift-monitoring/node-exporter-2ftgf"
Jul 28 01:17:05.751913 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.751911    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/75e27e38-737c-43d8-a1dc-2aec23e71b72-node-exporter-accelerators-collector-config\") pod \"node-exporter-2ftgf\" (UID: \"75e27e38-737c-43d8-a1dc-2aec23e71b72\") " pod="openshift-monitoring/node-exporter-2ftgf"
Jul 28 01:17:05.752231 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.751942    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/abc77241-2511-4272-9761-d7e5bd2e6280-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-b6plq\" (UID: \"abc77241-2511-4272-9761-d7e5bd2e6280\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b6plq"
Jul 28 01:17:05.752231 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.751971    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/75e27e38-737c-43d8-a1dc-2aec23e71b72-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2ftgf\" (UID: \"75e27e38-737c-43d8-a1dc-2aec23e71b72\") " pod="openshift-monitoring/node-exporter-2ftgf"
Jul 28 01:17:05.752231 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.752002    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/abc77241-2511-4272-9761-d7e5bd2e6280-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-b6plq\" (UID: \"abc77241-2511-4272-9761-d7e5bd2e6280\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b6plq"
Jul 28 01:17:05.752231 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.752048    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/75e27e38-737c-43d8-a1dc-2aec23e71b72-sys\") pod \"node-exporter-2ftgf\" (UID: \"75e27e38-737c-43d8-a1dc-2aec23e71b72\") " pod="openshift-monitoring/node-exporter-2ftgf"
Jul 28 01:17:05.752231 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.752072    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/abc77241-2511-4272-9761-d7e5bd2e6280-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-b6plq\" (UID: \"abc77241-2511-4272-9761-d7e5bd2e6280\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b6plq"
Jul 28 01:17:05.752231 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.752098    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75e27e38-737c-43d8-a1dc-2aec23e71b72-metrics-client-ca\") pod \"node-exporter-2ftgf\" (UID: \"75e27e38-737c-43d8-a1dc-2aec23e71b72\") " pod="openshift-monitoring/node-exporter-2ftgf"
Jul 28 01:17:05.752231 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.752126    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/abc77241-2511-4272-9761-d7e5bd2e6280-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-b6plq\" (UID: \"abc77241-2511-4272-9761-d7e5bd2e6280\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b6plq"
Jul 28 01:17:05.752231 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.752153    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/75e27e38-737c-43d8-a1dc-2aec23e71b72-node-exporter-tls\") pod \"node-exporter-2ftgf\" (UID: \"75e27e38-737c-43d8-a1dc-2aec23e71b72\") " pod="openshift-monitoring/node-exporter-2ftgf"
Jul 28 01:17:05.752231 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.752176    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqsmb\" (UniqueName: \"kubernetes.io/projected/75e27e38-737c-43d8-a1dc-2aec23e71b72-kube-api-access-cqsmb\") pod \"node-exporter-2ftgf\" (UID: \"75e27e38-737c-43d8-a1dc-2aec23e71b72\") " pod="openshift-monitoring/node-exporter-2ftgf"
Jul 28 01:17:05.752231 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.752201    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/abc77241-2511-4272-9761-d7e5bd2e6280-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-b6plq\" (UID: \"abc77241-2511-4272-9761-d7e5bd2e6280\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b6plq"
Jul 28 01:17:05.752231 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.752231    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b1f5138-d6e1-4185-8f07-4e9617e71e7c-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-kjcxs\" (UID: \"8b1f5138-d6e1-4185-8f07-4e9617e71e7c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjcxs"
Jul 28 01:17:05.752812 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.752257    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/75e27e38-737c-43d8-a1dc-2aec23e71b72-root\") pod \"node-exporter-2ftgf\" (UID: \"75e27e38-737c-43d8-a1dc-2aec23e71b72\") " pod="openshift-monitoring/node-exporter-2ftgf"
Jul 28 01:17:05.752812 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.752294    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b1f5138-d6e1-4185-8f07-4e9617e71e7c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-kjcxs\" (UID: \"8b1f5138-d6e1-4185-8f07-4e9617e71e7c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjcxs"
Jul 28 01:17:05.752812 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.752314    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/75e27e38-737c-43d8-a1dc-2aec23e71b72-node-exporter-textfile\") pod \"node-exporter-2ftgf\" (UID: \"75e27e38-737c-43d8-a1dc-2aec23e71b72\") " pod="openshift-monitoring/node-exporter-2ftgf"
Jul 28 01:17:05.752812 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.752345    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b1f5138-d6e1-4185-8f07-4e9617e71e7c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-kjcxs\" (UID: \"8b1f5138-d6e1-4185-8f07-4e9617e71e7c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjcxs"
Jul 28 01:17:05.756488 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:17:05.753034    2560 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 28 01:17:05.756488 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:17:05.753106    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abc77241-2511-4272-9761-d7e5bd2e6280-kube-state-metrics-tls podName:abc77241-2511-4272-9761-d7e5bd2e6280 nodeName:}" failed. No retries permitted until 2026-07-28 01:17:06.253083874 +0000 UTC m=+77.287127248 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/abc77241-2511-4272-9761-d7e5bd2e6280-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-b6plq" (UID: "abc77241-2511-4272-9761-d7e5bd2e6280") : secret "kube-state-metrics-tls" not found
Jul 28 01:17:05.756488 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.753536    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/abc77241-2511-4272-9761-d7e5bd2e6280-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-b6plq\" (UID: \"abc77241-2511-4272-9761-d7e5bd2e6280\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b6plq"
Jul 28 01:17:05.756488 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.753863    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75e27e38-737c-43d8-a1dc-2aec23e71b72-metrics-client-ca\") pod \"node-exporter-2ftgf\" (UID: \"75e27e38-737c-43d8-a1dc-2aec23e71b72\") " pod="openshift-monitoring/node-exporter-2ftgf"
Jul 28 01:17:05.756488 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.754126    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/75e27e38-737c-43d8-a1dc-2aec23e71b72-node-exporter-wtmp\") pod \"node-exporter-2ftgf\" (UID: \"75e27e38-737c-43d8-a1dc-2aec23e71b72\") " pod="openshift-monitoring/node-exporter-2ftgf"
Jul 28 01:17:05.756488 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:17:05.754336    2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 28 01:17:05.756488 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.754690    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/75e27e38-737c-43d8-a1dc-2aec23e71b72-node-exporter-accelerators-collector-config\") pod \"node-exporter-2ftgf\" (UID: \"75e27e38-737c-43d8-a1dc-2aec23e71b72\") " pod="openshift-monitoring/node-exporter-2ftgf"
Jul 28 01:17:05.756488 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.754760    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/75e27e38-737c-43d8-a1dc-2aec23e71b72-sys\") pod \"node-exporter-2ftgf\" (UID: \"75e27e38-737c-43d8-a1dc-2aec23e71b72\") " pod="openshift-monitoring/node-exporter-2ftgf"
Jul 28 01:17:05.756488 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.754975    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/abc77241-2511-4272-9761-d7e5bd2e6280-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-b6plq\" (UID: \"abc77241-2511-4272-9761-d7e5bd2e6280\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b6plq"
Jul 28 01:17:05.756488 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.755041    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/75e27e38-737c-43d8-a1dc-2aec23e71b72-root\") pod \"node-exporter-2ftgf\" (UID: \"75e27e38-737c-43d8-a1dc-2aec23e71b72\") " pod="openshift-monitoring/node-exporter-2ftgf"
Jul 28 01:17:05.756488 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.755705    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b1f5138-d6e1-4185-8f07-4e9617e71e7c-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-kjcxs\" (UID: \"8b1f5138-d6e1-4185-8f07-4e9617e71e7c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjcxs"
Jul 28 01:17:05.756488 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:17:05.755797    2560 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 28 01:17:05.756488 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:17:05.755884    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b1f5138-d6e1-4185-8f07-4e9617e71e7c-openshift-state-metrics-tls podName:8b1f5138-d6e1-4185-8f07-4e9617e71e7c nodeName:}" failed. No retries permitted until 2026-07-28 01:17:06.255866785 +0000 UTC m=+77.289910163 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/8b1f5138-d6e1-4185-8f07-4e9617e71e7c-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-kjcxs" (UID: "8b1f5138-d6e1-4185-8f07-4e9617e71e7c") : secret "openshift-state-metrics-tls" not found
Jul 28 01:17:05.756488 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.756103    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/75e27e38-737c-43d8-a1dc-2aec23e71b72-node-exporter-textfile\") pod \"node-exporter-2ftgf\" (UID: \"75e27e38-737c-43d8-a1dc-2aec23e71b72\") " pod="openshift-monitoring/node-exporter-2ftgf"
Jul 28 01:17:05.756488 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:17:05.756181    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75e27e38-737c-43d8-a1dc-2aec23e71b72-node-exporter-tls podName:75e27e38-737c-43d8-a1dc-2aec23e71b72 nodeName:}" failed. No retries permitted until 2026-07-28 01:17:06.25616761 +0000 UTC m=+77.290210982 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/75e27e38-737c-43d8-a1dc-2aec23e71b72-node-exporter-tls") pod "node-exporter-2ftgf" (UID: "75e27e38-737c-43d8-a1dc-2aec23e71b72") : secret "node-exporter-tls" not found
Jul 28 01:17:05.757840 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.757815    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/abc77241-2511-4272-9761-d7e5bd2e6280-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-b6plq\" (UID: \"abc77241-2511-4272-9761-d7e5bd2e6280\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b6plq"
Jul 28 01:17:05.762334 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.762294    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/abc77241-2511-4272-9761-d7e5bd2e6280-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-b6plq\" (UID: \"abc77241-2511-4272-9761-d7e5bd2e6280\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b6plq"
Jul 28 01:17:05.765711 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.765517    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/75e27e38-737c-43d8-a1dc-2aec23e71b72-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2ftgf\" (UID: \"75e27e38-737c-43d8-a1dc-2aec23e71b72\") " pod="openshift-monitoring/node-exporter-2ftgf"
Jul 28 01:17:05.766085 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.766040    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwqjc\" (UniqueName: \"kubernetes.io/projected/8b1f5138-d6e1-4185-8f07-4e9617e71e7c-kube-api-access-dwqjc\") pod \"openshift-state-metrics-b8f49f5c6-kjcxs\" (UID: \"8b1f5138-d6e1-4185-8f07-4e9617e71e7c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjcxs"
Jul 28 01:17:05.766889 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.766826    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqsmb\" (UniqueName: \"kubernetes.io/projected/75e27e38-737c-43d8-a1dc-2aec23e71b72-kube-api-access-cqsmb\") pod \"node-exporter-2ftgf\" (UID: \"75e27e38-737c-43d8-a1dc-2aec23e71b72\") " pod="openshift-monitoring/node-exporter-2ftgf"
Jul 28 01:17:05.767489 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.767419    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b1f5138-d6e1-4185-8f07-4e9617e71e7c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-kjcxs\" (UID: \"8b1f5138-d6e1-4185-8f07-4e9617e71e7c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjcxs"
Jul 28 01:17:05.767489 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.767468    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s879s\" (UniqueName: \"kubernetes.io/projected/abc77241-2511-4272-9761-d7e5bd2e6280-kube-api-access-s879s\") pod \"kube-state-metrics-56d9f944b4-b6plq\" (UID: \"abc77241-2511-4272-9761-d7e5bd2e6280\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b6plq"
Jul 28 01:17:05.784514 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.784477    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:05.916212 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:05.916131    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:06.111056 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:06.110982    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:06.211700 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:06.211624    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:06.256977 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:06.256941    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/75e27e38-737c-43d8-a1dc-2aec23e71b72-node-exporter-tls\") pod \"node-exporter-2ftgf\" (UID: \"75e27e38-737c-43d8-a1dc-2aec23e71b72\") " pod="openshift-monitoring/node-exporter-2ftgf"
Jul 28 01:17:06.257210 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:06.257040    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/abc77241-2511-4272-9761-d7e5bd2e6280-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-b6plq\" (UID: \"abc77241-2511-4272-9761-d7e5bd2e6280\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b6plq"
Jul 28 01:17:06.257210 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:17:06.257106    2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 28 01:17:06.257210 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:17:06.257187    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75e27e38-737c-43d8-a1dc-2aec23e71b72-node-exporter-tls podName:75e27e38-737c-43d8-a1dc-2aec23e71b72 nodeName:}" failed. No retries permitted until 2026-07-28 01:17:07.257165508 +0000 UTC m=+78.291208883 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/75e27e38-737c-43d8-a1dc-2aec23e71b72-node-exporter-tls") pod "node-exporter-2ftgf" (UID: "75e27e38-737c-43d8-a1dc-2aec23e71b72") : secret "node-exporter-tls" not found
Jul 28 01:17:06.257210 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:06.257210    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b1f5138-d6e1-4185-8f07-4e9617e71e7c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-kjcxs\" (UID: \"8b1f5138-d6e1-4185-8f07-4e9617e71e7c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjcxs"
Jul 28 01:17:06.257690 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:17:06.257316    2560 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 28 01:17:06.257690 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:17:06.257380    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b1f5138-d6e1-4185-8f07-4e9617e71e7c-openshift-state-metrics-tls podName:8b1f5138-d6e1-4185-8f07-4e9617e71e7c nodeName:}" failed. No retries permitted until 2026-07-28 01:17:07.257346712 +0000 UTC m=+78.291390096 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/8b1f5138-d6e1-4185-8f07-4e9617e71e7c-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-kjcxs" (UID: "8b1f5138-d6e1-4185-8f07-4e9617e71e7c") : secret "openshift-state-metrics-tls" not found
Jul 28 01:17:06.260694 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:06.260668    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/abc77241-2511-4272-9761-d7e5bd2e6280-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-b6plq\" (UID: \"abc77241-2511-4272-9761-d7e5bd2e6280\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b6plq"
Jul 28 01:17:06.318371 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:06.318286    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:06.414513 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:06.414477    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:06.500489 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:06.500409    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b6plq"
Jul 28 01:17:06.513866 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:06.513771    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:06.590098 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:06.590048    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:06.919533 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:06.919381    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:07.124388 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:07.124329    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:07.180108 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:07.179991    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:07.267111 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:07.266933    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/75e27e38-737c-43d8-a1dc-2aec23e71b72-node-exporter-tls\") pod \"node-exporter-2ftgf\" (UID: \"75e27e38-737c-43d8-a1dc-2aec23e71b72\") " pod="openshift-monitoring/node-exporter-2ftgf"
Jul 28 01:17:07.267111 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:07.267013    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b1f5138-d6e1-4185-8f07-4e9617e71e7c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-kjcxs\" (UID: \"8b1f5138-d6e1-4185-8f07-4e9617e71e7c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjcxs"
Jul 28 01:17:07.269902 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:07.269828    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/75e27e38-737c-43d8-a1dc-2aec23e71b72-node-exporter-tls\") pod \"node-exporter-2ftgf\" (UID: \"75e27e38-737c-43d8-a1dc-2aec23e71b72\") " pod="openshift-monitoring/node-exporter-2ftgf"
Jul 28 01:17:07.270107 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:07.270082    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b1f5138-d6e1-4185-8f07-4e9617e71e7c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-kjcxs\" (UID: \"8b1f5138-d6e1-4185-8f07-4e9617e71e7c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjcxs"
Jul 28 01:17:07.368570 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:07.368506    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2ftgf"
Jul 28 01:17:07.383776 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:07.383714    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjcxs"
Jul 28 01:17:07.514926 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:07.514897    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5596876655-skb2w"]
Jul 28 01:17:07.639185 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:07.639140    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:07.814578 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:07.814499    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:07.915823 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:07.915789    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:08.450974 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:08.450618    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:08.503260 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:08.503227    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5d8499cbb6-njhz5"]
Jul 28 01:17:08.518144 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:08.518118    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5d8499cbb6-njhz5"]
Jul 28 01:17:08.518310 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:08.518217    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5d8499cbb6-njhz5"
Jul 28 01:17:08.520381 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:08.520246    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 28 01:17:08.520381 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:08.520330    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:08.520566 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:08.520483    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 28 01:17:08.520736 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:08.520619    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-d7nfeap4f8n4p\""
Jul 28 01:17:08.521228 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:08.521004    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-wrshn\""
Jul 28 01:17:08.521228 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:08.521113    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 28 01:17:08.521228 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:08.521004    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 28 01:17:08.521571 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:08.521551    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 28 01:17:08.678788 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:08.678746    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpwqz\" (UniqueName: \"kubernetes.io/projected/772b4205-7a9a-4667-b44a-52e86906e46b-kube-api-access-vpwqz\") pod \"thanos-querier-5d8499cbb6-njhz5\" (UID: \"772b4205-7a9a-4667-b44a-52e86906e46b\") " pod="openshift-monitoring/thanos-querier-5d8499cbb6-njhz5"
Jul 28 01:17:08.678968 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:08.678802    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/772b4205-7a9a-4667-b44a-52e86906e46b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5d8499cbb6-njhz5\" (UID: \"772b4205-7a9a-4667-b44a-52e86906e46b\") " pod="openshift-monitoring/thanos-querier-5d8499cbb6-njhz5"
Jul 28 01:17:08.678968 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:08.678830    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/772b4205-7a9a-4667-b44a-52e86906e46b-metrics-client-ca\") pod \"thanos-querier-5d8499cbb6-njhz5\" (UID: \"772b4205-7a9a-4667-b44a-52e86906e46b\") " pod="openshift-monitoring/thanos-querier-5d8499cbb6-njhz5"
Jul 28 01:17:08.678968 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:08.678873    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/772b4205-7a9a-4667-b44a-52e86906e46b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5d8499cbb6-njhz5\" (UID: \"772b4205-7a9a-4667-b44a-52e86906e46b\") " pod="openshift-monitoring/thanos-querier-5d8499cbb6-njhz5"
Jul 28 01:17:08.678968 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:08.678926    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/772b4205-7a9a-4667-b44a-52e86906e46b-secret-grpc-tls\") pod \"thanos-querier-5d8499cbb6-njhz5\" (UID: \"772b4205-7a9a-4667-b44a-52e86906e46b\") " pod="openshift-monitoring/thanos-querier-5d8499cbb6-njhz5"
Jul 28 01:17:08.679155 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:08.678986    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/772b4205-7a9a-4667-b44a-52e86906e46b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5d8499cbb6-njhz5\" (UID: \"772b4205-7a9a-4667-b44a-52e86906e46b\") " pod="openshift-monitoring/thanos-querier-5d8499cbb6-njhz5"
Jul 28 01:17:08.679155 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:08.679017    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/772b4205-7a9a-4667-b44a-52e86906e46b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5d8499cbb6-njhz5\" (UID: \"772b4205-7a9a-4667-b44a-52e86906e46b\") " pod="openshift-monitoring/thanos-querier-5d8499cbb6-njhz5"
Jul 28 01:17:08.679155 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:08.679042    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/772b4205-7a9a-4667-b44a-52e86906e46b-secret-thanos-querier-tls\") pod \"thanos-querier-5d8499cbb6-njhz5\" (UID: \"772b4205-7a9a-4667-b44a-52e86906e46b\") " pod="openshift-monitoring/thanos-querier-5d8499cbb6-njhz5"
Jul 28 01:17:08.765831 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:08.765749    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:08.779782 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:08.779753    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/772b4205-7a9a-4667-b44a-52e86906e46b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5d8499cbb6-njhz5\" (UID: \"772b4205-7a9a-4667-b44a-52e86906e46b\") " pod="openshift-monitoring/thanos-querier-5d8499cbb6-njhz5"
Jul 28 01:17:08.779945 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:08.779788    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/772b4205-7a9a-4667-b44a-52e86906e46b-secret-grpc-tls\") pod \"thanos-querier-5d8499cbb6-njhz5\" (UID: \"772b4205-7a9a-4667-b44a-52e86906e46b\") " pod="openshift-monitoring/thanos-querier-5d8499cbb6-njhz5"
Jul 28 01:17:08.779945 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:08.779844    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/772b4205-7a9a-4667-b44a-52e86906e46b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5d8499cbb6-njhz5\" (UID: \"772b4205-7a9a-4667-b44a-52e86906e46b\") " pod="openshift-monitoring/thanos-querier-5d8499cbb6-njhz5"
Jul 28 01:17:08.779945 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:08.779874    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/772b4205-7a9a-4667-b44a-52e86906e46b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5d8499cbb6-njhz5\" (UID: \"772b4205-7a9a-4667-b44a-52e86906e46b\") " pod="openshift-monitoring/thanos-querier-5d8499cbb6-njhz5"
Jul 28 01:17:08.779945 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:08.779906    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/772b4205-7a9a-4667-b44a-52e86906e46b-secret-thanos-querier-tls\") pod \"thanos-querier-5d8499cbb6-njhz5\" (UID: \"772b4205-7a9a-4667-b44a-52e86906e46b\") " pod="openshift-monitoring/thanos-querier-5d8499cbb6-njhz5"
Jul 28 01:17:08.780148 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:08.779957    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpwqz\" (UniqueName: \"kubernetes.io/projected/772b4205-7a9a-4667-b44a-52e86906e46b-kube-api-access-vpwqz\") pod \"thanos-querier-5d8499cbb6-njhz5\" (UID: \"772b4205-7a9a-4667-b44a-52e86906e46b\") " pod="openshift-monitoring/thanos-querier-5d8499cbb6-njhz5"
Jul 28 01:17:08.780148 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:08.779983    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/772b4205-7a9a-4667-b44a-52e86906e46b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5d8499cbb6-njhz5\" (UID: \"772b4205-7a9a-4667-b44a-52e86906e46b\") " pod="openshift-monitoring/thanos-querier-5d8499cbb6-njhz5"
Jul 28 01:17:08.780148 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:08.780008    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/772b4205-7a9a-4667-b44a-52e86906e46b-metrics-client-ca\") pod \"thanos-querier-5d8499cbb6-njhz5\" (UID: \"772b4205-7a9a-4667-b44a-52e86906e46b\") " pod="openshift-monitoring/thanos-querier-5d8499cbb6-njhz5"
Jul 28 01:17:08.780808 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:08.780753    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/772b4205-7a9a-4667-b44a-52e86906e46b-metrics-client-ca\") pod \"thanos-querier-5d8499cbb6-njhz5\" (UID: \"772b4205-7a9a-4667-b44a-52e86906e46b\") " pod="openshift-monitoring/thanos-querier-5d8499cbb6-njhz5"
Jul 28 01:17:08.782665 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:08.782637    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/772b4205-7a9a-4667-b44a-52e86906e46b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5d8499cbb6-njhz5\" (UID: \"772b4205-7a9a-4667-b44a-52e86906e46b\") " pod="openshift-monitoring/thanos-querier-5d8499cbb6-njhz5"
Jul 28 01:17:08.782781 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:08.782697    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/772b4205-7a9a-4667-b44a-52e86906e46b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5d8499cbb6-njhz5\" (UID: \"772b4205-7a9a-4667-b44a-52e86906e46b\") " pod="openshift-monitoring/thanos-querier-5d8499cbb6-njhz5"
Jul 28 01:17:08.783505 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:08.783480    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/772b4205-7a9a-4667-b44a-52e86906e46b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5d8499cbb6-njhz5\" (UID: \"772b4205-7a9a-4667-b44a-52e86906e46b\") " pod="openshift-monitoring/thanos-querier-5d8499cbb6-njhz5"
Jul 28 01:17:08.783678 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:08.783658    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/772b4205-7a9a-4667-b44a-52e86906e46b-secret-thanos-querier-tls\") pod \"thanos-querier-5d8499cbb6-njhz5\" (UID: \"772b4205-7a9a-4667-b44a-52e86906e46b\") " pod="openshift-monitoring/thanos-querier-5d8499cbb6-njhz5"
Jul 28 01:17:08.783763 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:08.783667    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/772b4205-7a9a-4667-b44a-52e86906e46b-secret-grpc-tls\") pod \"thanos-querier-5d8499cbb6-njhz5\" (UID: \"772b4205-7a9a-4667-b44a-52e86906e46b\") " pod="openshift-monitoring/thanos-querier-5d8499cbb6-njhz5"
Jul 28 01:17:08.783763 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:08.783720    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/772b4205-7a9a-4667-b44a-52e86906e46b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5d8499cbb6-njhz5\" (UID: \"772b4205-7a9a-4667-b44a-52e86906e46b\") " pod="openshift-monitoring/thanos-querier-5d8499cbb6-njhz5"
Jul 28 01:17:08.786920 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:08.786897    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpwqz\" (UniqueName: \"kubernetes.io/projected/772b4205-7a9a-4667-b44a-52e86906e46b-kube-api-access-vpwqz\") pod \"thanos-querier-5d8499cbb6-njhz5\" (UID: \"772b4205-7a9a-4667-b44a-52e86906e46b\") " pod="openshift-monitoring/thanos-querier-5d8499cbb6-njhz5"
Jul 28 01:17:08.830674 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:08.830645    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5d8499cbb6-njhz5"
Jul 28 01:17:08.838249 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:08.838217    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:08.849762 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:08.849737    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5596876655-skb2w"
Jul 28 01:17:08.957718 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:08.957669    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:09.950621 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:09.950541    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:10.051726 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.051695    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:10.311900 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.311819    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:10.317056 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.317025    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-vdkbt"]
Jul 28 01:17:10.344481 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.344443    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-vdkbt"]
Jul 28 01:17:10.344633 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.344558    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-vdkbt"
Jul 28 01:17:10.346540 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.346517    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 28 01:17:10.346662 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.346552    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-66pnn\""
Jul 28 01:17:10.368496 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.368464    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:10.497093 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.497060    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl7tr\" (UniqueName: \"kubernetes.io/projected/de8abb0f-f052-4e21-9063-c9028515ad06-kube-api-access-nl7tr\") pod \"monitoring-plugin-68b7fc9574-vdkbt\" (UID: \"de8abb0f-f052-4e21-9063-c9028515ad06\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-vdkbt"
Jul 28 01:17:10.497257 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.497105    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/de8abb0f-f052-4e21-9063-c9028515ad06-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-vdkbt\" (UID: \"de8abb0f-f052-4e21-9063-c9028515ad06\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-vdkbt"
Jul 28 01:17:10.561044 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:17:10.561001    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75e27e38_737c_43d8_a1dc_2aec23e71b72.slice/crio-c0f64b13f20314cfd18f667ad2ada86ee881f55af0d494edbf34ea786f604687 WatchSource:0}: Error finding container c0f64b13f20314cfd18f667ad2ada86ee881f55af0d494edbf34ea786f604687: Status 404 returned error can't find the container with id c0f64b13f20314cfd18f667ad2ada86ee881f55af0d494edbf34ea786f604687
Jul 28 01:17:10.575505 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.573624    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:10.598113 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.598024    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl7tr\" (UniqueName: \"kubernetes.io/projected/de8abb0f-f052-4e21-9063-c9028515ad06-kube-api-access-nl7tr\") pod \"monitoring-plugin-68b7fc9574-vdkbt\" (UID: \"de8abb0f-f052-4e21-9063-c9028515ad06\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-vdkbt"
Jul 28 01:17:10.598113 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.598087    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/de8abb0f-f052-4e21-9063-c9028515ad06-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-vdkbt\" (UID: \"de8abb0f-f052-4e21-9063-c9028515ad06\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-vdkbt"
Jul 28 01:17:10.600894 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.600847    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/de8abb0f-f052-4e21-9063-c9028515ad06-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-vdkbt\" (UID: \"de8abb0f-f052-4e21-9063-c9028515ad06\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-vdkbt"
Jul 28 01:17:10.608084 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.608032    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl7tr\" (UniqueName: \"kubernetes.io/projected/de8abb0f-f052-4e21-9063-c9028515ad06-kube-api-access-nl7tr\") pod \"monitoring-plugin-68b7fc9574-vdkbt\" (UID: \"de8abb0f-f052-4e21-9063-c9028515ad06\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-vdkbt"
Jul 28 01:17:10.670789 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.666583    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-vdkbt"
Jul 28 01:17:10.680803 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.680746    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:10.745253 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.745222    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-b6plq"]
Jul 28 01:17:10.750549 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:17:10.750410    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabc77241_2511_4272_9761_d7e5bd2e6280.slice/crio-2e6af3e5efe9e1e6d86b803d45c5e7fa9a757656a4ce2e6b582549ac4ed7ae1c WatchSource:0}: Error finding container 2e6af3e5efe9e1e6d86b803d45c5e7fa9a757656a4ce2e6b582549ac4ed7ae1c: Status 404 returned error can't find the container with id 2e6af3e5efe9e1e6d86b803d45c5e7fa9a757656a4ce2e6b582549ac4ed7ae1c
Jul 28 01:17:10.767336 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.767114    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6b9546bd79-psxfj"]
Jul 28 01:17:10.787097 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.787072    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjcxs"]
Jul 28 01:17:10.787276 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.787137    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6b9546bd79-psxfj"]
Jul 28 01:17:10.787276 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.787254    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6b9546bd79-psxfj"
Jul 28 01:17:10.789618 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.789595    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 28 01:17:10.790422 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.790404    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 28 01:17:10.790529 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.790510    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 28 01:17:10.791287 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.790624    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 28 01:17:10.791287 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.790733    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 28 01:17:10.791287 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.791024    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-hmfnq\""
Jul 28 01:17:10.796577 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.796558    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 28 01:17:10.797906 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.797866    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5d8499cbb6-njhz5"]
Jul 28 01:17:10.845525 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.845451    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-vdkbt"]
Jul 28 01:17:10.847852 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.847828    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kc7hz" event={"ID":"7b958baa-25e6-45e5-82bd-a1d314a4bbad","Type":"ContainerStarted","Data":"08c17aa74b6ab8d89918d4248209448dfa0ec8b8f17097147962d6d3741cc857"}
Jul 28 01:17:10.847990 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.847923    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kc7hz"
Jul 28 01:17:10.849522 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.849487    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6zht5" event={"ID":"4ce4b7c0-28ad-45a2-9fac-0f0704533f48","Type":"ContainerStarted","Data":"4caabb95449ba4b8e31e012972c11412abdd3c0146d8de48f7809fa009e37b3c"}
Jul 28 01:17:10.850704 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.850670    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2ftgf" event={"ID":"75e27e38-737c-43d8-a1dc-2aec23e71b72","Type":"ContainerStarted","Data":"c0f64b13f20314cfd18f667ad2ada86ee881f55af0d494edbf34ea786f604687"}
Jul 28 01:17:10.851780 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.851762    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b6plq" event={"ID":"abc77241-2511-4272-9761-d7e5bd2e6280","Type":"ContainerStarted","Data":"2e6af3e5efe9e1e6d86b803d45c5e7fa9a757656a4ce2e6b582549ac4ed7ae1c"}
Jul 28 01:17:10.860532 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.860485    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kc7hz" podStartSLOduration=70.835893178 podStartE2EDuration="1m21.860469845s" totalImagesPullingTime="11.024576667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:17:10.860378916 +0000 UTC m=+81.894422312" watchObservedRunningTime="2026-07-28 01:17:10.860469845 +0000 UTC m=+81.894513239"
Jul 28 01:17:10.873737 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.873687    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6zht5" podStartSLOduration=70.758329612 podStartE2EDuration="1m21.87366866s" totalImagesPullingTime="11.115339048s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:17:10.872163335 +0000 UTC m=+81.906206730" watchObservedRunningTime="2026-07-28 01:17:10.87366866 +0000 UTC m=+81.907712054"
Jul 28 01:17:10.900377 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.900175    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c-telemeter-client-tls\") pod \"telemeter-client-6b9546bd79-psxfj\" (UID: \"c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c\") " pod="openshift-monitoring/telemeter-client-6b9546bd79-psxfj"
Jul 28 01:17:10.900377 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.900215    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c-metrics-client-ca\") pod \"telemeter-client-6b9546bd79-psxfj\" (UID: \"c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c\") " pod="openshift-monitoring/telemeter-client-6b9546bd79-psxfj"
Jul 28 01:17:10.900377 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.900247    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c-serving-certs-ca-bundle\") pod \"telemeter-client-6b9546bd79-psxfj\" (UID: \"c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c\") " pod="openshift-monitoring/telemeter-client-6b9546bd79-psxfj"
Jul 28 01:17:10.900377 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.900307    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6b9546bd79-psxfj\" (UID: \"c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c\") " pod="openshift-monitoring/telemeter-client-6b9546bd79-psxfj"
Jul 28 01:17:10.900749 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.900422    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c-federate-client-tls\") pod \"telemeter-client-6b9546bd79-psxfj\" (UID: \"c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c\") " pod="openshift-monitoring/telemeter-client-6b9546bd79-psxfj"
Jul 28 01:17:10.900749 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.900466    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c-secret-telemeter-client\") pod \"telemeter-client-6b9546bd79-psxfj\" (UID: \"c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c\") " pod="openshift-monitoring/telemeter-client-6b9546bd79-psxfj"
Jul 28 01:17:10.900749 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.900532    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jndph\" (UniqueName: \"kubernetes.io/projected/c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c-kube-api-access-jndph\") pod \"telemeter-client-6b9546bd79-psxfj\" (UID: \"c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c\") " pod="openshift-monitoring/telemeter-client-6b9546bd79-psxfj"
Jul 28 01:17:10.900749 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:10.900577    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6b9546bd79-psxfj\" (UID: \"c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c\") " pod="openshift-monitoring/telemeter-client-6b9546bd79-psxfj"
Jul 28 01:17:11.001046 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.001019    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6b9546bd79-psxfj\" (UID: \"c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c\") " pod="openshift-monitoring/telemeter-client-6b9546bd79-psxfj"
Jul 28 01:17:11.001408 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.001082    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c-telemeter-client-tls\") pod \"telemeter-client-6b9546bd79-psxfj\" (UID: \"c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c\") " pod="openshift-monitoring/telemeter-client-6b9546bd79-psxfj"
Jul 28 01:17:11.001408 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.001105    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c-metrics-client-ca\") pod \"telemeter-client-6b9546bd79-psxfj\" (UID: \"c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c\") " pod="openshift-monitoring/telemeter-client-6b9546bd79-psxfj"
Jul 28 01:17:11.001408 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.001132    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c-serving-certs-ca-bundle\") pod \"telemeter-client-6b9546bd79-psxfj\" (UID: \"c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c\") " pod="openshift-monitoring/telemeter-client-6b9546bd79-psxfj"
Jul 28 01:17:11.001408 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.001157    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6b9546bd79-psxfj\" (UID: \"c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c\") " pod="openshift-monitoring/telemeter-client-6b9546bd79-psxfj"
Jul 28 01:17:11.001408 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.001218    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c-federate-client-tls\") pod \"telemeter-client-6b9546bd79-psxfj\" (UID: \"c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c\") " pod="openshift-monitoring/telemeter-client-6b9546bd79-psxfj"
Jul 28 01:17:11.001408 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.001273    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c-secret-telemeter-client\") pod \"telemeter-client-6b9546bd79-psxfj\" (UID: \"c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c\") " pod="openshift-monitoring/telemeter-client-6b9546bd79-psxfj"
Jul 28 01:17:11.001408 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.001298    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jndph\" (UniqueName: \"kubernetes.io/projected/c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c-kube-api-access-jndph\") pod \"telemeter-client-6b9546bd79-psxfj\" (UID: \"c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c\") " pod="openshift-monitoring/telemeter-client-6b9546bd79-psxfj"
Jul 28 01:17:11.001980 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.001904    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c-metrics-client-ca\") pod \"telemeter-client-6b9546bd79-psxfj\" (UID: \"c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c\") " pod="openshift-monitoring/telemeter-client-6b9546bd79-psxfj"
Jul 28 01:17:11.001980 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.001906    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c-serving-certs-ca-bundle\") pod \"telemeter-client-6b9546bd79-psxfj\" (UID: \"c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c\") " pod="openshift-monitoring/telemeter-client-6b9546bd79-psxfj"
Jul 28 01:17:11.002674 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.002636    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6b9546bd79-psxfj\" (UID: \"c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c\") " pod="openshift-monitoring/telemeter-client-6b9546bd79-psxfj"
Jul 28 01:17:11.003891 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.003867    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c-telemeter-client-tls\") pod \"telemeter-client-6b9546bd79-psxfj\" (UID: \"c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c\") " pod="openshift-monitoring/telemeter-client-6b9546bd79-psxfj"
Jul 28 01:17:11.004311 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.004275    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6b9546bd79-psxfj\" (UID: \"c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c\") " pod="openshift-monitoring/telemeter-client-6b9546bd79-psxfj"
Jul 28 01:17:11.004398 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.004378    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c-secret-telemeter-client\") pod \"telemeter-client-6b9546bd79-psxfj\" (UID: \"c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c\") " pod="openshift-monitoring/telemeter-client-6b9546bd79-psxfj"
Jul 28 01:17:11.005666 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.005642    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c-federate-client-tls\") pod \"telemeter-client-6b9546bd79-psxfj\" (UID: \"c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c\") " pod="openshift-monitoring/telemeter-client-6b9546bd79-psxfj"
Jul 28 01:17:11.011952 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.011898    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jndph\" (UniqueName: \"kubernetes.io/projected/c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c-kube-api-access-jndph\") pod \"telemeter-client-6b9546bd79-psxfj\" (UID: \"c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c\") " pod="openshift-monitoring/telemeter-client-6b9546bd79-psxfj"
Jul 28 01:17:11.090370 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.090246    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:11.101662 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.101601    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6b9546bd79-psxfj"
Jul 28 01:17:11.190683 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.190610    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:11.265698 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.265673    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6b9546bd79-psxfj"]
Jul 28 01:17:11.267949 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:17:11.267918    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2d9500d_0a43_4b3b_a9a6_3bbfc132c73c.slice/crio-d69d37e56b02eee9719582c5cf02ce06446abf92ddffeb07a81aa84c47f58825 WatchSource:0}: Error finding container d69d37e56b02eee9719582c5cf02ce06446abf92ddffeb07a81aa84c47f58825: Status 404 returned error can't find the container with id d69d37e56b02eee9719582c5cf02ce06446abf92ddffeb07a81aa84c47f58825
Jul 28 01:17:11.709795 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.709760    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 01:17:11.714267 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.714231    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:11.728617 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.727656    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.730916 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.730313    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 28 01:17:11.730916 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.730380    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 28 01:17:11.730916 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.730633    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 28 01:17:11.730916 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.730693    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 28 01:17:11.730916 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.730635    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 28 01:17:11.730916 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.730868    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 28 01:17:11.731326 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.730935    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 01:17:11.732595 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.731580    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 28 01:17:11.732595 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.731756    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 28 01:17:11.732595 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.731951    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-70se9f9uvaoo8\""
Jul 28 01:17:11.732595 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.732126    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 28 01:17:11.732595 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.732294    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-csn27\""
Jul 28 01:17:11.732595 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.732483    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 28 01:17:11.732956 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.732747    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 28 01:17:11.732956 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.732923    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 28 01:17:11.734002 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.733457    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 28 01:17:11.735532 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.735515    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 28 01:17:11.737088 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.737067    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 28 01:17:11.796418 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.796380    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:11.808485 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.808449    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.808670 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.808511    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.808670 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.808603    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.808670 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.808645    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.808859 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.808732    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-config\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.808859 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.808795    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.808859 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.808832    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.809016 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.808862    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.809016 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.808898    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-config-out\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.809016 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.808930    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.809016 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.808958    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.809016 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.808977    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.809016 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.808994    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.809016 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.809013    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.809325 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.809033    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.809325 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.809047    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr7fk\" (UniqueName: \"kubernetes.io/projected/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-kube-api-access-tr7fk\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.809325 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.809084    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-web-config\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.809325 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.809116    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.809325 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.809131    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.809325 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.809151    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.861977 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.861943    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjcxs" event={"ID":"8b1f5138-d6e1-4185-8f07-4e9617e71e7c","Type":"ContainerStarted","Data":"77131b381c97ae75d55689401289b628696e5fa6906c2620ccf71ccfb3ffa2bd"}
Jul 28 01:17:11.862165 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.862011    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjcxs" event={"ID":"8b1f5138-d6e1-4185-8f07-4e9617e71e7c","Type":"ContainerStarted","Data":"a463a16be943fdaca52fe095207be3a9fd251ccb6c71017fa3af0ff99d2ee9ce"}
Jul 28 01:17:11.862165 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.862040    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjcxs" event={"ID":"8b1f5138-d6e1-4185-8f07-4e9617e71e7c","Type":"ContainerStarted","Data":"25ceec8712517a20525e462f255c3003ff778f28b044dc48cdeb2efd715f453a"}
Jul 28 01:17:11.866506 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.866471    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-vdkbt" event={"ID":"de8abb0f-f052-4e21-9063-c9028515ad06","Type":"ContainerStarted","Data":"751b4e0d4cb55f8da1df3794519af1fa19d4b3ddfa5dad45d1f71ebc41dc5a81"}
Jul 28 01:17:11.867904 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.867876    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b9546bd79-psxfj" event={"ID":"c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c","Type":"ContainerStarted","Data":"d69d37e56b02eee9719582c5cf02ce06446abf92ddffeb07a81aa84c47f58825"}
Jul 28 01:17:11.869740 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.869711    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d8499cbb6-njhz5" event={"ID":"772b4205-7a9a-4667-b44a-52e86906e46b","Type":"ContainerStarted","Data":"17c17abddd2495a473c23f2bcd171f0bdea7b03a8ae05dfe87f7edf28a75b144"}
Jul 28 01:17:11.873576 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.873546    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qth82" event={"ID":"94293167-f740-4904-8546-ba172bfc26c9","Type":"ContainerStarted","Data":"aa387012470fd2666103fe689fe7abdb5545fa99462ce255fb315cc77aadc80c"}
Jul 28 01:17:11.909893 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.909860    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.909893 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.909894    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.910139 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.909911    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.910225 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.910197    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.910306 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.910257    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.910306 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.910289    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.910601 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.910313    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr7fk\" (UniqueName: \"kubernetes.io/projected/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-kube-api-access-tr7fk\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.910601 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.910368    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-web-config\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.910601 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.910440    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.910601 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.910466    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.910601 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.910488    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.910601 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.910535    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.910601 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.910573    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.910891 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.910613    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.910891 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.910846    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.911636 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.911309    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.911636 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.911383    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-config\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.911636 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.911411    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.911636 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.911445    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.911636 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.911475    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.911636 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.911509    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-config-out\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.912255 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.912199    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.915376 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.912509    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.915376 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.912513    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.915376 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.913251    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.915376 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.913684    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.915376 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.914516    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.915376 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.914838    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.915731 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.915643    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.916491 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.916165    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.919531 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.917385    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.919531 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.919328    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-config-out\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.920297 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.919933    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-config\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.920431 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.920342    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-web-config\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.920720 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.920697    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.920887 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.920763    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.921292 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.921270    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.921392 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.921335    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.922797 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.922725    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr7fk\" (UniqueName: \"kubernetes.io/projected/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-kube-api-access-tr7fk\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:11.923044 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:11.923028    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:12.042720 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:12.042690    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:12.253338 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:12.253159    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 01:17:12.272615 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:17:12.272580    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8b36cfe_13b5_4a1b_8160_aa2b08e1844b.slice/crio-4511e53d642524d82b142e31aa288fac1d085300f426218c7f9ce8ad0a14a0ea WatchSource:0}: Error finding container 4511e53d642524d82b142e31aa288fac1d085300f426218c7f9ce8ad0a14a0ea: Status 404 returned error can't find the container with id 4511e53d642524d82b142e31aa288fac1d085300f426218c7f9ce8ad0a14a0ea
Jul 28 01:17:12.884402 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:12.884067    2560 generic.go:356] "Generic (PLEG): container finished" podID="75e27e38-737c-43d8-a1dc-2aec23e71b72" containerID="c25e273a8ae4cb2d9258643b2635bf15e99a9d69a681dcca51614d30e3481987" exitCode=0
Jul 28 01:17:12.884402 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:12.884168    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2ftgf" event={"ID":"75e27e38-737c-43d8-a1dc-2aec23e71b72","Type":"ContainerDied","Data":"c25e273a8ae4cb2d9258643b2635bf15e99a9d69a681dcca51614d30e3481987"}
Jul 28 01:17:12.887851 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:12.887710    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b","Type":"ContainerStarted","Data":"4511e53d642524d82b142e31aa288fac1d085300f426218c7f9ce8ad0a14a0ea"}
Jul 28 01:17:19.023327 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:19.023288    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:19.124861 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:19.124820    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:19.688031 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:19.687952    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:19.787138 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:19.787098    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:19.926167 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:19.926047    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjcxs" event={"ID":"8b1f5138-d6e1-4185-8f07-4e9617e71e7c","Type":"ContainerStarted","Data":"15396e1a3f6c5add9e837d41545cb45ce93915b28c2d1ca9ee95630ba1ffda1d"}
Jul 28 01:17:19.927855 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:19.927829    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-vdkbt" event={"ID":"de8abb0f-f052-4e21-9063-c9028515ad06","Type":"ContainerStarted","Data":"c1996e75fcbb1190ed167e8d846b3cb0de9f7fc70e6932000f39204b6f2ca284"}
Jul 28 01:17:19.933013 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:19.931453    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2ftgf" event={"ID":"75e27e38-737c-43d8-a1dc-2aec23e71b72","Type":"ContainerStarted","Data":"26e80281ae5819335c0a06e1c6b705e393e54bdfa758f414504ca0f67fada9ff"}
Jul 28 01:17:19.933013 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:19.931510    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2ftgf" event={"ID":"75e27e38-737c-43d8-a1dc-2aec23e71b72","Type":"ContainerStarted","Data":"39152a92d6825f3e3270b927f731a4262dd659699e1dd2e57cae75af8e67f073"}
Jul 28 01:17:19.935460 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:19.935435    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b9546bd79-psxfj" event={"ID":"c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c","Type":"ContainerStarted","Data":"712287b0b3084f312faf80e66d0891977a3af5f3c885ec7529edaa64bd1a626e"}
Jul 28 01:17:19.935669 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:19.935633    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b9546bd79-psxfj" event={"ID":"c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c","Type":"ContainerStarted","Data":"47369278ebe6ca4e1f45ee79f9fcbf71707e9d6c90ec6f6f2a372532945ab8db"}
Jul 28 01:17:19.938590 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:19.938492    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d8499cbb6-njhz5" event={"ID":"772b4205-7a9a-4667-b44a-52e86906e46b","Type":"ContainerStarted","Data":"08dc2c9deabd15c863c853c5c1ce77865ff35623e0f0b2714505e70cac3a50d0"}
Jul 28 01:17:19.941425 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:19.941309    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b6plq" event={"ID":"abc77241-2511-4272-9761-d7e5bd2e6280","Type":"ContainerStarted","Data":"8514982533ea14859052662be60ad93c40c377e7df9f3908d2b0485a77b3c640"}
Jul 28 01:17:19.941425 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:19.941386    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b6plq" event={"ID":"abc77241-2511-4272-9761-d7e5bd2e6280","Type":"ContainerStarted","Data":"b82da9e4d969c1ca1ec391d2578bf42c3708b177d170a16f5ad6cca2a3c90e0a"}
Jul 28 01:17:19.943325 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:19.943207    2560 generic.go:356] "Generic (PLEG): container finished" podID="a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" containerID="ed17a001904438080c3c8ddc8175f8af1a0a5a23ecdfd5b6ba9ab021218f9d54" exitCode=0
Jul 28 01:17:19.943325 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:19.943261    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b","Type":"ContainerDied","Data":"ed17a001904438080c3c8ddc8175f8af1a0a5a23ecdfd5b6ba9ab021218f9d54"}
Jul 28 01:17:19.985733 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:19.985686    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-kjcxs" podStartSLOduration=7.847973837 podStartE2EDuration="14.985666388s" totalImagesPullingTime="7.137692551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:17:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:17:19.985290322 +0000 UTC m=+91.019333719" watchObservedRunningTime="2026-07-28 01:17:19.985666388 +0000 UTC m=+91.019709774"
Jul 28 01:17:19.997473 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:19.997452    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-vdkbt"
Jul 28 01:17:20.004565 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:20.004545    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-vdkbt"
Jul 28 01:17:20.007569 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:20.007490    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2ftgf" podStartSLOduration=13.500445769 podStartE2EDuration="15.007478196s" totalImagesPullingTime="1.373818416s" totalInitContainerRuntime="133.214011ms" isStatefulPod=true podCreationTimestamp="2026-07-28 01:17:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:17:20.005833826 +0000 UTC m=+91.039877219" watchObservedRunningTime="2026-07-28 01:17:20.007478196 +0000 UTC m=+91.041521592"
Jul 28 01:17:20.952972 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:20.952871    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b9546bd79-psxfj" event={"ID":"c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c","Type":"ContainerStarted","Data":"e3ffa5fe64790d50aa6a06c75c49e7154d573cc013151c909fc1f1859a215825"}
Jul 28 01:17:20.956411 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:20.956383    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d8499cbb6-njhz5" event={"ID":"772b4205-7a9a-4667-b44a-52e86906e46b","Type":"ContainerStarted","Data":"d6d8a0e3a163298cee0938c34c8792554c315e21b7c74d4af78da0a6ee2a249b"}
Jul 28 01:17:20.956560 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:20.956460    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d8499cbb6-njhz5" event={"ID":"772b4205-7a9a-4667-b44a-52e86906e46b","Type":"ContainerStarted","Data":"203e6ef5bcf8754d634a86efc968ea49cf121a1675bd5f4add9ccdcb3501a886"}
Jul 28 01:17:20.958522 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:20.958498    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qth82" event={"ID":"94293167-f740-4904-8546-ba172bfc26c9","Type":"ContainerStarted","Data":"0bd7c6f4d9f5826e7f05a99092de89a2fb3369fe463f3182b9cf3bd2a804529e"}
Jul 28 01:17:20.961756 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:20.961431    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b6plq" event={"ID":"abc77241-2511-4272-9761-d7e5bd2e6280","Type":"ContainerStarted","Data":"c55ca15baf40306ba41d4fd427d5d6683165e7e3729484b1f6bd1ab4e1031da4"}
Jul 28 01:17:20.978296 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:20.977620    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-vdkbt" podStartSLOduration=2.454196629 podStartE2EDuration="10.977601393s" totalImagesPullingTime="8.523404764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:17:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:17:20.025013666 +0000 UTC m=+91.059057063" watchObservedRunningTime="2026-07-28 01:17:20.977601393 +0000 UTC m=+92.011644787"
Jul 28 01:17:20.979539 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:20.979265    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6b9546bd79-psxfj" podStartSLOduration=2.847503096 podStartE2EDuration="10.979246967s" totalImagesPullingTime="8.131743871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:17:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:17:20.976911396 +0000 UTC m=+92.010954790" watchObservedRunningTime="2026-07-28 01:17:20.979246967 +0000 UTC m=+92.013290361"
Jul 28 01:17:20.993794 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:20.992923    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b6plq" podStartSLOduration=7.487409848 podStartE2EDuration="15.992910233s" totalImagesPullingTime="8.505500385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:17:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:17:20.991665343 +0000 UTC m=+92.025708745" watchObservedRunningTime="2026-07-28 01:17:20.992910233 +0000 UTC m=+92.026953626"
Jul 28 01:17:21.975697 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:21.975160    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d8499cbb6-njhz5" event={"ID":"772b4205-7a9a-4667-b44a-52e86906e46b","Type":"ContainerStarted","Data":"4c03c7965aea191c99f6cafa6bb79733baf20edca606b9d54c266319d40a05f3"}
Jul 28 01:17:21.975697 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:21.975252    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d8499cbb6-njhz5" event={"ID":"772b4205-7a9a-4667-b44a-52e86906e46b","Type":"ContainerStarted","Data":"7634967e0d3c1d2779de3fb699d639d57267c9c448d0ecbde3297b462543ae9c"}
Jul 28 01:17:22.460886 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:22.460852    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:22.520477 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:22.520439    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:22.888457 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:22.888418    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:22.983409 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:22.983367    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5d8499cbb6-njhz5" event={"ID":"772b4205-7a9a-4667-b44a-52e86906e46b","Type":"ContainerStarted","Data":"2154f1c90cb1f15fde3343fe564ebfa715492ff327d890da246889fcccd99af3"}
Jul 28 01:17:22.983819 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:22.983497    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5d8499cbb6-njhz5"
Jul 28 01:17:22.988929 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:22.988898    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:23.005477 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:23.005423    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5d8499cbb6-njhz5" podStartSLOduration=5.343348538 podStartE2EDuration="15.005382112s" totalImagesPullingTime="9.662033574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:17:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:17:23.003422278 +0000 UTC m=+94.037465671" watchObservedRunningTime="2026-07-28 01:17:23.005382112 +0000 UTC m=+94.039425508"
Jul 28 01:17:27.003933 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:27.003880    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qth82" event={"ID":"94293167-f740-4904-8546-ba172bfc26c9","Type":"ContainerStarted","Data":"49f5e79f5b6efa3d49fb594eed7ab11171929b755c08addc7788742b2b1e883a"}
Jul 28 01:17:27.007272 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:27.007247    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b","Type":"ContainerStarted","Data":"0567aaae15c529d546773f80b2b1bb6a4a10f812a2d2ba2c098fc2bdfb4b292c"}
Jul 28 01:17:27.007397 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:27.007305    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b","Type":"ContainerStarted","Data":"3cd54267fb25dd5063e8288c965b70d6a3e515d2fe6dea419059e7e16027898e"}
Jul 28 01:17:27.007397 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:27.007330    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b","Type":"ContainerStarted","Data":"2b9ad8548a72d847e50dd87813f2e7832f76b1b03347c5a8fc781220ed9577ef"}
Jul 28 01:17:27.007397 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:27.007376    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b","Type":"ContainerStarted","Data":"653fcecd1be3580e875169e4801bbb626034a6ca666fe783810ef63e667c3f13"}
Jul 28 01:17:27.007501 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:27.007409    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b","Type":"ContainerStarted","Data":"33a63faf0f7f11592355b304f00c6bbaee4343ceed0bddc6cecd43a3f6c3b25d"}
Jul 28 01:17:27.007501 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:27.007433    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b","Type":"ContainerStarted","Data":"aff9d106267c4f00dddb23456bbd2f571871cebe8d9e3ba73f108d5556a531be"}
Jul 28 01:17:27.025151 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:27.025106    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qth82" podStartSLOduration=13.656186739 podStartE2EDuration="40.025092762s" totalImagesPullingTime="26.368906023s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:16:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:17:27.022927082 +0000 UTC m=+98.056970487" watchObservedRunningTime="2026-07-28 01:17:27.025092762 +0000 UTC m=+98.059136193"
Jul 28 01:17:27.044020 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:27.043996    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:17:27.053675 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:27.053620    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.7107356 podStartE2EDuration="16.053598324s" totalImagesPullingTime="13.312327459s" totalInitContainerRuntime="30.535265ms" isStatefulPod=false podCreationTimestamp="2026-07-28 01:17:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:17:27.050909877 +0000 UTC m=+98.084953269" watchObservedRunningTime="2026-07-28 01:17:27.053598324 +0000 UTC m=+98.087641719"
Jul 28 01:17:28.993444 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:28.993415    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5d8499cbb6-njhz5"
Jul 28 01:17:32.536459 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:32.536393    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5596876655-skb2w" podUID="74ea767c-9b69-417f-aedd-f5dddad3c6ea" containerName="console" containerID="cri-o://51ee3500f1bc6e87210b5c7404da8906742a1f94dc43d7574149bd87e5ee4966" gracePeriod=15
Jul 28 01:17:32.813643 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:32.813613    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5596876655-skb2w"
Jul 28 01:17:32.923753 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:32.923716    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c45w9\" (UniqueName: \"kubernetes.io/projected/74ea767c-9b69-417f-aedd-f5dddad3c6ea-kube-api-access-c45w9\") pod \"74ea767c-9b69-417f-aedd-f5dddad3c6ea\" (UID: \"74ea767c-9b69-417f-aedd-f5dddad3c6ea\") "
Jul 28 01:17:32.923753 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:32.923755    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74ea767c-9b69-417f-aedd-f5dddad3c6ea-console-config\") pod \"74ea767c-9b69-417f-aedd-f5dddad3c6ea\" (UID: \"74ea767c-9b69-417f-aedd-f5dddad3c6ea\") "
Jul 28 01:17:32.924004 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:32.923792    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74ea767c-9b69-417f-aedd-f5dddad3c6ea-console-serving-cert\") pod \"74ea767c-9b69-417f-aedd-f5dddad3c6ea\" (UID: \"74ea767c-9b69-417f-aedd-f5dddad3c6ea\") "
Jul 28 01:17:32.924004 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:32.923910    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74ea767c-9b69-417f-aedd-f5dddad3c6ea-service-ca\") pod \"74ea767c-9b69-417f-aedd-f5dddad3c6ea\" (UID: \"74ea767c-9b69-417f-aedd-f5dddad3c6ea\") "
Jul 28 01:17:32.924004 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:32.923958    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74ea767c-9b69-417f-aedd-f5dddad3c6ea-console-oauth-config\") pod \"74ea767c-9b69-417f-aedd-f5dddad3c6ea\" (UID: \"74ea767c-9b69-417f-aedd-f5dddad3c6ea\") "
Jul 28 01:17:32.924004 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:32.924006    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74ea767c-9b69-417f-aedd-f5dddad3c6ea-oauth-serving-cert\") pod \"74ea767c-9b69-417f-aedd-f5dddad3c6ea\" (UID: \"74ea767c-9b69-417f-aedd-f5dddad3c6ea\") "
Jul 28 01:17:32.924245 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:32.924221    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74ea767c-9b69-417f-aedd-f5dddad3c6ea-console-config" (OuterVolumeSpecName: "console-config") pod "74ea767c-9b69-417f-aedd-f5dddad3c6ea" (UID: "74ea767c-9b69-417f-aedd-f5dddad3c6ea"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:17:32.924306 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:32.924265    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74ea767c-9b69-417f-aedd-f5dddad3c6ea-service-ca" (OuterVolumeSpecName: "service-ca") pod "74ea767c-9b69-417f-aedd-f5dddad3c6ea" (UID: "74ea767c-9b69-417f-aedd-f5dddad3c6ea"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:17:32.924576 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:32.924538    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74ea767c-9b69-417f-aedd-f5dddad3c6ea-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "74ea767c-9b69-417f-aedd-f5dddad3c6ea" (UID: "74ea767c-9b69-417f-aedd-f5dddad3c6ea"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:17:32.926179 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:32.926152    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74ea767c-9b69-417f-aedd-f5dddad3c6ea-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "74ea767c-9b69-417f-aedd-f5dddad3c6ea" (UID: "74ea767c-9b69-417f-aedd-f5dddad3c6ea"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:17:32.926274 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:32.926207    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74ea767c-9b69-417f-aedd-f5dddad3c6ea-kube-api-access-c45w9" (OuterVolumeSpecName: "kube-api-access-c45w9") pod "74ea767c-9b69-417f-aedd-f5dddad3c6ea" (UID: "74ea767c-9b69-417f-aedd-f5dddad3c6ea"). InnerVolumeSpecName "kube-api-access-c45w9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:17:32.926274 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:32.926237    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74ea767c-9b69-417f-aedd-f5dddad3c6ea-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "74ea767c-9b69-417f-aedd-f5dddad3c6ea" (UID: "74ea767c-9b69-417f-aedd-f5dddad3c6ea"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:17:33.025252 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:33.025215    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74ea767c-9b69-417f-aedd-f5dddad3c6ea-service-ca\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:17:33.025252 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:33.025244    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74ea767c-9b69-417f-aedd-f5dddad3c6ea-console-oauth-config\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:17:33.025252 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:33.025254    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74ea767c-9b69-417f-aedd-f5dddad3c6ea-oauth-serving-cert\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:17:33.025252 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:33.025263    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c45w9\" (UniqueName: \"kubernetes.io/projected/74ea767c-9b69-417f-aedd-f5dddad3c6ea-kube-api-access-c45w9\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:17:33.025537 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:33.025271    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74ea767c-9b69-417f-aedd-f5dddad3c6ea-console-config\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:17:33.025537 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:33.025280    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74ea767c-9b69-417f-aedd-f5dddad3c6ea-console-serving-cert\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:17:33.031641 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:33.031613    2560 generic.go:356] "Generic (PLEG): container finished" podID="74ea767c-9b69-417f-aedd-f5dddad3c6ea" containerID="51ee3500f1bc6e87210b5c7404da8906742a1f94dc43d7574149bd87e5ee4966" exitCode=0
Jul 28 01:17:33.031775 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:33.031663    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5596876655-skb2w"
Jul 28 01:17:33.031775 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:33.031704    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5596876655-skb2w" event={"ID":"74ea767c-9b69-417f-aedd-f5dddad3c6ea","Type":"ContainerDied","Data":"51ee3500f1bc6e87210b5c7404da8906742a1f94dc43d7574149bd87e5ee4966"}
Jul 28 01:17:33.031775 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:33.031754    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5596876655-skb2w" event={"ID":"74ea767c-9b69-417f-aedd-f5dddad3c6ea","Type":"ContainerDied","Data":"f24a68292bd7c8187e4db51dc601dffcf28b76112a062ecc4d7a7888e77b48d2"}
Jul 28 01:17:33.031775 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:33.031774    2560 scope.go:117] "RemoveContainer" containerID="51ee3500f1bc6e87210b5c7404da8906742a1f94dc43d7574149bd87e5ee4966"
Jul 28 01:17:33.045821 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:33.045804    2560 scope.go:117] "RemoveContainer" containerID="51ee3500f1bc6e87210b5c7404da8906742a1f94dc43d7574149bd87e5ee4966"
Jul 28 01:17:33.046096 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:17:33.046076    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51ee3500f1bc6e87210b5c7404da8906742a1f94dc43d7574149bd87e5ee4966\": container with ID starting with 51ee3500f1bc6e87210b5c7404da8906742a1f94dc43d7574149bd87e5ee4966 not found: ID does not exist" containerID="51ee3500f1bc6e87210b5c7404da8906742a1f94dc43d7574149bd87e5ee4966"
Jul 28 01:17:33.046173 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:33.046110    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51ee3500f1bc6e87210b5c7404da8906742a1f94dc43d7574149bd87e5ee4966"} err="failed to get container status \"51ee3500f1bc6e87210b5c7404da8906742a1f94dc43d7574149bd87e5ee4966\": rpc error: code = NotFound desc = could not find container \"51ee3500f1bc6e87210b5c7404da8906742a1f94dc43d7574149bd87e5ee4966\": container with ID starting with 51ee3500f1bc6e87210b5c7404da8906742a1f94dc43d7574149bd87e5ee4966 not found: ID does not exist"
Jul 28 01:17:33.050585 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:33.050563    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5596876655-skb2w"]
Jul 28 01:17:33.053322 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:33.053298    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5596876655-skb2w"]
Jul 28 01:17:33.459566 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:33.459532    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74ea767c-9b69-417f-aedd-f5dddad3c6ea" path="/var/lib/kubelet/pods/74ea767c-9b69-417f-aedd-f5dddad3c6ea/volumes"
Jul 28 01:17:33.756601 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:33.756513    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:33.857081 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:33.857047    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:33.919507 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:33.919480    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:34.672881 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:34.672845    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:34.722169 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:34.722129    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:41.073135 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:41.073099    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:41.820652 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:41.820611    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:41.876045 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:41.876013    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kc7hz"
Jul 28 01:17:41.895053 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:41.895027    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:41.948389 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:17:41.948324    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:18:12.043702 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:12.043672    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:12.062071 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:12.062049    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:12.197496 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:12.197473    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:18.087185 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:18.087153    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:18:18.188144 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:18.188111    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:18:21.578167 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:21.578124    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:18:21.624709 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:21.624676    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:18:23.313861 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:23.313818    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:18:23.367914 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:23.367874    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:18:30.063812 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.063776    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 01:18:30.064273 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.064193    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" containerName="prometheus" containerID="cri-o://aff9d106267c4f00dddb23456bbd2f571871cebe8d9e3ba73f108d5556a531be" gracePeriod=600
Jul 28 01:18:30.064273 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.064255    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" containerName="config-reloader" containerID="cri-o://33a63faf0f7f11592355b304f00c6bbaee4343ceed0bddc6cecd43a3f6c3b25d" gracePeriod=600
Jul 28 01:18:30.064422 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.064271    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" containerName="kube-rbac-proxy-web" containerID="cri-o://2b9ad8548a72d847e50dd87813f2e7832f76b1b03347c5a8fc781220ed9577ef" gracePeriod=600
Jul 28 01:18:30.064422 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.064201    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" containerName="kube-rbac-proxy" containerID="cri-o://3cd54267fb25dd5063e8288c965b70d6a3e515d2fe6dea419059e7e16027898e" gracePeriod=600
Jul 28 01:18:30.064422 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.064207    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" containerName="thanos-sidecar" containerID="cri-o://653fcecd1be3580e875169e4801bbb626034a6ca666fe783810ef63e667c3f13" gracePeriod=600
Jul 28 01:18:30.064422 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.064238    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" containerName="kube-rbac-proxy-thanos" containerID="cri-o://0567aaae15c529d546773f80b2b1bb6a4a10f812a2d2ba2c098fc2bdfb4b292c" gracePeriod=600
Jul 28 01:18:30.259121 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.258971    2560 generic.go:356] "Generic (PLEG): container finished" podID="a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" containerID="0567aaae15c529d546773f80b2b1bb6a4a10f812a2d2ba2c098fc2bdfb4b292c" exitCode=0
Jul 28 01:18:30.259121 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.259004    2560 generic.go:356] "Generic (PLEG): container finished" podID="a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" containerID="3cd54267fb25dd5063e8288c965b70d6a3e515d2fe6dea419059e7e16027898e" exitCode=0
Jul 28 01:18:30.259121 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.259015    2560 generic.go:356] "Generic (PLEG): container finished" podID="a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" containerID="2b9ad8548a72d847e50dd87813f2e7832f76b1b03347c5a8fc781220ed9577ef" exitCode=0
Jul 28 01:18:30.259121 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.259023    2560 generic.go:356] "Generic (PLEG): container finished" podID="a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" containerID="653fcecd1be3580e875169e4801bbb626034a6ca666fe783810ef63e667c3f13" exitCode=0
Jul 28 01:18:30.259121 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.259033    2560 generic.go:356] "Generic (PLEG): container finished" podID="a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" containerID="33a63faf0f7f11592355b304f00c6bbaee4343ceed0bddc6cecd43a3f6c3b25d" exitCode=0
Jul 28 01:18:30.259121 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.259041    2560 generic.go:356] "Generic (PLEG): container finished" podID="a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" containerID="aff9d106267c4f00dddb23456bbd2f571871cebe8d9e3ba73f108d5556a531be" exitCode=0
Jul 28 01:18:30.259121 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.259067    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b","Type":"ContainerDied","Data":"0567aaae15c529d546773f80b2b1bb6a4a10f812a2d2ba2c098fc2bdfb4b292c"}
Jul 28 01:18:30.259598 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.259138    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b","Type":"ContainerDied","Data":"3cd54267fb25dd5063e8288c965b70d6a3e515d2fe6dea419059e7e16027898e"}
Jul 28 01:18:30.259598 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.259184    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b","Type":"ContainerDied","Data":"2b9ad8548a72d847e50dd87813f2e7832f76b1b03347c5a8fc781220ed9577ef"}
Jul 28 01:18:30.259598 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.259225    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b","Type":"ContainerDied","Data":"653fcecd1be3580e875169e4801bbb626034a6ca666fe783810ef63e667c3f13"}
Jul 28 01:18:30.259598 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.259264    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b","Type":"ContainerDied","Data":"33a63faf0f7f11592355b304f00c6bbaee4343ceed0bddc6cecd43a3f6c3b25d"}
Jul 28 01:18:30.259598 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.259301    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b","Type":"ContainerDied","Data":"aff9d106267c4f00dddb23456bbd2f571871cebe8d9e3ba73f108d5556a531be"}
Jul 28 01:18:30.337460 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.337428    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:30.375152 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.375030    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-secret-kube-rbac-proxy\") pod \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") "
Jul 28 01:18:30.375152 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.375073    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-prometheus-trusted-ca-bundle\") pod \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") "
Jul 28 01:18:30.375152 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.375104    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-configmap-kubelet-serving-ca-bundle\") pod \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") "
Jul 28 01:18:30.375152 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.375129    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-web-config\") pod \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") "
Jul 28 01:18:30.375152 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.375152    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-tls-assets\") pod \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") "
Jul 28 01:18:30.375571 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.375180    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tr7fk\" (UniqueName: \"kubernetes.io/projected/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-kube-api-access-tr7fk\") pod \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") "
Jul 28 01:18:30.375571 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.375224    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") "
Jul 28 01:18:30.375571 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.375259    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-config\") pod \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") "
Jul 28 01:18:30.375571 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.375289    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-secret-grpc-tls\") pod \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") "
Jul 28 01:18:30.375571 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.375310    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-secret-metrics-client-certs\") pod \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") "
Jul 28 01:18:30.375571 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.375371    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-config-out\") pod \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") "
Jul 28 01:18:30.375571 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.375395    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-prometheus-k8s-db\") pod \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") "
Jul 28 01:18:30.375571 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.375431    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-prometheus-k8s-rulefiles-1\") pod \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") "
Jul 28 01:18:30.375571 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.375480    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-configmap-serving-certs-ca-bundle\") pod \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") "
Jul 28 01:18:30.375571 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.375510    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-secret-prometheus-k8s-tls\") pod \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") "
Jul 28 01:18:30.375571 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.375538    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-configmap-metrics-client-ca\") pod \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") "
Jul 28 01:18:30.375571 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.375564    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-prometheus-k8s-rulefiles-0\") pod \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") "
Jul 28 01:18:30.376143 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.375588    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-prometheus-k8s-rulefiles-2\") pod \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") "
Jul 28 01:18:30.376143 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.375627    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") "
Jul 28 01:18:30.376143 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.375658    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-thanos-prometheus-http-client-file\") pod \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\" (UID: \"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b\") "
Jul 28 01:18:30.377889 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.376653    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" (UID: "a8b36cfe-13b5-4a1b-8160-aa2b08e1844b"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:18:30.380875 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.378711    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" (UID: "a8b36cfe-13b5-4a1b-8160-aa2b08e1844b"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:18:30.380875 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.378967    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" (UID: "a8b36cfe-13b5-4a1b-8160-aa2b08e1844b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:18:30.380875 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.378982    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" (UID: "a8b36cfe-13b5-4a1b-8160-aa2b08e1844b"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:18:30.380875 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.379056    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-config" (OuterVolumeSpecName: "config") pod "a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" (UID: "a8b36cfe-13b5-4a1b-8160-aa2b08e1844b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:18:30.380875 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.379328    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" (UID: "a8b36cfe-13b5-4a1b-8160-aa2b08e1844b"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:18:30.380875 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.379574    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" (UID: "a8b36cfe-13b5-4a1b-8160-aa2b08e1844b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:18:30.380875 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.380815    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" (UID: "a8b36cfe-13b5-4a1b-8160-aa2b08e1844b"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:18:30.381255 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.381084    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" (UID: "a8b36cfe-13b5-4a1b-8160-aa2b08e1844b"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:18:30.381513 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.381477    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-kube-api-access-tr7fk" (OuterVolumeSpecName: "kube-api-access-tr7fk") pod "a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" (UID: "a8b36cfe-13b5-4a1b-8160-aa2b08e1844b"). InnerVolumeSpecName "kube-api-access-tr7fk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:18:30.382623 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.382593    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" (UID: "a8b36cfe-13b5-4a1b-8160-aa2b08e1844b"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:18:30.382831 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.382796    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" (UID: "a8b36cfe-13b5-4a1b-8160-aa2b08e1844b"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:18:30.384688 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.383519    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" (UID: "a8b36cfe-13b5-4a1b-8160-aa2b08e1844b"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:18:30.384688 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.384418    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" (UID: "a8b36cfe-13b5-4a1b-8160-aa2b08e1844b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:18:30.385152 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.385128    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" (UID: "a8b36cfe-13b5-4a1b-8160-aa2b08e1844b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:18:30.385341 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.385313    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" (UID: "a8b36cfe-13b5-4a1b-8160-aa2b08e1844b"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:18:30.385517 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.385492    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" (UID: "a8b36cfe-13b5-4a1b-8160-aa2b08e1844b"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:18:30.385517 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.385509    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" (UID: "a8b36cfe-13b5-4a1b-8160-aa2b08e1844b"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:18:30.386746 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.386724    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-config-out" (OuterVolumeSpecName: "config-out") pod "a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" (UID: "a8b36cfe-13b5-4a1b-8160-aa2b08e1844b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:18:30.395786 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.395751    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-web-config" (OuterVolumeSpecName: "web-config") pod "a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" (UID: "a8b36cfe-13b5-4a1b-8160-aa2b08e1844b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:18:30.476271 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.476239    2560 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:18:30.476271 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.476264    2560 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-web-config\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:18:30.476271 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.476274    2560 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-tls-assets\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:18:30.476271 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.476282    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tr7fk\" (UniqueName: \"kubernetes.io/projected/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-kube-api-access-tr7fk\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:18:30.476549 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.476291    2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:18:30.476549 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.476301    2560 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-config\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:18:30.476549 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.476310    2560 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-secret-grpc-tls\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:18:30.476549 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.476318    2560 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-secret-metrics-client-certs\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:18:30.476549 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.476326    2560 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-config-out\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:18:30.476549 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.476333    2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-prometheus-k8s-db\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:18:30.476549 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.476341    2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:18:30.476549 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.476362    2560 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:18:30.476549 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.476372    2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-secret-prometheus-k8s-tls\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:18:30.476549 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.476380    2560 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-configmap-metrics-client-ca\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:18:30.476549 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.476389    2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:18:30.476549 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.476399    2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:18:30.476549 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.476407    2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:18:30.476549 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.476416    2560 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-thanos-prometheus-http-client-file\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:18:30.476549 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.476425    2560 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-secret-kube-rbac-proxy\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:18:30.476549 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:30.476432    2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b-prometheus-trusted-ca-bundle\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:18:31.266492 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.266457    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8b36cfe-13b5-4a1b-8160-aa2b08e1844b","Type":"ContainerDied","Data":"4511e53d642524d82b142e31aa288fac1d085300f426218c7f9ce8ad0a14a0ea"}
Jul 28 01:18:31.266492 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.266483    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.266920 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.266532    2560 scope.go:117] "RemoveContainer" containerID="0567aaae15c529d546773f80b2b1bb6a4a10f812a2d2ba2c098fc2bdfb4b292c"
Jul 28 01:18:31.275059 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.275036    2560 scope.go:117] "RemoveContainer" containerID="3cd54267fb25dd5063e8288c965b70d6a3e515d2fe6dea419059e7e16027898e"
Jul 28 01:18:31.282099 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.282072    2560 scope.go:117] "RemoveContainer" containerID="2b9ad8548a72d847e50dd87813f2e7832f76b1b03347c5a8fc781220ed9577ef"
Jul 28 01:18:31.287327 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.287304    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 01:18:31.291058 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.291032    2560 scope.go:117] "RemoveContainer" containerID="653fcecd1be3580e875169e4801bbb626034a6ca666fe783810ef63e667c3f13"
Jul 28 01:18:31.292252 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.292233    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 01:18:31.298185 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.298169    2560 scope.go:117] "RemoveContainer" containerID="33a63faf0f7f11592355b304f00c6bbaee4343ceed0bddc6cecd43a3f6c3b25d"
Jul 28 01:18:31.304569 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.304553    2560 scope.go:117] "RemoveContainer" containerID="aff9d106267c4f00dddb23456bbd2f571871cebe8d9e3ba73f108d5556a531be"
Jul 28 01:18:31.312079 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.312056    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 01:18:31.312424 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.312404    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74ea767c-9b69-417f-aedd-f5dddad3c6ea" containerName="console"
Jul 28 01:18:31.312424 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.312416    2560 scope.go:117] "RemoveContainer" containerID="ed17a001904438080c3c8ddc8175f8af1a0a5a23ecdfd5b6ba9ab021218f9d54"
Jul 28 01:18:31.312557 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.312424    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="74ea767c-9b69-417f-aedd-f5dddad3c6ea" containerName="console"
Jul 28 01:18:31.312557 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.312512    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" containerName="prometheus"
Jul 28 01:18:31.312557 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.312522    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" containerName="prometheus"
Jul 28 01:18:31.312557 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.312529    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" containerName="kube-rbac-proxy-web"
Jul 28 01:18:31.312557 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.312537    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" containerName="kube-rbac-proxy-web"
Jul 28 01:18:31.312557 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.312550    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" containerName="init-config-reloader"
Jul 28 01:18:31.312557 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.312558    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" containerName="init-config-reloader"
Jul 28 01:18:31.312813 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.312577    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" containerName="thanos-sidecar"
Jul 28 01:18:31.312813 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.312582    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" containerName="thanos-sidecar"
Jul 28 01:18:31.312813 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.312588    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" containerName="kube-rbac-proxy"
Jul 28 01:18:31.312813 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.312595    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" containerName="kube-rbac-proxy"
Jul 28 01:18:31.312813 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.312612    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" containerName="kube-rbac-proxy-thanos"
Jul 28 01:18:31.312813 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.312618    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" containerName="kube-rbac-proxy-thanos"
Jul 28 01:18:31.312813 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.312626    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" containerName="config-reloader"
Jul 28 01:18:31.312813 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.312631    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" containerName="config-reloader"
Jul 28 01:18:31.312813 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.312701    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" containerName="config-reloader"
Jul 28 01:18:31.312813 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.312714    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" containerName="kube-rbac-proxy-web"
Jul 28 01:18:31.312813 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.312724    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" containerName="kube-rbac-proxy"
Jul 28 01:18:31.312813 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.312734    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" containerName="thanos-sidecar"
Jul 28 01:18:31.312813 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.312744    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="74ea767c-9b69-417f-aedd-f5dddad3c6ea" containerName="console"
Jul 28 01:18:31.312813 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.312755    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" containerName="prometheus"
Jul 28 01:18:31.312813 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.312764    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" containerName="kube-rbac-proxy-thanos"
Jul 28 01:18:31.316727 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.316709    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.318739 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.318721    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 28 01:18:31.319162 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.318987    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-csn27\""
Jul 28 01:18:31.319162 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.318997    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 28 01:18:31.319162 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.319006    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 28 01:18:31.319162 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.318994    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 28 01:18:31.319162 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.318993    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 28 01:18:31.319650 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.319632    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 28 01:18:31.319827 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.319764    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 28 01:18:31.320090 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.320069    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 28 01:18:31.320365 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.320332    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 28 01:18:31.320460 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.320419    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 28 01:18:31.320601 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.320588    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 28 01:18:31.320652 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.320616    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 28 01:18:31.320734 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.320720    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-70se9f9uvaoo8\""
Jul 28 01:18:31.321264 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.321248    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 28 01:18:31.322315 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.322295    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 28 01:18:31.326396 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.325294    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 28 01:18:31.329579 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.329559    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 01:18:31.383054 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.383030    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/00355b7b-d25e-4adb-86f2-eb1a8733b531-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.383215 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.383061    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/00355b7b-d25e-4adb-86f2-eb1a8733b531-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.383215 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.383082    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00355b7b-d25e-4adb-86f2-eb1a8733b531-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.383215 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.383112    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/00355b7b-d25e-4adb-86f2-eb1a8733b531-config\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.383215 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.383175    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/00355b7b-d25e-4adb-86f2-eb1a8733b531-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.383215 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.383215    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00355b7b-d25e-4adb-86f2-eb1a8733b531-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.383466 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.383237    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00355b7b-d25e-4adb-86f2-eb1a8733b531-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.383466 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.383262    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/00355b7b-d25e-4adb-86f2-eb1a8733b531-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.383466 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.383283    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/00355b7b-d25e-4adb-86f2-eb1a8733b531-config-out\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.383466 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.383297    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00355b7b-d25e-4adb-86f2-eb1a8733b531-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.383466 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.383314    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/00355b7b-d25e-4adb-86f2-eb1a8733b531-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.383466 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.383376    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/00355b7b-d25e-4adb-86f2-eb1a8733b531-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.383466 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.383463    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/00355b7b-d25e-4adb-86f2-eb1a8733b531-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.383774 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.383491    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/00355b7b-d25e-4adb-86f2-eb1a8733b531-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.383774 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.383521    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/00355b7b-d25e-4adb-86f2-eb1a8733b531-web-config\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.383774 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.383552    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/00355b7b-d25e-4adb-86f2-eb1a8733b531-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.383774 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.383579    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/00355b7b-d25e-4adb-86f2-eb1a8733b531-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.383774 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.383606    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv79h\" (UniqueName: \"kubernetes.io/projected/00355b7b-d25e-4adb-86f2-eb1a8733b531-kube-api-access-dv79h\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.383774 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.383643    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/00355b7b-d25e-4adb-86f2-eb1a8733b531-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.383774 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.383673    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/00355b7b-d25e-4adb-86f2-eb1a8733b531-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.461116 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.461076    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8b36cfe-13b5-4a1b-8160-aa2b08e1844b" path="/var/lib/kubelet/pods/a8b36cfe-13b5-4a1b-8160-aa2b08e1844b/volumes"
Jul 28 01:18:31.484013 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.483983    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00355b7b-d25e-4adb-86f2-eb1a8733b531-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.484161 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.484018    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/00355b7b-d25e-4adb-86f2-eb1a8733b531-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.484161 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.484044    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/00355b7b-d25e-4adb-86f2-eb1a8733b531-config-out\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.484161 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.484070    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00355b7b-d25e-4adb-86f2-eb1a8733b531-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.484161 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.484097    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/00355b7b-d25e-4adb-86f2-eb1a8733b531-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.484161 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.484121    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/00355b7b-d25e-4adb-86f2-eb1a8733b531-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.484454 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.484269    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/00355b7b-d25e-4adb-86f2-eb1a8733b531-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.484454 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.484307    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/00355b7b-d25e-4adb-86f2-eb1a8733b531-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.484454 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.484337    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/00355b7b-d25e-4adb-86f2-eb1a8733b531-web-config\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.484454 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.484390    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/00355b7b-d25e-4adb-86f2-eb1a8733b531-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.484454 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.484418    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/00355b7b-d25e-4adb-86f2-eb1a8733b531-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.484454 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.484446    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv79h\" (UniqueName: \"kubernetes.io/projected/00355b7b-d25e-4adb-86f2-eb1a8733b531-kube-api-access-dv79h\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.484748 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.484457    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/00355b7b-d25e-4adb-86f2-eb1a8733b531-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.484748 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.484478    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/00355b7b-d25e-4adb-86f2-eb1a8733b531-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.484748 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.484506    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/00355b7b-d25e-4adb-86f2-eb1a8733b531-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.484748 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.484537    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/00355b7b-d25e-4adb-86f2-eb1a8733b531-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.484748 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.484567    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/00355b7b-d25e-4adb-86f2-eb1a8733b531-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.484748 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.484595    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00355b7b-d25e-4adb-86f2-eb1a8733b531-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.484748 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.484634    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/00355b7b-d25e-4adb-86f2-eb1a8733b531-config\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.484748 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.484661    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/00355b7b-d25e-4adb-86f2-eb1a8733b531-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.484748 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.484699    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00355b7b-d25e-4adb-86f2-eb1a8733b531-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.485185 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.485019    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00355b7b-d25e-4adb-86f2-eb1a8733b531-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.485251 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.485189    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00355b7b-d25e-4adb-86f2-eb1a8733b531-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.485400 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.485376    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00355b7b-d25e-4adb-86f2-eb1a8733b531-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.485591 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.485567    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/00355b7b-d25e-4adb-86f2-eb1a8733b531-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.486059 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.486036    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00355b7b-d25e-4adb-86f2-eb1a8733b531-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.486970 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.486947    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/00355b7b-d25e-4adb-86f2-eb1a8733b531-config-out\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.487135 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.487111    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/00355b7b-d25e-4adb-86f2-eb1a8733b531-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.488519 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.487639    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/00355b7b-d25e-4adb-86f2-eb1a8733b531-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.488519 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.487644    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/00355b7b-d25e-4adb-86f2-eb1a8733b531-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.488519 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.487886    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/00355b7b-d25e-4adb-86f2-eb1a8733b531-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.488519 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.488152    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/00355b7b-d25e-4adb-86f2-eb1a8733b531-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.488519 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.488325    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/00355b7b-d25e-4adb-86f2-eb1a8733b531-config\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.488816 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.488704    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/00355b7b-d25e-4adb-86f2-eb1a8733b531-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.489156 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.489132    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/00355b7b-d25e-4adb-86f2-eb1a8733b531-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.489534 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.489516    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/00355b7b-d25e-4adb-86f2-eb1a8733b531-web-config\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.489833 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.489807    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/00355b7b-d25e-4adb-86f2-eb1a8733b531-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.490658 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.490639    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/00355b7b-d25e-4adb-86f2-eb1a8733b531-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.490972 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.490954    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/00355b7b-d25e-4adb-86f2-eb1a8733b531-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.494936 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.494917    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv79h\" (UniqueName: \"kubernetes.io/projected/00355b7b-d25e-4adb-86f2-eb1a8733b531-kube-api-access-dv79h\") pod \"prometheus-k8s-0\" (UID: \"00355b7b-d25e-4adb-86f2-eb1a8733b531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.630250 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.630210    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:31.760681 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:31.760585    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 01:18:31.763229 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:18:31.763204    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00355b7b_d25e_4adb_86f2_eb1a8733b531.slice/crio-96ed89da1d777049f0921c1dbeb32734145937251ba0b37f2687739a9cda2bce WatchSource:0}: Error finding container 96ed89da1d777049f0921c1dbeb32734145937251ba0b37f2687739a9cda2bce: Status 404 returned error can't find the container with id 96ed89da1d777049f0921c1dbeb32734145937251ba0b37f2687739a9cda2bce
Jul 28 01:18:32.271595 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:32.271557    2560 generic.go:356] "Generic (PLEG): container finished" podID="00355b7b-d25e-4adb-86f2-eb1a8733b531" containerID="87af2e1a2a1371cbc919e0da515a3e352c45f5ef61477b5afe6b0088c7749bd8" exitCode=0
Jul 28 01:18:32.272023 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:32.271642    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"00355b7b-d25e-4adb-86f2-eb1a8733b531","Type":"ContainerDied","Data":"87af2e1a2a1371cbc919e0da515a3e352c45f5ef61477b5afe6b0088c7749bd8"}
Jul 28 01:18:32.272023 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:32.271710    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"00355b7b-d25e-4adb-86f2-eb1a8733b531","Type":"ContainerStarted","Data":"96ed89da1d777049f0921c1dbeb32734145937251ba0b37f2687739a9cda2bce"}
Jul 28 01:18:33.279562 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:33.279530    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"00355b7b-d25e-4adb-86f2-eb1a8733b531","Type":"ContainerStarted","Data":"b2486faecbef624c3bda43b9130bf307945a89c0703b3bd038bdd98d4d58ef74"}
Jul 28 01:18:33.279921 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:33.279589    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"00355b7b-d25e-4adb-86f2-eb1a8733b531","Type":"ContainerStarted","Data":"5d2bc0a89cb7a691db82fb1482e1191acd088068d2bead14718f249d1509acf1"}
Jul 28 01:18:33.279921 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:33.279616    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"00355b7b-d25e-4adb-86f2-eb1a8733b531","Type":"ContainerStarted","Data":"0151430fd4f3d21b2953f058446588856754b0dffd04f5a7e111ec747c28d599"}
Jul 28 01:18:33.279921 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:33.279638    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"00355b7b-d25e-4adb-86f2-eb1a8733b531","Type":"ContainerStarted","Data":"ce7fbd52b158c3845176d5c5e91558c3e970cef80932a11f0981830d5b2a12dd"}
Jul 28 01:18:33.279921 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:33.279660    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"00355b7b-d25e-4adb-86f2-eb1a8733b531","Type":"ContainerStarted","Data":"5177a8ff5bb0ea0e5922d51a587ada8aeafa4f22aa977c092d8e0211a06ddc5d"}
Jul 28 01:18:33.279921 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:33.279684    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"00355b7b-d25e-4adb-86f2-eb1a8733b531","Type":"ContainerStarted","Data":"84fd497d87d13fcb6f3916911e1a97d5476c6049d0f57aafc5812815a9eba2b7"}
Jul 28 01:18:33.308582 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:33.308302    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.291655934 podStartE2EDuration="2.308283845s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.627911ms" isStatefulPod=false podCreationTimestamp="2026-07-28 01:18:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:18:33.30650452 +0000 UTC m=+164.340547912" watchObservedRunningTime="2026-07-28 01:18:33.308283845 +0000 UTC m=+164.342327245"
Jul 28 01:18:33.553027 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:33.552948    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:18:33.604343 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:33.604312    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:18:33.974067 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:33.974029    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:18:34.074909 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:34.074877    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:18:34.125754 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:34.125720    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:18:36.630525 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:36.630477    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:18:49.694233 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:49.694199    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:18:49.794637 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:49.794598    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:18:49.898101 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:49.898075    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:18:53.068324 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:18:53.068287    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:19:27.829481 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:19:27.829447    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:19:27.923188 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:19:27.923156    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:19:31.631073 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:19:31.631032    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:19:31.646389 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:19:31.646363    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:19:32.517386 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:19:32.517340    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:19:54.534442 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:19:54.534402    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:19:55.372435 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:19:55.372394    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:19:58.143685 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:19:58.143649    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:19:58.243980 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:19:58.243945    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:19:59.559451 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:19:59.559415    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:19:59.686961 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:19:59.686919    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:20:00.354551 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:00.354521    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:20:00.450085 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:00.450049    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:20:02.331403 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:02.331345    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:20:02.735551 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:02.735524    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:20:04.932949 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:04.932915    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:20:05.034445 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:05.034403    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:20:07.481381 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:07.481310    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:20:07.538047 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:07.538018    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:20:10.913643 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:10.913573    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-5mrbs"]
Jul 28 01:20:10.915697 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:10.915678    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-5mrbs"
Jul 28 01:20:10.917419 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:10.917394    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 28 01:20:10.917531 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:10.917429    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 28 01:20:10.917531 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:10.917464    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-t42l4\""
Jul 28 01:20:10.932653 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:10.932591    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-5mrbs"]
Jul 28 01:20:10.932653 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:10.932592    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:20:10.998978 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:10.998946    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8p2b\" (UniqueName: \"kubernetes.io/projected/2bed4525-888b-487d-b3f7-48cdb2b3ed2d-kube-api-access-v8p2b\") pod \"cert-manager-55b4d954d5-5mrbs\" (UID: \"2bed4525-888b-487d-b3f7-48cdb2b3ed2d\") " pod="cert-manager/cert-manager-55b4d954d5-5mrbs"
Jul 28 01:20:10.999119 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:10.999018    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2bed4525-888b-487d-b3f7-48cdb2b3ed2d-bound-sa-token\") pod \"cert-manager-55b4d954d5-5mrbs\" (UID: \"2bed4525-888b-487d-b3f7-48cdb2b3ed2d\") " pod="cert-manager/cert-manager-55b4d954d5-5mrbs"
Jul 28 01:20:11.100321 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:11.100280    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2bed4525-888b-487d-b3f7-48cdb2b3ed2d-bound-sa-token\") pod \"cert-manager-55b4d954d5-5mrbs\" (UID: \"2bed4525-888b-487d-b3f7-48cdb2b3ed2d\") " pod="cert-manager/cert-manager-55b4d954d5-5mrbs"
Jul 28 01:20:11.100513 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:11.100331    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8p2b\" (UniqueName: \"kubernetes.io/projected/2bed4525-888b-487d-b3f7-48cdb2b3ed2d-kube-api-access-v8p2b\") pod \"cert-manager-55b4d954d5-5mrbs\" (UID: \"2bed4525-888b-487d-b3f7-48cdb2b3ed2d\") " pod="cert-manager/cert-manager-55b4d954d5-5mrbs"
Jul 28 01:20:11.107948 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:11.107911    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2bed4525-888b-487d-b3f7-48cdb2b3ed2d-bound-sa-token\") pod \"cert-manager-55b4d954d5-5mrbs\" (UID: \"2bed4525-888b-487d-b3f7-48cdb2b3ed2d\") " pod="cert-manager/cert-manager-55b4d954d5-5mrbs"
Jul 28 01:20:11.108066 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:11.107969    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8p2b\" (UniqueName: \"kubernetes.io/projected/2bed4525-888b-487d-b3f7-48cdb2b3ed2d-kube-api-access-v8p2b\") pod \"cert-manager-55b4d954d5-5mrbs\" (UID: \"2bed4525-888b-487d-b3f7-48cdb2b3ed2d\") " pod="cert-manager/cert-manager-55b4d954d5-5mrbs"
Jul 28 01:20:11.232911 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:11.232824    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-5mrbs"
Jul 28 01:20:11.359375 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:11.359335    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-5mrbs"]
Jul 28 01:20:11.651387 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:11.651338    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-5mrbs" event={"ID":"2bed4525-888b-487d-b3f7-48cdb2b3ed2d","Type":"ContainerStarted","Data":"57486664f9f5e99816f88aac2250d1dfa025621a462637ea6dd2f6194e7ef9f3"}
Jul 28 01:20:12.417859 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:12.417812    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:20:12.510167 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:12.510133    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:20:14.254553 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:14.254523    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-649qs"]
Jul 28 01:20:14.257556 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:14.257540    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-649qs"
Jul 28 01:20:14.259439 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:14.259413    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 28 01:20:14.259792 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:14.259774    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 28 01:20:14.259846 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:14.259775    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-vwsz4\""
Jul 28 01:20:14.266547 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:14.266524    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-649qs"]
Jul 28 01:20:14.327462 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:14.327439    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4702e965-7060-44d2-a557-24b09dbac2c9-tmp\") pod \"openshift-lws-operator-fd8ccff4c-649qs\" (UID: \"4702e965-7060-44d2-a557-24b09dbac2c9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-649qs"
Jul 28 01:20:14.327592 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:14.327468    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hbxc\" (UniqueName: \"kubernetes.io/projected/4702e965-7060-44d2-a557-24b09dbac2c9-kube-api-access-7hbxc\") pod \"openshift-lws-operator-fd8ccff4c-649qs\" (UID: \"4702e965-7060-44d2-a557-24b09dbac2c9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-649qs"
Jul 28 01:20:14.428829 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:14.428792    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4702e965-7060-44d2-a557-24b09dbac2c9-tmp\") pod \"openshift-lws-operator-fd8ccff4c-649qs\" (UID: \"4702e965-7060-44d2-a557-24b09dbac2c9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-649qs"
Jul 28 01:20:14.429020 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:14.428844    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hbxc\" (UniqueName: \"kubernetes.io/projected/4702e965-7060-44d2-a557-24b09dbac2c9-kube-api-access-7hbxc\") pod \"openshift-lws-operator-fd8ccff4c-649qs\" (UID: \"4702e965-7060-44d2-a557-24b09dbac2c9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-649qs"
Jul 28 01:20:14.429303 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:14.429281    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4702e965-7060-44d2-a557-24b09dbac2c9-tmp\") pod \"openshift-lws-operator-fd8ccff4c-649qs\" (UID: \"4702e965-7060-44d2-a557-24b09dbac2c9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-649qs"
Jul 28 01:20:14.436491 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:14.436462    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hbxc\" (UniqueName: \"kubernetes.io/projected/4702e965-7060-44d2-a557-24b09dbac2c9-kube-api-access-7hbxc\") pod \"openshift-lws-operator-fd8ccff4c-649qs\" (UID: \"4702e965-7060-44d2-a557-24b09dbac2c9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-649qs"
Jul 28 01:20:14.567410 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:14.567331    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-649qs"
Jul 28 01:20:14.690880 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:14.690793    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-649qs"]
Jul 28 01:20:14.693682 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:20:14.693659    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4702e965_7060_44d2_a557_24b09dbac2c9.slice/crio-89030a4ed5de93530ed3968eb327385475c0ad596c996f2946a6fa68810824a4 WatchSource:0}: Error finding container 89030a4ed5de93530ed3968eb327385475c0ad596c996f2946a6fa68810824a4: Status 404 returned error can't find the container with id 89030a4ed5de93530ed3968eb327385475c0ad596c996f2946a6fa68810824a4
Jul 28 01:20:15.670713 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:15.670674    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-649qs" event={"ID":"4702e965-7060-44d2-a557-24b09dbac2c9","Type":"ContainerStarted","Data":"89030a4ed5de93530ed3968eb327385475c0ad596c996f2946a6fa68810824a4"}
Jul 28 01:20:17.680041 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:17.680008    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-649qs" event={"ID":"4702e965-7060-44d2-a557-24b09dbac2c9","Type":"ContainerStarted","Data":"77584565a3ec5cc9642b026f110cfee425655dc5939b3717501875641b53178c"}
Jul 28 01:20:17.694224 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:17.694181    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-649qs" podStartSLOduration=1.326391267 podStartE2EDuration="3.694165444s" totalImagesPullingTime="2.367774177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:20:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:20:17.693420515 +0000 UTC m=+268.727463907" watchObservedRunningTime="2026-07-28 01:20:17.694165444 +0000 UTC m=+268.728208837"
Jul 28 01:20:18.438224 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:18.438190    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:20:18.538466 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:18.538435    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:20:20.594679 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:20.594644    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:20:22.701997 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:22.701963    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-5mrbs" event={"ID":"2bed4525-888b-487d-b3f7-48cdb2b3ed2d","Type":"ContainerStarted","Data":"a9d1b12256ee568423a05dbef28c1095832414a6b6dcc7c664a7d330ff9f90ef"}
Jul 28 01:20:22.718083 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:22.718030    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-5mrbs" podStartSLOduration=2.416758601 podStartE2EDuration="12.718013113s" totalImagesPullingTime="10.301254512s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:20:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:20:22.717864898 +0000 UTC m=+273.751908290" watchObservedRunningTime="2026-07-28 01:20:22.718013113 +0000 UTC m=+273.752056505"
Jul 28 01:20:36.379137 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:36.379102    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:20:37.418811 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:37.418780    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-d2zjj"]
Jul 28 01:20:37.484982 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:37.484958    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-d2zjj"]
Jul 28 01:20:37.485141 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:37.485090    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-d2zjj"
Jul 28 01:20:37.487471 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:37.487453    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 28 01:20:37.487677 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:37.487656    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 28 01:20:37.487753 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:37.487677    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 28 01:20:37.487753 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:37.487745    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ndl4c\""
Jul 28 01:20:37.487861 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:37.487812    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 28 01:20:37.512827 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:37.512805    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a25965c3-6fb0-49c5-8687-71e8bc483e6a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8699bb9d7c-d2zjj\" (UID: \"a25965c3-6fb0-49c5-8687-71e8bc483e6a\") " pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-d2zjj"
Jul 28 01:20:37.512956 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:37.512838    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a25965c3-6fb0-49c5-8687-71e8bc483e6a-webhook-cert\") pod \"opendatahub-operator-controller-manager-8699bb9d7c-d2zjj\" (UID: \"a25965c3-6fb0-49c5-8687-71e8bc483e6a\") " pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-d2zjj"
Jul 28 01:20:37.512956 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:37.512876    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sv5t\" (UniqueName: \"kubernetes.io/projected/a25965c3-6fb0-49c5-8687-71e8bc483e6a-kube-api-access-2sv5t\") pod \"opendatahub-operator-controller-manager-8699bb9d7c-d2zjj\" (UID: \"a25965c3-6fb0-49c5-8687-71e8bc483e6a\") " pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-d2zjj"
Jul 28 01:20:37.512956 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:37.512936    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a25965c3-6fb0-49c5-8687-71e8bc483e6a-tmp\") pod \"opendatahub-operator-controller-manager-8699bb9d7c-d2zjj\" (UID: \"a25965c3-6fb0-49c5-8687-71e8bc483e6a\") " pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-d2zjj"
Jul 28 01:20:37.513096 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:37.512998    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a25965c3-6fb0-49c5-8687-71e8bc483e6a-manifests\") pod \"opendatahub-operator-controller-manager-8699bb9d7c-d2zjj\" (UID: \"a25965c3-6fb0-49c5-8687-71e8bc483e6a\") " pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-d2zjj"
Jul 28 01:20:37.613939 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:37.613910    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a25965c3-6fb0-49c5-8687-71e8bc483e6a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8699bb9d7c-d2zjj\" (UID: \"a25965c3-6fb0-49c5-8687-71e8bc483e6a\") " pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-d2zjj"
Jul 28 01:20:37.613939 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:37.613938    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a25965c3-6fb0-49c5-8687-71e8bc483e6a-webhook-cert\") pod \"opendatahub-operator-controller-manager-8699bb9d7c-d2zjj\" (UID: \"a25965c3-6fb0-49c5-8687-71e8bc483e6a\") " pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-d2zjj"
Jul 28 01:20:37.614184 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:37.613968    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sv5t\" (UniqueName: \"kubernetes.io/projected/a25965c3-6fb0-49c5-8687-71e8bc483e6a-kube-api-access-2sv5t\") pod \"opendatahub-operator-controller-manager-8699bb9d7c-d2zjj\" (UID: \"a25965c3-6fb0-49c5-8687-71e8bc483e6a\") " pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-d2zjj"
Jul 28 01:20:37.614184 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:37.614008    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a25965c3-6fb0-49c5-8687-71e8bc483e6a-tmp\") pod \"opendatahub-operator-controller-manager-8699bb9d7c-d2zjj\" (UID: \"a25965c3-6fb0-49c5-8687-71e8bc483e6a\") " pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-d2zjj"
Jul 28 01:20:37.614184 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:37.614045    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a25965c3-6fb0-49c5-8687-71e8bc483e6a-manifests\") pod \"opendatahub-operator-controller-manager-8699bb9d7c-d2zjj\" (UID: \"a25965c3-6fb0-49c5-8687-71e8bc483e6a\") " pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-d2zjj"
Jul 28 01:20:37.614512 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:37.614489    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a25965c3-6fb0-49c5-8687-71e8bc483e6a-manifests\") pod \"opendatahub-operator-controller-manager-8699bb9d7c-d2zjj\" (UID: \"a25965c3-6fb0-49c5-8687-71e8bc483e6a\") " pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-d2zjj"
Jul 28 01:20:37.616305 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:37.616268    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a25965c3-6fb0-49c5-8687-71e8bc483e6a-tmp\") pod \"opendatahub-operator-controller-manager-8699bb9d7c-d2zjj\" (UID: \"a25965c3-6fb0-49c5-8687-71e8bc483e6a\") " pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-d2zjj"
Jul 28 01:20:37.616469 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:37.616381    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a25965c3-6fb0-49c5-8687-71e8bc483e6a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8699bb9d7c-d2zjj\" (UID: \"a25965c3-6fb0-49c5-8687-71e8bc483e6a\") " pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-d2zjj"
Jul 28 01:20:37.616535 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:37.616507    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a25965c3-6fb0-49c5-8687-71e8bc483e6a-webhook-cert\") pod \"opendatahub-operator-controller-manager-8699bb9d7c-d2zjj\" (UID: \"a25965c3-6fb0-49c5-8687-71e8bc483e6a\") " pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-d2zjj"
Jul 28 01:20:37.621330 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:37.621310    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sv5t\" (UniqueName: \"kubernetes.io/projected/a25965c3-6fb0-49c5-8687-71e8bc483e6a-kube-api-access-2sv5t\") pod \"opendatahub-operator-controller-manager-8699bb9d7c-d2zjj\" (UID: \"a25965c3-6fb0-49c5-8687-71e8bc483e6a\") " pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-d2zjj"
Jul 28 01:20:37.772484 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:37.772386    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:20:37.796364 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:37.796337    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-d2zjj"
Jul 28 01:20:37.855699 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:37.855660    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:20:37.949802 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:37.949769    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:20:37.958343 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:37.958324    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-d2zjj"]
Jul 28 01:20:37.960793 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:20:37.960767    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda25965c3_6fb0_49c5_8687_71e8bc483e6a.slice/crio-77f5b10fb32da2dcad9d074e32e19ed51fc4bc4c831e566d2d5c69c9a8845f66 WatchSource:0}: Error finding container 77f5b10fb32da2dcad9d074e32e19ed51fc4bc4c831e566d2d5c69c9a8845f66: Status 404 returned error can't find the container with id 77f5b10fb32da2dcad9d074e32e19ed51fc4bc4c831e566d2d5c69c9a8845f66
Jul 28 01:20:38.050702 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:38.050630    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:20:38.150478 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:38.150447    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:20:38.250736 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:38.250701    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:20:38.770628 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:38.770586    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-d2zjj" event={"ID":"a25965c3-6fb0-49c5-8687-71e8bc483e6a","Type":"ContainerStarted","Data":"77f5b10fb32da2dcad9d074e32e19ed51fc4bc4c831e566d2d5c69c9a8845f66"}
Jul 28 01:20:41.785522 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:41.785482    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-d2zjj" event={"ID":"a25965c3-6fb0-49c5-8687-71e8bc483e6a","Type":"ContainerStarted","Data":"8c86dcdd6c1ded5e3b94af8c9e98322b6da0529ca5fb7814a72292e21be54063"}
Jul 28 01:20:42.790705 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:42.790674    2560 generic.go:356] "Generic (PLEG): container finished" podID="a25965c3-6fb0-49c5-8687-71e8bc483e6a" containerID="8c86dcdd6c1ded5e3b94af8c9e98322b6da0529ca5fb7814a72292e21be54063" exitCode=0
Jul 28 01:20:42.791103 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:42.790763    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-d2zjj" event={"ID":"a25965c3-6fb0-49c5-8687-71e8bc483e6a","Type":"ContainerDied","Data":"8c86dcdd6c1ded5e3b94af8c9e98322b6da0529ca5fb7814a72292e21be54063"}
Jul 28 01:20:43.801767 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:43.801731    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-d2zjj" event={"ID":"a25965c3-6fb0-49c5-8687-71e8bc483e6a","Type":"ContainerStarted","Data":"a696db1125c80ba8818f75b8048f09cbe6accf62de1c8d23e13be5adf5ca790c"}
Jul 28 01:20:43.802220 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:43.801833    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-d2zjj"
Jul 28 01:20:43.820579 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:43.820532    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-d2zjj" podStartSLOduration=2.4145310220000002 podStartE2EDuration="6.820517472s" totalImagesPullingTime="3.34383706s" totalInitContainerRuntime="1.06214939s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:20:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:20:43.818577023 +0000 UTC m=+294.852620416" watchObservedRunningTime="2026-07-28 01:20:43.820517472 +0000 UTC m=+294.854560855"
Jul 28 01:20:49.350877 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:49.350847    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5f2zn_5311b0bc-9ad2-4e2f-bdde-81510c6d6b19/ovn-acl-logging/0.log"
Jul 28 01:20:49.361201 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:49.361162    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5f2zn_5311b0bc-9ad2-4e2f-bdde-81510c6d6b19/ovn-acl-logging/0.log"
Jul 28 01:20:49.363914 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:49.363892    2560 kubelet.go:1648] "Image garbage collection succeeded"
Jul 28 01:20:54.545189 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:54.545132    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:20:54.619476 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:54.619443    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:20:54.631996 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:54.631966    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d7cccf554-vd84j"]
Jul 28 01:20:54.635402 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:54.635376    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7d7cccf554-vd84j"
Jul 28 01:20:54.637685 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:54.637662    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 28 01:20:54.637685 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:54.637676    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 28 01:20:54.637685 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:54.637685    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 28 01:20:54.637933 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:54.637749    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-mzx7x\""
Jul 28 01:20:54.644080 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:54.644057    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d7cccf554-vd84j"]
Jul 28 01:20:54.754742 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:54.754710    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/596d9057-fbd0-4e06-be07-d386998f654f-metrics-cert\") pod \"lws-controller-manager-7d7cccf554-vd84j\" (UID: \"596d9057-fbd0-4e06-be07-d386998f654f\") " pod="openshift-lws-operator/lws-controller-manager-7d7cccf554-vd84j"
Jul 28 01:20:54.754908 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:54.754774    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/596d9057-fbd0-4e06-be07-d386998f654f-cert\") pod \"lws-controller-manager-7d7cccf554-vd84j\" (UID: \"596d9057-fbd0-4e06-be07-d386998f654f\") " pod="openshift-lws-operator/lws-controller-manager-7d7cccf554-vd84j"
Jul 28 01:20:54.754908 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:54.754813    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/596d9057-fbd0-4e06-be07-d386998f654f-manager-config\") pod \"lws-controller-manager-7d7cccf554-vd84j\" (UID: \"596d9057-fbd0-4e06-be07-d386998f654f\") " pod="openshift-lws-operator/lws-controller-manager-7d7cccf554-vd84j"
Jul 28 01:20:54.754908 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:54.754841    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhvtr\" (UniqueName: \"kubernetes.io/projected/596d9057-fbd0-4e06-be07-d386998f654f-kube-api-access-jhvtr\") pod \"lws-controller-manager-7d7cccf554-vd84j\" (UID: \"596d9057-fbd0-4e06-be07-d386998f654f\") " pod="openshift-lws-operator/lws-controller-manager-7d7cccf554-vd84j"
Jul 28 01:20:54.808342 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:54.808248    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8699bb9d7c-d2zjj"
Jul 28 01:20:54.855936 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:54.855906    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/596d9057-fbd0-4e06-be07-d386998f654f-cert\") pod \"lws-controller-manager-7d7cccf554-vd84j\" (UID: \"596d9057-fbd0-4e06-be07-d386998f654f\") " pod="openshift-lws-operator/lws-controller-manager-7d7cccf554-vd84j"
Jul 28 01:20:54.856107 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:54.855964    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/596d9057-fbd0-4e06-be07-d386998f654f-manager-config\") pod \"lws-controller-manager-7d7cccf554-vd84j\" (UID: \"596d9057-fbd0-4e06-be07-d386998f654f\") " pod="openshift-lws-operator/lws-controller-manager-7d7cccf554-vd84j"
Jul 28 01:20:54.856107 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:54.856004    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhvtr\" (UniqueName: \"kubernetes.io/projected/596d9057-fbd0-4e06-be07-d386998f654f-kube-api-access-jhvtr\") pod \"lws-controller-manager-7d7cccf554-vd84j\" (UID: \"596d9057-fbd0-4e06-be07-d386998f654f\") " pod="openshift-lws-operator/lws-controller-manager-7d7cccf554-vd84j"
Jul 28 01:20:54.856107 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:54.856057    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/596d9057-fbd0-4e06-be07-d386998f654f-metrics-cert\") pod \"lws-controller-manager-7d7cccf554-vd84j\" (UID: \"596d9057-fbd0-4e06-be07-d386998f654f\") " pod="openshift-lws-operator/lws-controller-manager-7d7cccf554-vd84j"
Jul 28 01:20:54.857042 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:54.857007    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/596d9057-fbd0-4e06-be07-d386998f654f-manager-config\") pod \"lws-controller-manager-7d7cccf554-vd84j\" (UID: \"596d9057-fbd0-4e06-be07-d386998f654f\") " pod="openshift-lws-operator/lws-controller-manager-7d7cccf554-vd84j"
Jul 28 01:20:54.859176 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:54.859149    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/596d9057-fbd0-4e06-be07-d386998f654f-metrics-cert\") pod \"lws-controller-manager-7d7cccf554-vd84j\" (UID: \"596d9057-fbd0-4e06-be07-d386998f654f\") " pod="openshift-lws-operator/lws-controller-manager-7d7cccf554-vd84j"
Jul 28 01:20:54.859682 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:54.859658    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/596d9057-fbd0-4e06-be07-d386998f654f-cert\") pod \"lws-controller-manager-7d7cccf554-vd84j\" (UID: \"596d9057-fbd0-4e06-be07-d386998f654f\") " pod="openshift-lws-operator/lws-controller-manager-7d7cccf554-vd84j"
Jul 28 01:20:54.874190 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:54.874168    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhvtr\" (UniqueName: \"kubernetes.io/projected/596d9057-fbd0-4e06-be07-d386998f654f-kube-api-access-jhvtr\") pod \"lws-controller-manager-7d7cccf554-vd84j\" (UID: \"596d9057-fbd0-4e06-be07-d386998f654f\") " pod="openshift-lws-operator/lws-controller-manager-7d7cccf554-vd84j"
Jul 28 01:20:54.945096 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:54.945052    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7d7cccf554-vd84j"
Jul 28 01:20:55.071088 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:55.071064    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d7cccf554-vd84j"]
Jul 28 01:20:55.073383 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:20:55.073343    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod596d9057_fbd0_4e06_be07_d386998f654f.slice/crio-334e512d3b41f4045bd8ea796e0f70073dfac5ee95fa7b457a2b9923d7d8042e WatchSource:0}: Error finding container 334e512d3b41f4045bd8ea796e0f70073dfac5ee95fa7b457a2b9923d7d8042e: Status 404 returned error can't find the container with id 334e512d3b41f4045bd8ea796e0f70073dfac5ee95fa7b457a2b9923d7d8042e
Jul 28 01:20:55.075143 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:55.075130    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 01:20:55.856311 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:55.856281    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7d7cccf554-vd84j" event={"ID":"596d9057-fbd0-4e06-be07-d386998f654f","Type":"ContainerStarted","Data":"334e512d3b41f4045bd8ea796e0f70073dfac5ee95fa7b457a2b9923d7d8042e"}
Jul 28 01:20:56.726526 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:56.726494    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:20:56.825766 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:56.825741    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:20:56.862282 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:56.862251    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7d7cccf554-vd84j" event={"ID":"596d9057-fbd0-4e06-be07-d386998f654f","Type":"ContainerStarted","Data":"76a0ededa82296b0845c05d954869a6df87c3a2393c4a99a00e82d20dd71dccc"}
Jul 28 01:20:56.862711 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:56.862382    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7d7cccf554-vd84j"
Jul 28 01:20:56.890211 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:56.890152    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7d7cccf554-vd84j" podStartSLOduration=1.194197615 podStartE2EDuration="2.890135837s" totalImagesPullingTime="1.695938222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:20:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:20:56.889456318 +0000 UTC m=+307.923499712" watchObservedRunningTime="2026-07-28 01:20:56.890135837 +0000 UTC m=+307.924179230"
Jul 28 01:20:57.391338 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:57.391290    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:20:57.462583 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:57.462550    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:20:57.797878 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:57.797780    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:20:57.985881 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:57.985848    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:20:58.087639 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:20:58.087553    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:21:02.426561 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:02.426530    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:21:02.490639 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:02.490611    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-78d7d88cc5-jzlr2"]
Jul 28 01:21:02.494098 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:02.494081    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-78d7d88cc5-jzlr2"
Jul 28 01:21:02.496015 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:02.495991    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 28 01:21:02.496127 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:02.496022    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 28 01:21:02.496127 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:02.496023    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 28 01:21:02.496298 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:02.496006    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 28 01:21:02.496475 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:02.496457    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-9wx22\""
Jul 28 01:21:02.503806 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:02.503786    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-78d7d88cc5-jzlr2"]
Jul 28 01:21:02.610730 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:02.610697    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:21:02.624723 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:02.624698    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9d52f05-40b4-4104-aecd-b67ed7c54515-tmp\") pod \"kube-auth-proxy-78d7d88cc5-jzlr2\" (UID: \"b9d52f05-40b4-4104-aecd-b67ed7c54515\") " pod="openshift-ingress/kube-auth-proxy-78d7d88cc5-jzlr2"
Jul 28 01:21:02.624828 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:02.624741    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9d52f05-40b4-4104-aecd-b67ed7c54515-tls-certs\") pod \"kube-auth-proxy-78d7d88cc5-jzlr2\" (UID: \"b9d52f05-40b4-4104-aecd-b67ed7c54515\") " pod="openshift-ingress/kube-auth-proxy-78d7d88cc5-jzlr2"
Jul 28 01:21:02.624828 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:02.624780    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r9nl\" (UniqueName: \"kubernetes.io/projected/b9d52f05-40b4-4104-aecd-b67ed7c54515-kube-api-access-5r9nl\") pod \"kube-auth-proxy-78d7d88cc5-jzlr2\" (UID: \"b9d52f05-40b4-4104-aecd-b67ed7c54515\") " pod="openshift-ingress/kube-auth-proxy-78d7d88cc5-jzlr2"
Jul 28 01:21:02.725947 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:02.725858    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r9nl\" (UniqueName: \"kubernetes.io/projected/b9d52f05-40b4-4104-aecd-b67ed7c54515-kube-api-access-5r9nl\") pod \"kube-auth-proxy-78d7d88cc5-jzlr2\" (UID: \"b9d52f05-40b4-4104-aecd-b67ed7c54515\") " pod="openshift-ingress/kube-auth-proxy-78d7d88cc5-jzlr2"
Jul 28 01:21:02.725947 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:02.725936    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9d52f05-40b4-4104-aecd-b67ed7c54515-tmp\") pod \"kube-auth-proxy-78d7d88cc5-jzlr2\" (UID: \"b9d52f05-40b4-4104-aecd-b67ed7c54515\") " pod="openshift-ingress/kube-auth-proxy-78d7d88cc5-jzlr2"
Jul 28 01:21:02.726139 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:02.725991    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9d52f05-40b4-4104-aecd-b67ed7c54515-tls-certs\") pod \"kube-auth-proxy-78d7d88cc5-jzlr2\" (UID: \"b9d52f05-40b4-4104-aecd-b67ed7c54515\") " pod="openshift-ingress/kube-auth-proxy-78d7d88cc5-jzlr2"
Jul 28 01:21:02.728289 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:02.728259    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9d52f05-40b4-4104-aecd-b67ed7c54515-tmp\") pod \"kube-auth-proxy-78d7d88cc5-jzlr2\" (UID: \"b9d52f05-40b4-4104-aecd-b67ed7c54515\") " pod="openshift-ingress/kube-auth-proxy-78d7d88cc5-jzlr2"
Jul 28 01:21:02.728447 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:02.728429    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9d52f05-40b4-4104-aecd-b67ed7c54515-tls-certs\") pod \"kube-auth-proxy-78d7d88cc5-jzlr2\" (UID: \"b9d52f05-40b4-4104-aecd-b67ed7c54515\") " pod="openshift-ingress/kube-auth-proxy-78d7d88cc5-jzlr2"
Jul 28 01:21:02.734022 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:02.734001    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r9nl\" (UniqueName: \"kubernetes.io/projected/b9d52f05-40b4-4104-aecd-b67ed7c54515-kube-api-access-5r9nl\") pod \"kube-auth-proxy-78d7d88cc5-jzlr2\" (UID: \"b9d52f05-40b4-4104-aecd-b67ed7c54515\") " pod="openshift-ingress/kube-auth-proxy-78d7d88cc5-jzlr2"
Jul 28 01:21:02.806047 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:02.806012    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-78d7d88cc5-jzlr2"
Jul 28 01:21:02.831669 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:02.831632    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:21:02.927337 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:02.927304    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:21:02.941950 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:02.941928    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-78d7d88cc5-jzlr2"]
Jul 28 01:21:02.943747 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:21:02.943704    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9d52f05_40b4_4104_aecd_b67ed7c54515.slice/crio-f48be86649a29db745ed4a6445357f43be56052c75257c3745068a14526e602f WatchSource:0}: Error finding container f48be86649a29db745ed4a6445357f43be56052c75257c3745068a14526e602f: Status 404 returned error can't find the container with id f48be86649a29db745ed4a6445357f43be56052c75257c3745068a14526e602f
Jul 28 01:21:03.755034 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:03.754983    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:21:03.818260 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:03.818209    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:21:03.898896 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:03.898854    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-78d7d88cc5-jzlr2" event={"ID":"b9d52f05-40b4-4104-aecd-b67ed7c54515","Type":"ContainerStarted","Data":"f48be86649a29db745ed4a6445357f43be56052c75257c3745068a14526e602f"}
Jul 28 01:21:04.977137 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:04.977100    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:21:05.909797 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:05.909705    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-78d7d88cc5-jzlr2" event={"ID":"b9d52f05-40b4-4104-aecd-b67ed7c54515","Type":"ContainerStarted","Data":"f2e4401af7442e10a7d3b7354bf8e20ed2d224220a1865cfa99a48c70ddba4dc"}
Jul 28 01:21:05.942136 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:05.942067    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-78d7d88cc5-jzlr2" podStartSLOduration=1.25085238 podStartE2EDuration="3.942047294s" totalImagesPullingTime="2.691194914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:21:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:21:05.9391529 +0000 UTC m=+316.973196305" watchObservedRunningTime="2026-07-28 01:21:05.942047294 +0000 UTC m=+316.976090689"
Jul 28 01:21:06.981515 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:06.981482    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:21:07.082888 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:07.082850    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:21:07.233338 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:07.233246    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:21:07.344145 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:07.344115    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:21:07.475582 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:07.475550    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:21:07.868803 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:07.868770    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7d7cccf554-vd84j"
Jul 28 01:21:07.960841 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:07.960808    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:21:08.166535 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:08.166455    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:21:08.267251 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:08.267221    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:21:08.585799 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:08.585719    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:21:08.748596 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:08.748565    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:21:08.980591 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:08.980551    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:21:58.234187 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:58.234104    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:21:58.330942 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:58.330910    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:21:58.401051 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:21:58.401016    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:22:16.054067 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:16.054032    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:22:16.109196 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:16.109166    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:22:17.994418 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:17.994376    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:22:18.046794 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:18.046742    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:22:26.727851 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:26.727819    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:22:27.385037 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:27.385000    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:22:29.043292 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:29.043249    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55b684c997-2x47v"]
Jul 28 01:22:29.046895 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:29.046872    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55b684c997-2x47v"
Jul 28 01:22:29.048863 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:29.048838    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 28 01:22:29.049026 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:29.049007    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 28 01:22:29.049122 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:29.049007    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 28 01:22:29.049122 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:29.049042    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 28 01:22:29.049122 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:29.049012    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 28 01:22:29.049122 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:29.049094    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wnlt7\""
Jul 28 01:22:29.053980 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:29.053959    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 28 01:22:29.057855 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:29.057836    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55b684c997-2x47v"]
Jul 28 01:22:29.085675 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:29.085647    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:22:29.145696 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:29.145661    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:22:29.147714 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:29.147691    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a4466dc-70e5-4937-850d-5d319ac57e09-console-config\") pod \"console-55b684c997-2x47v\" (UID: \"2a4466dc-70e5-4937-850d-5d319ac57e09\") " pod="openshift-console/console-55b684c997-2x47v"
Jul 28 01:22:29.147809 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:29.147723    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a4466dc-70e5-4937-850d-5d319ac57e09-console-oauth-config\") pod \"console-55b684c997-2x47v\" (UID: \"2a4466dc-70e5-4937-850d-5d319ac57e09\") " pod="openshift-console/console-55b684c997-2x47v"
Jul 28 01:22:29.147809 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:29.147741    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a4466dc-70e5-4937-850d-5d319ac57e09-trusted-ca-bundle\") pod \"console-55b684c997-2x47v\" (UID: \"2a4466dc-70e5-4937-850d-5d319ac57e09\") " pod="openshift-console/console-55b684c997-2x47v"
Jul 28 01:22:29.147809 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:29.147757    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tspzp\" (UniqueName: \"kubernetes.io/projected/2a4466dc-70e5-4937-850d-5d319ac57e09-kube-api-access-tspzp\") pod \"console-55b684c997-2x47v\" (UID: \"2a4466dc-70e5-4937-850d-5d319ac57e09\") " pod="openshift-console/console-55b684c997-2x47v"
Jul 28 01:22:29.147908 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:29.147828    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a4466dc-70e5-4937-850d-5d319ac57e09-service-ca\") pod \"console-55b684c997-2x47v\" (UID: \"2a4466dc-70e5-4937-850d-5d319ac57e09\") " pod="openshift-console/console-55b684c997-2x47v"
Jul 28 01:22:29.147908 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:29.147866    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a4466dc-70e5-4937-850d-5d319ac57e09-console-serving-cert\") pod \"console-55b684c997-2x47v\" (UID: \"2a4466dc-70e5-4937-850d-5d319ac57e09\") " pod="openshift-console/console-55b684c997-2x47v"
Jul 28 01:22:29.147975 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:29.147930    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a4466dc-70e5-4937-850d-5d319ac57e09-oauth-serving-cert\") pod \"console-55b684c997-2x47v\" (UID: \"2a4466dc-70e5-4937-850d-5d319ac57e09\") " pod="openshift-console/console-55b684c997-2x47v"
Jul 28 01:22:29.249021 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:29.248984    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a4466dc-70e5-4937-850d-5d319ac57e09-console-config\") pod \"console-55b684c997-2x47v\" (UID: \"2a4466dc-70e5-4937-850d-5d319ac57e09\") " pod="openshift-console/console-55b684c997-2x47v"
Jul 28 01:22:29.249021 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:29.249022    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a4466dc-70e5-4937-850d-5d319ac57e09-console-oauth-config\") pod \"console-55b684c997-2x47v\" (UID: \"2a4466dc-70e5-4937-850d-5d319ac57e09\") " pod="openshift-console/console-55b684c997-2x47v"
Jul 28 01:22:29.249212 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:29.249043    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a4466dc-70e5-4937-850d-5d319ac57e09-trusted-ca-bundle\") pod \"console-55b684c997-2x47v\" (UID: \"2a4466dc-70e5-4937-850d-5d319ac57e09\") " pod="openshift-console/console-55b684c997-2x47v"
Jul 28 01:22:29.249212 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:29.249067    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tspzp\" (UniqueName: \"kubernetes.io/projected/2a4466dc-70e5-4937-850d-5d319ac57e09-kube-api-access-tspzp\") pod \"console-55b684c997-2x47v\" (UID: \"2a4466dc-70e5-4937-850d-5d319ac57e09\") " pod="openshift-console/console-55b684c997-2x47v"
Jul 28 01:22:29.249212 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:29.249091    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a4466dc-70e5-4937-850d-5d319ac57e09-service-ca\") pod \"console-55b684c997-2x47v\" (UID: \"2a4466dc-70e5-4937-850d-5d319ac57e09\") " pod="openshift-console/console-55b684c997-2x47v"
Jul 28 01:22:29.249212 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:29.249116    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a4466dc-70e5-4937-850d-5d319ac57e09-console-serving-cert\") pod \"console-55b684c997-2x47v\" (UID: \"2a4466dc-70e5-4937-850d-5d319ac57e09\") " pod="openshift-console/console-55b684c997-2x47v"
Jul 28 01:22:29.249212 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:29.249185    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a4466dc-70e5-4937-850d-5d319ac57e09-oauth-serving-cert\") pod \"console-55b684c997-2x47v\" (UID: \"2a4466dc-70e5-4937-850d-5d319ac57e09\") " pod="openshift-console/console-55b684c997-2x47v"
Jul 28 01:22:29.249870 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:29.249842    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a4466dc-70e5-4937-850d-5d319ac57e09-service-ca\") pod \"console-55b684c997-2x47v\" (UID: \"2a4466dc-70e5-4937-850d-5d319ac57e09\") " pod="openshift-console/console-55b684c997-2x47v"
Jul 28 01:22:29.249870 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:29.249854    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a4466dc-70e5-4937-850d-5d319ac57e09-console-config\") pod \"console-55b684c997-2x47v\" (UID: \"2a4466dc-70e5-4937-850d-5d319ac57e09\") " pod="openshift-console/console-55b684c997-2x47v"
Jul 28 01:22:29.250042 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:29.250003    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a4466dc-70e5-4937-850d-5d319ac57e09-oauth-serving-cert\") pod \"console-55b684c997-2x47v\" (UID: \"2a4466dc-70e5-4937-850d-5d319ac57e09\") " pod="openshift-console/console-55b684c997-2x47v"
Jul 28 01:22:29.250126 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:29.250109    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a4466dc-70e5-4937-850d-5d319ac57e09-trusted-ca-bundle\") pod \"console-55b684c997-2x47v\" (UID: \"2a4466dc-70e5-4937-850d-5d319ac57e09\") " pod="openshift-console/console-55b684c997-2x47v"
Jul 28 01:22:29.251563 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:29.251530    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a4466dc-70e5-4937-850d-5d319ac57e09-console-oauth-config\") pod \"console-55b684c997-2x47v\" (UID: \"2a4466dc-70e5-4937-850d-5d319ac57e09\") " pod="openshift-console/console-55b684c997-2x47v"
Jul 28 01:22:29.251707 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:29.251690    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a4466dc-70e5-4937-850d-5d319ac57e09-console-serving-cert\") pod \"console-55b684c997-2x47v\" (UID: \"2a4466dc-70e5-4937-850d-5d319ac57e09\") " pod="openshift-console/console-55b684c997-2x47v"
Jul 28 01:22:29.255876 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:29.255858    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tspzp\" (UniqueName: \"kubernetes.io/projected/2a4466dc-70e5-4937-850d-5d319ac57e09-kube-api-access-tspzp\") pod \"console-55b684c997-2x47v\" (UID: \"2a4466dc-70e5-4937-850d-5d319ac57e09\") " pod="openshift-console/console-55b684c997-2x47v"
Jul 28 01:22:29.357179 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:29.357144    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55b684c997-2x47v"
Jul 28 01:22:29.504577 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:29.504548    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55b684c997-2x47v"]
Jul 28 01:22:29.508168 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:22:29.508143    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a4466dc_70e5_4937_850d_5d319ac57e09.slice/crio-116570d956892be985f72983a0cde881e6fc72ee23db60b66ec50058ac36c2dd WatchSource:0}: Error finding container 116570d956892be985f72983a0cde881e6fc72ee23db60b66ec50058ac36c2dd: Status 404 returned error can't find the container with id 116570d956892be985f72983a0cde881e6fc72ee23db60b66ec50058ac36c2dd
Jul 28 01:22:30.278281 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:30.278239    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55b684c997-2x47v" event={"ID":"2a4466dc-70e5-4937-850d-5d319ac57e09","Type":"ContainerStarted","Data":"fbb00a719a0d7fe6825429106f8bf05f2304cdeed1c029a83d34e0df13090720"}
Jul 28 01:22:30.278659 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:30.278341    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55b684c997-2x47v" event={"ID":"2a4466dc-70e5-4937-850d-5d319ac57e09","Type":"ContainerStarted","Data":"116570d956892be985f72983a0cde881e6fc72ee23db60b66ec50058ac36c2dd"}
Jul 28 01:22:30.295110 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:30.295061    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55b684c997-2x47v" podStartSLOduration=1.295044691 podStartE2EDuration="1.295044691s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:22:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:22:30.293454521 +0000 UTC m=+401.327497913" watchObservedRunningTime="2026-07-28 01:22:30.295044691 +0000 UTC m=+401.329088084"
Jul 28 01:22:32.155646 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:32.155591    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:22:34.190183 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:34.190144    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:22:34.745272 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:34.745235    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:22:35.776416 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:35.776372    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:22:37.234894 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:37.234729    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:22:39.347851 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:39.347800    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:22:39.357495 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:39.357470    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55b684c997-2x47v"
Jul 28 01:22:39.357622 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:39.357511    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55b684c997-2x47v"
Jul 28 01:22:39.362893 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:39.362871    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55b684c997-2x47v"
Jul 28 01:22:40.326817 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:40.326790    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55b684c997-2x47v"
Jul 28 01:22:40.517792 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:40.517753    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:22:40.665278 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:40.665242    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:22:40.771037 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:40.770991    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:22:41.187632 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:41.187600    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:22:42.337606 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:42.337571    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:22:42.390313 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:42.390287    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:22:42.739294 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:42.739263    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:22:42.796844 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:42.796790    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:22:46.542228 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:46.542193    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:22:46.640062 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:46.640012    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:22:47.182460 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:47.182423    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-bk8hr"]
Jul 28 01:22:47.185859 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:47.185836    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bk8hr"
Jul 28 01:22:47.187721 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:47.187698    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xgtzm\""
Jul 28 01:22:47.188114 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:47.188089    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 28 01:22:47.188221 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:47.188121    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 28 01:22:47.188221 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:47.188135    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 28 01:22:47.188532 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:47.188507    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 28 01:22:47.193064 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:47.193041    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-bk8hr"]
Jul 28 01:22:47.239708 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:47.239650    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:22:47.282657 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:47.282619    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn7bs\" (UniqueName: \"kubernetes.io/projected/72d18935-5198-4027-9740-a188149598c1-kube-api-access-fn7bs\") pod \"kuadrant-console-plugin-66b5774985-bk8hr\" (UID: \"72d18935-5198-4027-9740-a188149598c1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bk8hr"
Jul 28 01:22:47.282840 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:47.282676    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/72d18935-5198-4027-9740-a188149598c1-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-bk8hr\" (UID: \"72d18935-5198-4027-9740-a188149598c1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bk8hr"
Jul 28 01:22:47.282840 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:47.282766    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/72d18935-5198-4027-9740-a188149598c1-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-bk8hr\" (UID: \"72d18935-5198-4027-9740-a188149598c1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bk8hr"
Jul 28 01:22:47.383335 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:47.383296    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/72d18935-5198-4027-9740-a188149598c1-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-bk8hr\" (UID: \"72d18935-5198-4027-9740-a188149598c1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bk8hr"
Jul 28 01:22:47.383566 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:47.383402    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn7bs\" (UniqueName: \"kubernetes.io/projected/72d18935-5198-4027-9740-a188149598c1-kube-api-access-fn7bs\") pod \"kuadrant-console-plugin-66b5774985-bk8hr\" (UID: \"72d18935-5198-4027-9740-a188149598c1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bk8hr"
Jul 28 01:22:47.383566 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:47.383452    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/72d18935-5198-4027-9740-a188149598c1-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-bk8hr\" (UID: \"72d18935-5198-4027-9740-a188149598c1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bk8hr"
Jul 28 01:22:47.383680 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:22:47.383574    2560 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 28 01:22:47.383680 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:22:47.383651    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72d18935-5198-4027-9740-a188149598c1-plugin-serving-cert podName:72d18935-5198-4027-9740-a188149598c1 nodeName:}" failed. No retries permitted until 2026-07-28 01:22:47.883626512 +0000 UTC m=+418.917669883 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/72d18935-5198-4027-9740-a188149598c1-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-bk8hr" (UID: "72d18935-5198-4027-9740-a188149598c1") : secret "plugin-serving-cert" not found
Jul 28 01:22:47.384045 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:47.384023    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/72d18935-5198-4027-9740-a188149598c1-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-bk8hr\" (UID: \"72d18935-5198-4027-9740-a188149598c1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bk8hr"
Jul 28 01:22:47.391532 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:47.391507    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn7bs\" (UniqueName: \"kubernetes.io/projected/72d18935-5198-4027-9740-a188149598c1-kube-api-access-fn7bs\") pod \"kuadrant-console-plugin-66b5774985-bk8hr\" (UID: \"72d18935-5198-4027-9740-a188149598c1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bk8hr"
Jul 28 01:22:47.612153 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:47.612108    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:22:47.887421 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:47.887313    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/72d18935-5198-4027-9740-a188149598c1-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-bk8hr\" (UID: \"72d18935-5198-4027-9740-a188149598c1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bk8hr"
Jul 28 01:22:47.889673 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:47.889645    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/72d18935-5198-4027-9740-a188149598c1-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-bk8hr\" (UID: \"72d18935-5198-4027-9740-a188149598c1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bk8hr"
Jul 28 01:22:48.096684 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:48.096647    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bk8hr"
Jul 28 01:22:48.225790 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:48.225766    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-bk8hr"]
Jul 28 01:22:48.228326 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:22:48.228299    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod72d18935_5198_4027_9740_a188149598c1.slice/crio-5f8984b1b2dde9ec84723945e24e4ea71c81b991da08508ccf884b1495edbd8e WatchSource:0}: Error finding container 5f8984b1b2dde9ec84723945e24e4ea71c81b991da08508ccf884b1495edbd8e: Status 404 returned error can't find the container with id 5f8984b1b2dde9ec84723945e24e4ea71c81b991da08508ccf884b1495edbd8e
Jul 28 01:22:48.359644 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:48.359615    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bk8hr" event={"ID":"72d18935-5198-4027-9740-a188149598c1","Type":"ContainerStarted","Data":"5f8984b1b2dde9ec84723945e24e4ea71c81b991da08508ccf884b1495edbd8e"}
Jul 28 01:22:50.440172 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:50.440123    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:22:50.490305 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:50.490273    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:22:57.163606 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:57.163538    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:22:57.270666 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:57.270618    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:22:57.275503 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:57.275481    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-thwdr"]
Jul 28 01:22:57.284006 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:57.283980    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-thwdr"
Jul 28 01:22:57.285981 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:57.285960    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-lxpxk\""
Jul 28 01:22:57.291686 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:57.291619    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-thwdr"]
Jul 28 01:22:57.375148 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:57.375114    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6fkx\" (UniqueName: \"kubernetes.io/projected/ea72be64-3259-4475-821c-7391727a690d-kube-api-access-g6fkx\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-thwdr\" (UID: \"ea72be64-3259-4475-821c-7391727a690d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-thwdr"
Jul 28 01:22:57.375331 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:57.375186    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ea72be64-3259-4475-821c-7391727a690d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-thwdr\" (UID: \"ea72be64-3259-4475-821c-7391727a690d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-thwdr"
Jul 28 01:22:57.475919 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:57.475841    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6fkx\" (UniqueName: \"kubernetes.io/projected/ea72be64-3259-4475-821c-7391727a690d-kube-api-access-g6fkx\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-thwdr\" (UID: \"ea72be64-3259-4475-821c-7391727a690d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-thwdr"
Jul 28 01:22:57.475919 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:57.475894    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ea72be64-3259-4475-821c-7391727a690d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-thwdr\" (UID: \"ea72be64-3259-4475-821c-7391727a690d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-thwdr"
Jul 28 01:22:57.476270 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:57.476247    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ea72be64-3259-4475-821c-7391727a690d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-thwdr\" (UID: \"ea72be64-3259-4475-821c-7391727a690d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-thwdr"
Jul 28 01:22:57.487824 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:57.487783    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6fkx\" (UniqueName: \"kubernetes.io/projected/ea72be64-3259-4475-821c-7391727a690d-kube-api-access-g6fkx\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-thwdr\" (UID: \"ea72be64-3259-4475-821c-7391727a690d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-thwdr"
Jul 28 01:22:57.599741 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:57.599707    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-thwdr"
Jul 28 01:22:57.942301 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:57.942265    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-thwdr"]
Jul 28 01:22:57.953370 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:57.950488    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-thwdr"]
Jul 28 01:22:57.968487 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:57.968450    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cbl72"]
Jul 28 01:22:57.975879 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:57.975851    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cbl72"
Jul 28 01:22:57.995342 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:57.995283    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cbl72"]
Jul 28 01:22:58.082044 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:58.081995    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/023d1ff5-37b1-4969-ae4a-15e37d8eb9fe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-cbl72\" (UID: \"023d1ff5-37b1-4969-ae4a-15e37d8eb9fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cbl72"
Jul 28 01:22:58.082044 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:58.082040    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkxw4\" (UniqueName: \"kubernetes.io/projected/023d1ff5-37b1-4969-ae4a-15e37d8eb9fe-kube-api-access-rkxw4\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-cbl72\" (UID: \"023d1ff5-37b1-4969-ae4a-15e37d8eb9fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cbl72"
Jul 28 01:22:58.182854 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:58.182815    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/023d1ff5-37b1-4969-ae4a-15e37d8eb9fe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-cbl72\" (UID: \"023d1ff5-37b1-4969-ae4a-15e37d8eb9fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cbl72"
Jul 28 01:22:58.183384 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:58.182863    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkxw4\" (UniqueName: \"kubernetes.io/projected/023d1ff5-37b1-4969-ae4a-15e37d8eb9fe-kube-api-access-rkxw4\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-cbl72\" (UID: \"023d1ff5-37b1-4969-ae4a-15e37d8eb9fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cbl72"
Jul 28 01:22:58.183384 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:58.183154    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/023d1ff5-37b1-4969-ae4a-15e37d8eb9fe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-cbl72\" (UID: \"023d1ff5-37b1-4969-ae4a-15e37d8eb9fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cbl72"
Jul 28 01:22:58.194887 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:58.194811    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkxw4\" (UniqueName: \"kubernetes.io/projected/023d1ff5-37b1-4969-ae4a-15e37d8eb9fe-kube-api-access-rkxw4\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-cbl72\" (UID: \"023d1ff5-37b1-4969-ae4a-15e37d8eb9fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cbl72"
Jul 28 01:22:58.293034 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:22:58.292991    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cbl72"
Jul 28 01:23:00.936171 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:00.936128    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:23:01.036473 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:01.036437    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:23:01.142335 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:01.142299    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:23:01.237555 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:01.237475    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:23:01.707517 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:01.707434    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:23:01.807254 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:01.807205    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:23:02.721556 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:02.721518    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:23:02.822400 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:02.822345    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:23:07.838942 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:07.838904    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:23:07.939956 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:07.939913    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:23:11.181701 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:11.181676    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cbl72"]
Jul 28 01:23:11.184077 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:23:11.184047    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod023d1ff5_37b1_4969_ae4a_15e37d8eb9fe.slice/crio-f259b183a6a761bf31a8043e3095d0d46408b0a6c5ee48f203afa2eedec3f7df WatchSource:0}: Error finding container f259b183a6a761bf31a8043e3095d0d46408b0a6c5ee48f203afa2eedec3f7df: Status 404 returned error can't find the container with id f259b183a6a761bf31a8043e3095d0d46408b0a6c5ee48f203afa2eedec3f7df
Jul 28 01:23:11.480995 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:11.480961    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cbl72" event={"ID":"023d1ff5-37b1-4969-ae4a-15e37d8eb9fe","Type":"ContainerStarted","Data":"f259b183a6a761bf31a8043e3095d0d46408b0a6c5ee48f203afa2eedec3f7df"}
Jul 28 01:23:12.487430 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:12.487389    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bk8hr" event={"ID":"72d18935-5198-4027-9740-a188149598c1","Type":"ContainerStarted","Data":"0e35b3901e95ece7e5fb049beac22c5da1dfeb46689176b6676da7f46d294125"}
Jul 28 01:23:12.504957 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:12.504908    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bk8hr" podStartSLOduration=1.943269058 podStartE2EDuration="25.504890219s" totalImagesPullingTime="23.561621161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:22:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:23:12.50318331 +0000 UTC m=+443.537226899" watchObservedRunningTime="2026-07-28 01:23:12.504890219 +0000 UTC m=+443.538933612"
Jul 28 01:23:13.585822 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:23:13.585777    2560 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-thwdr_kuadrant-system_ea72be64-3259-4475-821c-7391727a690d_0(d83562bce9497e26280b1b0037319388fa098298371f67b30731ab4a14917313): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-thwdr to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 28 01:23:13.586089 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:23:13.585847    2560 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-thwdr_kuadrant-system_ea72be64-3259-4475-821c-7391727a690d_0(d83562bce9497e26280b1b0037319388fa098298371f67b30731ab4a14917313): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-thwdr to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-thwdr"
Jul 28 01:23:14.499177 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:14.499136    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-thwdr"
Jul 28 01:23:14.503422 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:23:14.503340    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-thwdr\" is forbidden: User \"system:node:ip-10-0-131-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-213.ec2.internal' and this object" podUID="ea72be64-3259-4475-821c-7391727a690d" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-thwdr"
Jul 28 01:23:14.511636 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:14.511609    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-thwdr"
Jul 28 01:23:14.513259 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:23:14.513232    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-thwdr\" is forbidden: User \"system:node:ip-10-0-131-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-213.ec2.internal' and this object" podUID="ea72be64-3259-4475-821c-7391727a690d" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-thwdr"
Jul 28 01:23:14.632528 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:14.632501    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6fkx\" (UniqueName: \"kubernetes.io/projected/ea72be64-3259-4475-821c-7391727a690d-kube-api-access-g6fkx\") pod \"ea72be64-3259-4475-821c-7391727a690d\" (UID: \"ea72be64-3259-4475-821c-7391727a690d\") "
Jul 28 01:23:14.632976 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:14.632542    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ea72be64-3259-4475-821c-7391727a690d-extensions-socket-volume\") pod \"ea72be64-3259-4475-821c-7391727a690d\" (UID: \"ea72be64-3259-4475-821c-7391727a690d\") "
Jul 28 01:23:14.632976 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:14.632885    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea72be64-3259-4475-821c-7391727a690d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ea72be64-3259-4475-821c-7391727a690d" (UID: "ea72be64-3259-4475-821c-7391727a690d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:23:14.634885 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:14.634849    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea72be64-3259-4475-821c-7391727a690d-kube-api-access-g6fkx" (OuterVolumeSpecName: "kube-api-access-g6fkx") pod "ea72be64-3259-4475-821c-7391727a690d" (UID: "ea72be64-3259-4475-821c-7391727a690d"). InnerVolumeSpecName "kube-api-access-g6fkx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:23:14.733860 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:14.733828    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6fkx\" (UniqueName: \"kubernetes.io/projected/ea72be64-3259-4475-821c-7391727a690d-kube-api-access-g6fkx\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:23:14.733860 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:14.733862    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ea72be64-3259-4475-821c-7391727a690d-extensions-socket-volume\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:23:14.861740 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:14.861679    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:23:14.980963 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:14.980928    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:23:15.460988 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:15.460955    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea72be64-3259-4475-821c-7391727a690d" path="/var/lib/kubelet/pods/ea72be64-3259-4475-821c-7391727a690d/volumes"
Jul 28 01:23:15.504966 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:15.504937    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-thwdr"
Jul 28 01:23:15.506881 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:23:15.506832    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-thwdr\" is forbidden: User \"system:node:ip-10-0-131-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-213.ec2.internal' and this object" podUID="ea72be64-3259-4475-821c-7391727a690d" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-thwdr"
Jul 28 01:23:15.508948 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:23:15.508917    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-thwdr\" is forbidden: User \"system:node:ip-10-0-131-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-213.ec2.internal' and this object" podUID="ea72be64-3259-4475-821c-7391727a690d" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-thwdr"
Jul 28 01:23:16.511597 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:16.511562    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cbl72" event={"ID":"023d1ff5-37b1-4969-ae4a-15e37d8eb9fe","Type":"ContainerStarted","Data":"64ff2c1beddb55c536c8fb3b8c78e983308e8f4a19cfe67f1b58274a651244d8"}
Jul 28 01:23:16.511981 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:16.511671    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cbl72"
Jul 28 01:23:16.513064 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:23:16.513041    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-thwdr\" is forbidden: User \"system:node:ip-10-0-131-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-213.ec2.internal' and this object" podUID="ea72be64-3259-4475-821c-7391727a690d" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-thwdr"
Jul 28 01:23:16.530161 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:16.530111    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cbl72" podStartSLOduration=14.957667733 podStartE2EDuration="19.530090798s" totalImagesPullingTime="4.572423065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:22:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:23:16.528626524 +0000 UTC m=+447.562670175" watchObservedRunningTime="2026-07-28 01:23:16.530090798 +0000 UTC m=+447.564134187"
Jul 28 01:23:18.654709 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:18.654670    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:23:18.755525 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:18.755472    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:23:19.062780 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:19.062676    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:23:19.120697 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:19.120669    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:23:21.657553 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:21.657521    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:23:21.707397 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:21.707345    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:23:27.062893 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:27.062851    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:23:27.126032 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:27.126005    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:23:27.518416 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:27.518389    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cbl72"
Jul 28 01:23:34.465692 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:34.465646    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:23:34.567332 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:34.567295    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:23:39.485761 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:39.485732    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cbl72"]
Jul 28 01:23:39.486162 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:39.485952    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cbl72" podUID="023d1ff5-37b1-4969-ae4a-15e37d8eb9fe" containerName="manager" containerID="cri-o://64ff2c1beddb55c536c8fb3b8c78e983308e8f4a19cfe67f1b58274a651244d8" gracePeriod=10
Jul 28 01:23:39.619760 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:39.619729    2560 generic.go:356] "Generic (PLEG): container finished" podID="023d1ff5-37b1-4969-ae4a-15e37d8eb9fe" containerID="64ff2c1beddb55c536c8fb3b8c78e983308e8f4a19cfe67f1b58274a651244d8" exitCode=0
Jul 28 01:23:39.619916 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:39.619796    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cbl72" event={"ID":"023d1ff5-37b1-4969-ae4a-15e37d8eb9fe","Type":"ContainerDied","Data":"64ff2c1beddb55c536c8fb3b8c78e983308e8f4a19cfe67f1b58274a651244d8"}
Jul 28 01:23:39.742089 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:39.742034    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cbl72"
Jul 28 01:23:39.760117 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:39.760088    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkxw4\" (UniqueName: \"kubernetes.io/projected/023d1ff5-37b1-4969-ae4a-15e37d8eb9fe-kube-api-access-rkxw4\") pod \"023d1ff5-37b1-4969-ae4a-15e37d8eb9fe\" (UID: \"023d1ff5-37b1-4969-ae4a-15e37d8eb9fe\") "
Jul 28 01:23:39.760281 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:39.760125    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/023d1ff5-37b1-4969-ae4a-15e37d8eb9fe-extensions-socket-volume\") pod \"023d1ff5-37b1-4969-ae4a-15e37d8eb9fe\" (UID: \"023d1ff5-37b1-4969-ae4a-15e37d8eb9fe\") "
Jul 28 01:23:39.760746 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:39.760718    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/023d1ff5-37b1-4969-ae4a-15e37d8eb9fe-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "023d1ff5-37b1-4969-ae4a-15e37d8eb9fe" (UID: "023d1ff5-37b1-4969-ae4a-15e37d8eb9fe"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:23:39.762649 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:39.762620    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/023d1ff5-37b1-4969-ae4a-15e37d8eb9fe-kube-api-access-rkxw4" (OuterVolumeSpecName: "kube-api-access-rkxw4") pod "023d1ff5-37b1-4969-ae4a-15e37d8eb9fe" (UID: "023d1ff5-37b1-4969-ae4a-15e37d8eb9fe"). InnerVolumeSpecName "kube-api-access-rkxw4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:23:39.860870 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:39.860834    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkxw4\" (UniqueName: \"kubernetes.io/projected/023d1ff5-37b1-4969-ae4a-15e37d8eb9fe-kube-api-access-rkxw4\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:23:39.860870 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:39.860867    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/023d1ff5-37b1-4969-ae4a-15e37d8eb9fe-extensions-socket-volume\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:23:40.032076 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:40.031990    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:23:40.135074 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:40.135035    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:23:40.625462 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:40.625429    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cbl72"
Jul 28 01:23:40.625462 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:40.625443    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cbl72" event={"ID":"023d1ff5-37b1-4969-ae4a-15e37d8eb9fe","Type":"ContainerDied","Data":"f259b183a6a761bf31a8043e3095d0d46408b0a6c5ee48f203afa2eedec3f7df"}
Jul 28 01:23:40.625919 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:40.625509    2560 scope.go:117] "RemoveContainer" containerID="64ff2c1beddb55c536c8fb3b8c78e983308e8f4a19cfe67f1b58274a651244d8"
Jul 28 01:23:40.646130 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:40.646101    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cbl72"]
Jul 28 01:23:40.651782 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:40.651760    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cbl72"]
Jul 28 01:23:41.461179 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:41.461147    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="023d1ff5-37b1-4969-ae4a-15e37d8eb9fe" path="/var/lib/kubelet/pods/023d1ff5-37b1-4969-ae4a-15e37d8eb9fe/volumes"
Jul 28 01:23:43.986307 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:43.986273    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:23:44.143178 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:44.143148    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:23:49.583189 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:49.583159    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:23:49.680724 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:49.680635    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:23:49.732369 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:49.732330    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:23:49.906479 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:49.906448    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:23:49.906803 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:49.906789    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="023d1ff5-37b1-4969-ae4a-15e37d8eb9fe" containerName="manager"
Jul 28 01:23:49.906855 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:49.906804    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="023d1ff5-37b1-4969-ae4a-15e37d8eb9fe" containerName="manager"
Jul 28 01:23:49.906893 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:49.906862    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="023d1ff5-37b1-4969-ae4a-15e37d8eb9fe" containerName="manager"
Jul 28 01:23:50.107806 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:50.107773    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:23:50.107960 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:50.107816    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:23:50.107960 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:50.107892    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"
Jul 28 01:23:50.110184 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:50.110166    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 28 01:23:50.145933 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:50.145911    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4q9x\" (UniqueName: \"kubernetes.io/projected/6b897c57-2c1f-4d64-986f-d9a5131d2a96-kube-api-access-w4q9x\") pod \"limitador-limitador-54d6d988d5-pbnq6\" (UID: \"6b897c57-2c1f-4d64-986f-d9a5131d2a96\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"
Jul 28 01:23:50.146059 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:50.145986    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6b897c57-2c1f-4d64-986f-d9a5131d2a96-config-file\") pod \"limitador-limitador-54d6d988d5-pbnq6\" (UID: \"6b897c57-2c1f-4d64-986f-d9a5131d2a96\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"
Jul 28 01:23:50.246838 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:50.246806    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6b897c57-2c1f-4d64-986f-d9a5131d2a96-config-file\") pod \"limitador-limitador-54d6d988d5-pbnq6\" (UID: \"6b897c57-2c1f-4d64-986f-d9a5131d2a96\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"
Jul 28 01:23:50.246973 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:50.246868    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4q9x\" (UniqueName: \"kubernetes.io/projected/6b897c57-2c1f-4d64-986f-d9a5131d2a96-kube-api-access-w4q9x\") pod \"limitador-limitador-54d6d988d5-pbnq6\" (UID: \"6b897c57-2c1f-4d64-986f-d9a5131d2a96\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"
Jul 28 01:23:50.247419 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:50.247399    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6b897c57-2c1f-4d64-986f-d9a5131d2a96-config-file\") pod \"limitador-limitador-54d6d988d5-pbnq6\" (UID: \"6b897c57-2c1f-4d64-986f-d9a5131d2a96\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"
Jul 28 01:23:50.254430 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:50.254408    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4q9x\" (UniqueName: \"kubernetes.io/projected/6b897c57-2c1f-4d64-986f-d9a5131d2a96-kube-api-access-w4q9x\") pod \"limitador-limitador-54d6d988d5-pbnq6\" (UID: \"6b897c57-2c1f-4d64-986f-d9a5131d2a96\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"
Jul 28 01:23:50.398863 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:50.398783    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:23:50.418048 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:50.418022    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"
Jul 28 01:23:50.454702 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:50.454671    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:23:50.490135 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:50.490104    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-sqck2"]
Jul 28 01:23:50.494040 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:50.494018    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-sqck2"
Jul 28 01:23:50.495896 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:50.495875    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dmvq8\""
Jul 28 01:23:50.499586 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:50.499563    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-sqck2"]
Jul 28 01:23:50.549813 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:50.549743    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dc86\" (UniqueName: \"kubernetes.io/projected/70cad0dd-6c34-4939-91b0-1ed1fa795d56-kube-api-access-7dc86\") pod \"authorino-75d556bd77-sqck2\" (UID: \"70cad0dd-6c34-4939-91b0-1ed1fa795d56\") " pod="kuadrant-system/authorino-75d556bd77-sqck2"
Jul 28 01:23:50.550645 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:50.550625    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:23:50.552419 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:23:50.552396    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b897c57_2c1f_4d64_986f_d9a5131d2a96.slice/crio-178e2d3fcae3ac72d0aa6758660dfad5042216166bba808d7506b2d24622addf WatchSource:0}: Error finding container 178e2d3fcae3ac72d0aa6758660dfad5042216166bba808d7506b2d24622addf: Status 404 returned error can't find the container with id 178e2d3fcae3ac72d0aa6758660dfad5042216166bba808d7506b2d24622addf
Jul 28 01:23:50.651247 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:50.651162    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dc86\" (UniqueName: \"kubernetes.io/projected/70cad0dd-6c34-4939-91b0-1ed1fa795d56-kube-api-access-7dc86\") pod \"authorino-75d556bd77-sqck2\" (UID: \"70cad0dd-6c34-4939-91b0-1ed1fa795d56\") " pod="kuadrant-system/authorino-75d556bd77-sqck2"
Jul 28 01:23:50.658116 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:50.658087    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dc86\" (UniqueName: \"kubernetes.io/projected/70cad0dd-6c34-4939-91b0-1ed1fa795d56-kube-api-access-7dc86\") pod \"authorino-75d556bd77-sqck2\" (UID: \"70cad0dd-6c34-4939-91b0-1ed1fa795d56\") " pod="kuadrant-system/authorino-75d556bd77-sqck2"
Jul 28 01:23:50.679385 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:50.679338    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-pbnq6" event={"ID":"6b897c57-2c1f-4d64-986f-d9a5131d2a96","Type":"ContainerStarted","Data":"178e2d3fcae3ac72d0aa6758660dfad5042216166bba808d7506b2d24622addf"}
Jul 28 01:23:50.805718 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:50.805686    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-sqck2"
Jul 28 01:23:50.934022 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:50.933925    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-sqck2"]
Jul 28 01:23:50.935739 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:23:50.935710    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod70cad0dd_6c34_4939_91b0_1ed1fa795d56.slice/crio-a6bafa2c1eb6297dec6596185f1312b61b495a1dd097275502441bb0fb3d505f WatchSource:0}: Error finding container a6bafa2c1eb6297dec6596185f1312b61b495a1dd097275502441bb0fb3d505f: Status 404 returned error can't find the container with id a6bafa2c1eb6297dec6596185f1312b61b495a1dd097275502441bb0fb3d505f
Jul 28 01:23:51.687755 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:51.687707    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-sqck2" event={"ID":"70cad0dd-6c34-4939-91b0-1ed1fa795d56","Type":"ContainerStarted","Data":"a6bafa2c1eb6297dec6596185f1312b61b495a1dd097275502441bb0fb3d505f"}
Jul 28 01:23:55.714230 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:55.714184    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-pbnq6" event={"ID":"6b897c57-2c1f-4d64-986f-d9a5131d2a96","Type":"ContainerStarted","Data":"558c1987d361178452dfe23855b6680b740cb63a6480cc62f0b3811fd2d1cc60"}
Jul 28 01:23:55.714678 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:55.714254    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"
Jul 28 01:23:55.715604 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:55.715578    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-sqck2" event={"ID":"70cad0dd-6c34-4939-91b0-1ed1fa795d56","Type":"ContainerStarted","Data":"244b7f9e6cda04d6a844fca59bd500f20c6dcd5d1c91ca4d7db5f5845363f9d7"}
Jul 28 01:23:55.729782 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:55.729737    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-pbnq6" podStartSLOduration=2.481942987 podStartE2EDuration="6.72972221s" totalImagesPullingTime="4.247779223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:23:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:23:55.727572033 +0000 UTC m=+486.761615426" watchObservedRunningTime="2026-07-28 01:23:55.72972221 +0000 UTC m=+486.763765637"
Jul 28 01:23:55.742058 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:23:55.742018    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-sqck2" podStartSLOduration=1.914806908 podStartE2EDuration="5.742004544s" totalImagesPullingTime="3.827197636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:23:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:23:55.740739798 +0000 UTC m=+486.774783205" watchObservedRunningTime="2026-07-28 01:23:55.742004544 +0000 UTC m=+486.776047970"
Jul 28 01:24:06.721279 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:24:06.721248    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"
Jul 28 01:24:10.788427 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:24:10.788387    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:24:10.888415 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:24:10.888346    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:24:11.293207 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:24:11.293164    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:24:23.028154 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:24:23.028106    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:24:23.248055 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:24:23.248018    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:24:24.775483 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:24:24.775450    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-sqck2"]
Jul 28 01:24:24.775848 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:24:24.775634    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-sqck2" podUID="70cad0dd-6c34-4939-91b0-1ed1fa795d56" containerName="authorino" containerID="cri-o://244b7f9e6cda04d6a844fca59bd500f20c6dcd5d1c91ca4d7db5f5845363f9d7" gracePeriod=30
Jul 28 01:24:25.017513 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:24:25.017486    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-sqck2"
Jul 28 01:24:25.056692 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:24:25.056616    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7dc86\" (UniqueName: \"kubernetes.io/projected/70cad0dd-6c34-4939-91b0-1ed1fa795d56-kube-api-access-7dc86\") pod \"70cad0dd-6c34-4939-91b0-1ed1fa795d56\" (UID: \"70cad0dd-6c34-4939-91b0-1ed1fa795d56\") "
Jul 28 01:24:25.058657 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:24:25.058626    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70cad0dd-6c34-4939-91b0-1ed1fa795d56-kube-api-access-7dc86" (OuterVolumeSpecName: "kube-api-access-7dc86") pod "70cad0dd-6c34-4939-91b0-1ed1fa795d56" (UID: "70cad0dd-6c34-4939-91b0-1ed1fa795d56"). InnerVolumeSpecName "kube-api-access-7dc86". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:24:25.157509 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:24:25.157475    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dc86\" (UniqueName: \"kubernetes.io/projected/70cad0dd-6c34-4939-91b0-1ed1fa795d56-kube-api-access-7dc86\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:24:25.853388 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:24:25.853275    2560 generic.go:356] "Generic (PLEG): container finished" podID="70cad0dd-6c34-4939-91b0-1ed1fa795d56" containerID="244b7f9e6cda04d6a844fca59bd500f20c6dcd5d1c91ca4d7db5f5845363f9d7" exitCode=0
Jul 28 01:24:25.853388 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:24:25.853375    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-sqck2"
Jul 28 01:24:25.853848 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:24:25.853382    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-sqck2" event={"ID":"70cad0dd-6c34-4939-91b0-1ed1fa795d56","Type":"ContainerDied","Data":"244b7f9e6cda04d6a844fca59bd500f20c6dcd5d1c91ca4d7db5f5845363f9d7"}
Jul 28 01:24:25.853848 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:24:25.853435    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-sqck2" event={"ID":"70cad0dd-6c34-4939-91b0-1ed1fa795d56","Type":"ContainerDied","Data":"a6bafa2c1eb6297dec6596185f1312b61b495a1dd097275502441bb0fb3d505f"}
Jul 28 01:24:25.853848 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:24:25.853456    2560 scope.go:117] "RemoveContainer" containerID="244b7f9e6cda04d6a844fca59bd500f20c6dcd5d1c91ca4d7db5f5845363f9d7"
Jul 28 01:24:25.861917 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:24:25.861897    2560 scope.go:117] "RemoveContainer" containerID="244b7f9e6cda04d6a844fca59bd500f20c6dcd5d1c91ca4d7db5f5845363f9d7"
Jul 28 01:24:25.862191 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:24:25.862169    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"244b7f9e6cda04d6a844fca59bd500f20c6dcd5d1c91ca4d7db5f5845363f9d7\": container with ID starting with 244b7f9e6cda04d6a844fca59bd500f20c6dcd5d1c91ca4d7db5f5845363f9d7 not found: ID does not exist" containerID="244b7f9e6cda04d6a844fca59bd500f20c6dcd5d1c91ca4d7db5f5845363f9d7"
Jul 28 01:24:25.862260 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:24:25.862198    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"244b7f9e6cda04d6a844fca59bd500f20c6dcd5d1c91ca4d7db5f5845363f9d7"} err="failed to get container status \"244b7f9e6cda04d6a844fca59bd500f20c6dcd5d1c91ca4d7db5f5845363f9d7\": rpc error: code = NotFound desc = could not find container \"244b7f9e6cda04d6a844fca59bd500f20c6dcd5d1c91ca4d7db5f5845363f9d7\": container with ID starting with 244b7f9e6cda04d6a844fca59bd500f20c6dcd5d1c91ca4d7db5f5845363f9d7 not found: ID does not exist"
Jul 28 01:24:25.868105 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:24:25.868080    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-sqck2"]
Jul 28 01:24:25.871225 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:24:25.871206    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-sqck2"]
Jul 28 01:24:27.460466 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:24:27.460390    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70cad0dd-6c34-4939-91b0-1ed1fa795d56" path="/var/lib/kubelet/pods/70cad0dd-6c34-4939-91b0-1ed1fa795d56/volumes"
Jul 28 01:24:29.397374 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:24:29.397323    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:24:29.525680 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:24:29.525648    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:24:29.626168 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:24:29.626122    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:24:29.720601 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:24:29.720514    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:24:32.785314 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:24:32.785275    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:24:32.884755 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:24:32.884717    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:24:34.021732 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:24:34.021699    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:24:39.861419 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:24:39.861386    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:24:39.908738 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:24:39.908708    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:25:01.867817 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:01.867775    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:25:01.968972 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:01.968932    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:25:02.437850 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:02.437814    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:25:02.676342 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:02.676302    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:25:03.071894 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:03.071857    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:25:03.166942 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:03.166910    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:25:03.195703 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:03.195654    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-npbcz"]
Jul 28 01:25:03.196094 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:03.196077    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70cad0dd-6c34-4939-91b0-1ed1fa795d56" containerName="authorino"
Jul 28 01:25:03.196184 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:03.196097    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="70cad0dd-6c34-4939-91b0-1ed1fa795d56" containerName="authorino"
Jul 28 01:25:03.196235 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:03.196201    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="70cad0dd-6c34-4939-91b0-1ed1fa795d56" containerName="authorino"
Jul 28 01:25:03.198753 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:03.198727    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-npbcz"
Jul 28 01:25:03.200803 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:03.200783    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 28 01:25:03.200910 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:03.200786    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-hxvwj\""
Jul 28 01:25:03.208130 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:03.208108    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-npbcz"]
Jul 28 01:25:03.292741 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:03.292706    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d87f77ac-c168-4475-a294-e7e43ec47f36-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-npbcz\" (UID: \"d87f77ac-c168-4475-a294-e7e43ec47f36\") " pod="openshift-ingress/payload-processing-5cc6cd444b-npbcz"
Jul 28 01:25:03.292892 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:03.292760    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d4pt\" (UniqueName: \"kubernetes.io/projected/d87f77ac-c168-4475-a294-e7e43ec47f36-kube-api-access-5d4pt\") pod \"payload-processing-5cc6cd444b-npbcz\" (UID: \"d87f77ac-c168-4475-a294-e7e43ec47f36\") " pod="openshift-ingress/payload-processing-5cc6cd444b-npbcz"
Jul 28 01:25:03.393672 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:03.393637    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5d4pt\" (UniqueName: \"kubernetes.io/projected/d87f77ac-c168-4475-a294-e7e43ec47f36-kube-api-access-5d4pt\") pod \"payload-processing-5cc6cd444b-npbcz\" (UID: \"d87f77ac-c168-4475-a294-e7e43ec47f36\") " pod="openshift-ingress/payload-processing-5cc6cd444b-npbcz"
Jul 28 01:25:03.393838 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:03.393749    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d87f77ac-c168-4475-a294-e7e43ec47f36-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-npbcz\" (UID: \"d87f77ac-c168-4475-a294-e7e43ec47f36\") " pod="openshift-ingress/payload-processing-5cc6cd444b-npbcz"
Jul 28 01:25:03.394405 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:03.394388    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d87f77ac-c168-4475-a294-e7e43ec47f36-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-npbcz\" (UID: \"d87f77ac-c168-4475-a294-e7e43ec47f36\") " pod="openshift-ingress/payload-processing-5cc6cd444b-npbcz"
Jul 28 01:25:03.401274 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:03.401253    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:25:03.405056 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:03.405028    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d4pt\" (UniqueName: \"kubernetes.io/projected/d87f77ac-c168-4475-a294-e7e43ec47f36-kube-api-access-5d4pt\") pod \"payload-processing-5cc6cd444b-npbcz\" (UID: \"d87f77ac-c168-4475-a294-e7e43ec47f36\") " pod="openshift-ingress/payload-processing-5cc6cd444b-npbcz"
Jul 28 01:25:03.509248 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:03.509218    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-npbcz"
Jul 28 01:25:03.633872 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:03.633748    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-npbcz"]
Jul 28 01:25:03.636213 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:25:03.636181    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd87f77ac_c168_4475_a294_e7e43ec47f36.slice/crio-5f4844afb95c49595486e553f78d2857ea74549eae138c052826d7d89c478735 WatchSource:0}: Error finding container 5f4844afb95c49595486e553f78d2857ea74549eae138c052826d7d89c478735: Status 404 returned error can't find the container with id 5f4844afb95c49595486e553f78d2857ea74549eae138c052826d7d89c478735
Jul 28 01:25:04.022693 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:04.022649    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-npbcz" event={"ID":"d87f77ac-c168-4475-a294-e7e43ec47f36","Type":"ContainerStarted","Data":"5f4844afb95c49595486e553f78d2857ea74549eae138c052826d7d89c478735"}
Jul 28 01:25:04.958553 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:04.958519    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:25:06.033301 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:06.033269    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-npbcz" event={"ID":"d87f77ac-c168-4475-a294-e7e43ec47f36","Type":"ContainerStarted","Data":"ee3ac34526224ff032f2d69652c96df71db2866032022f9e5602b938b7cc74f3"}
Jul 28 01:25:06.033676 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:06.033395    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-npbcz"
Jul 28 01:25:06.052580 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:06.052537    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-npbcz" podStartSLOduration=1.653166652 podStartE2EDuration="3.052522047s" totalImagesPullingTime="1.399355395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:25:06.050906807 +0000 UTC m=+557.084950199" watchObservedRunningTime="2026-07-28 01:25:06.052522047 +0000 UTC m=+557.086565459"
Jul 28 01:25:07.816579 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:07.816543    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:25:07.918680 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:07.918633    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:25:14.003428 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:14.003393    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:25:14.102457 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:14.102427    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:25:17.040546 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:17.040511    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-npbcz"
Jul 28 01:25:21.137574 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:21.137538    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:25:49.388228 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:49.388200    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5f2zn_5311b0bc-9ad2-4e2f-bdde-81510c6d6b19/ovn-acl-logging/0.log"
Jul 28 01:25:49.389928 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:49.389902    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5f2zn_5311b0bc-9ad2-4e2f-bdde-81510c6d6b19/ovn-acl-logging/0.log"
Jul 28 01:25:51.004584 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:51.004518    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:25:51.480639 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:51.480603    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:25:55.866760 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:55.866727    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-4gsrl"]
Jul 28 01:25:55.869067 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:55.869052    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4gsrl"
Jul 28 01:25:55.871148 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:55.871129    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 28 01:25:55.871242 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:55.871135    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 28 01:25:55.871734 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:55.871714    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 28 01:25:55.871849 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:55.871748    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-rtwcb\""
Jul 28 01:25:55.880549 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:55.880528    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-4gsrl"]
Jul 28 01:25:55.945497 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:55.945465    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/373f5530-d48a-4a5d-8961-c3ddccd2d559-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4gsrl\" (UID: \"373f5530-d48a-4a5d-8961-c3ddccd2d559\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4gsrl"
Jul 28 01:25:55.945497 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:55.945496    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxxmn\" (UniqueName: \"kubernetes.io/projected/373f5530-d48a-4a5d-8961-c3ddccd2d559-kube-api-access-pxxmn\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4gsrl\" (UID: \"373f5530-d48a-4a5d-8961-c3ddccd2d559\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4gsrl"
Jul 28 01:25:55.945696 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:55.945543    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/373f5530-d48a-4a5d-8961-c3ddccd2d559-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4gsrl\" (UID: \"373f5530-d48a-4a5d-8961-c3ddccd2d559\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4gsrl"
Jul 28 01:25:55.945696 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:55.945559    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/373f5530-d48a-4a5d-8961-c3ddccd2d559-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4gsrl\" (UID: \"373f5530-d48a-4a5d-8961-c3ddccd2d559\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4gsrl"
Jul 28 01:25:55.945696 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:55.945584    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/373f5530-d48a-4a5d-8961-c3ddccd2d559-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4gsrl\" (UID: \"373f5530-d48a-4a5d-8961-c3ddccd2d559\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4gsrl"
Jul 28 01:25:55.945823 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:55.945691    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/373f5530-d48a-4a5d-8961-c3ddccd2d559-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4gsrl\" (UID: \"373f5530-d48a-4a5d-8961-c3ddccd2d559\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4gsrl"
Jul 28 01:25:55.994126 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:55.994090    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:25:56.046157 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:56.046128    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/373f5530-d48a-4a5d-8961-c3ddccd2d559-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4gsrl\" (UID: \"373f5530-d48a-4a5d-8961-c3ddccd2d559\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4gsrl"
Jul 28 01:25:56.046157 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:56.046157    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxxmn\" (UniqueName: \"kubernetes.io/projected/373f5530-d48a-4a5d-8961-c3ddccd2d559-kube-api-access-pxxmn\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4gsrl\" (UID: \"373f5530-d48a-4a5d-8961-c3ddccd2d559\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4gsrl"
Jul 28 01:25:56.046361 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:56.046201    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/373f5530-d48a-4a5d-8961-c3ddccd2d559-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4gsrl\" (UID: \"373f5530-d48a-4a5d-8961-c3ddccd2d559\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4gsrl"
Jul 28 01:25:56.046361 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:56.046217    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/373f5530-d48a-4a5d-8961-c3ddccd2d559-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4gsrl\" (UID: \"373f5530-d48a-4a5d-8961-c3ddccd2d559\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4gsrl"
Jul 28 01:25:56.046469 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:56.046384    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/373f5530-d48a-4a5d-8961-c3ddccd2d559-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4gsrl\" (UID: \"373f5530-d48a-4a5d-8961-c3ddccd2d559\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4gsrl"
Jul 28 01:25:56.046539 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:56.046485    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/373f5530-d48a-4a5d-8961-c3ddccd2d559-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4gsrl\" (UID: \"373f5530-d48a-4a5d-8961-c3ddccd2d559\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4gsrl"
Jul 28 01:25:56.046669 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:56.046645    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/373f5530-d48a-4a5d-8961-c3ddccd2d559-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4gsrl\" (UID: \"373f5530-d48a-4a5d-8961-c3ddccd2d559\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4gsrl"
Jul 28 01:25:56.046778 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:56.046675    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/373f5530-d48a-4a5d-8961-c3ddccd2d559-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4gsrl\" (UID: \"373f5530-d48a-4a5d-8961-c3ddccd2d559\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4gsrl"
Jul 28 01:25:56.046778 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:56.046719    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/373f5530-d48a-4a5d-8961-c3ddccd2d559-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4gsrl\" (UID: \"373f5530-d48a-4a5d-8961-c3ddccd2d559\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4gsrl"
Jul 28 01:25:56.048377 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:56.048331    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/373f5530-d48a-4a5d-8961-c3ddccd2d559-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4gsrl\" (UID: \"373f5530-d48a-4a5d-8961-c3ddccd2d559\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4gsrl"
Jul 28 01:25:56.048746 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:56.048724    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/373f5530-d48a-4a5d-8961-c3ddccd2d559-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4gsrl\" (UID: \"373f5530-d48a-4a5d-8961-c3ddccd2d559\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4gsrl"
Jul 28 01:25:56.053574 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:56.053550    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxxmn\" (UniqueName: \"kubernetes.io/projected/373f5530-d48a-4a5d-8961-c3ddccd2d559-kube-api-access-pxxmn\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4gsrl\" (UID: \"373f5530-d48a-4a5d-8961-c3ddccd2d559\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4gsrl"
Jul 28 01:25:56.179403 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:56.179309    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4gsrl"
Jul 28 01:25:56.303502 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:56.303473    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-4gsrl"]
Jul 28 01:25:56.306696 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:25:56.306664    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod373f5530_d48a_4a5d_8961_c3ddccd2d559.slice/crio-17533a754fe9059dbc167b1b6ee20264d013823d60dddda7748212b9f5619dab WatchSource:0}: Error finding container 17533a754fe9059dbc167b1b6ee20264d013823d60dddda7748212b9f5619dab: Status 404 returned error can't find the container with id 17533a754fe9059dbc167b1b6ee20264d013823d60dddda7748212b9f5619dab
Jul 28 01:25:56.308026 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:56.308010    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 01:25:56.681121 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:56.681089    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:25:57.280904 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:57.280868    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4gsrl" event={"ID":"373f5530-d48a-4a5d-8961-c3ddccd2d559","Type":"ContainerStarted","Data":"17533a754fe9059dbc167b1b6ee20264d013823d60dddda7748212b9f5619dab"}
Jul 28 01:25:58.286838 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:58.286802    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4gsrl" event={"ID":"373f5530-d48a-4a5d-8961-c3ddccd2d559","Type":"ContainerStarted","Data":"a185f579335839d3892c8a9d36f791917311f08f2e43b469592e6b38177db146"}
Jul 28 01:25:58.303050 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:25:58.303003    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4gsrl" podStartSLOduration=2.325567856 podStartE2EDuration="3.302987969s" totalImagesPullingTime="977.420113ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:25:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:25:58.301901243 +0000 UTC m=+609.335944635" watchObservedRunningTime="2026-07-28 01:25:58.302987969 +0000 UTC m=+609.337031394"
Jul 28 01:26:03.591399 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:26:03.591347    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:26:04.690865 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:26:04.690820    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:26:06.179912 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:26:06.179868    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4gsrl"
Jul 28 01:26:06.180307 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:26:06.179948    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4gsrl"
Jul 28 01:26:06.192766 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:26:06.192739    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4gsrl"
Jul 28 01:26:06.333290 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:26:06.333258    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4gsrl"
Jul 28 01:26:22.481062 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:26:22.480988    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:26:23.986128 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:26:23.986090    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:26:48.994241 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:26:48.994208    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:26:51.090567 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:26:51.090529    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:27:02.992007 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:27:02.991967    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf"]
Jul 28 01:27:02.995534 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:27:02.995518    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf"
Jul 28 01:27:02.997549 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:27:02.997526    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 28 01:27:03.003261 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:27:03.003238    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf"]
Jul 28 01:27:03.032518 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:27:03.032487    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:27:03.159665 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:27:03.159623    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55e57455-0c67-4b50-aeca-83acd5ebe77f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf\" (UID: \"55e57455-0c67-4b50-aeca-83acd5ebe77f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf"
Jul 28 01:27:03.159846 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:27:03.159670    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78vhz\" (UniqueName: \"kubernetes.io/projected/55e57455-0c67-4b50-aeca-83acd5ebe77f-kube-api-access-78vhz\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf\" (UID: \"55e57455-0c67-4b50-aeca-83acd5ebe77f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf"
Jul 28 01:27:03.159846 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:27:03.159777    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55e57455-0c67-4b50-aeca-83acd5ebe77f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf\" (UID: \"55e57455-0c67-4b50-aeca-83acd5ebe77f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf"
Jul 28 01:27:03.159846 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:27:03.159803    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55e57455-0c67-4b50-aeca-83acd5ebe77f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf\" (UID: \"55e57455-0c67-4b50-aeca-83acd5ebe77f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf"
Jul 28 01:27:03.159962 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:27:03.159851    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55e57455-0c67-4b50-aeca-83acd5ebe77f-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf\" (UID: \"55e57455-0c67-4b50-aeca-83acd5ebe77f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf"
Jul 28 01:27:03.159962 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:27:03.159886    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55e57455-0c67-4b50-aeca-83acd5ebe77f-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf\" (UID: \"55e57455-0c67-4b50-aeca-83acd5ebe77f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf"
Jul 28 01:27:03.260481 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:27:03.260398    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55e57455-0c67-4b50-aeca-83acd5ebe77f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf\" (UID: \"55e57455-0c67-4b50-aeca-83acd5ebe77f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf"
Jul 28 01:27:03.260481 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:27:03.260435    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55e57455-0c67-4b50-aeca-83acd5ebe77f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf\" (UID: \"55e57455-0c67-4b50-aeca-83acd5ebe77f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf"
Jul 28 01:27:03.260481 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:27:03.260478    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55e57455-0c67-4b50-aeca-83acd5ebe77f-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf\" (UID: \"55e57455-0c67-4b50-aeca-83acd5ebe77f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf"
Jul 28 01:27:03.260748 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:27:03.260501    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55e57455-0c67-4b50-aeca-83acd5ebe77f-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf\" (UID: \"55e57455-0c67-4b50-aeca-83acd5ebe77f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf"
Jul 28 01:27:03.260748 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:27:03.260560    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55e57455-0c67-4b50-aeca-83acd5ebe77f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf\" (UID: \"55e57455-0c67-4b50-aeca-83acd5ebe77f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf"
Jul 28 01:27:03.260748 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:27:03.260588    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78vhz\" (UniqueName: \"kubernetes.io/projected/55e57455-0c67-4b50-aeca-83acd5ebe77f-kube-api-access-78vhz\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf\" (UID: \"55e57455-0c67-4b50-aeca-83acd5ebe77f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf"
Jul 28 01:27:03.260908 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:27:03.260840    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55e57455-0c67-4b50-aeca-83acd5ebe77f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf\" (UID: \"55e57455-0c67-4b50-aeca-83acd5ebe77f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf"
Jul 28 01:27:03.260908 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:27:03.260892    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55e57455-0c67-4b50-aeca-83acd5ebe77f-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf\" (UID: \"55e57455-0c67-4b50-aeca-83acd5ebe77f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf"
Jul 28 01:27:03.260908 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:27:03.260903    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55e57455-0c67-4b50-aeca-83acd5ebe77f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf\" (UID: \"55e57455-0c67-4b50-aeca-83acd5ebe77f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf"
Jul 28 01:27:03.262817 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:27:03.262793    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55e57455-0c67-4b50-aeca-83acd5ebe77f-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf\" (UID: \"55e57455-0c67-4b50-aeca-83acd5ebe77f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf"
Jul 28 01:27:03.263074 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:27:03.263058    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55e57455-0c67-4b50-aeca-83acd5ebe77f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf\" (UID: \"55e57455-0c67-4b50-aeca-83acd5ebe77f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf"
Jul 28 01:27:03.267415 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:27:03.267392    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78vhz\" (UniqueName: \"kubernetes.io/projected/55e57455-0c67-4b50-aeca-83acd5ebe77f-kube-api-access-78vhz\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf\" (UID: \"55e57455-0c67-4b50-aeca-83acd5ebe77f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf"
Jul 28 01:27:03.305571 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:27:03.305549    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf"
Jul 28 01:27:03.434825 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:27:03.434799    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf"]
Jul 28 01:27:03.436557 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:27:03.436530    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod55e57455_0c67_4b50_aeca_83acd5ebe77f.slice/crio-0ec41a2dd036e80bbe491be826e152943d7b18704cae68c877806b7619a32d87 WatchSource:0}: Error finding container 0ec41a2dd036e80bbe491be826e152943d7b18704cae68c877806b7619a32d87: Status 404 returned error can't find the container with id 0ec41a2dd036e80bbe491be826e152943d7b18704cae68c877806b7619a32d87
Jul 28 01:27:03.586180 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:27:03.586098    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf" event={"ID":"55e57455-0c67-4b50-aeca-83acd5ebe77f","Type":"ContainerStarted","Data":"0ec41a2dd036e80bbe491be826e152943d7b18704cae68c877806b7619a32d87"}
Jul 28 01:27:04.592296 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:27:04.592262    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf" event={"ID":"55e57455-0c67-4b50-aeca-83acd5ebe77f","Type":"ContainerStarted","Data":"36887b6d60c2c8799ce3592f50b957be60ccb1ad2ea916a6ff3c96ce21a767c9"}
Jul 28 01:27:04.607886 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:27:04.607835    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf" podStartSLOduration=2.435532823 podStartE2EDuration="2.607815257s" totalImagesPullingTime="172.282434ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:27:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:27:04.606973713 +0000 UTC m=+675.641017105" watchObservedRunningTime="2026-07-28 01:27:04.607815257 +0000 UTC m=+675.641858654"
Jul 28 01:27:05.085955 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:27:05.085916    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:27:13.306381 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:27:13.306333    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf"
Jul 28 01:27:13.306843 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:27:13.306405    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf"
Jul 28 01:27:13.318879 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:27:13.318855    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf"
Jul 28 01:27:13.644888 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:27:13.644860    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf"
Jul 28 01:28:00.632579 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:28:00.632502    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6685467ff7-xh25m"]
Jul 28 01:28:00.635925 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:28:00.635908    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6685467ff7-xh25m"
Jul 28 01:28:00.638098 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:28:00.638065    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 28 01:28:00.638415 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:28:00.638397    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dmvq8\""
Jul 28 01:28:00.643498 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:28:00.643478    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6685467ff7-xh25m"]
Jul 28 01:28:00.691801 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:28:00.691759    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl458\" (UniqueName: \"kubernetes.io/projected/ae2203b8-0a0c-48f2-a975-4a275fc2a061-kube-api-access-bl458\") pod \"authorino-6685467ff7-xh25m\" (UID: \"ae2203b8-0a0c-48f2-a975-4a275fc2a061\") " pod="kuadrant-system/authorino-6685467ff7-xh25m"
Jul 28 01:28:00.692018 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:28:00.691816    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ae2203b8-0a0c-48f2-a975-4a275fc2a061-tls-cert\") pod \"authorino-6685467ff7-xh25m\" (UID: \"ae2203b8-0a0c-48f2-a975-4a275fc2a061\") " pod="kuadrant-system/authorino-6685467ff7-xh25m"
Jul 28 01:28:00.793246 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:28:00.793207    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ae2203b8-0a0c-48f2-a975-4a275fc2a061-tls-cert\") pod \"authorino-6685467ff7-xh25m\" (UID: \"ae2203b8-0a0c-48f2-a975-4a275fc2a061\") " pod="kuadrant-system/authorino-6685467ff7-xh25m"
Jul 28 01:28:00.793440 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:28:00.793332    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bl458\" (UniqueName: \"kubernetes.io/projected/ae2203b8-0a0c-48f2-a975-4a275fc2a061-kube-api-access-bl458\") pod \"authorino-6685467ff7-xh25m\" (UID: \"ae2203b8-0a0c-48f2-a975-4a275fc2a061\") " pod="kuadrant-system/authorino-6685467ff7-xh25m"
Jul 28 01:28:00.795794 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:28:00.795775    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ae2203b8-0a0c-48f2-a975-4a275fc2a061-tls-cert\") pod \"authorino-6685467ff7-xh25m\" (UID: \"ae2203b8-0a0c-48f2-a975-4a275fc2a061\") " pod="kuadrant-system/authorino-6685467ff7-xh25m"
Jul 28 01:28:00.799932 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:28:00.799908    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl458\" (UniqueName: \"kubernetes.io/projected/ae2203b8-0a0c-48f2-a975-4a275fc2a061-kube-api-access-bl458\") pod \"authorino-6685467ff7-xh25m\" (UID: \"ae2203b8-0a0c-48f2-a975-4a275fc2a061\") " pod="kuadrant-system/authorino-6685467ff7-xh25m"
Jul 28 01:28:00.945557 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:28:00.945477    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6685467ff7-xh25m"
Jul 28 01:28:00.967938 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:28:00.967902    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:28:01.066884 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:28:01.066846    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:28:01.081780 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:28:01.081757    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6685467ff7-xh25m"]
Jul 28 01:28:01.084275 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:28:01.084235    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podae2203b8_0a0c_48f2_a975_4a275fc2a061.slice/crio-a6447245733a1661cbceebd1974631b240efd7268f94cf5c11dab33001872fba WatchSource:0}: Error finding container a6447245733a1661cbceebd1974631b240efd7268f94cf5c11dab33001872fba: Status 404 returned error can't find the container with id a6447245733a1661cbceebd1974631b240efd7268f94cf5c11dab33001872fba
Jul 28 01:28:01.858953 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:28:01.858916    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6685467ff7-xh25m" event={"ID":"ae2203b8-0a0c-48f2-a975-4a275fc2a061","Type":"ContainerStarted","Data":"356e9f3e7bd6091f67efa1ea53cb84e1d044b9aba51e19da1934b7c528f5b0ce"}
Jul 28 01:28:01.859391 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:28:01.858971    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6685467ff7-xh25m" event={"ID":"ae2203b8-0a0c-48f2-a975-4a275fc2a061","Type":"ContainerStarted","Data":"a6447245733a1661cbceebd1974631b240efd7268f94cf5c11dab33001872fba"}
Jul 28 01:28:01.873141 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:28:01.873084    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6685467ff7-xh25m" podStartSLOduration=1.439747339 podStartE2EDuration="1.873062935s" totalImagesPullingTime="433.315596ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:28:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:28:01.872236023 +0000 UTC m=+732.906279418" watchObservedRunningTime="2026-07-28 01:28:01.873062935 +0000 UTC m=+732.907106329"
Jul 28 01:28:02.144563 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:28:02.144475    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:28:02.240838 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:28:02.240800    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:28:07.922652 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:28:07.922618    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:28:07.973174 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:28:07.973145    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:28:30.779912 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:28:30.779860    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:28:40.384668 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:28:40.384635    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:28:50.486225 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:28:50.486189    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:30:06.987506 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:30:06.987466    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:30:08.226846 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:30:08.226811    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:30:32.682257 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:30:32.682220    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:30:36.823515 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:30:36.823474    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:30:36.878560 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:30:36.878531    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:30:45.201972 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:30:45.201883    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:30:49.425576 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:30:49.425546    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5f2zn_5311b0bc-9ad2-4e2f-bdde-81510c6d6b19/ovn-acl-logging/0.log"
Jul 28 01:30:49.425576 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:30:49.425568    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5f2zn_5311b0bc-9ad2-4e2f-bdde-81510c6d6b19/ovn-acl-logging/0.log"
Jul 28 01:30:49.941798 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:30:49.941749    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:30:50.034837 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:30:50.034803    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:30:50.169073 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:30:50.169042    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:30:55.843496 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:30:55.843462    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:30:58.136012 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:30:58.135970    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:31:01.759364 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:31:01.759314    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:31:01.894622 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:31:01.894584    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:31:18.482138 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:31:18.482106    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:31:21.410147 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:31:21.410117    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:31:28.378876 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:31:28.378840    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:31:38.878813 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:31:38.878777    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:31:47.093228 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:31:47.093184    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:31:56.787294 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:31:56.787251    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:32:12.577387 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:32:12.577302    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:32:19.979640 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:32:19.979607    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:32:27.576835 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:32:27.576800    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:32:49.477066 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:32:49.477035    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:33:01.882026 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:33:01.881991    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:33:22.154740 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:33:22.154706    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:33:24.692240 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:33:24.692202    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:33:35.079721 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:33:35.079688    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:33:44.286689 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:33:44.286606    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:34:00.889851 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:34:00.889819    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:34:12.388717 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:34:12.388679    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:34:22.088827 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:34:22.088790    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:34:31.683014 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:34:31.682979    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:34:40.785481 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:34:40.785443    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:35:49.455375 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:35:49.455333    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5f2zn_5311b0bc-9ad2-4e2f-bdde-81510c6d6b19/ovn-acl-logging/0.log"
Jul 28 01:35:49.456426 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:35:49.456401    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5f2zn_5311b0bc-9ad2-4e2f-bdde-81510c6d6b19/ovn-acl-logging/0.log"
Jul 28 01:36:29.282495 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:36:29.282460    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:36:40.182472 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:36:40.182440    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:36:53.092884 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:36:53.092850    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:36:55.227884 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:36:55.227846    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:36:56.163105 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:36:56.163071    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:37:03.388200 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:37:03.388155    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:37:12.776572 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:37:12.776538    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:37:20.880449 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:37:20.880416    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:37:31.285681 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:37:31.285644    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:37:42.279139 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:37:42.279104    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:37:51.682550 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:37:51.682516    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:38:02.681589 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:38:02.681549    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:38:04.972057 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:38:04.972020    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:38:14.982077 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:38:14.981996    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:38:23.180388 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:38:23.180342    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:38:41.191436 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:38:41.191397    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:38:50.384040 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:38:50.384006    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:39:01.701045 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:01.701013    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll"]
Jul 28 01:39:01.704603 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:01.704583    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll"
Jul 28 01:39:01.706409 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:01.706388    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-4be075e6-kserve-self-signed-certs\""
Jul 28 01:39:01.721893 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:01.721868    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll"]
Jul 28 01:39:01.797919 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:01.797884    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:39:01.806115 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:01.806085    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2129cee2-b966-42cf-ac0f-e26c19b990ea-model-cache\") pod \"e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll\" (UID: \"2129cee2-b966-42cf-ac0f-e26c19b990ea\") " pod="llm/e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll"
Jul 28 01:39:01.806257 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:01.806119    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2129cee2-b966-42cf-ac0f-e26c19b990ea-tls-certs\") pod \"e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll\" (UID: \"2129cee2-b966-42cf-ac0f-e26c19b990ea\") " pod="llm/e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll"
Jul 28 01:39:01.806257 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:01.806241    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7wtf\" (UniqueName: \"kubernetes.io/projected/2129cee2-b966-42cf-ac0f-e26c19b990ea-kube-api-access-q7wtf\") pod \"e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll\" (UID: \"2129cee2-b966-42cf-ac0f-e26c19b990ea\") " pod="llm/e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll"
Jul 28 01:39:01.806395 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:01.806290    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2129cee2-b966-42cf-ac0f-e26c19b990ea-dshm\") pod \"e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll\" (UID: \"2129cee2-b966-42cf-ac0f-e26c19b990ea\") " pod="llm/e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll"
Jul 28 01:39:01.806395 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:01.806320    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2129cee2-b966-42cf-ac0f-e26c19b990ea-home\") pod \"e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll\" (UID: \"2129cee2-b966-42cf-ac0f-e26c19b990ea\") " pod="llm/e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll"
Jul 28 01:39:01.806395 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:01.806389    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2129cee2-b966-42cf-ac0f-e26c19b990ea-tmp-dir\") pod \"e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll\" (UID: \"2129cee2-b966-42cf-ac0f-e26c19b990ea\") " pod="llm/e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll"
Jul 28 01:39:01.907596 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:01.907562    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7wtf\" (UniqueName: \"kubernetes.io/projected/2129cee2-b966-42cf-ac0f-e26c19b990ea-kube-api-access-q7wtf\") pod \"e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll\" (UID: \"2129cee2-b966-42cf-ac0f-e26c19b990ea\") " pod="llm/e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll"
Jul 28 01:39:01.907755 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:01.907604    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2129cee2-b966-42cf-ac0f-e26c19b990ea-dshm\") pod \"e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll\" (UID: \"2129cee2-b966-42cf-ac0f-e26c19b990ea\") " pod="llm/e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll"
Jul 28 01:39:01.907755 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:01.907697    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2129cee2-b966-42cf-ac0f-e26c19b990ea-home\") pod \"e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll\" (UID: \"2129cee2-b966-42cf-ac0f-e26c19b990ea\") " pod="llm/e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll"
Jul 28 01:39:01.907755 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:01.907722    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2129cee2-b966-42cf-ac0f-e26c19b990ea-tmp-dir\") pod \"e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll\" (UID: \"2129cee2-b966-42cf-ac0f-e26c19b990ea\") " pod="llm/e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll"
Jul 28 01:39:01.907755 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:01.907748    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2129cee2-b966-42cf-ac0f-e26c19b990ea-model-cache\") pod \"e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll\" (UID: \"2129cee2-b966-42cf-ac0f-e26c19b990ea\") " pod="llm/e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll"
Jul 28 01:39:01.907970 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:01.907762    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2129cee2-b966-42cf-ac0f-e26c19b990ea-tls-certs\") pod \"e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll\" (UID: \"2129cee2-b966-42cf-ac0f-e26c19b990ea\") " pod="llm/e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll"
Jul 28 01:39:01.908183 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:01.908143    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2129cee2-b966-42cf-ac0f-e26c19b990ea-model-cache\") pod \"e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll\" (UID: \"2129cee2-b966-42cf-ac0f-e26c19b990ea\") " pod="llm/e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll"
Jul 28 01:39:01.908183 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:01.908148    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2129cee2-b966-42cf-ac0f-e26c19b990ea-tmp-dir\") pod \"e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll\" (UID: \"2129cee2-b966-42cf-ac0f-e26c19b990ea\") " pod="llm/e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll"
Jul 28 01:39:01.908376 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:01.908199    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2129cee2-b966-42cf-ac0f-e26c19b990ea-home\") pod \"e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll\" (UID: \"2129cee2-b966-42cf-ac0f-e26c19b990ea\") " pod="llm/e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll"
Jul 28 01:39:01.909990 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:01.909973    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2129cee2-b966-42cf-ac0f-e26c19b990ea-dshm\") pod \"e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll\" (UID: \"2129cee2-b966-42cf-ac0f-e26c19b990ea\") " pod="llm/e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll"
Jul 28 01:39:01.910274 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:01.910258    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2129cee2-b966-42cf-ac0f-e26c19b990ea-tls-certs\") pod \"e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll\" (UID: \"2129cee2-b966-42cf-ac0f-e26c19b990ea\") " pod="llm/e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll"
Jul 28 01:39:01.914679 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:01.914655    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7wtf\" (UniqueName: \"kubernetes.io/projected/2129cee2-b966-42cf-ac0f-e26c19b990ea-kube-api-access-q7wtf\") pod \"e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll\" (UID: \"2129cee2-b966-42cf-ac0f-e26c19b990ea\") " pod="llm/e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll"
Jul 28 01:39:02.014363 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:02.014268    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll"
Jul 28 01:39:02.143391 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:02.143280    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll"]
Jul 28 01:39:02.145773 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:39:02.145746    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2129cee2_b966_42cf_ac0f_e26c19b990ea.slice/crio-01f0d9dc38dc31142ee3eb261961bb4046013589c1aee75c08b8d540e5804b7d WatchSource:0}: Error finding container 01f0d9dc38dc31142ee3eb261961bb4046013589c1aee75c08b8d540e5804b7d: Status 404 returned error can't find the container with id 01f0d9dc38dc31142ee3eb261961bb4046013589c1aee75c08b8d540e5804b7d
Jul 28 01:39:03.025199 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:03.025160    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll" event={"ID":"2129cee2-b966-42cf-ac0f-e26c19b990ea","Type":"ContainerStarted","Data":"9957d771803dcde213162f75256c4a06fe81ac9af993c616ca83f83f5ff833d7"}
Jul 28 01:39:03.025199 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:03.025201    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll" event={"ID":"2129cee2-b966-42cf-ac0f-e26c19b990ea","Type":"ContainerStarted","Data":"01f0d9dc38dc31142ee3eb261961bb4046013589c1aee75c08b8d540e5804b7d"}
Jul 28 01:39:03.042246 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:03.042198    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll" podStartSLOduration=2.042184156 podStartE2EDuration="2.042184156s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:39:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:39:03.040176931 +0000 UTC m=+1394.074220324" watchObservedRunningTime="2026-07-28 01:39:03.042184156 +0000 UTC m=+1394.076227567"
Jul 28 01:39:04.884213 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:04.884177    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:39:12.015490 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:12.015405    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll"
Jul 28 01:39:12.015490 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:12.015460    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll"
Jul 28 01:39:12.028244 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:12.028220    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll"
Jul 28 01:39:12.080709 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:12.080687    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll"
Jul 28 01:39:14.998387 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:14.998335    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:39:20.281011 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:20.280972    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:39:32.106316 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:32.106284    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll"]
Jul 28 01:39:32.125587 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:32.125554    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:39:32.603263 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:32.603179    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:39:35.986029 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:35.985997    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:39:47.127154 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:47.127047    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll" podUID="2129cee2-b966-42cf-ac0f-e26c19b990ea" containerName="main" containerID="cri-o://9957d771803dcde213162f75256c4a06fe81ac9af993c616ca83f83f5ff833d7" gracePeriod=45
Jul 28 01:39:47.245690 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:47.245660    2560 generic.go:356] "Generic (PLEG): container finished" podID="2129cee2-b966-42cf-ac0f-e26c19b990ea" containerID="9957d771803dcde213162f75256c4a06fe81ac9af993c616ca83f83f5ff833d7" exitCode=0
Jul 28 01:39:47.245852 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:47.245738    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll" event={"ID":"2129cee2-b966-42cf-ac0f-e26c19b990ea","Type":"ContainerDied","Data":"9957d771803dcde213162f75256c4a06fe81ac9af993c616ca83f83f5ff833d7"}
Jul 28 01:39:47.391865 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:47.391805    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll"
Jul 28 01:39:47.509406 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:47.509376    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2129cee2-b966-42cf-ac0f-e26c19b990ea-tmp-dir\") pod \"2129cee2-b966-42cf-ac0f-e26c19b990ea\" (UID: \"2129cee2-b966-42cf-ac0f-e26c19b990ea\") "
Jul 28 01:39:47.509406 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:47.509411    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2129cee2-b966-42cf-ac0f-e26c19b990ea-dshm\") pod \"2129cee2-b966-42cf-ac0f-e26c19b990ea\" (UID: \"2129cee2-b966-42cf-ac0f-e26c19b990ea\") "
Jul 28 01:39:47.509639 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:47.509432    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7wtf\" (UniqueName: \"kubernetes.io/projected/2129cee2-b966-42cf-ac0f-e26c19b990ea-kube-api-access-q7wtf\") pod \"2129cee2-b966-42cf-ac0f-e26c19b990ea\" (UID: \"2129cee2-b966-42cf-ac0f-e26c19b990ea\") "
Jul 28 01:39:47.509639 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:47.509467    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2129cee2-b966-42cf-ac0f-e26c19b990ea-tls-certs\") pod \"2129cee2-b966-42cf-ac0f-e26c19b990ea\" (UID: \"2129cee2-b966-42cf-ac0f-e26c19b990ea\") "
Jul 28 01:39:47.509639 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:47.509499    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2129cee2-b966-42cf-ac0f-e26c19b990ea-home\") pod \"2129cee2-b966-42cf-ac0f-e26c19b990ea\" (UID: \"2129cee2-b966-42cf-ac0f-e26c19b990ea\") "
Jul 28 01:39:47.509937 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:47.509614    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2129cee2-b966-42cf-ac0f-e26c19b990ea-model-cache\") pod \"2129cee2-b966-42cf-ac0f-e26c19b990ea\" (UID: \"2129cee2-b966-42cf-ac0f-e26c19b990ea\") "
Jul 28 01:39:47.510013 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:47.509664    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2129cee2-b966-42cf-ac0f-e26c19b990ea-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2129cee2-b966-42cf-ac0f-e26c19b990ea" (UID: "2129cee2-b966-42cf-ac0f-e26c19b990ea"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:39:47.510064 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:47.509896    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2129cee2-b966-42cf-ac0f-e26c19b990ea-home" (OuterVolumeSpecName: "home") pod "2129cee2-b966-42cf-ac0f-e26c19b990ea" (UID: "2129cee2-b966-42cf-ac0f-e26c19b990ea"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:39:47.510064 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:47.509906    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2129cee2-b966-42cf-ac0f-e26c19b990ea-model-cache" (OuterVolumeSpecName: "model-cache") pod "2129cee2-b966-42cf-ac0f-e26c19b990ea" (UID: "2129cee2-b966-42cf-ac0f-e26c19b990ea"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:39:47.510318 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:47.510295    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2129cee2-b966-42cf-ac0f-e26c19b990ea-tmp-dir\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:39:47.510318 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:47.510318    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2129cee2-b966-42cf-ac0f-e26c19b990ea-home\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:39:47.510504 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:47.510330    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2129cee2-b966-42cf-ac0f-e26c19b990ea-model-cache\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:39:47.511915 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:47.511887    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2129cee2-b966-42cf-ac0f-e26c19b990ea-dshm" (OuterVolumeSpecName: "dshm") pod "2129cee2-b966-42cf-ac0f-e26c19b990ea" (UID: "2129cee2-b966-42cf-ac0f-e26c19b990ea"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:39:47.512049 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:47.512029    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2129cee2-b966-42cf-ac0f-e26c19b990ea-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2129cee2-b966-42cf-ac0f-e26c19b990ea" (UID: "2129cee2-b966-42cf-ac0f-e26c19b990ea"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:39:47.512161 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:47.512138    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2129cee2-b966-42cf-ac0f-e26c19b990ea-kube-api-access-q7wtf" (OuterVolumeSpecName: "kube-api-access-q7wtf") pod "2129cee2-b966-42cf-ac0f-e26c19b990ea" (UID: "2129cee2-b966-42cf-ac0f-e26c19b990ea"). InnerVolumeSpecName "kube-api-access-q7wtf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:39:47.610993 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:47.610957    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2129cee2-b966-42cf-ac0f-e26c19b990ea-dshm\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:39:47.611152 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:47.611012    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7wtf\" (UniqueName: \"kubernetes.io/projected/2129cee2-b966-42cf-ac0f-e26c19b990ea-kube-api-access-q7wtf\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:39:47.611152 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:47.611025    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2129cee2-b966-42cf-ac0f-e26c19b990ea-tls-certs\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:39:47.780079 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:47.779983    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:39:48.252453 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:48.252327    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll" event={"ID":"2129cee2-b966-42cf-ac0f-e26c19b990ea","Type":"ContainerDied","Data":"01f0d9dc38dc31142ee3eb261961bb4046013589c1aee75c08b8d540e5804b7d"}
Jul 28 01:39:48.252887 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:48.252476    2560 scope.go:117] "RemoveContainer" containerID="9957d771803dcde213162f75256c4a06fe81ac9af993c616ca83f83f5ff833d7"
Jul 28 01:39:48.252887 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:48.252382    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll"
Jul 28 01:39:48.271245 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:48.271217    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll"]
Jul 28 01:39:48.276909 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:48.276885    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-4be075e6-kserve-589dfc4c5-xxxll"]
Jul 28 01:39:49.461693 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:49.461660    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2129cee2-b966-42cf-ac0f-e26c19b990ea" path="/var/lib/kubelet/pods/2129cee2-b966-42cf-ac0f-e26c19b990ea/volumes"
Jul 28 01:39:58.482451 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:39:58.482410    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:40:04.644394 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:40:04.644333    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:40:07.787620 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:40:07.787569    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:40:21.276629 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:40:21.276596    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:40:29.983345 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:40:29.983309    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:40:40.793075 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:40:40.793040    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:40:49.485024 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:40:49.484997    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5f2zn_5311b0bc-9ad2-4e2f-bdde-81510c6d6b19/ovn-acl-logging/0.log"
Jul 28 01:40:49.487298 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:40:49.487275    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5f2zn_5311b0bc-9ad2-4e2f-bdde-81510c6d6b19/ovn-acl-logging/0.log"
Jul 28 01:40:49.788455 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:40:49.788361    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:40:59.187118 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:40:59.187075    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:41:12.563912 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:41:12.563823    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:41:21.980741 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:41:21.980699    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:41:31.983201 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:41:31.983158    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:41:44.177024 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:41:44.176988    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:41:53.180842 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:41:53.180807    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:41:59.782208 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:41:59.782173    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:42:14.682716 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:42:14.682676    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:42:26.484100 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:42:26.484052    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:42:36.388480 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:42:36.388448    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:42:45.283007 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:42:45.282927    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:42:46.852784 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:42:46.852749    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:42:58.279799 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:42:58.279760    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:43:07.788314 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:07.788277    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:43:08.673557 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:08.673525    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:43:12.129099 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:12.129061    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:43:12.229381 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:12.229337    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:43:12.581776 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:12.581681    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:43:17.781346 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:17.781313    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:43:18.274954 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:18.274920    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:43:18.429001 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:18.428966    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:43:18.523439 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:18.523393    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:43:18.830437 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:18.830404    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:43:19.042787 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:19.042748    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:43:20.815497 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:20.815469    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:43:20.899886 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:20.899852    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:43:20.960728 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:20.960702    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:43:21.396426 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:21.396378    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:43:21.483546 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:21.483507    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:43:21.491216 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:21.491189    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9dc1294f-5d6f8f9596-847tv"]
Jul 28 01:43:21.491640 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:21.491624    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2129cee2-b966-42cf-ac0f-e26c19b990ea" containerName="main"
Jul 28 01:43:21.491736 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:21.491643    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2129cee2-b966-42cf-ac0f-e26c19b990ea" containerName="main"
Jul 28 01:43:21.491791 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:21.491747    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2129cee2-b966-42cf-ac0f-e26c19b990ea" containerName="main"
Jul 28 01:43:21.494739 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:21.494719    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9dc1294f-5d6f8f9596-847tv"
Jul 28 01:43:21.496774 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:21.496756    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-9dc1294f\""
Jul 28 01:43:21.496882 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:21.496756    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-9dc1294f-dockercfg-875mj\""
Jul 28 01:43:21.504947 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:21.504925    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9dc1294f-6c6f8b6d68-9g85s"]
Jul 28 01:43:21.508230 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:21.508210    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9dc1294f-5d6f8f9596-847tv"]
Jul 28 01:43:21.508339 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:21.508319    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9dc1294f-6c6f8b6d68-9g85s"
Jul 28 01:43:21.519694 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:21.519669    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9dc1294f-6c6f8b6d68-9g85s"]
Jul 28 01:43:21.562123 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:21.562086    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qldb\" (UniqueName: \"kubernetes.io/projected/790ff0ab-7f88-4a6e-930b-4ad4d17752d0-kube-api-access-8qldb\") pod \"payload-pre-processing-e2e-ait-9dc1294f-5d6f8f9596-847tv\" (UID: \"790ff0ab-7f88-4a6e-930b-4ad4d17752d0\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9dc1294f-5d6f8f9596-847tv"
Jul 28 01:43:21.562280 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:21.562138    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/790ff0ab-7f88-4a6e-930b-4ad4d17752d0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9dc1294f-5d6f8f9596-847tv\" (UID: \"790ff0ab-7f88-4a6e-930b-4ad4d17752d0\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9dc1294f-5d6f8f9596-847tv"
Jul 28 01:43:21.562280 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:21.562227    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff3ac1e5-4d02-4514-8e93-c1f86fae86ce-plugins-config-volume\") pod \"payload-processing-e2e-ait-9dc1294f-6c6f8b6d68-9g85s\" (UID: \"ff3ac1e5-4d02-4514-8e93-c1f86fae86ce\") " pod="openshift-ingress/payload-processing-e2e-ait-9dc1294f-6c6f8b6d68-9g85s"
Jul 28 01:43:21.562497 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:21.562283    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd7st\" (UniqueName: \"kubernetes.io/projected/ff3ac1e5-4d02-4514-8e93-c1f86fae86ce-kube-api-access-fd7st\") pod \"payload-processing-e2e-ait-9dc1294f-6c6f8b6d68-9g85s\" (UID: \"ff3ac1e5-4d02-4514-8e93-c1f86fae86ce\") " pod="openshift-ingress/payload-processing-e2e-ait-9dc1294f-6c6f8b6d68-9g85s"
Jul 28 01:43:21.618096 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:21.618062    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:43:21.663191 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:21.663098    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff3ac1e5-4d02-4514-8e93-c1f86fae86ce-plugins-config-volume\") pod \"payload-processing-e2e-ait-9dc1294f-6c6f8b6d68-9g85s\" (UID: \"ff3ac1e5-4d02-4514-8e93-c1f86fae86ce\") " pod="openshift-ingress/payload-processing-e2e-ait-9dc1294f-6c6f8b6d68-9g85s"
Jul 28 01:43:21.663191 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:21.663161    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd7st\" (UniqueName: \"kubernetes.io/projected/ff3ac1e5-4d02-4514-8e93-c1f86fae86ce-kube-api-access-fd7st\") pod \"payload-processing-e2e-ait-9dc1294f-6c6f8b6d68-9g85s\" (UID: \"ff3ac1e5-4d02-4514-8e93-c1f86fae86ce\") " pod="openshift-ingress/payload-processing-e2e-ait-9dc1294f-6c6f8b6d68-9g85s"
Jul 28 01:43:21.663450 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:21.663208    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qldb\" (UniqueName: \"kubernetes.io/projected/790ff0ab-7f88-4a6e-930b-4ad4d17752d0-kube-api-access-8qldb\") pod \"payload-pre-processing-e2e-ait-9dc1294f-5d6f8f9596-847tv\" (UID: \"790ff0ab-7f88-4a6e-930b-4ad4d17752d0\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9dc1294f-5d6f8f9596-847tv"
Jul 28 01:43:21.663450 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:21.663240    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/790ff0ab-7f88-4a6e-930b-4ad4d17752d0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9dc1294f-5d6f8f9596-847tv\" (UID: \"790ff0ab-7f88-4a6e-930b-4ad4d17752d0\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9dc1294f-5d6f8f9596-847tv"
Jul 28 01:43:21.663838 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:21.663817    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff3ac1e5-4d02-4514-8e93-c1f86fae86ce-plugins-config-volume\") pod \"payload-processing-e2e-ait-9dc1294f-6c6f8b6d68-9g85s\" (UID: \"ff3ac1e5-4d02-4514-8e93-c1f86fae86ce\") " pod="openshift-ingress/payload-processing-e2e-ait-9dc1294f-6c6f8b6d68-9g85s"
Jul 28 01:43:21.663970 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:21.663951    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/790ff0ab-7f88-4a6e-930b-4ad4d17752d0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9dc1294f-5d6f8f9596-847tv\" (UID: \"790ff0ab-7f88-4a6e-930b-4ad4d17752d0\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9dc1294f-5d6f8f9596-847tv"
Jul 28 01:43:21.670906 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:21.670885    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd7st\" (UniqueName: \"kubernetes.io/projected/ff3ac1e5-4d02-4514-8e93-c1f86fae86ce-kube-api-access-fd7st\") pod \"payload-processing-e2e-ait-9dc1294f-6c6f8b6d68-9g85s\" (UID: \"ff3ac1e5-4d02-4514-8e93-c1f86fae86ce\") " pod="openshift-ingress/payload-processing-e2e-ait-9dc1294f-6c6f8b6d68-9g85s"
Jul 28 01:43:21.671015 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:21.670917    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qldb\" (UniqueName: \"kubernetes.io/projected/790ff0ab-7f88-4a6e-930b-4ad4d17752d0-kube-api-access-8qldb\") pod \"payload-pre-processing-e2e-ait-9dc1294f-5d6f8f9596-847tv\" (UID: \"790ff0ab-7f88-4a6e-930b-4ad4d17752d0\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9dc1294f-5d6f8f9596-847tv"
Jul 28 01:43:21.805922 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:21.805892    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9dc1294f-5d6f8f9596-847tv"
Jul 28 01:43:21.818426 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:21.818398    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9dc1294f-6c6f8b6d68-9g85s"
Jul 28 01:43:21.950737 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:21.950699    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9dc1294f-5d6f8f9596-847tv"]
Jul 28 01:43:21.954058 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:43:21.954026    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod790ff0ab_7f88_4a6e_930b_4ad4d17752d0.slice/crio-732bed99d4562188c2b8236008a8893ea67dbd1e2dc2ec3370b10fa21bd72584 WatchSource:0}: Error finding container 732bed99d4562188c2b8236008a8893ea67dbd1e2dc2ec3370b10fa21bd72584: Status 404 returned error can't find the container with id 732bed99d4562188c2b8236008a8893ea67dbd1e2dc2ec3370b10fa21bd72584
Jul 28 01:43:21.973822 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:21.973799    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9dc1294f-6c6f8b6d68-9g85s"]
Jul 28 01:43:21.976119 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:43:21.976095    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff3ac1e5_4d02_4514_8e93_c1f86fae86ce.slice/crio-a679ae868f7e5b63f75d796ff9f55ee9fd4a22dc23489c47fda752d087003a00 WatchSource:0}: Error finding container a679ae868f7e5b63f75d796ff9f55ee9fd4a22dc23489c47fda752d087003a00: Status 404 returned error can't find the container with id a679ae868f7e5b63f75d796ff9f55ee9fd4a22dc23489c47fda752d087003a00
Jul 28 01:43:22.255928 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:22.255838    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9dc1294f-6c6f8b6d68-9g85s" event={"ID":"ff3ac1e5-4d02-4514-8e93-c1f86fae86ce","Type":"ContainerStarted","Data":"26295a3b1e686c8c83e79473a56ae8022cf80f342beeebf89295ad95aea59ec2"}
Jul 28 01:43:22.255928 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:22.255891    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9dc1294f-6c6f8b6d68-9g85s" event={"ID":"ff3ac1e5-4d02-4514-8e93-c1f86fae86ce","Type":"ContainerStarted","Data":"a679ae868f7e5b63f75d796ff9f55ee9fd4a22dc23489c47fda752d087003a00"}
Jul 28 01:43:22.256168 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:22.255946    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-9dc1294f-6c6f8b6d68-9g85s"
Jul 28 01:43:22.257558 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:22.257527    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9dc1294f-5d6f8f9596-847tv" event={"ID":"790ff0ab-7f88-4a6e-930b-4ad4d17752d0","Type":"ContainerStarted","Data":"56e85c104c745493b795a7ac52e61ddf01a389afaa2f2807c19c625b1ebaff0b"}
Jul 28 01:43:22.257697 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:22.257572    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9dc1294f-5d6f8f9596-847tv" event={"ID":"790ff0ab-7f88-4a6e-930b-4ad4d17752d0","Type":"ContainerStarted","Data":"732bed99d4562188c2b8236008a8893ea67dbd1e2dc2ec3370b10fa21bd72584"}
Jul 28 01:43:22.257697 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:22.257604    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-9dc1294f-5d6f8f9596-847tv"
Jul 28 01:43:22.270228 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:22.270156    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-9dc1294f-6c6f8b6d68-9g85s" podStartSLOduration=1.27013902 podStartE2EDuration="1.27013902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:43:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:43:22.270006909 +0000 UTC m=+1653.304050304" watchObservedRunningTime="2026-07-28 01:43:22.27013902 +0000 UTC m=+1653.304182415"
Jul 28 01:43:22.283451 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:22.283409    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-9dc1294f-5d6f8f9596-847tv" podStartSLOduration=1.283389409 podStartE2EDuration="1.283389409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:43:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:43:22.282443057 +0000 UTC m=+1653.316486451" watchObservedRunningTime="2026-07-28 01:43:22.283389409 +0000 UTC m=+1653.317432801"
Jul 28 01:43:28.081322 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:28.081289    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:43:33.264315 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:33.264283    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-9dc1294f-6c6f8b6d68-9g85s"
Jul 28 01:43:33.264716 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:33.264433    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-9dc1294f-5d6f8f9596-847tv"
Jul 28 01:43:56.804831 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:56.804794    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:43:56.829674 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:56.829646    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9dc1294f-6c6f8b6d68-9g85s"]
Jul 28 01:43:56.829885 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:56.829855    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-9dc1294f-6c6f8b6d68-9g85s" podUID="ff3ac1e5-4d02-4514-8e93-c1f86fae86ce" containerName="payload-processing" containerID="cri-o://26295a3b1e686c8c83e79473a56ae8022cf80f342beeebf89295ad95aea59ec2" gracePeriod=30
Jul 28 01:43:56.837157 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:56.837131    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9dc1294f-5d6f8f9596-847tv"]
Jul 28 01:43:56.837432 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:56.837389    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-9dc1294f-5d6f8f9596-847tv" podUID="790ff0ab-7f88-4a6e-930b-4ad4d17752d0" containerName="payload-pre-processing" containerID="cri-o://56e85c104c745493b795a7ac52e61ddf01a389afaa2f2807c19c625b1ebaff0b" gracePeriod=30
Jul 28 01:43:56.865957 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:56.865920    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:43:56.924691 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:56.924665    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:43:57.081301 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:57.081277    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9dc1294f-6c6f8b6d68-9g85s"
Jul 28 01:43:57.109745 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:57.109724    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9dc1294f-5d6f8f9596-847tv"
Jul 28 01:43:57.183680 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:57.183652    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fd7st\" (UniqueName: \"kubernetes.io/projected/ff3ac1e5-4d02-4514-8e93-c1f86fae86ce-kube-api-access-fd7st\") pod \"ff3ac1e5-4d02-4514-8e93-c1f86fae86ce\" (UID: \"ff3ac1e5-4d02-4514-8e93-c1f86fae86ce\") "
Jul 28 01:43:57.183807 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:57.183730    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qldb\" (UniqueName: \"kubernetes.io/projected/790ff0ab-7f88-4a6e-930b-4ad4d17752d0-kube-api-access-8qldb\") pod \"790ff0ab-7f88-4a6e-930b-4ad4d17752d0\" (UID: \"790ff0ab-7f88-4a6e-930b-4ad4d17752d0\") "
Jul 28 01:43:57.183807 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:57.183755    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff3ac1e5-4d02-4514-8e93-c1f86fae86ce-plugins-config-volume\") pod \"ff3ac1e5-4d02-4514-8e93-c1f86fae86ce\" (UID: \"ff3ac1e5-4d02-4514-8e93-c1f86fae86ce\") "
Jul 28 01:43:57.183807 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:57.183799    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/790ff0ab-7f88-4a6e-930b-4ad4d17752d0-plugins-config-volume\") pod \"790ff0ab-7f88-4a6e-930b-4ad4d17752d0\" (UID: \"790ff0ab-7f88-4a6e-930b-4ad4d17752d0\") "
Jul 28 01:43:57.184156 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:57.184130    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/790ff0ab-7f88-4a6e-930b-4ad4d17752d0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "790ff0ab-7f88-4a6e-930b-4ad4d17752d0" (UID: "790ff0ab-7f88-4a6e-930b-4ad4d17752d0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:43:57.184259 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:57.184165    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff3ac1e5-4d02-4514-8e93-c1f86fae86ce-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ff3ac1e5-4d02-4514-8e93-c1f86fae86ce" (UID: "ff3ac1e5-4d02-4514-8e93-c1f86fae86ce"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:43:57.185922 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:57.185905    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/790ff0ab-7f88-4a6e-930b-4ad4d17752d0-kube-api-access-8qldb" (OuterVolumeSpecName: "kube-api-access-8qldb") pod "790ff0ab-7f88-4a6e-930b-4ad4d17752d0" (UID: "790ff0ab-7f88-4a6e-930b-4ad4d17752d0"). InnerVolumeSpecName "kube-api-access-8qldb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:43:57.185994 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:57.185949    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff3ac1e5-4d02-4514-8e93-c1f86fae86ce-kube-api-access-fd7st" (OuterVolumeSpecName: "kube-api-access-fd7st") pod "ff3ac1e5-4d02-4514-8e93-c1f86fae86ce" (UID: "ff3ac1e5-4d02-4514-8e93-c1f86fae86ce"). InnerVolumeSpecName "kube-api-access-fd7st". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:43:57.284833 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:57.284807    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qldb\" (UniqueName: \"kubernetes.io/projected/790ff0ab-7f88-4a6e-930b-4ad4d17752d0-kube-api-access-8qldb\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:43:57.284833 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:57.284827    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff3ac1e5-4d02-4514-8e93-c1f86fae86ce-plugins-config-volume\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:43:57.284833 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:57.284837    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/790ff0ab-7f88-4a6e-930b-4ad4d17752d0-plugins-config-volume\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:43:57.285013 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:57.284845    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fd7st\" (UniqueName: \"kubernetes.io/projected/ff3ac1e5-4d02-4514-8e93-c1f86fae86ce-kube-api-access-fd7st\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:43:57.428138 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:57.428109    2560 generic.go:356] "Generic (PLEG): container finished" podID="ff3ac1e5-4d02-4514-8e93-c1f86fae86ce" containerID="26295a3b1e686c8c83e79473a56ae8022cf80f342beeebf89295ad95aea59ec2" exitCode=0
Jul 28 01:43:57.428290 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:57.428147    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9dc1294f-6c6f8b6d68-9g85s"
Jul 28 01:43:57.428290 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:57.428178    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9dc1294f-6c6f8b6d68-9g85s" event={"ID":"ff3ac1e5-4d02-4514-8e93-c1f86fae86ce","Type":"ContainerDied","Data":"26295a3b1e686c8c83e79473a56ae8022cf80f342beeebf89295ad95aea59ec2"}
Jul 28 01:43:57.428290 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:57.428231    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9dc1294f-6c6f8b6d68-9g85s" event={"ID":"ff3ac1e5-4d02-4514-8e93-c1f86fae86ce","Type":"ContainerDied","Data":"a679ae868f7e5b63f75d796ff9f55ee9fd4a22dc23489c47fda752d087003a00"}
Jul 28 01:43:57.428290 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:57.428262    2560 scope.go:117] "RemoveContainer" containerID="26295a3b1e686c8c83e79473a56ae8022cf80f342beeebf89295ad95aea59ec2"
Jul 28 01:43:57.429607 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:57.429577    2560 generic.go:356] "Generic (PLEG): container finished" podID="790ff0ab-7f88-4a6e-930b-4ad4d17752d0" containerID="56e85c104c745493b795a7ac52e61ddf01a389afaa2f2807c19c625b1ebaff0b" exitCode=0
Jul 28 01:43:57.429737 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:57.429623    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9dc1294f-5d6f8f9596-847tv"
Jul 28 01:43:57.429737 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:57.429650    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9dc1294f-5d6f8f9596-847tv" event={"ID":"790ff0ab-7f88-4a6e-930b-4ad4d17752d0","Type":"ContainerDied","Data":"56e85c104c745493b795a7ac52e61ddf01a389afaa2f2807c19c625b1ebaff0b"}
Jul 28 01:43:57.429737 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:57.429704    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9dc1294f-5d6f8f9596-847tv" event={"ID":"790ff0ab-7f88-4a6e-930b-4ad4d17752d0","Type":"ContainerDied","Data":"732bed99d4562188c2b8236008a8893ea67dbd1e2dc2ec3370b10fa21bd72584"}
Jul 28 01:43:57.437437 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:57.437420    2560 scope.go:117] "RemoveContainer" containerID="26295a3b1e686c8c83e79473a56ae8022cf80f342beeebf89295ad95aea59ec2"
Jul 28 01:43:57.437734 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:43:57.437709    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26295a3b1e686c8c83e79473a56ae8022cf80f342beeebf89295ad95aea59ec2\": container with ID starting with 26295a3b1e686c8c83e79473a56ae8022cf80f342beeebf89295ad95aea59ec2 not found: ID does not exist" containerID="26295a3b1e686c8c83e79473a56ae8022cf80f342beeebf89295ad95aea59ec2"
Jul 28 01:43:57.437824 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:57.437747    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26295a3b1e686c8c83e79473a56ae8022cf80f342beeebf89295ad95aea59ec2"} err="failed to get container status \"26295a3b1e686c8c83e79473a56ae8022cf80f342beeebf89295ad95aea59ec2\": rpc error: code = NotFound desc = could not find container \"26295a3b1e686c8c83e79473a56ae8022cf80f342beeebf89295ad95aea59ec2\": container with ID starting with 26295a3b1e686c8c83e79473a56ae8022cf80f342beeebf89295ad95aea59ec2 not found: ID does not exist"
Jul 28 01:43:57.437824 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:57.437771    2560 scope.go:117] "RemoveContainer" containerID="56e85c104c745493b795a7ac52e61ddf01a389afaa2f2807c19c625b1ebaff0b"
Jul 28 01:43:57.445845 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:57.445827    2560 scope.go:117] "RemoveContainer" containerID="56e85c104c745493b795a7ac52e61ddf01a389afaa2f2807c19c625b1ebaff0b"
Jul 28 01:43:57.446085 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:43:57.446067    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56e85c104c745493b795a7ac52e61ddf01a389afaa2f2807c19c625b1ebaff0b\": container with ID starting with 56e85c104c745493b795a7ac52e61ddf01a389afaa2f2807c19c625b1ebaff0b not found: ID does not exist" containerID="56e85c104c745493b795a7ac52e61ddf01a389afaa2f2807c19c625b1ebaff0b"
Jul 28 01:43:57.446128 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:57.446091    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56e85c104c745493b795a7ac52e61ddf01a389afaa2f2807c19c625b1ebaff0b"} err="failed to get container status \"56e85c104c745493b795a7ac52e61ddf01a389afaa2f2807c19c625b1ebaff0b\": rpc error: code = NotFound desc = could not find container \"56e85c104c745493b795a7ac52e61ddf01a389afaa2f2807c19c625b1ebaff0b\": container with ID starting with 56e85c104c745493b795a7ac52e61ddf01a389afaa2f2807c19c625b1ebaff0b not found: ID does not exist"
Jul 28 01:43:57.449069 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:57.449051    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9dc1294f-6c6f8b6d68-9g85s"]
Jul 28 01:43:57.452846 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:57.452827    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9dc1294f-6c6f8b6d68-9g85s"]
Jul 28 01:43:57.459887 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:57.459864    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff3ac1e5-4d02-4514-8e93-c1f86fae86ce" path="/var/lib/kubelet/pods/ff3ac1e5-4d02-4514-8e93-c1f86fae86ce/volumes"
Jul 28 01:43:57.461899 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:57.461882    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9dc1294f-5d6f8f9596-847tv"]
Jul 28 01:43:57.465783 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:57.465765    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9dc1294f-5d6f8f9596-847tv"]
Jul 28 01:43:59.460531 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:59.460499    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="790ff0ab-7f88-4a6e-930b-4ad4d17752d0" path="/var/lib/kubelet/pods/790ff0ab-7f88-4a6e-930b-4ad4d17752d0/volumes"
Jul 28 01:43:59.584434 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:43:59.584401    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:44:01.415703 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:01.415664    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:44:01.580294 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:01.580267    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:44:01.837840 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:01.837755    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:44:02.122919 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:02.122887    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:44:02.226134 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:02.226099    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:44:02.369375 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:02.369320    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:44:02.822779 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:02.822747    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:44:03.089375 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:03.089272    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:44:04.672293 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:04.672234    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:44:04.750570 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:04.750540    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:44:05.342403 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:05.342327    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:44:05.516319 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:05.516288    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:44:05.713403 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:05.713374    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:44:06.016935 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:06.016855    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:44:06.111822 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:06.111791    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:44:06.118068 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:06.118042    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-e887be66-669f49ff9b-ffh2s"]
Jul 28 01:44:06.118462 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:06.118449    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff3ac1e5-4d02-4514-8e93-c1f86fae86ce" containerName="payload-processing"
Jul 28 01:44:06.118507 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:06.118465    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff3ac1e5-4d02-4514-8e93-c1f86fae86ce" containerName="payload-processing"
Jul 28 01:44:06.118507 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:06.118504    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="790ff0ab-7f88-4a6e-930b-4ad4d17752d0" containerName="payload-pre-processing"
Jul 28 01:44:06.118571 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:06.118510    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="790ff0ab-7f88-4a6e-930b-4ad4d17752d0" containerName="payload-pre-processing"
Jul 28 01:44:06.118604 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:06.118571    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff3ac1e5-4d02-4514-8e93-c1f86fae86ce" containerName="payload-processing"
Jul 28 01:44:06.118604 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:06.118585    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="790ff0ab-7f88-4a6e-930b-4ad4d17752d0" containerName="payload-pre-processing"
Jul 28 01:44:06.122894 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:06.122876    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e887be66-669f49ff9b-ffh2s"
Jul 28 01:44:06.125585 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:06.125551    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-e887be66-dockercfg-pqhcc\""
Jul 28 01:44:06.125685 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:06.125573    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-e887be66\""
Jul 28 01:44:06.131692 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:06.131669    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-e887be66-669f49ff9b-ffh2s"]
Jul 28 01:44:06.154927 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:06.154900    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-e887be66-666cb55f4f-4jxcv"]
Jul 28 01:44:06.158636 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:06.158616    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-e887be66-666cb55f4f-4jxcv"
Jul 28 01:44:06.169062 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:06.169036    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-e887be66-666cb55f4f-4jxcv"]
Jul 28 01:44:06.270932 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:06.270847    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/000d5360-e719-47e4-8b6c-4a7ec7081872-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-e887be66-669f49ff9b-ffh2s\" (UID: \"000d5360-e719-47e4-8b6c-4a7ec7081872\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-e887be66-669f49ff9b-ffh2s"
Jul 28 01:44:06.270932 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:06.270893    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ade56061-895e-4fd6-9efd-99849f047250-plugins-config-volume\") pod \"payload-processing-e2e-migrate-e887be66-666cb55f4f-4jxcv\" (UID: \"ade56061-895e-4fd6-9efd-99849f047250\") " pod="openshift-ingress/payload-processing-e2e-migrate-e887be66-666cb55f4f-4jxcv"
Jul 28 01:44:06.271116 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:06.270973    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vtjc\" (UniqueName: \"kubernetes.io/projected/ade56061-895e-4fd6-9efd-99849f047250-kube-api-access-2vtjc\") pod \"payload-processing-e2e-migrate-e887be66-666cb55f4f-4jxcv\" (UID: \"ade56061-895e-4fd6-9efd-99849f047250\") " pod="openshift-ingress/payload-processing-e2e-migrate-e887be66-666cb55f4f-4jxcv"
Jul 28 01:44:06.271116 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:06.271046    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9x24\" (UniqueName: \"kubernetes.io/projected/000d5360-e719-47e4-8b6c-4a7ec7081872-kube-api-access-m9x24\") pod \"payload-pre-processing-e2e-migrate-e887be66-669f49ff9b-ffh2s\" (UID: \"000d5360-e719-47e4-8b6c-4a7ec7081872\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-e887be66-669f49ff9b-ffh2s"
Jul 28 01:44:06.371902 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:06.371869    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/000d5360-e719-47e4-8b6c-4a7ec7081872-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-e887be66-669f49ff9b-ffh2s\" (UID: \"000d5360-e719-47e4-8b6c-4a7ec7081872\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-e887be66-669f49ff9b-ffh2s"
Jul 28 01:44:06.372111 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:06.371914    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ade56061-895e-4fd6-9efd-99849f047250-plugins-config-volume\") pod \"payload-processing-e2e-migrate-e887be66-666cb55f4f-4jxcv\" (UID: \"ade56061-895e-4fd6-9efd-99849f047250\") " pod="openshift-ingress/payload-processing-e2e-migrate-e887be66-666cb55f4f-4jxcv"
Jul 28 01:44:06.372111 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:06.371956    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vtjc\" (UniqueName: \"kubernetes.io/projected/ade56061-895e-4fd6-9efd-99849f047250-kube-api-access-2vtjc\") pod \"payload-processing-e2e-migrate-e887be66-666cb55f4f-4jxcv\" (UID: \"ade56061-895e-4fd6-9efd-99849f047250\") " pod="openshift-ingress/payload-processing-e2e-migrate-e887be66-666cb55f4f-4jxcv"
Jul 28 01:44:06.372111 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:06.371978    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9x24\" (UniqueName: \"kubernetes.io/projected/000d5360-e719-47e4-8b6c-4a7ec7081872-kube-api-access-m9x24\") pod \"payload-pre-processing-e2e-migrate-e887be66-669f49ff9b-ffh2s\" (UID: \"000d5360-e719-47e4-8b6c-4a7ec7081872\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-e887be66-669f49ff9b-ffh2s"
Jul 28 01:44:06.372659 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:06.372634    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/000d5360-e719-47e4-8b6c-4a7ec7081872-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-e887be66-669f49ff9b-ffh2s\" (UID: \"000d5360-e719-47e4-8b6c-4a7ec7081872\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-e887be66-669f49ff9b-ffh2s"
Jul 28 01:44:06.372772 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:06.372711    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ade56061-895e-4fd6-9efd-99849f047250-plugins-config-volume\") pod \"payload-processing-e2e-migrate-e887be66-666cb55f4f-4jxcv\" (UID: \"ade56061-895e-4fd6-9efd-99849f047250\") " pod="openshift-ingress/payload-processing-e2e-migrate-e887be66-666cb55f4f-4jxcv"
Jul 28 01:44:06.380370 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:06.380324    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9x24\" (UniqueName: \"kubernetes.io/projected/000d5360-e719-47e4-8b6c-4a7ec7081872-kube-api-access-m9x24\") pod \"payload-pre-processing-e2e-migrate-e887be66-669f49ff9b-ffh2s\" (UID: \"000d5360-e719-47e4-8b6c-4a7ec7081872\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-e887be66-669f49ff9b-ffh2s"
Jul 28 01:44:06.380523 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:06.380506    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vtjc\" (UniqueName: \"kubernetes.io/projected/ade56061-895e-4fd6-9efd-99849f047250-kube-api-access-2vtjc\") pod \"payload-processing-e2e-migrate-e887be66-666cb55f4f-4jxcv\" (UID: \"ade56061-895e-4fd6-9efd-99849f047250\") " pod="openshift-ingress/payload-processing-e2e-migrate-e887be66-666cb55f4f-4jxcv"
Jul 28 01:44:06.434628 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:06.434598    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e887be66-669f49ff9b-ffh2s"
Jul 28 01:44:06.469519 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:06.469488    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-e887be66-666cb55f4f-4jxcv"
Jul 28 01:44:06.577674 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:06.577641    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-e887be66-669f49ff9b-ffh2s"]
Jul 28 01:44:06.581602 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:44:06.581568    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod000d5360_e719_47e4_8b6c_4a7ec7081872.slice/crio-c5f37cd63afeac388b8345850d1547535d9dd2f522da1ef4549371b03752ac27 WatchSource:0}: Error finding container c5f37cd63afeac388b8345850d1547535d9dd2f522da1ef4549371b03752ac27: Status 404 returned error can't find the container with id c5f37cd63afeac388b8345850d1547535d9dd2f522da1ef4549371b03752ac27
Jul 28 01:44:06.621384 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:06.621290    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-e887be66-666cb55f4f-4jxcv"]
Jul 28 01:44:06.624016 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:44:06.623987    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podade56061_895e_4fd6_9efd_99849f047250.slice/crio-6749818309c373b80f25ab2be7c804f3096bab01a818c66a36ebcf7af6e351eb WatchSource:0}: Error finding container 6749818309c373b80f25ab2be7c804f3096bab01a818c66a36ebcf7af6e351eb: Status 404 returned error can't find the container with id 6749818309c373b80f25ab2be7c804f3096bab01a818c66a36ebcf7af6e351eb
Jul 28 01:44:07.477966 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:07.477921    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e887be66-669f49ff9b-ffh2s" event={"ID":"000d5360-e719-47e4-8b6c-4a7ec7081872","Type":"ContainerStarted","Data":"9b796137ffdf1bac0572f448d0d71a9f5b72178e91936dfa1a7eda1fbdedcd50"}
Jul 28 01:44:07.478444 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:07.478096    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e887be66-669f49ff9b-ffh2s"
Jul 28 01:44:07.478444 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:07.478137    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e887be66-669f49ff9b-ffh2s" event={"ID":"000d5360-e719-47e4-8b6c-4a7ec7081872","Type":"ContainerStarted","Data":"c5f37cd63afeac388b8345850d1547535d9dd2f522da1ef4549371b03752ac27"}
Jul 28 01:44:07.479399 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:07.479377    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-e887be66-666cb55f4f-4jxcv" event={"ID":"ade56061-895e-4fd6-9efd-99849f047250","Type":"ContainerStarted","Data":"5a002835fd5fd3141a172b03dd6c05cd6cf8b646f01bb4d94b78dcefda467352"}
Jul 28 01:44:07.479515 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:07.479418    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-e887be66-666cb55f4f-4jxcv"
Jul 28 01:44:07.479515 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:07.479433    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-e887be66-666cb55f4f-4jxcv" event={"ID":"ade56061-895e-4fd6-9efd-99849f047250","Type":"ContainerStarted","Data":"6749818309c373b80f25ab2be7c804f3096bab01a818c66a36ebcf7af6e351eb"}
Jul 28 01:44:07.494914 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:07.494875    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e887be66-669f49ff9b-ffh2s" podStartSLOduration=1.494857369 podStartE2EDuration="1.494857369s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:44:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:44:07.493542124 +0000 UTC m=+1698.527585518" watchObservedRunningTime="2026-07-28 01:44:07.494857369 +0000 UTC m=+1698.528900763"
Jul 28 01:44:07.510600 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:07.510542    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-e887be66-666cb55f4f-4jxcv" podStartSLOduration=1.510526853 podStartE2EDuration="1.510526853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:44:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:44:07.508228349 +0000 UTC m=+1698.542271772" watchObservedRunningTime="2026-07-28 01:44:07.510526853 +0000 UTC m=+1698.544570271"
Jul 28 01:44:11.781090 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:11.780992    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:44:18.486535 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:18.486501    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-e887be66-666cb55f4f-4jxcv"
Jul 28 01:44:18.486971 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:18.486569    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e887be66-669f49ff9b-ffh2s"
Jul 28 01:44:28.772608 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:28.772553    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:44:40.717323 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:40.717291    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:44:40.748277 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:40.748243    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-e887be66-666cb55f4f-4jxcv"]
Jul 28 01:44:40.748558 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:40.748526    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-e887be66-666cb55f4f-4jxcv" podUID="ade56061-895e-4fd6-9efd-99849f047250" containerName="payload-processing" containerID="cri-o://5a002835fd5fd3141a172b03dd6c05cd6cf8b646f01bb4d94b78dcefda467352" gracePeriod=30
Jul 28 01:44:40.754957 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:40.754930    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-e887be66-669f49ff9b-ffh2s"]
Jul 28 01:44:40.755198 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:40.755164    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e887be66-669f49ff9b-ffh2s" podUID="000d5360-e719-47e4-8b6c-4a7ec7081872" containerName="payload-pre-processing" containerID="cri-o://9b796137ffdf1bac0572f448d0d71a9f5b72178e91936dfa1a7eda1fbdedcd50" gracePeriod=30
Jul 28 01:44:40.792154 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:40.783195    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:44:40.882872 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:40.882844    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:44:41.024490 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:41.024464    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-e887be66-666cb55f4f-4jxcv"
Jul 28 01:44:41.027490 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:41.027461    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e887be66-669f49ff9b-ffh2s"
Jul 28 01:44:41.079464 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:41.079428    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/000d5360-e719-47e4-8b6c-4a7ec7081872-plugins-config-volume\") pod \"000d5360-e719-47e4-8b6c-4a7ec7081872\" (UID: \"000d5360-e719-47e4-8b6c-4a7ec7081872\") "
Jul 28 01:44:41.079464 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:41.079459    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vtjc\" (UniqueName: \"kubernetes.io/projected/ade56061-895e-4fd6-9efd-99849f047250-kube-api-access-2vtjc\") pod \"ade56061-895e-4fd6-9efd-99849f047250\" (UID: \"ade56061-895e-4fd6-9efd-99849f047250\") "
Jul 28 01:44:41.079687 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:41.079478    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9x24\" (UniqueName: \"kubernetes.io/projected/000d5360-e719-47e4-8b6c-4a7ec7081872-kube-api-access-m9x24\") pod \"000d5360-e719-47e4-8b6c-4a7ec7081872\" (UID: \"000d5360-e719-47e4-8b6c-4a7ec7081872\") "
Jul 28 01:44:41.079687 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:41.079517    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ade56061-895e-4fd6-9efd-99849f047250-plugins-config-volume\") pod \"ade56061-895e-4fd6-9efd-99849f047250\" (UID: \"ade56061-895e-4fd6-9efd-99849f047250\") "
Jul 28 01:44:41.079944 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:41.079915    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/000d5360-e719-47e4-8b6c-4a7ec7081872-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "000d5360-e719-47e4-8b6c-4a7ec7081872" (UID: "000d5360-e719-47e4-8b6c-4a7ec7081872"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:44:41.079944 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:41.079932    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ade56061-895e-4fd6-9efd-99849f047250-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ade56061-895e-4fd6-9efd-99849f047250" (UID: "ade56061-895e-4fd6-9efd-99849f047250"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:44:41.081787 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:41.081763    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/000d5360-e719-47e4-8b6c-4a7ec7081872-kube-api-access-m9x24" (OuterVolumeSpecName: "kube-api-access-m9x24") pod "000d5360-e719-47e4-8b6c-4a7ec7081872" (UID: "000d5360-e719-47e4-8b6c-4a7ec7081872"). InnerVolumeSpecName "kube-api-access-m9x24". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:44:41.081925 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:41.081904    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ade56061-895e-4fd6-9efd-99849f047250-kube-api-access-2vtjc" (OuterVolumeSpecName: "kube-api-access-2vtjc") pod "ade56061-895e-4fd6-9efd-99849f047250" (UID: "ade56061-895e-4fd6-9efd-99849f047250"). InnerVolumeSpecName "kube-api-access-2vtjc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:44:41.180584 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:41.180548    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/000d5360-e719-47e4-8b6c-4a7ec7081872-plugins-config-volume\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:44:41.180584 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:41.180578    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vtjc\" (UniqueName: \"kubernetes.io/projected/ade56061-895e-4fd6-9efd-99849f047250-kube-api-access-2vtjc\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:44:41.180584 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:41.180590    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9x24\" (UniqueName: \"kubernetes.io/projected/000d5360-e719-47e4-8b6c-4a7ec7081872-kube-api-access-m9x24\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:44:41.180827 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:41.180603    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ade56061-895e-4fd6-9efd-99849f047250-plugins-config-volume\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:44:41.640167 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:41.640137    2560 generic.go:356] "Generic (PLEG): container finished" podID="ade56061-895e-4fd6-9efd-99849f047250" containerID="5a002835fd5fd3141a172b03dd6c05cd6cf8b646f01bb4d94b78dcefda467352" exitCode=0
Jul 28 01:44:41.640366 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:41.640182    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-e887be66-666cb55f4f-4jxcv"
Jul 28 01:44:41.640366 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:41.640226    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-e887be66-666cb55f4f-4jxcv" event={"ID":"ade56061-895e-4fd6-9efd-99849f047250","Type":"ContainerDied","Data":"5a002835fd5fd3141a172b03dd6c05cd6cf8b646f01bb4d94b78dcefda467352"}
Jul 28 01:44:41.640366 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:41.640285    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-e887be66-666cb55f4f-4jxcv" event={"ID":"ade56061-895e-4fd6-9efd-99849f047250","Type":"ContainerDied","Data":"6749818309c373b80f25ab2be7c804f3096bab01a818c66a36ebcf7af6e351eb"}
Jul 28 01:44:41.640366 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:41.640315    2560 scope.go:117] "RemoveContainer" containerID="5a002835fd5fd3141a172b03dd6c05cd6cf8b646f01bb4d94b78dcefda467352"
Jul 28 01:44:41.641697 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:41.641674    2560 generic.go:356] "Generic (PLEG): container finished" podID="000d5360-e719-47e4-8b6c-4a7ec7081872" containerID="9b796137ffdf1bac0572f448d0d71a9f5b72178e91936dfa1a7eda1fbdedcd50" exitCode=0
Jul 28 01:44:41.641795 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:41.641735    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e887be66-669f49ff9b-ffh2s"
Jul 28 01:44:41.641795 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:41.641751    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e887be66-669f49ff9b-ffh2s" event={"ID":"000d5360-e719-47e4-8b6c-4a7ec7081872","Type":"ContainerDied","Data":"9b796137ffdf1bac0572f448d0d71a9f5b72178e91936dfa1a7eda1fbdedcd50"}
Jul 28 01:44:41.641795 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:41.641787    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e887be66-669f49ff9b-ffh2s" event={"ID":"000d5360-e719-47e4-8b6c-4a7ec7081872","Type":"ContainerDied","Data":"c5f37cd63afeac388b8345850d1547535d9dd2f522da1ef4549371b03752ac27"}
Jul 28 01:44:41.649157 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:41.649129    2560 scope.go:117] "RemoveContainer" containerID="5a002835fd5fd3141a172b03dd6c05cd6cf8b646f01bb4d94b78dcefda467352"
Jul 28 01:44:41.649413 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:44:41.649383    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a002835fd5fd3141a172b03dd6c05cd6cf8b646f01bb4d94b78dcefda467352\": container with ID starting with 5a002835fd5fd3141a172b03dd6c05cd6cf8b646f01bb4d94b78dcefda467352 not found: ID does not exist" containerID="5a002835fd5fd3141a172b03dd6c05cd6cf8b646f01bb4d94b78dcefda467352"
Jul 28 01:44:41.649511 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:41.649421    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a002835fd5fd3141a172b03dd6c05cd6cf8b646f01bb4d94b78dcefda467352"} err="failed to get container status \"5a002835fd5fd3141a172b03dd6c05cd6cf8b646f01bb4d94b78dcefda467352\": rpc error: code = NotFound desc = could not find container \"5a002835fd5fd3141a172b03dd6c05cd6cf8b646f01bb4d94b78dcefda467352\": container with ID starting with 5a002835fd5fd3141a172b03dd6c05cd6cf8b646f01bb4d94b78dcefda467352 not found: ID does not exist"
Jul 28 01:44:41.649511 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:41.649440    2560 scope.go:117] "RemoveContainer" containerID="9b796137ffdf1bac0572f448d0d71a9f5b72178e91936dfa1a7eda1fbdedcd50"
Jul 28 01:44:41.657710 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:41.657695    2560 scope.go:117] "RemoveContainer" containerID="9b796137ffdf1bac0572f448d0d71a9f5b72178e91936dfa1a7eda1fbdedcd50"
Jul 28 01:44:41.657954 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:41.657936    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-e887be66-666cb55f4f-4jxcv"]
Jul 28 01:44:41.658027 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:44:41.657956    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b796137ffdf1bac0572f448d0d71a9f5b72178e91936dfa1a7eda1fbdedcd50\": container with ID starting with 9b796137ffdf1bac0572f448d0d71a9f5b72178e91936dfa1a7eda1fbdedcd50 not found: ID does not exist" containerID="9b796137ffdf1bac0572f448d0d71a9f5b72178e91936dfa1a7eda1fbdedcd50"
Jul 28 01:44:41.658027 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:41.657991    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b796137ffdf1bac0572f448d0d71a9f5b72178e91936dfa1a7eda1fbdedcd50"} err="failed to get container status \"9b796137ffdf1bac0572f448d0d71a9f5b72178e91936dfa1a7eda1fbdedcd50\": rpc error: code = NotFound desc = could not find container \"9b796137ffdf1bac0572f448d0d71a9f5b72178e91936dfa1a7eda1fbdedcd50\": container with ID starting with 9b796137ffdf1bac0572f448d0d71a9f5b72178e91936dfa1a7eda1fbdedcd50 not found: ID does not exist"
Jul 28 01:44:41.662318 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:41.662296    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-e887be66-666cb55f4f-4jxcv"]
Jul 28 01:44:41.672724 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:41.672701    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-e887be66-669f49ff9b-ffh2s"]
Jul 28 01:44:41.676749 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:41.676720    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-e887be66-669f49ff9b-ffh2s"]
Jul 28 01:44:43.461078 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:43.461041    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="000d5360-e719-47e4-8b6c-4a7ec7081872" path="/var/lib/kubelet/pods/000d5360-e719-47e4-8b6c-4a7ec7081872/volumes"
Jul 28 01:44:43.461468 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:43.461431    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ade56061-895e-4fd6-9efd-99849f047250" path="/var/lib/kubelet/pods/ade56061-895e-4fd6-9efd-99849f047250/volumes"
Jul 28 01:44:43.792810 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:43.792719    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:44:45.337516 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:45.337480    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:44:45.495063 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:45.495035    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:44:45.714212 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:45.714186    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:44:45.939797 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:45.939764    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:44:46.241106 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:46.241075    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:44:46.615295 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:46.615268    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:44:48.337293 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:48.337259    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:44:48.418068 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:48.418032    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:44:48.474635 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:48.474597    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:44:48.949093 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:48.949057    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:44:49.040181 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:49.040145    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:44:49.041092 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:49.041068    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1c712754-7466bff56-wp7wh"]
Jul 28 01:44:49.041453 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:49.041441    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="000d5360-e719-47e4-8b6c-4a7ec7081872" containerName="payload-pre-processing"
Jul 28 01:44:49.041496 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:49.041456    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="000d5360-e719-47e4-8b6c-4a7ec7081872" containerName="payload-pre-processing"
Jul 28 01:44:49.041496 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:49.041471    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ade56061-895e-4fd6-9efd-99849f047250" containerName="payload-processing"
Jul 28 01:44:49.041496 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:49.041478    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ade56061-895e-4fd6-9efd-99849f047250" containerName="payload-processing"
Jul 28 01:44:49.041591 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:49.041544    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="000d5360-e719-47e4-8b6c-4a7ec7081872" containerName="payload-pre-processing"
Jul 28 01:44:49.041591 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:49.041556    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ade56061-895e-4fd6-9efd-99849f047250" containerName="payload-processing"
Jul 28 01:44:49.046590 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:49.046571    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c712754-7466bff56-wp7wh"
Jul 28 01:44:49.048506 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:49.048484    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-1c712754\""
Jul 28 01:44:49.052515 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:49.052496    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1c712754-7466bff56-wp7wh"]
Jul 28 01:44:49.077279 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:49.077249    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1c712754-7c6947c9b4-nbh8b"]
Jul 28 01:44:49.080664 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:49.080648    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1c712754-7c6947c9b4-nbh8b"
Jul 28 01:44:49.082633 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:49.082607    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-1c712754-dockercfg-zkl6x\""
Jul 28 01:44:49.094215 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:49.094191    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1c712754-7c6947c9b4-nbh8b"]
Jul 28 01:44:49.130409 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:49.130375    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:44:49.149361 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:49.149321    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfzmv\" (UniqueName: \"kubernetes.io/projected/570229a9-8e4f-41ed-a6d1-392ccd047243-kube-api-access-jfzmv\") pod \"payload-processing-e2e-ait-1c712754-7c6947c9b4-nbh8b\" (UID: \"570229a9-8e4f-41ed-a6d1-392ccd047243\") " pod="openshift-ingress/payload-processing-e2e-ait-1c712754-7c6947c9b4-nbh8b"
Jul 28 01:44:49.149525 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:49.149374    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20bc7ce9-c131-4c10-971f-f80099d51460-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-1c712754-7466bff56-wp7wh\" (UID: \"20bc7ce9-c131-4c10-971f-f80099d51460\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1c712754-7466bff56-wp7wh"
Jul 28 01:44:49.149525 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:49.149406    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/570229a9-8e4f-41ed-a6d1-392ccd047243-plugins-config-volume\") pod \"payload-processing-e2e-ait-1c712754-7c6947c9b4-nbh8b\" (UID: \"570229a9-8e4f-41ed-a6d1-392ccd047243\") " pod="openshift-ingress/payload-processing-e2e-ait-1c712754-7c6947c9b4-nbh8b"
Jul 28 01:44:49.149525 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:49.149427    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxr74\" (UniqueName: \"kubernetes.io/projected/20bc7ce9-c131-4c10-971f-f80099d51460-kube-api-access-kxr74\") pod \"payload-pre-processing-e2e-ait-1c712754-7466bff56-wp7wh\" (UID: \"20bc7ce9-c131-4c10-971f-f80099d51460\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1c712754-7466bff56-wp7wh"
Jul 28 01:44:49.250891 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:49.250783    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfzmv\" (UniqueName: \"kubernetes.io/projected/570229a9-8e4f-41ed-a6d1-392ccd047243-kube-api-access-jfzmv\") pod \"payload-processing-e2e-ait-1c712754-7c6947c9b4-nbh8b\" (UID: \"570229a9-8e4f-41ed-a6d1-392ccd047243\") " pod="openshift-ingress/payload-processing-e2e-ait-1c712754-7c6947c9b4-nbh8b"
Jul 28 01:44:49.250891 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:49.250851    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20bc7ce9-c131-4c10-971f-f80099d51460-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-1c712754-7466bff56-wp7wh\" (UID: \"20bc7ce9-c131-4c10-971f-f80099d51460\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1c712754-7466bff56-wp7wh"
Jul 28 01:44:49.250891 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:49.250884    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/570229a9-8e4f-41ed-a6d1-392ccd047243-plugins-config-volume\") pod \"payload-processing-e2e-ait-1c712754-7c6947c9b4-nbh8b\" (UID: \"570229a9-8e4f-41ed-a6d1-392ccd047243\") " pod="openshift-ingress/payload-processing-e2e-ait-1c712754-7c6947c9b4-nbh8b"
Jul 28 01:44:49.250891 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:49.250899    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxr74\" (UniqueName: \"kubernetes.io/projected/20bc7ce9-c131-4c10-971f-f80099d51460-kube-api-access-kxr74\") pod \"payload-pre-processing-e2e-ait-1c712754-7466bff56-wp7wh\" (UID: \"20bc7ce9-c131-4c10-971f-f80099d51460\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1c712754-7466bff56-wp7wh"
Jul 28 01:44:49.251626 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:49.251600    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/570229a9-8e4f-41ed-a6d1-392ccd047243-plugins-config-volume\") pod \"payload-processing-e2e-ait-1c712754-7c6947c9b4-nbh8b\" (UID: \"570229a9-8e4f-41ed-a6d1-392ccd047243\") " pod="openshift-ingress/payload-processing-e2e-ait-1c712754-7c6947c9b4-nbh8b"
Jul 28 01:44:49.251816 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:49.251710    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20bc7ce9-c131-4c10-971f-f80099d51460-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-1c712754-7466bff56-wp7wh\" (UID: \"20bc7ce9-c131-4c10-971f-f80099d51460\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1c712754-7466bff56-wp7wh"
Jul 28 01:44:49.258472 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:49.258450    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfzmv\" (UniqueName: \"kubernetes.io/projected/570229a9-8e4f-41ed-a6d1-392ccd047243-kube-api-access-jfzmv\") pod \"payload-processing-e2e-ait-1c712754-7c6947c9b4-nbh8b\" (UID: \"570229a9-8e4f-41ed-a6d1-392ccd047243\") " pod="openshift-ingress/payload-processing-e2e-ait-1c712754-7c6947c9b4-nbh8b"
Jul 28 01:44:49.258572 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:49.258504    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxr74\" (UniqueName: \"kubernetes.io/projected/20bc7ce9-c131-4c10-971f-f80099d51460-kube-api-access-kxr74\") pod \"payload-pre-processing-e2e-ait-1c712754-7466bff56-wp7wh\" (UID: \"20bc7ce9-c131-4c10-971f-f80099d51460\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1c712754-7466bff56-wp7wh"
Jul 28 01:44:49.357992 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:49.357955    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c712754-7466bff56-wp7wh"
Jul 28 01:44:49.392739 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:49.392710    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-1c712754-dockercfg-zkl6x\""
Jul 28 01:44:49.401232 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:49.401206    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1c712754-7c6947c9b4-nbh8b"
Jul 28 01:44:49.506287 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:49.506255    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1c712754-7466bff56-wp7wh"]
Jul 28 01:44:49.507274 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:44:49.507235    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20bc7ce9_c131_4c10_971f_f80099d51460.slice/crio-b6f69ec6ca366ee1ea7b6addd86cfaa563144c13336b7c03e1f3acb9d8b41ef9 WatchSource:0}: Error finding container b6f69ec6ca366ee1ea7b6addd86cfaa563144c13336b7c03e1f3acb9d8b41ef9: Status 404 returned error can't find the container with id b6f69ec6ca366ee1ea7b6addd86cfaa563144c13336b7c03e1f3acb9d8b41ef9
Jul 28 01:44:49.549655 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:49.549632    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1c712754-7c6947c9b4-nbh8b"]
Jul 28 01:44:49.562668 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:44:49.562641    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod570229a9_8e4f_41ed_a6d1_392ccd047243.slice/crio-d899148883d9cf8edfb558c77c67dac5b6d7d9a89b5bcbde76f29334261b5df1 WatchSource:0}: Error finding container d899148883d9cf8edfb558c77c67dac5b6d7d9a89b5bcbde76f29334261b5df1: Status 404 returned error can't find the container with id d899148883d9cf8edfb558c77c67dac5b6d7d9a89b5bcbde76f29334261b5df1
Jul 28 01:44:49.689071 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:49.689029    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1c712754-7c6947c9b4-nbh8b" event={"ID":"570229a9-8e4f-41ed-a6d1-392ccd047243","Type":"ContainerStarted","Data":"9e45e52cb2471e398c8f6b954f54d90528b8537c7c48bb4136c3da8d31f0abc9"}
Jul 28 01:44:49.689234 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:49.689094    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1c712754-7c6947c9b4-nbh8b" event={"ID":"570229a9-8e4f-41ed-a6d1-392ccd047243","Type":"ContainerStarted","Data":"d899148883d9cf8edfb558c77c67dac5b6d7d9a89b5bcbde76f29334261b5df1"}
Jul 28 01:44:49.689234 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:49.689122    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-1c712754-7c6947c9b4-nbh8b"
Jul 28 01:44:49.690618 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:49.690587    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c712754-7466bff56-wp7wh" event={"ID":"20bc7ce9-c131-4c10-971f-f80099d51460","Type":"ContainerStarted","Data":"c6777eb60ea483aef111e2ddfe13d58af77f30a07773b2b4fbb36500782fe45e"}
Jul 28 01:44:49.690737 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:49.690637    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c712754-7466bff56-wp7wh" event={"ID":"20bc7ce9-c131-4c10-971f-f80099d51460","Type":"ContainerStarted","Data":"b6f69ec6ca366ee1ea7b6addd86cfaa563144c13336b7c03e1f3acb9d8b41ef9"}
Jul 28 01:44:49.690737 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:49.690666    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c712754-7466bff56-wp7wh"
Jul 28 01:44:49.704992 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:49.704949    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-1c712754-7c6947c9b4-nbh8b" podStartSLOduration=0.704934098 podStartE2EDuration="704.934098ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:44:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:44:49.703313716 +0000 UTC m=+1740.737357122" watchObservedRunningTime="2026-07-28 01:44:49.704934098 +0000 UTC m=+1740.738977490"
Jul 28 01:44:49.719135 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:49.719081    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c712754-7466bff56-wp7wh" podStartSLOduration=0.719060901 podStartE2EDuration="719.060901ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:44:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:44:49.717496845 +0000 UTC m=+1740.751540315" watchObservedRunningTime="2026-07-28 01:44:49.719060901 +0000 UTC m=+1740.753104296"
Jul 28 01:44:54.982514 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:44:54.982476    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:45:00.697517 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:00.697487    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c712754-7466bff56-wp7wh"
Jul 28 01:45:00.697888 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:00.697555    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-1c712754-7c6947c9b4-nbh8b"
Jul 28 01:45:24.645545 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:24.645508    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1c712754-7c6947c9b4-nbh8b"]
Jul 28 01:45:24.646098 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:24.645757    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-1c712754-7c6947c9b4-nbh8b" podUID="570229a9-8e4f-41ed-a6d1-392ccd047243" containerName="payload-processing" containerID="cri-o://9e45e52cb2471e398c8f6b954f54d90528b8537c7c48bb4136c3da8d31f0abc9" gracePeriod=30
Jul 28 01:45:24.652987 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:24.652949    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1c712754-7466bff56-wp7wh"]
Jul 28 01:45:24.653207 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:24.653178    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c712754-7466bff56-wp7wh" podUID="20bc7ce9-c131-4c10-971f-f80099d51460" containerName="payload-pre-processing" containerID="cri-o://c6777eb60ea483aef111e2ddfe13d58af77f30a07773b2b4fbb36500782fe45e" gracePeriod=30
Jul 28 01:45:24.655185 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:24.655158    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:45:24.750513 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:24.750480    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:45:24.860439 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:24.860402    2560 generic.go:356] "Generic (PLEG): container finished" podID="570229a9-8e4f-41ed-a6d1-392ccd047243" containerID="9e45e52cb2471e398c8f6b954f54d90528b8537c7c48bb4136c3da8d31f0abc9" exitCode=0
Jul 28 01:45:24.860594 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:24.860473    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1c712754-7c6947c9b4-nbh8b" event={"ID":"570229a9-8e4f-41ed-a6d1-392ccd047243","Type":"ContainerDied","Data":"9e45e52cb2471e398c8f6b954f54d90528b8537c7c48bb4136c3da8d31f0abc9"}
Jul 28 01:45:24.862294 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:24.862271    2560 generic.go:356] "Generic (PLEG): container finished" podID="20bc7ce9-c131-4c10-971f-f80099d51460" containerID="c6777eb60ea483aef111e2ddfe13d58af77f30a07773b2b4fbb36500782fe45e" exitCode=0
Jul 28 01:45:24.862427 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:24.862328    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c712754-7466bff56-wp7wh" event={"ID":"20bc7ce9-c131-4c10-971f-f80099d51460","Type":"ContainerDied","Data":"c6777eb60ea483aef111e2ddfe13d58af77f30a07773b2b4fbb36500782fe45e"}
Jul 28 01:45:24.919447 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:24.919426    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1c712754-7c6947c9b4-nbh8b"
Jul 28 01:45:24.922564 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:24.922545    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c712754-7466bff56-wp7wh"
Jul 28 01:45:24.986336 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:24.986304    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxr74\" (UniqueName: \"kubernetes.io/projected/20bc7ce9-c131-4c10-971f-f80099d51460-kube-api-access-kxr74\") pod \"20bc7ce9-c131-4c10-971f-f80099d51460\" (UID: \"20bc7ce9-c131-4c10-971f-f80099d51460\") "
Jul 28 01:45:24.986533 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:24.986378    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/570229a9-8e4f-41ed-a6d1-392ccd047243-plugins-config-volume\") pod \"570229a9-8e4f-41ed-a6d1-392ccd047243\" (UID: \"570229a9-8e4f-41ed-a6d1-392ccd047243\") "
Jul 28 01:45:24.986533 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:24.986404    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20bc7ce9-c131-4c10-971f-f80099d51460-plugins-config-volume\") pod \"20bc7ce9-c131-4c10-971f-f80099d51460\" (UID: \"20bc7ce9-c131-4c10-971f-f80099d51460\") "
Jul 28 01:45:24.986533 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:24.986516    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jfzmv\" (UniqueName: \"kubernetes.io/projected/570229a9-8e4f-41ed-a6d1-392ccd047243-kube-api-access-jfzmv\") pod \"570229a9-8e4f-41ed-a6d1-392ccd047243\" (UID: \"570229a9-8e4f-41ed-a6d1-392ccd047243\") "
Jul 28 01:45:24.986771 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:24.986745    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20bc7ce9-c131-4c10-971f-f80099d51460-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "20bc7ce9-c131-4c10-971f-f80099d51460" (UID: "20bc7ce9-c131-4c10-971f-f80099d51460"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:45:24.986842 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:24.986770    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/570229a9-8e4f-41ed-a6d1-392ccd047243-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "570229a9-8e4f-41ed-a6d1-392ccd047243" (UID: "570229a9-8e4f-41ed-a6d1-392ccd047243"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:45:24.986895 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:24.986880    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/570229a9-8e4f-41ed-a6d1-392ccd047243-plugins-config-volume\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:45:24.986942 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:24.986899    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20bc7ce9-c131-4c10-971f-f80099d51460-plugins-config-volume\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:45:24.988594 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:24.988571    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20bc7ce9-c131-4c10-971f-f80099d51460-kube-api-access-kxr74" (OuterVolumeSpecName: "kube-api-access-kxr74") pod "20bc7ce9-c131-4c10-971f-f80099d51460" (UID: "20bc7ce9-c131-4c10-971f-f80099d51460"). InnerVolumeSpecName "kube-api-access-kxr74". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:45:24.988674 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:24.988624    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/570229a9-8e4f-41ed-a6d1-392ccd047243-kube-api-access-jfzmv" (OuterVolumeSpecName: "kube-api-access-jfzmv") pod "570229a9-8e4f-41ed-a6d1-392ccd047243" (UID: "570229a9-8e4f-41ed-a6d1-392ccd047243"). InnerVolumeSpecName "kube-api-access-jfzmv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:45:25.088083 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:25.088043    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfzmv\" (UniqueName: \"kubernetes.io/projected/570229a9-8e4f-41ed-a6d1-392ccd047243-kube-api-access-jfzmv\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:45:25.088083 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:25.088073    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxr74\" (UniqueName: \"kubernetes.io/projected/20bc7ce9-c131-4c10-971f-f80099d51460-kube-api-access-kxr74\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:45:25.867839 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:25.867800    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c712754-7466bff56-wp7wh"
Jul 28 01:45:25.868286 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:25.867803    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1c712754-7466bff56-wp7wh" event={"ID":"20bc7ce9-c131-4c10-971f-f80099d51460","Type":"ContainerDied","Data":"b6f69ec6ca366ee1ea7b6addd86cfaa563144c13336b7c03e1f3acb9d8b41ef9"}
Jul 28 01:45:25.868286 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:25.867972    2560 scope.go:117] "RemoveContainer" containerID="c6777eb60ea483aef111e2ddfe13d58af77f30a07773b2b4fbb36500782fe45e"
Jul 28 01:45:25.869341 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:25.869162    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1c712754-7c6947c9b4-nbh8b" event={"ID":"570229a9-8e4f-41ed-a6d1-392ccd047243","Type":"ContainerDied","Data":"d899148883d9cf8edfb558c77c67dac5b6d7d9a89b5bcbde76f29334261b5df1"}
Jul 28 01:45:25.869341 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:25.869186    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1c712754-7c6947c9b4-nbh8b"
Jul 28 01:45:25.876720 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:25.876689    2560 scope.go:117] "RemoveContainer" containerID="9e45e52cb2471e398c8f6b954f54d90528b8537c7c48bb4136c3da8d31f0abc9"
Jul 28 01:45:25.885524 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:25.885505    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1c712754-7466bff56-wp7wh"]
Jul 28 01:45:25.889787 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:25.889767    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1c712754-7466bff56-wp7wh"]
Jul 28 01:45:25.899858 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:25.899840    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1c712754-7c6947c9b4-nbh8b"]
Jul 28 01:45:25.902633 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:25.902615    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1c712754-7c6947c9b4-nbh8b"]
Jul 28 01:45:27.461076 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:27.461045    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20bc7ce9-c131-4c10-971f-f80099d51460" path="/var/lib/kubelet/pods/20bc7ce9-c131-4c10-971f-f80099d51460/volumes"
Jul 28 01:45:27.461475 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:27.461420    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="570229a9-8e4f-41ed-a6d1-392ccd047243" path="/var/lib/kubelet/pods/570229a9-8e4f-41ed-a6d1-392ccd047243/volumes"
Jul 28 01:45:27.789968 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:27.789883    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:45:29.161127 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:29.161078    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:45:30.362971 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:30.362915    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:45:30.629057 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:30.628974    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:45:30.874174 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:30.874132    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:45:31.251705 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:31.251674    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:45:31.401110 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:31.401082    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:45:33.601436 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:33.601401    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:45:33.678344 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:33.678311    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:45:33.743863 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:33.743831    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:45:33.938178 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:33.938144    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:45:34.152681 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:34.152653    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:45:34.256469 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:34.256394    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:45:34.257334 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:34.257316    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-5442bcc0-7c5d88b668-9hd8w"]
Jul 28 01:45:34.257716 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:34.257703    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="570229a9-8e4f-41ed-a6d1-392ccd047243" containerName="payload-processing"
Jul 28 01:45:34.257755 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:34.257718    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="570229a9-8e4f-41ed-a6d1-392ccd047243" containerName="payload-processing"
Jul 28 01:45:34.257755 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:34.257740    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20bc7ce9-c131-4c10-971f-f80099d51460" containerName="payload-pre-processing"
Jul 28 01:45:34.257755 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:34.257745    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="20bc7ce9-c131-4c10-971f-f80099d51460" containerName="payload-pre-processing"
Jul 28 01:45:34.257844 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:34.257818    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="570229a9-8e4f-41ed-a6d1-392ccd047243" containerName="payload-processing"
Jul 28 01:45:34.257844 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:34.257833    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="20bc7ce9-c131-4c10-971f-f80099d51460" containerName="payload-pre-processing"
Jul 28 01:45:34.262487 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:34.262469    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-5442bcc0-7c5d88b668-9hd8w"
Jul 28 01:45:34.264390 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:34.264370    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-5442bcc0\""
Jul 28 01:45:34.267937 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:34.267908    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-5442bcc0-7c5d88b668-9hd8w"]
Jul 28 01:45:34.295903 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:34.295870    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-5442bcc0-6944d96d4b-qx4dm"]
Jul 28 01:45:34.299255 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:34.299237    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-5442bcc0-6944d96d4b-qx4dm"
Jul 28 01:45:34.301286 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:34.301266    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-5442bcc0-dockercfg-qmrlz\""
Jul 28 01:45:34.306657 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:34.306632    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-5442bcc0-6944d96d4b-qx4dm"]
Jul 28 01:45:34.374776 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:34.374739    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b16c8f2d-dfad-4c8c-a594-62c47ac69a5f-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-5442bcc0-7c5d88b668-9hd8w\" (UID: \"b16c8f2d-dfad-4c8c-a594-62c47ac69a5f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-5442bcc0-7c5d88b668-9hd8w"
Jul 28 01:45:34.374930 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:34.374831    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbhjj\" (UniqueName: \"kubernetes.io/projected/b16c8f2d-dfad-4c8c-a594-62c47ac69a5f-kube-api-access-wbhjj\") pod \"payload-pre-processing-e2e-derive-5442bcc0-7c5d88b668-9hd8w\" (UID: \"b16c8f2d-dfad-4c8c-a594-62c47ac69a5f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-5442bcc0-7c5d88b668-9hd8w"
Jul 28 01:45:34.374930 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:34.374859    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p5bp\" (UniqueName: \"kubernetes.io/projected/0a65bdeb-cf22-40fc-b73a-319875faf127-kube-api-access-7p5bp\") pod \"payload-processing-e2e-derive-5442bcc0-6944d96d4b-qx4dm\" (UID: \"0a65bdeb-cf22-40fc-b73a-319875faf127\") " pod="openshift-ingress/payload-processing-e2e-derive-5442bcc0-6944d96d4b-qx4dm"
Jul 28 01:45:34.374930 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:34.374893    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a65bdeb-cf22-40fc-b73a-319875faf127-plugins-config-volume\") pod \"payload-processing-e2e-derive-5442bcc0-6944d96d4b-qx4dm\" (UID: \"0a65bdeb-cf22-40fc-b73a-319875faf127\") " pod="openshift-ingress/payload-processing-e2e-derive-5442bcc0-6944d96d4b-qx4dm"
Jul 28 01:45:34.475412 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:34.475373    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b16c8f2d-dfad-4c8c-a594-62c47ac69a5f-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-5442bcc0-7c5d88b668-9hd8w\" (UID: \"b16c8f2d-dfad-4c8c-a594-62c47ac69a5f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-5442bcc0-7c5d88b668-9hd8w"
Jul 28 01:45:34.475610 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:34.475473    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbhjj\" (UniqueName: \"kubernetes.io/projected/b16c8f2d-dfad-4c8c-a594-62c47ac69a5f-kube-api-access-wbhjj\") pod \"payload-pre-processing-e2e-derive-5442bcc0-7c5d88b668-9hd8w\" (UID: \"b16c8f2d-dfad-4c8c-a594-62c47ac69a5f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-5442bcc0-7c5d88b668-9hd8w"
Jul 28 01:45:34.475610 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:34.475513    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p5bp\" (UniqueName: \"kubernetes.io/projected/0a65bdeb-cf22-40fc-b73a-319875faf127-kube-api-access-7p5bp\") pod \"payload-processing-e2e-derive-5442bcc0-6944d96d4b-qx4dm\" (UID: \"0a65bdeb-cf22-40fc-b73a-319875faf127\") " pod="openshift-ingress/payload-processing-e2e-derive-5442bcc0-6944d96d4b-qx4dm"
Jul 28 01:45:34.475610 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:34.475557    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a65bdeb-cf22-40fc-b73a-319875faf127-plugins-config-volume\") pod \"payload-processing-e2e-derive-5442bcc0-6944d96d4b-qx4dm\" (UID: \"0a65bdeb-cf22-40fc-b73a-319875faf127\") " pod="openshift-ingress/payload-processing-e2e-derive-5442bcc0-6944d96d4b-qx4dm"
Jul 28 01:45:34.476322 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:34.476295    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b16c8f2d-dfad-4c8c-a594-62c47ac69a5f-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-5442bcc0-7c5d88b668-9hd8w\" (UID: \"b16c8f2d-dfad-4c8c-a594-62c47ac69a5f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-5442bcc0-7c5d88b668-9hd8w"
Jul 28 01:45:34.476404 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:34.476345    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a65bdeb-cf22-40fc-b73a-319875faf127-plugins-config-volume\") pod \"payload-processing-e2e-derive-5442bcc0-6944d96d4b-qx4dm\" (UID: \"0a65bdeb-cf22-40fc-b73a-319875faf127\") " pod="openshift-ingress/payload-processing-e2e-derive-5442bcc0-6944d96d4b-qx4dm"
Jul 28 01:45:34.483905 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:34.483880    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p5bp\" (UniqueName: \"kubernetes.io/projected/0a65bdeb-cf22-40fc-b73a-319875faf127-kube-api-access-7p5bp\") pod \"payload-processing-e2e-derive-5442bcc0-6944d96d4b-qx4dm\" (UID: \"0a65bdeb-cf22-40fc-b73a-319875faf127\") " pod="openshift-ingress/payload-processing-e2e-derive-5442bcc0-6944d96d4b-qx4dm"
Jul 28 01:45:34.483991 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:34.483939    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbhjj\" (UniqueName: \"kubernetes.io/projected/b16c8f2d-dfad-4c8c-a594-62c47ac69a5f-kube-api-access-wbhjj\") pod \"payload-pre-processing-e2e-derive-5442bcc0-7c5d88b668-9hd8w\" (UID: \"b16c8f2d-dfad-4c8c-a594-62c47ac69a5f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-5442bcc0-7c5d88b668-9hd8w"
Jul 28 01:45:34.574804 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:34.574709    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-5442bcc0-7c5d88b668-9hd8w"
Jul 28 01:45:34.611242 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:34.611211    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-5442bcc0-6944d96d4b-qx4dm"
Jul 28 01:45:34.722089 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:34.722058    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-5442bcc0-7c5d88b668-9hd8w"]
Jul 28 01:45:34.726872 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:45:34.726842    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb16c8f2d_dfad_4c8c_a594_62c47ac69a5f.slice/crio-d4c496dabb331d5e42e139d702ad20a1bd953e77b1a4f502479c184205b32c5e WatchSource:0}: Error finding container d4c496dabb331d5e42e139d702ad20a1bd953e77b1a4f502479c184205b32c5e: Status 404 returned error can't find the container with id d4c496dabb331d5e42e139d702ad20a1bd953e77b1a4f502479c184205b32c5e
Jul 28 01:45:34.757363 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:34.757323    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-5442bcc0-6944d96d4b-qx4dm"]
Jul 28 01:45:34.772521 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:45:34.772486    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a65bdeb_cf22_40fc_b73a_319875faf127.slice/crio-51527843c9c14ac8a01f7dc234ea97f4261ffea575cc22e75ea62ebef9243f48 WatchSource:0}: Error finding container 51527843c9c14ac8a01f7dc234ea97f4261ffea575cc22e75ea62ebef9243f48: Status 404 returned error can't find the container with id 51527843c9c14ac8a01f7dc234ea97f4261ffea575cc22e75ea62ebef9243f48
Jul 28 01:45:34.914051 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:34.914015    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-5442bcc0-7c5d88b668-9hd8w" event={"ID":"b16c8f2d-dfad-4c8c-a594-62c47ac69a5f","Type":"ContainerStarted","Data":"51bd1a254b1ebe6a4b3f862894d66c32538c4afe486648a2aa7ebadc297029f0"}
Jul 28 01:45:34.914251 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:34.914067    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-5442bcc0-7c5d88b668-9hd8w" event={"ID":"b16c8f2d-dfad-4c8c-a594-62c47ac69a5f","Type":"ContainerStarted","Data":"d4c496dabb331d5e42e139d702ad20a1bd953e77b1a4f502479c184205b32c5e"}
Jul 28 01:45:34.914569 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:34.914532    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-5442bcc0-7c5d88b668-9hd8w"
Jul 28 01:45:34.921196 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:34.921168    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-5442bcc0-6944d96d4b-qx4dm" event={"ID":"0a65bdeb-cf22-40fc-b73a-319875faf127","Type":"ContainerStarted","Data":"e4b79c204c954b6cbd069ce615fc29edd989131b156e3d6324b4f833bf1ab9a3"}
Jul 28 01:45:34.921386 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:34.921265    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-5442bcc0-6944d96d4b-qx4dm" event={"ID":"0a65bdeb-cf22-40fc-b73a-319875faf127","Type":"ContainerStarted","Data":"51527843c9c14ac8a01f7dc234ea97f4261ffea575cc22e75ea62ebef9243f48"}
Jul 28 01:45:34.921857 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:34.921835    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-5442bcc0-6944d96d4b-qx4dm"
Jul 28 01:45:34.931039 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:34.930992    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-5442bcc0-7c5d88b668-9hd8w" podStartSLOduration=0.930978271 podStartE2EDuration="930.978271ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:45:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:45:34.929423235 +0000 UTC m=+1785.963466629" watchObservedRunningTime="2026-07-28 01:45:34.930978271 +0000 UTC m=+1785.965021664"
Jul 28 01:45:34.944104 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:34.944038    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-5442bcc0-6944d96d4b-qx4dm" podStartSLOduration=0.944019651 podStartE2EDuration="944.019651ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:45:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:45:34.943225894 +0000 UTC m=+1785.977269286" watchObservedRunningTime="2026-07-28 01:45:34.944019651 +0000 UTC m=+1785.978063047"
Jul 28 01:45:36.885074 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:36.885041    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:45:45.929607 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:45.929507    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-derive-5442bcc0-7c5d88b668-9hd8w" podUID="b16c8f2d-dfad-4c8c-a594-62c47ac69a5f" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.42:9004: connect: connection refused"
Jul 28 01:45:45.930128 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:45.930108    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-5442bcc0-6944d96d4b-qx4dm"
Jul 28 01:45:49.516231 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:49.516204    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5f2zn_5311b0bc-9ad2-4e2f-bdde-81510c6d6b19/ovn-acl-logging/0.log"
Jul 28 01:45:49.517158 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:49.517136    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5f2zn_5311b0bc-9ad2-4e2f-bdde-81510c6d6b19/ovn-acl-logging/0.log"
Jul 28 01:45:55.929531 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:45:55.929502    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-5442bcc0-7c5d88b668-9hd8w"
Jul 28 01:46:08.944340 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:08.944301    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:46:08.983070 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:08.983037    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-5442bcc0-6944d96d4b-qx4dm"]
Jul 28 01:46:08.983306 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:08.983280    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-5442bcc0-6944d96d4b-qx4dm" podUID="0a65bdeb-cf22-40fc-b73a-319875faf127" containerName="payload-processing" containerID="cri-o://e4b79c204c954b6cbd069ce615fc29edd989131b156e3d6324b4f833bf1ab9a3" gracePeriod=30
Jul 28 01:46:08.988855 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:08.988824    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-5442bcc0-7c5d88b668-9hd8w"]
Jul 28 01:46:08.989224 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:08.989044    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-5442bcc0-7c5d88b668-9hd8w" podUID="b16c8f2d-dfad-4c8c-a594-62c47ac69a5f" containerName="payload-pre-processing" containerID="cri-o://51bd1a254b1ebe6a4b3f862894d66c32538c4afe486648a2aa7ebadc297029f0" gracePeriod=30
Jul 28 01:46:09.018816 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:09.018796    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:46:09.119904 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:09.119876    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:46:09.263780 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:09.263756    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-5442bcc0-6944d96d4b-qx4dm"
Jul 28 01:46:09.266737 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:09.266713    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-5442bcc0-7c5d88b668-9hd8w"
Jul 28 01:46:09.393771 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:09.393736    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbhjj\" (UniqueName: \"kubernetes.io/projected/b16c8f2d-dfad-4c8c-a594-62c47ac69a5f-kube-api-access-wbhjj\") pod \"b16c8f2d-dfad-4c8c-a594-62c47ac69a5f\" (UID: \"b16c8f2d-dfad-4c8c-a594-62c47ac69a5f\") "
Jul 28 01:46:09.393771 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:09.393771    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b16c8f2d-dfad-4c8c-a594-62c47ac69a5f-plugins-config-volume\") pod \"b16c8f2d-dfad-4c8c-a594-62c47ac69a5f\" (UID: \"b16c8f2d-dfad-4c8c-a594-62c47ac69a5f\") "
Jul 28 01:46:09.393985 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:09.393800    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7p5bp\" (UniqueName: \"kubernetes.io/projected/0a65bdeb-cf22-40fc-b73a-319875faf127-kube-api-access-7p5bp\") pod \"0a65bdeb-cf22-40fc-b73a-319875faf127\" (UID: \"0a65bdeb-cf22-40fc-b73a-319875faf127\") "
Jul 28 01:46:09.393985 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:09.393823    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a65bdeb-cf22-40fc-b73a-319875faf127-plugins-config-volume\") pod \"0a65bdeb-cf22-40fc-b73a-319875faf127\" (UID: \"0a65bdeb-cf22-40fc-b73a-319875faf127\") "
Jul 28 01:46:09.394298 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:09.394268    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a65bdeb-cf22-40fc-b73a-319875faf127-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0a65bdeb-cf22-40fc-b73a-319875faf127" (UID: "0a65bdeb-cf22-40fc-b73a-319875faf127"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:46:09.394462 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:09.394275    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b16c8f2d-dfad-4c8c-a594-62c47ac69a5f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b16c8f2d-dfad-4c8c-a594-62c47ac69a5f" (UID: "b16c8f2d-dfad-4c8c-a594-62c47ac69a5f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:46:09.395986 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:09.395964    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a65bdeb-cf22-40fc-b73a-319875faf127-kube-api-access-7p5bp" (OuterVolumeSpecName: "kube-api-access-7p5bp") pod "0a65bdeb-cf22-40fc-b73a-319875faf127" (UID: "0a65bdeb-cf22-40fc-b73a-319875faf127"). InnerVolumeSpecName "kube-api-access-7p5bp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:46:09.396098 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:09.396042    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b16c8f2d-dfad-4c8c-a594-62c47ac69a5f-kube-api-access-wbhjj" (OuterVolumeSpecName: "kube-api-access-wbhjj") pod "b16c8f2d-dfad-4c8c-a594-62c47ac69a5f" (UID: "b16c8f2d-dfad-4c8c-a594-62c47ac69a5f"). InnerVolumeSpecName "kube-api-access-wbhjj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:46:09.495453 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:09.495345    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbhjj\" (UniqueName: \"kubernetes.io/projected/b16c8f2d-dfad-4c8c-a594-62c47ac69a5f-kube-api-access-wbhjj\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:46:09.495453 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:09.495400    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b16c8f2d-dfad-4c8c-a594-62c47ac69a5f-plugins-config-volume\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:46:09.495453 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:09.495412    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7p5bp\" (UniqueName: \"kubernetes.io/projected/0a65bdeb-cf22-40fc-b73a-319875faf127-kube-api-access-7p5bp\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:46:09.495453 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:09.495420    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a65bdeb-cf22-40fc-b73a-319875faf127-plugins-config-volume\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:46:10.099994 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:10.099953    2560 generic.go:356] "Generic (PLEG): container finished" podID="b16c8f2d-dfad-4c8c-a594-62c47ac69a5f" containerID="51bd1a254b1ebe6a4b3f862894d66c32538c4afe486648a2aa7ebadc297029f0" exitCode=0
Jul 28 01:46:10.100501 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:10.100008    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-5442bcc0-7c5d88b668-9hd8w"
Jul 28 01:46:10.100501 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:10.100040    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-5442bcc0-7c5d88b668-9hd8w" event={"ID":"b16c8f2d-dfad-4c8c-a594-62c47ac69a5f","Type":"ContainerDied","Data":"51bd1a254b1ebe6a4b3f862894d66c32538c4afe486648a2aa7ebadc297029f0"}
Jul 28 01:46:10.100501 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:10.100138    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-5442bcc0-7c5d88b668-9hd8w" event={"ID":"b16c8f2d-dfad-4c8c-a594-62c47ac69a5f","Type":"ContainerDied","Data":"d4c496dabb331d5e42e139d702ad20a1bd953e77b1a4f502479c184205b32c5e"}
Jul 28 01:46:10.100501 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:10.100173    2560 scope.go:117] "RemoveContainer" containerID="51bd1a254b1ebe6a4b3f862894d66c32538c4afe486648a2aa7ebadc297029f0"
Jul 28 01:46:10.101486 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:10.101247    2560 generic.go:356] "Generic (PLEG): container finished" podID="0a65bdeb-cf22-40fc-b73a-319875faf127" containerID="e4b79c204c954b6cbd069ce615fc29edd989131b156e3d6324b4f833bf1ab9a3" exitCode=0
Jul 28 01:46:10.101486 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:10.101297    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-5442bcc0-6944d96d4b-qx4dm" event={"ID":"0a65bdeb-cf22-40fc-b73a-319875faf127","Type":"ContainerDied","Data":"e4b79c204c954b6cbd069ce615fc29edd989131b156e3d6324b4f833bf1ab9a3"}
Jul 28 01:46:10.101486 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:10.101302    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-5442bcc0-6944d96d4b-qx4dm"
Jul 28 01:46:10.101486 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:10.101367    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-5442bcc0-6944d96d4b-qx4dm" event={"ID":"0a65bdeb-cf22-40fc-b73a-319875faf127","Type":"ContainerDied","Data":"51527843c9c14ac8a01f7dc234ea97f4261ffea575cc22e75ea62ebef9243f48"}
Jul 28 01:46:10.108667 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:10.108651    2560 scope.go:117] "RemoveContainer" containerID="51bd1a254b1ebe6a4b3f862894d66c32538c4afe486648a2aa7ebadc297029f0"
Jul 28 01:46:10.108946 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:46:10.108886    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51bd1a254b1ebe6a4b3f862894d66c32538c4afe486648a2aa7ebadc297029f0\": container with ID starting with 51bd1a254b1ebe6a4b3f862894d66c32538c4afe486648a2aa7ebadc297029f0 not found: ID does not exist" containerID="51bd1a254b1ebe6a4b3f862894d66c32538c4afe486648a2aa7ebadc297029f0"
Jul 28 01:46:10.108998 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:10.108954    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51bd1a254b1ebe6a4b3f862894d66c32538c4afe486648a2aa7ebadc297029f0"} err="failed to get container status \"51bd1a254b1ebe6a4b3f862894d66c32538c4afe486648a2aa7ebadc297029f0\": rpc error: code = NotFound desc = could not find container \"51bd1a254b1ebe6a4b3f862894d66c32538c4afe486648a2aa7ebadc297029f0\": container with ID starting with 51bd1a254b1ebe6a4b3f862894d66c32538c4afe486648a2aa7ebadc297029f0 not found: ID does not exist"
Jul 28 01:46:10.108998 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:10.108971    2560 scope.go:117] "RemoveContainer" containerID="e4b79c204c954b6cbd069ce615fc29edd989131b156e3d6324b4f833bf1ab9a3"
Jul 28 01:46:10.116341 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:10.116315    2560 scope.go:117] "RemoveContainer" containerID="e4b79c204c954b6cbd069ce615fc29edd989131b156e3d6324b4f833bf1ab9a3"
Jul 28 01:46:10.116733 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:46:10.116702    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4b79c204c954b6cbd069ce615fc29edd989131b156e3d6324b4f833bf1ab9a3\": container with ID starting with e4b79c204c954b6cbd069ce615fc29edd989131b156e3d6324b4f833bf1ab9a3 not found: ID does not exist" containerID="e4b79c204c954b6cbd069ce615fc29edd989131b156e3d6324b4f833bf1ab9a3"
Jul 28 01:46:10.116834 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:10.116751    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4b79c204c954b6cbd069ce615fc29edd989131b156e3d6324b4f833bf1ab9a3"} err="failed to get container status \"e4b79c204c954b6cbd069ce615fc29edd989131b156e3d6324b4f833bf1ab9a3\": rpc error: code = NotFound desc = could not find container \"e4b79c204c954b6cbd069ce615fc29edd989131b156e3d6324b4f833bf1ab9a3\": container with ID starting with e4b79c204c954b6cbd069ce615fc29edd989131b156e3d6324b4f833bf1ab9a3 not found: ID does not exist"
Jul 28 01:46:10.118204 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:10.118185    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-5442bcc0-6944d96d4b-qx4dm"]
Jul 28 01:46:10.120973 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:10.120939    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-5442bcc0-6944d96d4b-qx4dm"]
Jul 28 01:46:10.130391 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:10.130338    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-5442bcc0-7c5d88b668-9hd8w"]
Jul 28 01:46:10.138950 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:10.138928    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-5442bcc0-7c5d88b668-9hd8w"]
Jul 28 01:46:11.460448 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:11.460411    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a65bdeb-cf22-40fc-b73a-319875faf127" path="/var/lib/kubelet/pods/0a65bdeb-cf22-40fc-b73a-319875faf127/volumes"
Jul 28 01:46:11.460941 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:11.460921    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b16c8f2d-dfad-4c8c-a594-62c47ac69a5f" path="/var/lib/kubelet/pods/b16c8f2d-dfad-4c8c-a594-62c47ac69a5f/volumes"
Jul 28 01:46:11.975028 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:11.974989    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:46:13.579977 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:13.579940    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:46:13.740179 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:13.740150    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:46:14.016644 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:14.016614    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:46:14.539149 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:14.539119    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:46:14.635602 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:14.635568    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:46:14.735596 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:14.735565    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:46:16.262412 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:16.262347    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:46:22.386017 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:22.385983    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:46:22.487742 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:22.487712    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:46:22.588101 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:22.588065    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:46:22.691495 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:22.691417    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:46:23.165589 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:23.165554    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:46:49.207372 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:49.207312    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:46:55.263913 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:55.263871    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:46:55.364854 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:55.364821    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:46:55.464429 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:46:55.464399    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:11.447542 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:47:11.447461    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:17.242563 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:47:17.242527    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:17.346581 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:47:17.346541    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:17.442967 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:47:17.442933    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:27.956677 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:47:27.956632    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:28.789961 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:47:28.789923    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:35.035019 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:47:35.034966    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:35.143535 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:47:35.143496    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:35.237424 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:47:35.237345    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:35.335250 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:47:35.335169    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:37.683686 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:47:37.683654    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:47:44.741124 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:47:44.741088    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:44.831477 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:47:44.831437    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:44.932668 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:47:44.932634    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:46.684440 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:47:46.684404    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:48.582866 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:47:48.582826    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:47:52.511706 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:47:52.511652    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:53.579629 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:47:53.579592    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:58.827821 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:47:58.827775    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:58.893501 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:47:58.893467    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:59.077044 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:47:59.077012    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:59.285068 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:47:59.285034    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:47:59.385052 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:47:59.385021    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:59.516377 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:47:59.516329    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:48:02.070583 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:02.070547    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:48:02.162050 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:02.162012    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:48:02.226032 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:02.225997    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:48:02.445000 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:02.444966    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:48:02.855081 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:02.854998    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:48:02.962365 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:02.962309    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:48:02.962532 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:02.962374    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-43a6ae00-587c5bcb96-7x7cr"]
Jul 28 01:48:02.962748 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:02.962734    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a65bdeb-cf22-40fc-b73a-319875faf127" containerName="payload-processing"
Jul 28 01:48:02.962795 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:02.962750    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a65bdeb-cf22-40fc-b73a-319875faf127" containerName="payload-processing"
Jul 28 01:48:02.962795 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:02.962770    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b16c8f2d-dfad-4c8c-a594-62c47ac69a5f" containerName="payload-pre-processing"
Jul 28 01:48:02.962795 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:02.962776    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b16c8f2d-dfad-4c8c-a594-62c47ac69a5f" containerName="payload-pre-processing"
Jul 28 01:48:02.962896 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:02.962827    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b16c8f2d-dfad-4c8c-a594-62c47ac69a5f" containerName="payload-pre-processing"
Jul 28 01:48:02.962896 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:02.962838    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a65bdeb-cf22-40fc-b73a-319875faf127" containerName="payload-processing"
Jul 28 01:48:02.965535 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:02.965518    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-43a6ae00-587c5bcb96-7x7cr"
Jul 28 01:48:02.971438 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:02.971414    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-43a6ae00-dockercfg-4t84x\""
Jul 28 01:48:02.971604 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:02.971585    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-43a6ae00\""
Jul 28 01:48:02.978256 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:02.978236    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-43a6ae00-587c5bcb96-7x7cr"]
Jul 28 01:48:02.995928 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:02.995900    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-43a6ae00-c87dd98d6-ngq6m"]
Jul 28 01:48:02.999415 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:02.999395    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-43a6ae00-c87dd98d6-ngq6m"
Jul 28 01:48:03.011368 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:03.011321    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-43a6ae00-c87dd98d6-ngq6m"]
Jul 28 01:48:03.126705 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:03.126669    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3537391-ccca-430f-a599-1d924b18520e-plugins-config-volume\") pod \"payload-processing-e2e-mt-43a6ae00-c87dd98d6-ngq6m\" (UID: \"e3537391-ccca-430f-a599-1d924b18520e\") " pod="openshift-ingress/payload-processing-e2e-mt-43a6ae00-c87dd98d6-ngq6m"
Jul 28 01:48:03.127159 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:03.126784    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e93c5b63-2c26-46e1-a214-5f84c125c1cc-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-43a6ae00-587c5bcb96-7x7cr\" (UID: \"e93c5b63-2c26-46e1-a214-5f84c125c1cc\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-43a6ae00-587c5bcb96-7x7cr"
Jul 28 01:48:03.127159 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:03.126882    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz2hv\" (UniqueName: \"kubernetes.io/projected/e3537391-ccca-430f-a599-1d924b18520e-kube-api-access-zz2hv\") pod \"payload-processing-e2e-mt-43a6ae00-c87dd98d6-ngq6m\" (UID: \"e3537391-ccca-430f-a599-1d924b18520e\") " pod="openshift-ingress/payload-processing-e2e-mt-43a6ae00-c87dd98d6-ngq6m"
Jul 28 01:48:03.127159 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:03.126918    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6dtk\" (UniqueName: \"kubernetes.io/projected/e93c5b63-2c26-46e1-a214-5f84c125c1cc-kube-api-access-h6dtk\") pod \"payload-pre-processing-e2e-mt-43a6ae00-587c5bcb96-7x7cr\" (UID: \"e93c5b63-2c26-46e1-a214-5f84c125c1cc\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-43a6ae00-587c5bcb96-7x7cr"
Jul 28 01:48:03.228259 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:03.228216    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zz2hv\" (UniqueName: \"kubernetes.io/projected/e3537391-ccca-430f-a599-1d924b18520e-kube-api-access-zz2hv\") pod \"payload-processing-e2e-mt-43a6ae00-c87dd98d6-ngq6m\" (UID: \"e3537391-ccca-430f-a599-1d924b18520e\") " pod="openshift-ingress/payload-processing-e2e-mt-43a6ae00-c87dd98d6-ngq6m"
Jul 28 01:48:03.228259 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:03.228263    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6dtk\" (UniqueName: \"kubernetes.io/projected/e93c5b63-2c26-46e1-a214-5f84c125c1cc-kube-api-access-h6dtk\") pod \"payload-pre-processing-e2e-mt-43a6ae00-587c5bcb96-7x7cr\" (UID: \"e93c5b63-2c26-46e1-a214-5f84c125c1cc\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-43a6ae00-587c5bcb96-7x7cr"
Jul 28 01:48:03.228562 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:03.228295    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3537391-ccca-430f-a599-1d924b18520e-plugins-config-volume\") pod \"payload-processing-e2e-mt-43a6ae00-c87dd98d6-ngq6m\" (UID: \"e3537391-ccca-430f-a599-1d924b18520e\") " pod="openshift-ingress/payload-processing-e2e-mt-43a6ae00-c87dd98d6-ngq6m"
Jul 28 01:48:03.228562 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:03.228340    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e93c5b63-2c26-46e1-a214-5f84c125c1cc-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-43a6ae00-587c5bcb96-7x7cr\" (UID: \"e93c5b63-2c26-46e1-a214-5f84c125c1cc\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-43a6ae00-587c5bcb96-7x7cr"
Jul 28 01:48:03.229039 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:03.229018    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e93c5b63-2c26-46e1-a214-5f84c125c1cc-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-43a6ae00-587c5bcb96-7x7cr\" (UID: \"e93c5b63-2c26-46e1-a214-5f84c125c1cc\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-43a6ae00-587c5bcb96-7x7cr"
Jul 28 01:48:03.229247 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:03.229224    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3537391-ccca-430f-a599-1d924b18520e-plugins-config-volume\") pod \"payload-processing-e2e-mt-43a6ae00-c87dd98d6-ngq6m\" (UID: \"e3537391-ccca-430f-a599-1d924b18520e\") " pod="openshift-ingress/payload-processing-e2e-mt-43a6ae00-c87dd98d6-ngq6m"
Jul 28 01:48:03.235833 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:03.235809    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz2hv\" (UniqueName: \"kubernetes.io/projected/e3537391-ccca-430f-a599-1d924b18520e-kube-api-access-zz2hv\") pod \"payload-processing-e2e-mt-43a6ae00-c87dd98d6-ngq6m\" (UID: \"e3537391-ccca-430f-a599-1d924b18520e\") " pod="openshift-ingress/payload-processing-e2e-mt-43a6ae00-c87dd98d6-ngq6m"
Jul 28 01:48:03.235974 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:03.235952    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6dtk\" (UniqueName: \"kubernetes.io/projected/e93c5b63-2c26-46e1-a214-5f84c125c1cc-kube-api-access-h6dtk\") pod \"payload-pre-processing-e2e-mt-43a6ae00-587c5bcb96-7x7cr\" (UID: \"e93c5b63-2c26-46e1-a214-5f84c125c1cc\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-43a6ae00-587c5bcb96-7x7cr"
Jul 28 01:48:03.276437 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:03.276386    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-43a6ae00-587c5bcb96-7x7cr"
Jul 28 01:48:03.313315 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:03.313276    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-43a6ae00-c87dd98d6-ngq6m"
Jul 28 01:48:03.445635 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:03.445608    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-43a6ae00-587c5bcb96-7x7cr"]
Jul 28 01:48:03.480798 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:03.480770    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-43a6ae00-c87dd98d6-ngq6m"]
Jul 28 01:48:03.482022 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:48:03.481990    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3537391_ccca_430f_a599_1d924b18520e.slice/crio-f219d5440d6f63012a1ccbbdf98e334d7060f821a40a719f68538866a0cb8e81 WatchSource:0}: Error finding container f219d5440d6f63012a1ccbbdf98e334d7060f821a40a719f68538866a0cb8e81: Status 404 returned error can't find the container with id f219d5440d6f63012a1ccbbdf98e334d7060f821a40a719f68538866a0cb8e81
Jul 28 01:48:03.657105 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:03.656951    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-43a6ae00-587c5bcb96-7x7cr" event={"ID":"e93c5b63-2c26-46e1-a214-5f84c125c1cc","Type":"ContainerStarted","Data":"c361ab85750dfa5d88df9ceb9301e44ab9da8cd00be8867fc86a10cef29f72ce"}
Jul 28 01:48:03.657105 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:03.657017    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-43a6ae00-587c5bcb96-7x7cr" event={"ID":"e93c5b63-2c26-46e1-a214-5f84c125c1cc","Type":"ContainerStarted","Data":"2a4051a27638a3dd493c389ae259e1c3f3b303ba80aa5507053a557fa28e73b4"}
Jul 28 01:48:03.658701 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:03.658587    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-43a6ae00-587c5bcb96-7x7cr"
Jul 28 01:48:03.659519 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:03.659490    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-43a6ae00-c87dd98d6-ngq6m" event={"ID":"e3537391-ccca-430f-a599-1d924b18520e","Type":"ContainerStarted","Data":"ee6e198599edb713617cb78fa9ea07d91bc9db17ceaf3bfcb13c61baa8c701e4"}
Jul 28 01:48:03.659624 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:03.659545    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-43a6ae00-c87dd98d6-ngq6m" event={"ID":"e3537391-ccca-430f-a599-1d924b18520e","Type":"ContainerStarted","Data":"f219d5440d6f63012a1ccbbdf98e334d7060f821a40a719f68538866a0cb8e81"}
Jul 28 01:48:03.659624 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:03.659574    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-43a6ae00-c87dd98d6-ngq6m"
Jul 28 01:48:03.674934 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:03.674887    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-43a6ae00-587c5bcb96-7x7cr" podStartSLOduration=1.674871742 podStartE2EDuration="1.674871742s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:48:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:48:03.672951463 +0000 UTC m=+1934.706994857" watchObservedRunningTime="2026-07-28 01:48:03.674871742 +0000 UTC m=+1934.708915135"
Jul 28 01:48:03.687693 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:03.687637    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-43a6ae00-c87dd98d6-ngq6m" podStartSLOduration=1.687616941 podStartE2EDuration="1.687616941s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:48:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:48:03.685591313 +0000 UTC m=+1934.719634707" watchObservedRunningTime="2026-07-28 01:48:03.687616941 +0000 UTC m=+1934.721660335"
Jul 28 01:48:06.559729 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:06.559694    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:48:07.206836 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:07.206807    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:48:07.366813 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:07.366781    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:48:07.648568 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:07.648540    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:48:08.987014 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:08.981888    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:48:13.339962 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:13.339924    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:48:13.407386 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:13.407334    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:48:14.666789 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:14.666737    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-mt-43a6ae00-587c5bcb96-7x7cr" podUID="e93c5b63-2c26-46e1-a214-5f84c125c1cc" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.44:9004: connect: connection refused"
Jul 28 01:48:14.667232 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:14.667196    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-43a6ae00-c87dd98d6-ngq6m"
Jul 28 01:48:24.151301 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:24.151263    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:48:24.173494 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:24.173461    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-43a6ae00-c87dd98d6-ngq6m"]
Jul 28 01:48:24.173742 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:24.173713    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-43a6ae00-c87dd98d6-ngq6m" podUID="e3537391-ccca-430f-a599-1d924b18520e" containerName="payload-processing" containerID="cri-o://ee6e198599edb713617cb78fa9ea07d91bc9db17ceaf3bfcb13c61baa8c701e4" gracePeriod=30
Jul 28 01:48:24.182321 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:24.182298    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-43a6ae00-587c5bcb96-7x7cr"]
Jul 28 01:48:24.183129 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:24.183103    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-43a6ae00-587c5bcb96-7x7cr" podUID="e93c5b63-2c26-46e1-a214-5f84c125c1cc" containerName="payload-pre-processing" containerID="cri-o://c361ab85750dfa5d88df9ceb9301e44ab9da8cd00be8867fc86a10cef29f72ce" gracePeriod=30
Jul 28 01:48:24.183441 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:24.183419    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-43a6ae00-587c5bcb96-7x7cr"
Jul 28 01:48:24.218886 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:24.218860    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:48:24.273674 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:24.273640    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:48:24.453754 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:24.453728    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-43a6ae00-c87dd98d6-ngq6m"
Jul 28 01:48:24.456704 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:24.456686    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-43a6ae00-587c5bcb96-7x7cr"
Jul 28 01:48:24.516249 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:24.516220    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zz2hv\" (UniqueName: \"kubernetes.io/projected/e3537391-ccca-430f-a599-1d924b18520e-kube-api-access-zz2hv\") pod \"e3537391-ccca-430f-a599-1d924b18520e\" (UID: \"e3537391-ccca-430f-a599-1d924b18520e\") "
Jul 28 01:48:24.516249 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:24.516255    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e93c5b63-2c26-46e1-a214-5f84c125c1cc-plugins-config-volume\") pod \"e93c5b63-2c26-46e1-a214-5f84c125c1cc\" (UID: \"e93c5b63-2c26-46e1-a214-5f84c125c1cc\") "
Jul 28 01:48:24.516521 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:24.516275    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3537391-ccca-430f-a599-1d924b18520e-plugins-config-volume\") pod \"e3537391-ccca-430f-a599-1d924b18520e\" (UID: \"e3537391-ccca-430f-a599-1d924b18520e\") "
Jul 28 01:48:24.516521 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:24.516292    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6dtk\" (UniqueName: \"kubernetes.io/projected/e93c5b63-2c26-46e1-a214-5f84c125c1cc-kube-api-access-h6dtk\") pod \"e93c5b63-2c26-46e1-a214-5f84c125c1cc\" (UID: \"e93c5b63-2c26-46e1-a214-5f84c125c1cc\") "
Jul 28 01:48:24.516682 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:24.516648    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3537391-ccca-430f-a599-1d924b18520e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e3537391-ccca-430f-a599-1d924b18520e" (UID: "e3537391-ccca-430f-a599-1d924b18520e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:48:24.516682 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:24.516650    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e93c5b63-2c26-46e1-a214-5f84c125c1cc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e93c5b63-2c26-46e1-a214-5f84c125c1cc" (UID: "e93c5b63-2c26-46e1-a214-5f84c125c1cc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:48:24.517038 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:24.516995    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e93c5b63-2c26-46e1-a214-5f84c125c1cc-plugins-config-volume\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:48:24.517038 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:24.517022    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3537391-ccca-430f-a599-1d924b18520e-plugins-config-volume\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:48:24.518539 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:24.518507    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e93c5b63-2c26-46e1-a214-5f84c125c1cc-kube-api-access-h6dtk" (OuterVolumeSpecName: "kube-api-access-h6dtk") pod "e93c5b63-2c26-46e1-a214-5f84c125c1cc" (UID: "e93c5b63-2c26-46e1-a214-5f84c125c1cc"). InnerVolumeSpecName "kube-api-access-h6dtk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:48:24.518657 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:24.518641    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3537391-ccca-430f-a599-1d924b18520e-kube-api-access-zz2hv" (OuterVolumeSpecName: "kube-api-access-zz2hv") pod "e3537391-ccca-430f-a599-1d924b18520e" (UID: "e3537391-ccca-430f-a599-1d924b18520e"). InnerVolumeSpecName "kube-api-access-zz2hv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:48:24.617691 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:24.617660    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zz2hv\" (UniqueName: \"kubernetes.io/projected/e3537391-ccca-430f-a599-1d924b18520e-kube-api-access-zz2hv\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:48:24.617691 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:24.617686    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6dtk\" (UniqueName: \"kubernetes.io/projected/e93c5b63-2c26-46e1-a214-5f84c125c1cc-kube-api-access-h6dtk\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:48:24.761419 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:24.761316    2560 generic.go:356] "Generic (PLEG): container finished" podID="e3537391-ccca-430f-a599-1d924b18520e" containerID="ee6e198599edb713617cb78fa9ea07d91bc9db17ceaf3bfcb13c61baa8c701e4" exitCode=0
Jul 28 01:48:24.761419 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:24.761375    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-43a6ae00-c87dd98d6-ngq6m"
Jul 28 01:48:24.761419 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:24.761398    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-43a6ae00-c87dd98d6-ngq6m" event={"ID":"e3537391-ccca-430f-a599-1d924b18520e","Type":"ContainerDied","Data":"ee6e198599edb713617cb78fa9ea07d91bc9db17ceaf3bfcb13c61baa8c701e4"}
Jul 28 01:48:24.761666 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:24.761449    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-43a6ae00-c87dd98d6-ngq6m" event={"ID":"e3537391-ccca-430f-a599-1d924b18520e","Type":"ContainerDied","Data":"f219d5440d6f63012a1ccbbdf98e334d7060f821a40a719f68538866a0cb8e81"}
Jul 28 01:48:24.761666 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:24.761473    2560 scope.go:117] "RemoveContainer" containerID="ee6e198599edb713617cb78fa9ea07d91bc9db17ceaf3bfcb13c61baa8c701e4"
Jul 28 01:48:24.762808 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:24.762780    2560 generic.go:356] "Generic (PLEG): container finished" podID="e93c5b63-2c26-46e1-a214-5f84c125c1cc" containerID="c361ab85750dfa5d88df9ceb9301e44ab9da8cd00be8867fc86a10cef29f72ce" exitCode=0
Jul 28 01:48:24.762914 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:24.762833    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-43a6ae00-587c5bcb96-7x7cr"
Jul 28 01:48:24.762914 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:24.762892    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-43a6ae00-587c5bcb96-7x7cr" event={"ID":"e93c5b63-2c26-46e1-a214-5f84c125c1cc","Type":"ContainerDied","Data":"c361ab85750dfa5d88df9ceb9301e44ab9da8cd00be8867fc86a10cef29f72ce"}
Jul 28 01:48:24.763062 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:24.762934    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-43a6ae00-587c5bcb96-7x7cr" event={"ID":"e93c5b63-2c26-46e1-a214-5f84c125c1cc","Type":"ContainerDied","Data":"2a4051a27638a3dd493c389ae259e1c3f3b303ba80aa5507053a557fa28e73b4"}
Jul 28 01:48:24.770698 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:24.770617    2560 scope.go:117] "RemoveContainer" containerID="ee6e198599edb713617cb78fa9ea07d91bc9db17ceaf3bfcb13c61baa8c701e4"
Jul 28 01:48:24.770965 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:48:24.770944    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee6e198599edb713617cb78fa9ea07d91bc9db17ceaf3bfcb13c61baa8c701e4\": container with ID starting with ee6e198599edb713617cb78fa9ea07d91bc9db17ceaf3bfcb13c61baa8c701e4 not found: ID does not exist" containerID="ee6e198599edb713617cb78fa9ea07d91bc9db17ceaf3bfcb13c61baa8c701e4"
Jul 28 01:48:24.771067 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:24.770975    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee6e198599edb713617cb78fa9ea07d91bc9db17ceaf3bfcb13c61baa8c701e4"} err="failed to get container status \"ee6e198599edb713617cb78fa9ea07d91bc9db17ceaf3bfcb13c61baa8c701e4\": rpc error: code = NotFound desc = could not find container \"ee6e198599edb713617cb78fa9ea07d91bc9db17ceaf3bfcb13c61baa8c701e4\": container with ID starting with ee6e198599edb713617cb78fa9ea07d91bc9db17ceaf3bfcb13c61baa8c701e4 not found: ID does not exist"
Jul 28 01:48:24.771067 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:24.770994    2560 scope.go:117] "RemoveContainer" containerID="c361ab85750dfa5d88df9ceb9301e44ab9da8cd00be8867fc86a10cef29f72ce"
Jul 28 01:48:24.778656 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:24.778640    2560 scope.go:117] "RemoveContainer" containerID="c361ab85750dfa5d88df9ceb9301e44ab9da8cd00be8867fc86a10cef29f72ce"
Jul 28 01:48:24.778912 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:48:24.778895    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c361ab85750dfa5d88df9ceb9301e44ab9da8cd00be8867fc86a10cef29f72ce\": container with ID starting with c361ab85750dfa5d88df9ceb9301e44ab9da8cd00be8867fc86a10cef29f72ce not found: ID does not exist" containerID="c361ab85750dfa5d88df9ceb9301e44ab9da8cd00be8867fc86a10cef29f72ce"
Jul 28 01:48:24.778958 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:24.778920    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c361ab85750dfa5d88df9ceb9301e44ab9da8cd00be8867fc86a10cef29f72ce"} err="failed to get container status \"c361ab85750dfa5d88df9ceb9301e44ab9da8cd00be8867fc86a10cef29f72ce\": rpc error: code = NotFound desc = could not find container \"c361ab85750dfa5d88df9ceb9301e44ab9da8cd00be8867fc86a10cef29f72ce\": container with ID starting with c361ab85750dfa5d88df9ceb9301e44ab9da8cd00be8867fc86a10cef29f72ce not found: ID does not exist"
Jul 28 01:48:24.783900 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:24.783877    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-43a6ae00-587c5bcb96-7x7cr"]
Jul 28 01:48:24.786077 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:24.786056    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-43a6ae00-587c5bcb96-7x7cr"]
Jul 28 01:48:24.794537 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:24.794515    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-43a6ae00-c87dd98d6-ngq6m"]
Jul 28 01:48:24.796429 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:24.796410    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-43a6ae00-c87dd98d6-ngq6m"]
Jul 28 01:48:25.460155 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:25.460112    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3537391-ccca-430f-a599-1d924b18520e" path="/var/lib/kubelet/pods/e3537391-ccca-430f-a599-1d924b18520e/volumes"
Jul 28 01:48:25.460689 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:25.460665    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e93c5b63-2c26-46e1-a214-5f84c125c1cc" path="/var/lib/kubelet/pods/e93c5b63-2c26-46e1-a214-5f84c125c1cc/volumes"
Jul 28 01:48:27.183975 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:27.183942    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:48:28.763240 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:28.763206    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:48:29.211569 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:29.211530    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:48:34.876488 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:34.876434    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:48:34.977716 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:34.977684    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:48:35.210903 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:35.210814    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:48:35.388783 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:35.388750    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:48:35.504168 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:35.504078    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:48:35.595394 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:35.595337    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:48:35.717234 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:35.717204    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:48:41.363993 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:41.363921    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:48:41.464369 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:41.464333    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:48:41.564553 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:41.564525    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:48:41.704759 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:41.704686    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:48:47.277368 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:47.277323    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:48:47.335769 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:47.335724    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:48:54.163935 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:54.163898    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:48:54.476217 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:54.476135    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:48:54.576343 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:54.576303    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:48:57.225868 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:57.225837    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:48:57.310401 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:57.310345    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:48:57.376062 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:57.376033    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:48:57.524880 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:57.524806    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:48:57.897536 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:57.897505    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:48:58.001519 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:58.001486    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:48:58.002030 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:58.002009    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2a202a1f-54fbd59c56-rbh28"]
Jul 28 01:48:58.002390 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:58.002377    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e93c5b63-2c26-46e1-a214-5f84c125c1cc" containerName="payload-pre-processing"
Jul 28 01:48:58.002428 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:58.002391    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e93c5b63-2c26-46e1-a214-5f84c125c1cc" containerName="payload-pre-processing"
Jul 28 01:48:58.002428 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:58.002413    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3537391-ccca-430f-a599-1d924b18520e" containerName="payload-processing"
Jul 28 01:48:58.002428 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:58.002419    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3537391-ccca-430f-a599-1d924b18520e" containerName="payload-processing"
Jul 28 01:48:58.002535 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:58.002488    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3537391-ccca-430f-a599-1d924b18520e" containerName="payload-processing"
Jul 28 01:48:58.002535 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:58.002498    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e93c5b63-2c26-46e1-a214-5f84c125c1cc" containerName="payload-pre-processing"
Jul 28 01:48:58.005285 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:58.005264    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-2a202a1f-54fbd59c56-rbh28"
Jul 28 01:48:58.007274 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:58.007251    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-2a202a1f\""
Jul 28 01:48:58.007388 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:58.007255    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-2a202a1f-dockercfg-b8nr2\""
Jul 28 01:48:58.016515 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:58.016494    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2a202a1f-54fbd59c56-rbh28"]
Jul 28 01:48:58.025778 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:58.025760    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb152e4d-6225-409a-93ed-57d1209d031d-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-2a202a1f-54fbd59c56-rbh28\" (UID: \"cb152e4d-6225-409a-93ed-57d1209d031d\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2a202a1f-54fbd59c56-rbh28"
Jul 28 01:48:58.025864 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:58.025784    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwl7n\" (UniqueName: \"kubernetes.io/projected/cb152e4d-6225-409a-93ed-57d1209d031d-kube-api-access-vwl7n\") pod \"payload-pre-processing-e2e-mt-2a202a1f-54fbd59c56-rbh28\" (UID: \"cb152e4d-6225-409a-93ed-57d1209d031d\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2a202a1f-54fbd59c56-rbh28"
Jul 28 01:48:58.028442 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:58.028412    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2a202a1f-6f668fcd94-4tngg"]
Jul 28 01:48:58.031928 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:58.031906    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2a202a1f-6f668fcd94-4tngg"
Jul 28 01:48:58.041057 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:58.041033    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2a202a1f-6f668fcd94-4tngg"]
Jul 28 01:48:58.126608 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:58.126577    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9g47\" (UniqueName: \"kubernetes.io/projected/01e7adc3-a0d1-4877-bc06-a23189ab96c0-kube-api-access-t9g47\") pod \"payload-processing-e2e-mt-2a202a1f-6f668fcd94-4tngg\" (UID: \"01e7adc3-a0d1-4877-bc06-a23189ab96c0\") " pod="openshift-ingress/payload-processing-e2e-mt-2a202a1f-6f668fcd94-4tngg"
Jul 28 01:48:58.126753 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:58.126632    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01e7adc3-a0d1-4877-bc06-a23189ab96c0-plugins-config-volume\") pod \"payload-processing-e2e-mt-2a202a1f-6f668fcd94-4tngg\" (UID: \"01e7adc3-a0d1-4877-bc06-a23189ab96c0\") " pod="openshift-ingress/payload-processing-e2e-mt-2a202a1f-6f668fcd94-4tngg"
Jul 28 01:48:58.126753 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:58.126658    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb152e4d-6225-409a-93ed-57d1209d031d-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-2a202a1f-54fbd59c56-rbh28\" (UID: \"cb152e4d-6225-409a-93ed-57d1209d031d\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2a202a1f-54fbd59c56-rbh28"
Jul 28 01:48:58.126753 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:58.126675    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwl7n\" (UniqueName: \"kubernetes.io/projected/cb152e4d-6225-409a-93ed-57d1209d031d-kube-api-access-vwl7n\") pod \"payload-pre-processing-e2e-mt-2a202a1f-54fbd59c56-rbh28\" (UID: \"cb152e4d-6225-409a-93ed-57d1209d031d\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2a202a1f-54fbd59c56-rbh28"
Jul 28 01:48:58.127239 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:58.127220    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb152e4d-6225-409a-93ed-57d1209d031d-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-2a202a1f-54fbd59c56-rbh28\" (UID: \"cb152e4d-6225-409a-93ed-57d1209d031d\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2a202a1f-54fbd59c56-rbh28"
Jul 28 01:48:58.134972 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:58.134948    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwl7n\" (UniqueName: \"kubernetes.io/projected/cb152e4d-6225-409a-93ed-57d1209d031d-kube-api-access-vwl7n\") pod \"payload-pre-processing-e2e-mt-2a202a1f-54fbd59c56-rbh28\" (UID: \"cb152e4d-6225-409a-93ed-57d1209d031d\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2a202a1f-54fbd59c56-rbh28"
Jul 28 01:48:58.228069 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:58.228001    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9g47\" (UniqueName: \"kubernetes.io/projected/01e7adc3-a0d1-4877-bc06-a23189ab96c0-kube-api-access-t9g47\") pod \"payload-processing-e2e-mt-2a202a1f-6f668fcd94-4tngg\" (UID: \"01e7adc3-a0d1-4877-bc06-a23189ab96c0\") " pod="openshift-ingress/payload-processing-e2e-mt-2a202a1f-6f668fcd94-4tngg"
Jul 28 01:48:58.228499 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:58.228066    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01e7adc3-a0d1-4877-bc06-a23189ab96c0-plugins-config-volume\") pod \"payload-processing-e2e-mt-2a202a1f-6f668fcd94-4tngg\" (UID: \"01e7adc3-a0d1-4877-bc06-a23189ab96c0\") " pod="openshift-ingress/payload-processing-e2e-mt-2a202a1f-6f668fcd94-4tngg"
Jul 28 01:48:58.230422 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:58.230370    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01e7adc3-a0d1-4877-bc06-a23189ab96c0-plugins-config-volume\") pod \"payload-processing-e2e-mt-2a202a1f-6f668fcd94-4tngg\" (UID: \"01e7adc3-a0d1-4877-bc06-a23189ab96c0\") " pod="openshift-ingress/payload-processing-e2e-mt-2a202a1f-6f668fcd94-4tngg"
Jul 28 01:48:58.236748 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:58.236717    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9g47\" (UniqueName: \"kubernetes.io/projected/01e7adc3-a0d1-4877-bc06-a23189ab96c0-kube-api-access-t9g47\") pod \"payload-processing-e2e-mt-2a202a1f-6f668fcd94-4tngg\" (UID: \"01e7adc3-a0d1-4877-bc06-a23189ab96c0\") " pod="openshift-ingress/payload-processing-e2e-mt-2a202a1f-6f668fcd94-4tngg"
Jul 28 01:48:58.315461 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:58.315432    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-2a202a1f-54fbd59c56-rbh28"
Jul 28 01:48:58.342599 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:58.342571    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2a202a1f-6f668fcd94-4tngg"
Jul 28 01:48:58.662413 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:58.662387    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2a202a1f-54fbd59c56-rbh28"]
Jul 28 01:48:58.664399 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:48:58.664364    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb152e4d_6225_409a_93ed_57d1209d031d.slice/crio-3fa7b720201cf2d35779cdf8efe63fb8712052fddfce1b4afbb21ba5c3d9d666 WatchSource:0}: Error finding container 3fa7b720201cf2d35779cdf8efe63fb8712052fddfce1b4afbb21ba5c3d9d666: Status 404 returned error can't find the container with id 3fa7b720201cf2d35779cdf8efe63fb8712052fddfce1b4afbb21ba5c3d9d666
Jul 28 01:48:58.689217 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:58.689191    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2a202a1f-6f668fcd94-4tngg"]
Jul 28 01:48:58.693335 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:48:58.693309    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01e7adc3_a0d1_4877_bc06_a23189ab96c0.slice/crio-eb0543427d8c181ada73183be4182753ef2f9c4886ddd6b4eb22b2355d702a3c WatchSource:0}: Error finding container eb0543427d8c181ada73183be4182753ef2f9c4886ddd6b4eb22b2355d702a3c: Status 404 returned error can't find the container with id eb0543427d8c181ada73183be4182753ef2f9c4886ddd6b4eb22b2355d702a3c
Jul 28 01:48:58.933007 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:58.932909    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-2a202a1f-54fbd59c56-rbh28" event={"ID":"cb152e4d-6225-409a-93ed-57d1209d031d","Type":"ContainerStarted","Data":"2436face85e74cb6161142fc2ac8e940f13de6b9220d23f22cd651932f7410ac"}
Jul 28 01:48:58.933007 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:58.932985    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-2a202a1f-54fbd59c56-rbh28"
Jul 28 01:48:58.933249 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:58.933011    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-2a202a1f-54fbd59c56-rbh28" event={"ID":"cb152e4d-6225-409a-93ed-57d1209d031d","Type":"ContainerStarted","Data":"3fa7b720201cf2d35779cdf8efe63fb8712052fddfce1b4afbb21ba5c3d9d666"}
Jul 28 01:48:58.934585 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:58.934560    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2a202a1f-6f668fcd94-4tngg" event={"ID":"01e7adc3-a0d1-4877-bc06-a23189ab96c0","Type":"ContainerStarted","Data":"c8569c76c4f530940baf1e5517f936e0f76fda0dc1683f0bd714bbd37d85d54f"}
Jul 28 01:48:58.934698 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:58.934599    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2a202a1f-6f668fcd94-4tngg" event={"ID":"01e7adc3-a0d1-4877-bc06-a23189ab96c0","Type":"ContainerStarted","Data":"eb0543427d8c181ada73183be4182753ef2f9c4886ddd6b4eb22b2355d702a3c"}
Jul 28 01:48:58.934698 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:58.934650    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-2a202a1f-6f668fcd94-4tngg"
Jul 28 01:48:58.949337 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:58.949290    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-2a202a1f-54fbd59c56-rbh28" podStartSLOduration=1.949271569 podStartE2EDuration="1.949271569s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:48:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:48:58.945578547 +0000 UTC m=+1989.979621950" watchObservedRunningTime="2026-07-28 01:48:58.949271569 +0000 UTC m=+1989.983314964"
Jul 28 01:48:58.959632 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:48:58.959590    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-2a202a1f-6f668fcd94-4tngg" podStartSLOduration=0.959577266 podStartE2EDuration="959.577266ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:48:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:48:58.958610021 +0000 UTC m=+1989.992653464" watchObservedRunningTime="2026-07-28 01:48:58.959577266 +0000 UTC m=+1989.993620658"
Jul 28 01:49:01.745444 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:49:01.745411    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:49:02.482778 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:49:02.482747    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:49:09.941740 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:49:09.941709    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-2a202a1f-54fbd59c56-rbh28"
Jul 28 01:49:09.942111 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:49:09.941892    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-2a202a1f-6f668fcd94-4tngg"
Jul 28 01:49:15.847409 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:49:15.847372    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:49:19.084128 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:49:19.084092    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:49:47.290581 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:49:47.290548    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:49:53.610773 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:49:53.610736    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:49:53.711062 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:49:53.711029    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:50:05.788958 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:05.788922    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:50:07.158952 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:07.158910    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:50:07.167274 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:07.167239    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2a202a1f-6f668fcd94-4tngg"]
Jul 28 01:50:07.167568 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:07.167540    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-2a202a1f-6f668fcd94-4tngg" podUID="01e7adc3-a0d1-4877-bc06-a23189ab96c0" containerName="payload-processing" containerID="cri-o://c8569c76c4f530940baf1e5517f936e0f76fda0dc1683f0bd714bbd37d85d54f" gracePeriod=30
Jul 28 01:50:07.174089 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:07.174033    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2a202a1f-54fbd59c56-rbh28"]
Jul 28 01:50:07.174281 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:07.174248    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-2a202a1f-54fbd59c56-rbh28" podUID="cb152e4d-6225-409a-93ed-57d1209d031d" containerName="payload-pre-processing" containerID="cri-o://2436face85e74cb6161142fc2ac8e940f13de6b9220d23f22cd651932f7410ac" gracePeriod=30
Jul 28 01:50:07.259085 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:07.259054    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:50:07.451516 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:07.451493    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2a202a1f-6f668fcd94-4tngg"
Jul 28 01:50:07.454288 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:07.454262    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-2a202a1f-54fbd59c56-rbh28"
Jul 28 01:50:07.552292 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:07.552261    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9g47\" (UniqueName: \"kubernetes.io/projected/01e7adc3-a0d1-4877-bc06-a23189ab96c0-kube-api-access-t9g47\") pod \"01e7adc3-a0d1-4877-bc06-a23189ab96c0\" (UID: \"01e7adc3-a0d1-4877-bc06-a23189ab96c0\") "
Jul 28 01:50:07.552468 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:07.552302    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01e7adc3-a0d1-4877-bc06-a23189ab96c0-plugins-config-volume\") pod \"01e7adc3-a0d1-4877-bc06-a23189ab96c0\" (UID: \"01e7adc3-a0d1-4877-bc06-a23189ab96c0\") "
Jul 28 01:50:07.552468 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:07.552337    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb152e4d-6225-409a-93ed-57d1209d031d-plugins-config-volume\") pod \"cb152e4d-6225-409a-93ed-57d1209d031d\" (UID: \"cb152e4d-6225-409a-93ed-57d1209d031d\") "
Jul 28 01:50:07.552468 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:07.552418    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwl7n\" (UniqueName: \"kubernetes.io/projected/cb152e4d-6225-409a-93ed-57d1209d031d-kube-api-access-vwl7n\") pod \"cb152e4d-6225-409a-93ed-57d1209d031d\" (UID: \"cb152e4d-6225-409a-93ed-57d1209d031d\") "
Jul 28 01:50:07.552741 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:07.552707    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01e7adc3-a0d1-4877-bc06-a23189ab96c0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "01e7adc3-a0d1-4877-bc06-a23189ab96c0" (UID: "01e7adc3-a0d1-4877-bc06-a23189ab96c0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:50:07.552892 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:07.552750    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb152e4d-6225-409a-93ed-57d1209d031d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cb152e4d-6225-409a-93ed-57d1209d031d" (UID: "cb152e4d-6225-409a-93ed-57d1209d031d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:50:07.554436 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:07.554414    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb152e4d-6225-409a-93ed-57d1209d031d-kube-api-access-vwl7n" (OuterVolumeSpecName: "kube-api-access-vwl7n") pod "cb152e4d-6225-409a-93ed-57d1209d031d" (UID: "cb152e4d-6225-409a-93ed-57d1209d031d"). InnerVolumeSpecName "kube-api-access-vwl7n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:50:07.554523 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:07.554507    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01e7adc3-a0d1-4877-bc06-a23189ab96c0-kube-api-access-t9g47" (OuterVolumeSpecName: "kube-api-access-t9g47") pod "01e7adc3-a0d1-4877-bc06-a23189ab96c0" (UID: "01e7adc3-a0d1-4877-bc06-a23189ab96c0"). InnerVolumeSpecName "kube-api-access-t9g47". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:50:07.653540 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:07.653506    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwl7n\" (UniqueName: \"kubernetes.io/projected/cb152e4d-6225-409a-93ed-57d1209d031d-kube-api-access-vwl7n\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:50:07.653540 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:07.653535    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9g47\" (UniqueName: \"kubernetes.io/projected/01e7adc3-a0d1-4877-bc06-a23189ab96c0-kube-api-access-t9g47\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:50:07.653540 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:07.653546    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01e7adc3-a0d1-4877-bc06-a23189ab96c0-plugins-config-volume\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:50:07.653762 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:07.653557    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb152e4d-6225-409a-93ed-57d1209d031d-plugins-config-volume\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:50:08.272318 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:08.272281    2560 generic.go:356] "Generic (PLEG): container finished" podID="cb152e4d-6225-409a-93ed-57d1209d031d" containerID="2436face85e74cb6161142fc2ac8e940f13de6b9220d23f22cd651932f7410ac" exitCode=0
Jul 28 01:50:08.272721 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:08.272327    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-2a202a1f-54fbd59c56-rbh28"
Jul 28 01:50:08.272721 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:08.272377    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-2a202a1f-54fbd59c56-rbh28" event={"ID":"cb152e4d-6225-409a-93ed-57d1209d031d","Type":"ContainerDied","Data":"2436face85e74cb6161142fc2ac8e940f13de6b9220d23f22cd651932f7410ac"}
Jul 28 01:50:08.272721 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:08.272440    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-2a202a1f-54fbd59c56-rbh28" event={"ID":"cb152e4d-6225-409a-93ed-57d1209d031d","Type":"ContainerDied","Data":"3fa7b720201cf2d35779cdf8efe63fb8712052fddfce1b4afbb21ba5c3d9d666"}
Jul 28 01:50:08.272721 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:08.272464    2560 scope.go:117] "RemoveContainer" containerID="2436face85e74cb6161142fc2ac8e940f13de6b9220d23f22cd651932f7410ac"
Jul 28 01:50:08.273749 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:08.273659    2560 generic.go:356] "Generic (PLEG): container finished" podID="01e7adc3-a0d1-4877-bc06-a23189ab96c0" containerID="c8569c76c4f530940baf1e5517f936e0f76fda0dc1683f0bd714bbd37d85d54f" exitCode=0
Jul 28 01:50:08.273749 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:08.273691    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2a202a1f-6f668fcd94-4tngg" event={"ID":"01e7adc3-a0d1-4877-bc06-a23189ab96c0","Type":"ContainerDied","Data":"c8569c76c4f530940baf1e5517f936e0f76fda0dc1683f0bd714bbd37d85d54f"}
Jul 28 01:50:08.273848 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:08.273746    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2a202a1f-6f668fcd94-4tngg" event={"ID":"01e7adc3-a0d1-4877-bc06-a23189ab96c0","Type":"ContainerDied","Data":"eb0543427d8c181ada73183be4182753ef2f9c4886ddd6b4eb22b2355d702a3c"}
Jul 28 01:50:08.273848 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:08.273703    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2a202a1f-6f668fcd94-4tngg"
Jul 28 01:50:08.281067 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:08.281052    2560 scope.go:117] "RemoveContainer" containerID="2436face85e74cb6161142fc2ac8e940f13de6b9220d23f22cd651932f7410ac"
Jul 28 01:50:08.281341 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:50:08.281322    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2436face85e74cb6161142fc2ac8e940f13de6b9220d23f22cd651932f7410ac\": container with ID starting with 2436face85e74cb6161142fc2ac8e940f13de6b9220d23f22cd651932f7410ac not found: ID does not exist" containerID="2436face85e74cb6161142fc2ac8e940f13de6b9220d23f22cd651932f7410ac"
Jul 28 01:50:08.281445 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:08.281413    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2436face85e74cb6161142fc2ac8e940f13de6b9220d23f22cd651932f7410ac"} err="failed to get container status \"2436face85e74cb6161142fc2ac8e940f13de6b9220d23f22cd651932f7410ac\": rpc error: code = NotFound desc = could not find container \"2436face85e74cb6161142fc2ac8e940f13de6b9220d23f22cd651932f7410ac\": container with ID starting with 2436face85e74cb6161142fc2ac8e940f13de6b9220d23f22cd651932f7410ac not found: ID does not exist"
Jul 28 01:50:08.281445 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:08.281442    2560 scope.go:117] "RemoveContainer" containerID="c8569c76c4f530940baf1e5517f936e0f76fda0dc1683f0bd714bbd37d85d54f"
Jul 28 01:50:08.289117 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:08.289099    2560 scope.go:117] "RemoveContainer" containerID="c8569c76c4f530940baf1e5517f936e0f76fda0dc1683f0bd714bbd37d85d54f"
Jul 28 01:50:08.289388 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:50:08.289344    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8569c76c4f530940baf1e5517f936e0f76fda0dc1683f0bd714bbd37d85d54f\": container with ID starting with c8569c76c4f530940baf1e5517f936e0f76fda0dc1683f0bd714bbd37d85d54f not found: ID does not exist" containerID="c8569c76c4f530940baf1e5517f936e0f76fda0dc1683f0bd714bbd37d85d54f"
Jul 28 01:50:08.289457 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:08.289393    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8569c76c4f530940baf1e5517f936e0f76fda0dc1683f0bd714bbd37d85d54f"} err="failed to get container status \"c8569c76c4f530940baf1e5517f936e0f76fda0dc1683f0bd714bbd37d85d54f\": rpc error: code = NotFound desc = could not find container \"c8569c76c4f530940baf1e5517f936e0f76fda0dc1683f0bd714bbd37d85d54f\": container with ID starting with c8569c76c4f530940baf1e5517f936e0f76fda0dc1683f0bd714bbd37d85d54f not found: ID does not exist"
Jul 28 01:50:08.296718 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:08.296699    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2a202a1f-54fbd59c56-rbh28"]
Jul 28 01:50:08.302022 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:08.302002    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2a202a1f-54fbd59c56-rbh28"]
Jul 28 01:50:08.311071 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:08.311051    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2a202a1f-6f668fcd94-4tngg"]
Jul 28 01:50:08.317235 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:08.317214    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2a202a1f-6f668fcd94-4tngg"]
Jul 28 01:50:09.461539 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:09.461511    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01e7adc3-a0d1-4877-bc06-a23189ab96c0" path="/var/lib/kubelet/pods/01e7adc3-a0d1-4877-bc06-a23189ab96c0/volumes"
Jul 28 01:50:09.461906 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:09.461878    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb152e4d-6225-409a-93ed-57d1209d031d" path="/var/lib/kubelet/pods/cb152e4d-6225-409a-93ed-57d1209d031d/volumes"
Jul 28 01:50:11.718380 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:11.718286    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:50:14.883714 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:14.883681    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:50:15.029879 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:15.029851    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:50:20.067846 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:20.067814    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:50:49.547859 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:49.547830    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5f2zn_5311b0bc-9ad2-4e2f-bdde-81510c6d6b19/ovn-acl-logging/0.log"
Jul 28 01:50:49.550832 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:49.550811    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5f2zn_5311b0bc-9ad2-4e2f-bdde-81510c6d6b19/ovn-acl-logging/0.log"
Jul 28 01:50:56.573761 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:56.573726    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:50:56.957873 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:50:56.957837    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:51:02.414973 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:51:02.414933    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:51:07.662392 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:51:07.662340    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:51:16.459588 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:51:16.459554    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:51:16.516706 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:51:16.516666    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:51:16.739451 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:51:16.739372    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:51:16.974954 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:51:16.974926    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:51:18.058095 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:51:18.058056    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:51:18.151207 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:51:18.151171    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:51:18.251263 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:51:18.251236    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:51:18.951486 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:51:18.951448    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:51:19.052719 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:51:19.052690    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:51:19.154848 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:51:19.154818    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:51:20.564016 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:51:20.563987    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:51:20.687189 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:51:20.687156    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:51:26.320173 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:51:26.320138    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:51:26.373679 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:51:26.373643    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:51:26.983586 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:51:26.983550    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:51:27.264496 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:51:27.264414    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:51:32.830949 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:51:32.830884    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:51:32.933909 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:51:32.933878    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:51:33.002014 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:51:33.001969    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:51:33.005327 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:51:33.005298    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:51:41.414709 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:51:41.414630    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:51:43.515799 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:51:43.515759    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:51:43.834191 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:51:43.834103    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:51:49.070597 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:51:49.070559    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:52:04.786402 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:04.786338    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:52:10.863701 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:10.863662    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:52:10.971064 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:10.971016    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:52:11.232339 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:11.232251    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:52:11.533853 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:11.533775    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:52:11.736281 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:11.736242    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:52:14.328298 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:14.328266    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:52:14.406864 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:14.406832    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:52:14.544033 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:14.544000    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:52:14.883106 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:14.883073    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:52:15.014806 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:15.014777    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:52:15.093915 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:15.093880    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:52:15.097553 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:15.097528    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-896d36-5bd87796b4-6298j"]
Jul 28 01:52:15.097908 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:15.097896    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01e7adc3-a0d1-4877-bc06-a23189ab96c0" containerName="payload-processing"
Jul 28 01:52:15.097955 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:15.097910    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="01e7adc3-a0d1-4877-bc06-a23189ab96c0" containerName="payload-processing"
Jul 28 01:52:15.097955 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:15.097920    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb152e4d-6225-409a-93ed-57d1209d031d" containerName="payload-pre-processing"
Jul 28 01:52:15.097955 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:15.097927    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb152e4d-6225-409a-93ed-57d1209d031d" containerName="payload-pre-processing"
Jul 28 01:52:15.098076 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:15.098022    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb152e4d-6225-409a-93ed-57d1209d031d" containerName="payload-pre-processing"
Jul 28 01:52:15.098076 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:15.098030    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="01e7adc3-a0d1-4877-bc06-a23189ab96c0" containerName="payload-processing"
Jul 28 01:52:15.101210 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:15.101191    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-896d36-5bd87796b4-6298j"
Jul 28 01:52:15.103067 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:15.103045    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-896d36\""
Jul 28 01:52:15.103185 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:15.103110    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-896d36-dockercfg-rn4xb\""
Jul 28 01:52:15.111567 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:15.111543    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-896d36-5bd87796b4-6298j"]
Jul 28 01:52:15.148053 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:15.147976    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-896d36-749cf85d86-fgqfz"]
Jul 28 01:52:15.151464 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:15.151445    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-896d36-749cf85d86-fgqfz"
Jul 28 01:52:15.166192 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:15.166170    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-896d36-749cf85d86-fgqfz"]
Jul 28 01:52:15.198567 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:15.198539    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4gxx\" (UniqueName: \"kubernetes.io/projected/c478e559-ba8c-4f14-acb3-a48f094b0567-kube-api-access-w4gxx\") pod \"payload-pre-processing-e2e-inf-a-896d36-5bd87796b4-6298j\" (UID: \"c478e559-ba8c-4f14-acb3-a48f094b0567\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-896d36-5bd87796b4-6298j"
Jul 28 01:52:15.198692 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:15.198574    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c478e559-ba8c-4f14-acb3-a48f094b0567-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-896d36-5bd87796b4-6298j\" (UID: \"c478e559-ba8c-4f14-acb3-a48f094b0567\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-896d36-5bd87796b4-6298j"
Jul 28 01:52:15.299501 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:15.299462    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c478e559-ba8c-4f14-acb3-a48f094b0567-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-896d36-5bd87796b4-6298j\" (UID: \"c478e559-ba8c-4f14-acb3-a48f094b0567\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-896d36-5bd87796b4-6298j"
Jul 28 01:52:15.299678 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:15.299626    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spwm5\" (UniqueName: \"kubernetes.io/projected/5cca327e-fccb-4dd8-a794-933d9470ab45-kube-api-access-spwm5\") pod \"payload-processing-e2e-inf-a-896d36-749cf85d86-fgqfz\" (UID: \"5cca327e-fccb-4dd8-a794-933d9470ab45\") " pod="openshift-ingress/payload-processing-e2e-inf-a-896d36-749cf85d86-fgqfz"
Jul 28 01:52:15.299731 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:15.299718    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4gxx\" (UniqueName: \"kubernetes.io/projected/c478e559-ba8c-4f14-acb3-a48f094b0567-kube-api-access-w4gxx\") pod \"payload-pre-processing-e2e-inf-a-896d36-5bd87796b4-6298j\" (UID: \"c478e559-ba8c-4f14-acb3-a48f094b0567\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-896d36-5bd87796b4-6298j"
Jul 28 01:52:15.299768 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:15.299739    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5cca327e-fccb-4dd8-a794-933d9470ab45-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-896d36-749cf85d86-fgqfz\" (UID: \"5cca327e-fccb-4dd8-a794-933d9470ab45\") " pod="openshift-ingress/payload-processing-e2e-inf-a-896d36-749cf85d86-fgqfz"
Jul 28 01:52:15.300179 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:15.300162    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c478e559-ba8c-4f14-acb3-a48f094b0567-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-896d36-5bd87796b4-6298j\" (UID: \"c478e559-ba8c-4f14-acb3-a48f094b0567\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-896d36-5bd87796b4-6298j"
Jul 28 01:52:15.307050 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:15.307031    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4gxx\" (UniqueName: \"kubernetes.io/projected/c478e559-ba8c-4f14-acb3-a48f094b0567-kube-api-access-w4gxx\") pod \"payload-pre-processing-e2e-inf-a-896d36-5bd87796b4-6298j\" (UID: \"c478e559-ba8c-4f14-acb3-a48f094b0567\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-896d36-5bd87796b4-6298j"
Jul 28 01:52:15.401188 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:15.401098    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5cca327e-fccb-4dd8-a794-933d9470ab45-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-896d36-749cf85d86-fgqfz\" (UID: \"5cca327e-fccb-4dd8-a794-933d9470ab45\") " pod="openshift-ingress/payload-processing-e2e-inf-a-896d36-749cf85d86-fgqfz"
Jul 28 01:52:15.401588 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:15.401195    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spwm5\" (UniqueName: \"kubernetes.io/projected/5cca327e-fccb-4dd8-a794-933d9470ab45-kube-api-access-spwm5\") pod \"payload-processing-e2e-inf-a-896d36-749cf85d86-fgqfz\" (UID: \"5cca327e-fccb-4dd8-a794-933d9470ab45\") " pod="openshift-ingress/payload-processing-e2e-inf-a-896d36-749cf85d86-fgqfz"
Jul 28 01:52:15.401789 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:15.401769    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5cca327e-fccb-4dd8-a794-933d9470ab45-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-896d36-749cf85d86-fgqfz\" (UID: \"5cca327e-fccb-4dd8-a794-933d9470ab45\") " pod="openshift-ingress/payload-processing-e2e-inf-a-896d36-749cf85d86-fgqfz"
Jul 28 01:52:15.408449 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:15.408431    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spwm5\" (UniqueName: \"kubernetes.io/projected/5cca327e-fccb-4dd8-a794-933d9470ab45-kube-api-access-spwm5\") pod \"payload-processing-e2e-inf-a-896d36-749cf85d86-fgqfz\" (UID: \"5cca327e-fccb-4dd8-a794-933d9470ab45\") " pod="openshift-ingress/payload-processing-e2e-inf-a-896d36-749cf85d86-fgqfz"
Jul 28 01:52:15.412342 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:15.412322    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-896d36-5bd87796b4-6298j"
Jul 28 01:52:15.461379 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:15.461338    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-896d36-749cf85d86-fgqfz"
Jul 28 01:52:15.558290 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:15.557720    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-896d36-5bd87796b4-6298j"]
Jul 28 01:52:15.560961 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:52:15.560877    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc478e559_ba8c_4f14_acb3_a48f094b0567.slice/crio-b55bd98997eb20a1aa190098f4924f1c8170365be5c889315eca519952ca0c7a WatchSource:0}: Error finding container b55bd98997eb20a1aa190098f4924f1c8170365be5c889315eca519952ca0c7a: Status 404 returned error can't find the container with id b55bd98997eb20a1aa190098f4924f1c8170365be5c889315eca519952ca0c7a
Jul 28 01:52:15.610983 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:15.610957    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-896d36-749cf85d86-fgqfz"]
Jul 28 01:52:15.612681 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:52:15.612657    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cca327e_fccb_4dd8_a794_933d9470ab45.slice/crio-0fad117475b6682604ef629b7335ef8958cbdff013feba22f03500458bf8dc88 WatchSource:0}: Error finding container 0fad117475b6682604ef629b7335ef8958cbdff013feba22f03500458bf8dc88: Status 404 returned error can't find the container with id 0fad117475b6682604ef629b7335ef8958cbdff013feba22f03500458bf8dc88
Jul 28 01:52:15.871068 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:15.871028    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-896d36-5bd87796b4-6298j" event={"ID":"c478e559-ba8c-4f14-acb3-a48f094b0567","Type":"ContainerStarted","Data":"110de71574cb82b7962ef01d835b80ec28289f9c9f794e22f76f486cc375324c"}
Jul 28 01:52:15.871256 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:15.871085    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-896d36-5bd87796b4-6298j" event={"ID":"c478e559-ba8c-4f14-acb3-a48f094b0567","Type":"ContainerStarted","Data":"b55bd98997eb20a1aa190098f4924f1c8170365be5c889315eca519952ca0c7a"}
Jul 28 01:52:15.871256 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:15.871113    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-896d36-5bd87796b4-6298j"
Jul 28 01:52:15.872531 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:15.872507    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-896d36-749cf85d86-fgqfz" event={"ID":"5cca327e-fccb-4dd8-a794-933d9470ab45","Type":"ContainerStarted","Data":"f337f896a763500d4474f1837522b3af89eca71afa913bb6dbee4f802a0a757d"}
Jul 28 01:52:15.872656 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:15.872551    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-896d36-749cf85d86-fgqfz" event={"ID":"5cca327e-fccb-4dd8-a794-933d9470ab45","Type":"ContainerStarted","Data":"0fad117475b6682604ef629b7335ef8958cbdff013feba22f03500458bf8dc88"}
Jul 28 01:52:15.872656 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:15.872578    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-896d36-749cf85d86-fgqfz"
Jul 28 01:52:15.887360 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:15.887300    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-896d36-5bd87796b4-6298j" podStartSLOduration=0.887284348 podStartE2EDuration="887.284348ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:52:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:52:15.885116962 +0000 UTC m=+2186.919160356" watchObservedRunningTime="2026-07-28 01:52:15.887284348 +0000 UTC m=+2186.921327718"
Jul 28 01:52:15.901088 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:15.901045    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-896d36-749cf85d86-fgqfz" podStartSLOduration=0.901030134 podStartE2EDuration="901.030134ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:52:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:52:15.898934255 +0000 UTC m=+2186.932977685" watchObservedRunningTime="2026-07-28 01:52:15.901030134 +0000 UTC m=+2186.935073527"
Jul 28 01:52:17.083452 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:17.083413    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:52:18.849383 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:18.849326    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:52:19.184049 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:19.184000    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:52:19.493117 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:19.493026    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:52:19.757866 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:19.757786    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:52:22.078748 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:22.078704    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:52:22.598628 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:22.598598    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:52:22.676772 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:22.676739    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:52:22.741052 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:22.741022    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:52:23.111093 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:23.111058    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:52:23.294813 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:23.294784    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:52:23.365515 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:23.365429    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:52:23.365991 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:23.365965    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-afe8f9-7679497464-qbsmz"]
Jul 28 01:52:23.369408 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:23.369393    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-afe8f9-7679497464-qbsmz"
Jul 28 01:52:23.371462 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:23.371436    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-afe8f9\""
Jul 28 01:52:23.377901 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:23.377875    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-afe8f9-7679497464-qbsmz"]
Jul 28 01:52:23.387800 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:23.387775    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-afe8f9-66566d9494-nmhtm"]
Jul 28 01:52:23.391153 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:23.391136    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-afe8f9-66566d9494-nmhtm"
Jul 28 01:52:23.392840 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:23.392825    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-afe8f9-dockercfg-w8j4t\""
Jul 28 01:52:23.400307 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:23.400283    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-afe8f9-66566d9494-nmhtm"]
Jul 28 01:52:23.476305 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:23.476271    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt7hc\" (UniqueName: \"kubernetes.io/projected/c1ab4455-fd74-4adc-a798-52bf271cbebf-kube-api-access-kt7hc\") pod \"payload-processing-e2e-inf-b-afe8f9-66566d9494-nmhtm\" (UID: \"c1ab4455-fd74-4adc-a798-52bf271cbebf\") " pod="openshift-ingress/payload-processing-e2e-inf-b-afe8f9-66566d9494-nmhtm"
Jul 28 01:52:23.476492 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:23.476344    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/70ef6c62-218f-4873-91e6-2efbea589b1f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-afe8f9-7679497464-qbsmz\" (UID: \"70ef6c62-218f-4873-91e6-2efbea589b1f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-afe8f9-7679497464-qbsmz"
Jul 28 01:52:23.476492 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:23.476398    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nks5z\" (UniqueName: \"kubernetes.io/projected/70ef6c62-218f-4873-91e6-2efbea589b1f-kube-api-access-nks5z\") pod \"payload-pre-processing-e2e-inf-b-afe8f9-7679497464-qbsmz\" (UID: \"70ef6c62-218f-4873-91e6-2efbea589b1f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-afe8f9-7679497464-qbsmz"
Jul 28 01:52:23.476492 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:23.476443    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1ab4455-fd74-4adc-a798-52bf271cbebf-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-afe8f9-66566d9494-nmhtm\" (UID: \"c1ab4455-fd74-4adc-a798-52bf271cbebf\") " pod="openshift-ingress/payload-processing-e2e-inf-b-afe8f9-66566d9494-nmhtm"
Jul 28 01:52:23.577100 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:23.577060    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/70ef6c62-218f-4873-91e6-2efbea589b1f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-afe8f9-7679497464-qbsmz\" (UID: \"70ef6c62-218f-4873-91e6-2efbea589b1f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-afe8f9-7679497464-qbsmz"
Jul 28 01:52:23.577100 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:23.577099    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nks5z\" (UniqueName: \"kubernetes.io/projected/70ef6c62-218f-4873-91e6-2efbea589b1f-kube-api-access-nks5z\") pod \"payload-pre-processing-e2e-inf-b-afe8f9-7679497464-qbsmz\" (UID: \"70ef6c62-218f-4873-91e6-2efbea589b1f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-afe8f9-7679497464-qbsmz"
Jul 28 01:52:23.577324 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:23.577142    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1ab4455-fd74-4adc-a798-52bf271cbebf-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-afe8f9-66566d9494-nmhtm\" (UID: \"c1ab4455-fd74-4adc-a798-52bf271cbebf\") " pod="openshift-ingress/payload-processing-e2e-inf-b-afe8f9-66566d9494-nmhtm"
Jul 28 01:52:23.577324 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:23.577183    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt7hc\" (UniqueName: \"kubernetes.io/projected/c1ab4455-fd74-4adc-a798-52bf271cbebf-kube-api-access-kt7hc\") pod \"payload-processing-e2e-inf-b-afe8f9-66566d9494-nmhtm\" (UID: \"c1ab4455-fd74-4adc-a798-52bf271cbebf\") " pod="openshift-ingress/payload-processing-e2e-inf-b-afe8f9-66566d9494-nmhtm"
Jul 28 01:52:23.577857 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:23.577836    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/70ef6c62-218f-4873-91e6-2efbea589b1f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-afe8f9-7679497464-qbsmz\" (UID: \"70ef6c62-218f-4873-91e6-2efbea589b1f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-afe8f9-7679497464-qbsmz"
Jul 28 01:52:23.577912 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:23.577894    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1ab4455-fd74-4adc-a798-52bf271cbebf-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-afe8f9-66566d9494-nmhtm\" (UID: \"c1ab4455-fd74-4adc-a798-52bf271cbebf\") " pod="openshift-ingress/payload-processing-e2e-inf-b-afe8f9-66566d9494-nmhtm"
Jul 28 01:52:23.588007 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:23.587978    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt7hc\" (UniqueName: \"kubernetes.io/projected/c1ab4455-fd74-4adc-a798-52bf271cbebf-kube-api-access-kt7hc\") pod \"payload-processing-e2e-inf-b-afe8f9-66566d9494-nmhtm\" (UID: \"c1ab4455-fd74-4adc-a798-52bf271cbebf\") " pod="openshift-ingress/payload-processing-e2e-inf-b-afe8f9-66566d9494-nmhtm"
Jul 28 01:52:23.588007 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:23.588002    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nks5z\" (UniqueName: \"kubernetes.io/projected/70ef6c62-218f-4873-91e6-2efbea589b1f-kube-api-access-nks5z\") pod \"payload-pre-processing-e2e-inf-b-afe8f9-7679497464-qbsmz\" (UID: \"70ef6c62-218f-4873-91e6-2efbea589b1f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-afe8f9-7679497464-qbsmz"
Jul 28 01:52:23.681232 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:23.681135    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-afe8f9-7679497464-qbsmz"
Jul 28 01:52:23.701090 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:23.701058    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-afe8f9-66566d9494-nmhtm"
Jul 28 01:52:23.827158 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:23.827083    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-afe8f9-7679497464-qbsmz"]
Jul 28 01:52:23.829403 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:52:23.829373    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70ef6c62_218f_4873_91e6_2efbea589b1f.slice/crio-6a8c563e7e28155b4a8829521340990bca55251c9803677bfe23020e45ee19a6 WatchSource:0}: Error finding container 6a8c563e7e28155b4a8829521340990bca55251c9803677bfe23020e45ee19a6: Status 404 returned error can't find the container with id 6a8c563e7e28155b4a8829521340990bca55251c9803677bfe23020e45ee19a6
Jul 28 01:52:23.852754 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:23.852717    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-afe8f9-66566d9494-nmhtm"]
Jul 28 01:52:23.853383 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:52:23.853340    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1ab4455_fd74_4adc_a798_52bf271cbebf.slice/crio-46443c531f08f21fe80b805e1a128fd2097d512e98470e2855bbc2d49465f002 WatchSource:0}: Error finding container 46443c531f08f21fe80b805e1a128fd2097d512e98470e2855bbc2d49465f002: Status 404 returned error can't find the container with id 46443c531f08f21fe80b805e1a128fd2097d512e98470e2855bbc2d49465f002
Jul 28 01:52:23.913102 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:23.913069    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-afe8f9-7679497464-qbsmz" event={"ID":"70ef6c62-218f-4873-91e6-2efbea589b1f","Type":"ContainerStarted","Data":"5e8a0436e9ccf0d9d9d35281ea843d61fc79ffda68344e7760086c74a7dd9e4b"}
Jul 28 01:52:23.913266 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:23.913133    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-afe8f9-7679497464-qbsmz" event={"ID":"70ef6c62-218f-4873-91e6-2efbea589b1f","Type":"ContainerStarted","Data":"6a8c563e7e28155b4a8829521340990bca55251c9803677bfe23020e45ee19a6"}
Jul 28 01:52:23.913266 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:23.913166    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-afe8f9-7679497464-qbsmz"
Jul 28 01:52:23.914762 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:23.914734    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-afe8f9-66566d9494-nmhtm" event={"ID":"c1ab4455-fd74-4adc-a798-52bf271cbebf","Type":"ContainerStarted","Data":"d4e1c81c8e15ef6f6f6207200dab23a9093fa8d433f75d7a79fcd376238f8188"}
Jul 28 01:52:23.914884 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:23.914792    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-afe8f9-66566d9494-nmhtm"
Jul 28 01:52:23.914884 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:23.914815    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-afe8f9-66566d9494-nmhtm" event={"ID":"c1ab4455-fd74-4adc-a798-52bf271cbebf","Type":"ContainerStarted","Data":"46443c531f08f21fe80b805e1a128fd2097d512e98470e2855bbc2d49465f002"}
Jul 28 01:52:23.928302 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:23.928256    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-afe8f9-7679497464-qbsmz" podStartSLOduration=0.9282394 podStartE2EDuration="928.2394ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:52:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:52:23.926603463 +0000 UTC m=+2194.960646859" watchObservedRunningTime="2026-07-28 01:52:23.9282394 +0000 UTC m=+2194.962282793"
Jul 28 01:52:23.941769 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:23.941681    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-afe8f9-66566d9494-nmhtm" podStartSLOduration=0.941664258 podStartE2EDuration="941.664258ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:52:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:52:23.939894127 +0000 UTC m=+2194.973937521" watchObservedRunningTime="2026-07-28 01:52:23.941664258 +0000 UTC m=+2194.975707650"
Jul 28 01:52:26.881908 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:26.881879    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-896d36-749cf85d86-fgqfz"
Jul 28 01:52:26.882294 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:26.881956    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-896d36-5bd87796b4-6298j"
Jul 28 01:52:27.090600 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:27.090569    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:52:34.921149 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:34.921117    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-afe8f9-7679497464-qbsmz"
Jul 28 01:52:34.921569 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:34.921191    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-afe8f9-66566d9494-nmhtm"
Jul 28 01:52:35.482653 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:35.482621    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:52:54.587304 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:54.587275    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:52:57.884692 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:52:57.884657    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:53:09.477016 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:53:09.476982    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:53:35.689612 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:53:35.689576    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-afe8f9/test-model-afe8f9-kserve-8594b6b4c9-5hxzf"]
Jul 28 01:53:35.693011 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:53:35.692987    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-afe8f9/test-model-afe8f9-kserve-8594b6b4c9-5hxzf"
Jul 28 01:53:35.695086 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:53:35.695064    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-afe8f9\"/\"kube-root-ca.crt\""
Jul 28 01:53:35.695497 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:53:35.695474    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-afe8f9\"/\"default-dockercfg-zfrcj\""
Jul 28 01:53:35.695618 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:53:35.695474    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-afe8f9\"/\"openshift-service-ca.crt\""
Jul 28 01:53:35.695693 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:53:35.695619    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-afe8f9\"/\"test-model-afe8f9-kserve-self-signed-certs\""
Jul 28 01:53:35.703939 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:53:35.703912    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-afe8f9/test-model-afe8f9-kserve-8594b6b4c9-5hxzf"]
Jul 28 01:53:35.721787 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:53:35.721760    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:53:35.731903 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:53:35.731878    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ee657f4-e91a-4d79-8b94-b995024e1e82-home\") pod \"test-model-afe8f9-kserve-8594b6b4c9-5hxzf\" (UID: \"3ee657f4-e91a-4d79-8b94-b995024e1e82\") " pod="ai-tenant-e2e-inf-b-afe8f9/test-model-afe8f9-kserve-8594b6b4c9-5hxzf"
Jul 28 01:53:35.732021 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:53:35.731914    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ee657f4-e91a-4d79-8b94-b995024e1e82-tmp-dir\") pod \"test-model-afe8f9-kserve-8594b6b4c9-5hxzf\" (UID: \"3ee657f4-e91a-4d79-8b94-b995024e1e82\") " pod="ai-tenant-e2e-inf-b-afe8f9/test-model-afe8f9-kserve-8594b6b4c9-5hxzf"
Jul 28 01:53:35.732021 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:53:35.731939    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xswc\" (UniqueName: \"kubernetes.io/projected/3ee657f4-e91a-4d79-8b94-b995024e1e82-kube-api-access-9xswc\") pod \"test-model-afe8f9-kserve-8594b6b4c9-5hxzf\" (UID: \"3ee657f4-e91a-4d79-8b94-b995024e1e82\") " pod="ai-tenant-e2e-inf-b-afe8f9/test-model-afe8f9-kserve-8594b6b4c9-5hxzf"
Jul 28 01:53:35.732110 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:53:35.732047    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ee657f4-e91a-4d79-8b94-b995024e1e82-tls-certs\") pod \"test-model-afe8f9-kserve-8594b6b4c9-5hxzf\" (UID: \"3ee657f4-e91a-4d79-8b94-b995024e1e82\") " pod="ai-tenant-e2e-inf-b-afe8f9/test-model-afe8f9-kserve-8594b6b4c9-5hxzf"
Jul 28 01:53:35.732146 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:53:35.732129    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ee657f4-e91a-4d79-8b94-b995024e1e82-model-cache\") pod \"test-model-afe8f9-kserve-8594b6b4c9-5hxzf\" (UID: \"3ee657f4-e91a-4d79-8b94-b995024e1e82\") " pod="ai-tenant-e2e-inf-b-afe8f9/test-model-afe8f9-kserve-8594b6b4c9-5hxzf"
Jul 28 01:53:35.732180 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:53:35.732158    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ee657f4-e91a-4d79-8b94-b995024e1e82-dshm\") pod \"test-model-afe8f9-kserve-8594b6b4c9-5hxzf\" (UID: \"3ee657f4-e91a-4d79-8b94-b995024e1e82\") " pod="ai-tenant-e2e-inf-b-afe8f9/test-model-afe8f9-kserve-8594b6b4c9-5hxzf"
Jul 28 01:53:35.833330 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:53:35.833295    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ee657f4-e91a-4d79-8b94-b995024e1e82-model-cache\") pod \"test-model-afe8f9-kserve-8594b6b4c9-5hxzf\" (UID: \"3ee657f4-e91a-4d79-8b94-b995024e1e82\") " pod="ai-tenant-e2e-inf-b-afe8f9/test-model-afe8f9-kserve-8594b6b4c9-5hxzf"
Jul 28 01:53:35.833330 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:53:35.833334    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ee657f4-e91a-4d79-8b94-b995024e1e82-dshm\") pod \"test-model-afe8f9-kserve-8594b6b4c9-5hxzf\" (UID: \"3ee657f4-e91a-4d79-8b94-b995024e1e82\") " pod="ai-tenant-e2e-inf-b-afe8f9/test-model-afe8f9-kserve-8594b6b4c9-5hxzf"
Jul 28 01:53:35.833578 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:53:35.833385    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ee657f4-e91a-4d79-8b94-b995024e1e82-home\") pod \"test-model-afe8f9-kserve-8594b6b4c9-5hxzf\" (UID: \"3ee657f4-e91a-4d79-8b94-b995024e1e82\") " pod="ai-tenant-e2e-inf-b-afe8f9/test-model-afe8f9-kserve-8594b6b4c9-5hxzf"
Jul 28 01:53:35.833578 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:53:35.833401    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ee657f4-e91a-4d79-8b94-b995024e1e82-tmp-dir\") pod \"test-model-afe8f9-kserve-8594b6b4c9-5hxzf\" (UID: \"3ee657f4-e91a-4d79-8b94-b995024e1e82\") " pod="ai-tenant-e2e-inf-b-afe8f9/test-model-afe8f9-kserve-8594b6b4c9-5hxzf"
Jul 28 01:53:35.833578 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:53:35.833416    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xswc\" (UniqueName: \"kubernetes.io/projected/3ee657f4-e91a-4d79-8b94-b995024e1e82-kube-api-access-9xswc\") pod \"test-model-afe8f9-kserve-8594b6b4c9-5hxzf\" (UID: \"3ee657f4-e91a-4d79-8b94-b995024e1e82\") " pod="ai-tenant-e2e-inf-b-afe8f9/test-model-afe8f9-kserve-8594b6b4c9-5hxzf"
Jul 28 01:53:35.833578 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:53:35.833448    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ee657f4-e91a-4d79-8b94-b995024e1e82-tls-certs\") pod \"test-model-afe8f9-kserve-8594b6b4c9-5hxzf\" (UID: \"3ee657f4-e91a-4d79-8b94-b995024e1e82\") " pod="ai-tenant-e2e-inf-b-afe8f9/test-model-afe8f9-kserve-8594b6b4c9-5hxzf"
Jul 28 01:53:35.833789 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:53:35.833767    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ee657f4-e91a-4d79-8b94-b995024e1e82-model-cache\") pod \"test-model-afe8f9-kserve-8594b6b4c9-5hxzf\" (UID: \"3ee657f4-e91a-4d79-8b94-b995024e1e82\") " pod="ai-tenant-e2e-inf-b-afe8f9/test-model-afe8f9-kserve-8594b6b4c9-5hxzf"
Jul 28 01:53:35.833848 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:53:35.833789    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ee657f4-e91a-4d79-8b94-b995024e1e82-home\") pod \"test-model-afe8f9-kserve-8594b6b4c9-5hxzf\" (UID: \"3ee657f4-e91a-4d79-8b94-b995024e1e82\") " pod="ai-tenant-e2e-inf-b-afe8f9/test-model-afe8f9-kserve-8594b6b4c9-5hxzf"
Jul 28 01:53:35.833848 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:53:35.833820    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ee657f4-e91a-4d79-8b94-b995024e1e82-tmp-dir\") pod \"test-model-afe8f9-kserve-8594b6b4c9-5hxzf\" (UID: \"3ee657f4-e91a-4d79-8b94-b995024e1e82\") " pod="ai-tenant-e2e-inf-b-afe8f9/test-model-afe8f9-kserve-8594b6b4c9-5hxzf"
Jul 28 01:53:35.835663 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:53:35.835637    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ee657f4-e91a-4d79-8b94-b995024e1e82-dshm\") pod \"test-model-afe8f9-kserve-8594b6b4c9-5hxzf\" (UID: \"3ee657f4-e91a-4d79-8b94-b995024e1e82\") " pod="ai-tenant-e2e-inf-b-afe8f9/test-model-afe8f9-kserve-8594b6b4c9-5hxzf"
Jul 28 01:53:35.835974 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:53:35.835958    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ee657f4-e91a-4d79-8b94-b995024e1e82-tls-certs\") pod \"test-model-afe8f9-kserve-8594b6b4c9-5hxzf\" (UID: \"3ee657f4-e91a-4d79-8b94-b995024e1e82\") " pod="ai-tenant-e2e-inf-b-afe8f9/test-model-afe8f9-kserve-8594b6b4c9-5hxzf"
Jul 28 01:53:35.840474 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:53:35.840453    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xswc\" (UniqueName: \"kubernetes.io/projected/3ee657f4-e91a-4d79-8b94-b995024e1e82-kube-api-access-9xswc\") pod \"test-model-afe8f9-kserve-8594b6b4c9-5hxzf\" (UID: \"3ee657f4-e91a-4d79-8b94-b995024e1e82\") " pod="ai-tenant-e2e-inf-b-afe8f9/test-model-afe8f9-kserve-8594b6b4c9-5hxzf"
Jul 28 01:53:36.005116 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:53:36.005038    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-afe8f9/test-model-afe8f9-kserve-8594b6b4c9-5hxzf"
Jul 28 01:53:36.136203 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:53:36.136178    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-afe8f9/test-model-afe8f9-kserve-8594b6b4c9-5hxzf"]
Jul 28 01:53:36.138732 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:53:36.138699    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ee657f4_e91a_4d79_8b94_b995024e1e82.slice/crio-440d74d21d29998f296bd8fd468429514d641a439280f48b0686913877a7c8c4 WatchSource:0}: Error finding container 440d74d21d29998f296bd8fd468429514d641a439280f48b0686913877a7c8c4: Status 404 returned error can't find the container with id 440d74d21d29998f296bd8fd468429514d641a439280f48b0686913877a7c8c4
Jul 28 01:53:36.266277 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:53:36.266181    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-afe8f9/test-model-afe8f9-kserve-8594b6b4c9-5hxzf" event={"ID":"3ee657f4-e91a-4d79-8b94-b995024e1e82","Type":"ContainerStarted","Data":"d07f16adc54a3eae97904d0700dcc652c771dcf42fdb7c87285442fac8be8e1d"}
Jul 28 01:53:36.266277 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:53:36.266223    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-afe8f9/test-model-afe8f9-kserve-8594b6b4c9-5hxzf" event={"ID":"3ee657f4-e91a-4d79-8b94-b995024e1e82","Type":"ContainerStarted","Data":"440d74d21d29998f296bd8fd468429514d641a439280f48b0686913877a7c8c4"}
Jul 28 01:53:36.281626 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:53:36.281581    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-afe8f9/test-model-afe8f9-kserve-8594b6b4c9-5hxzf" podStartSLOduration=1.28156445 podStartE2EDuration="1.28156445s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:53:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:53:36.280041799 +0000 UTC m=+2267.314085192" watchObservedRunningTime="2026-07-28 01:53:36.28156445 +0000 UTC m=+2267.315607842"
Jul 28 01:53:39.980015 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:53:39.979982    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:53:46.005303 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:53:46.005264    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-afe8f9/test-model-afe8f9-kserve-8594b6b4c9-5hxzf"
Jul 28 01:53:46.005801 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:53:46.005316    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-afe8f9/test-model-afe8f9-kserve-8594b6b4c9-5hxzf"
Jul 28 01:53:46.017949 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:53:46.017919    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-afe8f9/test-model-afe8f9-kserve-8594b6b4c9-5hxzf"
Jul 28 01:53:46.332290 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:53:46.332210    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-afe8f9/test-model-afe8f9-kserve-8594b6b4c9-5hxzf"
Jul 28 01:53:53.190900 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:53:53.190863    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:54:17.584282 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:17.584243    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:54:18.532288 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:18.532253    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-afe8f9/test-model-afe8f9-kserve-8594b6b4c9-5hxzf"]
Jul 28 01:54:18.550291 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:18.550260    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:54:22.285276 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:22.285239    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:54:29.215425 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:29.215394    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:54:29.248131 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:29.248091    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-896d36-749cf85d86-fgqfz"]
Jul 28 01:54:29.248425 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:29.248395    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-896d36-749cf85d86-fgqfz" podUID="5cca327e-fccb-4dd8-a794-933d9470ab45" containerName="payload-processing" containerID="cri-o://f337f896a763500d4474f1837522b3af89eca71afa913bb6dbee4f802a0a757d" gracePeriod=30
Jul 28 01:54:29.254409 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:29.254371    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-896d36-5bd87796b4-6298j"]
Jul 28 01:54:29.254824 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:29.254792    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-896d36-5bd87796b4-6298j" podUID="c478e559-ba8c-4f14-acb3-a48f094b0567" containerName="payload-pre-processing" containerID="cri-o://110de71574cb82b7962ef01d835b80ec28289f9c9f794e22f76f486cc375324c" gracePeriod=30
Jul 28 01:54:29.284661 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:29.284632    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:54:29.345244 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:29.345213    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:54:29.529674 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:29.529653    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-896d36-749cf85d86-fgqfz"
Jul 28 01:54:29.532570 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:29.532544    2560 generic.go:356] "Generic (PLEG): container finished" podID="c478e559-ba8c-4f14-acb3-a48f094b0567" containerID="110de71574cb82b7962ef01d835b80ec28289f9c9f794e22f76f486cc375324c" exitCode=0
Jul 28 01:54:29.532697 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:29.532620    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-896d36-5bd87796b4-6298j" event={"ID":"c478e559-ba8c-4f14-acb3-a48f094b0567","Type":"ContainerDied","Data":"110de71574cb82b7962ef01d835b80ec28289f9c9f794e22f76f486cc375324c"}
Jul 28 01:54:29.532697 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:29.532667    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-896d36-5bd87796b4-6298j" event={"ID":"c478e559-ba8c-4f14-acb3-a48f094b0567","Type":"ContainerDied","Data":"b55bd98997eb20a1aa190098f4924f1c8170365be5c889315eca519952ca0c7a"}
Jul 28 01:54:29.532697 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:29.532687    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b55bd98997eb20a1aa190098f4924f1c8170365be5c889315eca519952ca0c7a"
Jul 28 01:54:29.532864 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:29.532845    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-896d36-5bd87796b4-6298j"
Jul 28 01:54:29.533962 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:29.533936    2560 generic.go:356] "Generic (PLEG): container finished" podID="5cca327e-fccb-4dd8-a794-933d9470ab45" containerID="f337f896a763500d4474f1837522b3af89eca71afa913bb6dbee4f802a0a757d" exitCode=0
Jul 28 01:54:29.534059 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:29.533972    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-896d36-749cf85d86-fgqfz" event={"ID":"5cca327e-fccb-4dd8-a794-933d9470ab45","Type":"ContainerDied","Data":"f337f896a763500d4474f1837522b3af89eca71afa913bb6dbee4f802a0a757d"}
Jul 28 01:54:29.534059 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:29.533982    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-896d36-749cf85d86-fgqfz"
Jul 28 01:54:29.534059 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:29.534016    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-896d36-749cf85d86-fgqfz" event={"ID":"5cca327e-fccb-4dd8-a794-933d9470ab45","Type":"ContainerDied","Data":"0fad117475b6682604ef629b7335ef8958cbdff013feba22f03500458bf8dc88"}
Jul 28 01:54:29.534059 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:29.534045    2560 scope.go:117] "RemoveContainer" containerID="f337f896a763500d4474f1837522b3af89eca71afa913bb6dbee4f802a0a757d"
Jul 28 01:54:29.544387 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:29.544368    2560 scope.go:117] "RemoveContainer" containerID="f337f896a763500d4474f1837522b3af89eca71afa913bb6dbee4f802a0a757d"
Jul 28 01:54:29.544673 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:54:29.544655    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f337f896a763500d4474f1837522b3af89eca71afa913bb6dbee4f802a0a757d\": container with ID starting with f337f896a763500d4474f1837522b3af89eca71afa913bb6dbee4f802a0a757d not found: ID does not exist" containerID="f337f896a763500d4474f1837522b3af89eca71afa913bb6dbee4f802a0a757d"
Jul 28 01:54:29.544824 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:29.544683    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f337f896a763500d4474f1837522b3af89eca71afa913bb6dbee4f802a0a757d"} err="failed to get container status \"f337f896a763500d4474f1837522b3af89eca71afa913bb6dbee4f802a0a757d\": rpc error: code = NotFound desc = could not find container \"f337f896a763500d4474f1837522b3af89eca71afa913bb6dbee4f802a0a757d\": container with ID starting with f337f896a763500d4474f1837522b3af89eca71afa913bb6dbee4f802a0a757d not found: ID does not exist"
Jul 28 01:54:29.629765 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:29.629733    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5cca327e-fccb-4dd8-a794-933d9470ab45-plugins-config-volume\") pod \"5cca327e-fccb-4dd8-a794-933d9470ab45\" (UID: \"5cca327e-fccb-4dd8-a794-933d9470ab45\") "
Jul 28 01:54:29.629963 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:29.629777    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spwm5\" (UniqueName: \"kubernetes.io/projected/5cca327e-fccb-4dd8-a794-933d9470ab45-kube-api-access-spwm5\") pod \"5cca327e-fccb-4dd8-a794-933d9470ab45\" (UID: \"5cca327e-fccb-4dd8-a794-933d9470ab45\") "
Jul 28 01:54:29.629963 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:29.629802    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c478e559-ba8c-4f14-acb3-a48f094b0567-plugins-config-volume\") pod \"c478e559-ba8c-4f14-acb3-a48f094b0567\" (UID: \"c478e559-ba8c-4f14-acb3-a48f094b0567\") "
Jul 28 01:54:29.629963 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:29.629869    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4gxx\" (UniqueName: \"kubernetes.io/projected/c478e559-ba8c-4f14-acb3-a48f094b0567-kube-api-access-w4gxx\") pod \"c478e559-ba8c-4f14-acb3-a48f094b0567\" (UID: \"c478e559-ba8c-4f14-acb3-a48f094b0567\") "
Jul 28 01:54:29.630210 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:29.630185    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cca327e-fccb-4dd8-a794-933d9470ab45-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5cca327e-fccb-4dd8-a794-933d9470ab45" (UID: "5cca327e-fccb-4dd8-a794-933d9470ab45"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:54:29.630271 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:29.630231    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c478e559-ba8c-4f14-acb3-a48f094b0567-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c478e559-ba8c-4f14-acb3-a48f094b0567" (UID: "c478e559-ba8c-4f14-acb3-a48f094b0567"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:54:29.631983 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:29.631962    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c478e559-ba8c-4f14-acb3-a48f094b0567-kube-api-access-w4gxx" (OuterVolumeSpecName: "kube-api-access-w4gxx") pod "c478e559-ba8c-4f14-acb3-a48f094b0567" (UID: "c478e559-ba8c-4f14-acb3-a48f094b0567"). InnerVolumeSpecName "kube-api-access-w4gxx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:54:29.632038 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:29.632020    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cca327e-fccb-4dd8-a794-933d9470ab45-kube-api-access-spwm5" (OuterVolumeSpecName: "kube-api-access-spwm5") pod "5cca327e-fccb-4dd8-a794-933d9470ab45" (UID: "5cca327e-fccb-4dd8-a794-933d9470ab45"). InnerVolumeSpecName "kube-api-access-spwm5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:54:29.731060 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:29.731022    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4gxx\" (UniqueName: \"kubernetes.io/projected/c478e559-ba8c-4f14-acb3-a48f094b0567-kube-api-access-w4gxx\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:54:29.731060 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:29.731053    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5cca327e-fccb-4dd8-a794-933d9470ab45-plugins-config-volume\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:54:29.731060 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:29.731063    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spwm5\" (UniqueName: \"kubernetes.io/projected/5cca327e-fccb-4dd8-a794-933d9470ab45-kube-api-access-spwm5\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:54:29.731293 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:29.731073    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c478e559-ba8c-4f14-acb3-a48f094b0567-plugins-config-volume\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:54:29.854615 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:29.854589    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-896d36-749cf85d86-fgqfz"]
Jul 28 01:54:29.858308 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:29.858285    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-896d36-749cf85d86-fgqfz"]
Jul 28 01:54:30.539455 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:30.539422    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-896d36-5bd87796b4-6298j"
Jul 28 01:54:30.559427 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:30.559403    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-896d36-5bd87796b4-6298j"]
Jul 28 01:54:30.563010 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:30.562986    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-896d36-5bd87796b4-6298j"]
Jul 28 01:54:31.460782 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:31.460749    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cca327e-fccb-4dd8-a794-933d9470ab45" path="/var/lib/kubelet/pods/5cca327e-fccb-4dd8-a794-933d9470ab45/volumes"
Jul 28 01:54:31.461107 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:31.461095    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c478e559-ba8c-4f14-acb3-a48f094b0567" path="/var/lib/kubelet/pods/c478e559-ba8c-4f14-acb3-a48f094b0567/volumes"
Jul 28 01:54:33.551927 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:33.551887    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-afe8f9/test-model-afe8f9-kserve-8594b6b4c9-5hxzf" podUID="3ee657f4-e91a-4d79-8b94-b995024e1e82" containerName="main" containerID="cri-o://d07f16adc54a3eae97904d0700dcc652c771dcf42fdb7c87285442fac8be8e1d" gracePeriod=45
Jul 28 01:54:33.732855 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:33.732822    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:54:33.802123 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:33.802067    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-afe8f9/test-model-afe8f9-kserve-8594b6b4c9-5hxzf"
Jul 28 01:54:33.973051 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:33.973014    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ee657f4-e91a-4d79-8b94-b995024e1e82-home\") pod \"3ee657f4-e91a-4d79-8b94-b995024e1e82\" (UID: \"3ee657f4-e91a-4d79-8b94-b995024e1e82\") "
Jul 28 01:54:33.973051 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:33.973051    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ee657f4-e91a-4d79-8b94-b995024e1e82-tls-certs\") pod \"3ee657f4-e91a-4d79-8b94-b995024e1e82\" (UID: \"3ee657f4-e91a-4d79-8b94-b995024e1e82\") "
Jul 28 01:54:33.973310 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:33.973072    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ee657f4-e91a-4d79-8b94-b995024e1e82-model-cache\") pod \"3ee657f4-e91a-4d79-8b94-b995024e1e82\" (UID: \"3ee657f4-e91a-4d79-8b94-b995024e1e82\") "
Jul 28 01:54:33.973310 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:33.973088    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ee657f4-e91a-4d79-8b94-b995024e1e82-dshm\") pod \"3ee657f4-e91a-4d79-8b94-b995024e1e82\" (UID: \"3ee657f4-e91a-4d79-8b94-b995024e1e82\") "
Jul 28 01:54:33.973310 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:33.973255    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ee657f4-e91a-4d79-8b94-b995024e1e82-tmp-dir\") pod \"3ee657f4-e91a-4d79-8b94-b995024e1e82\" (UID: \"3ee657f4-e91a-4d79-8b94-b995024e1e82\") "
Jul 28 01:54:33.973511 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:33.973327    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ee657f4-e91a-4d79-8b94-b995024e1e82-home" (OuterVolumeSpecName: "home") pod "3ee657f4-e91a-4d79-8b94-b995024e1e82" (UID: "3ee657f4-e91a-4d79-8b94-b995024e1e82"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:54:33.973511 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:33.973345    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ee657f4-e91a-4d79-8b94-b995024e1e82-model-cache" (OuterVolumeSpecName: "model-cache") pod "3ee657f4-e91a-4d79-8b94-b995024e1e82" (UID: "3ee657f4-e91a-4d79-8b94-b995024e1e82"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:54:33.973511 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:33.973336    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xswc\" (UniqueName: \"kubernetes.io/projected/3ee657f4-e91a-4d79-8b94-b995024e1e82-kube-api-access-9xswc\") pod \"3ee657f4-e91a-4d79-8b94-b995024e1e82\" (UID: \"3ee657f4-e91a-4d79-8b94-b995024e1e82\") "
Jul 28 01:54:33.973666 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:33.973530    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ee657f4-e91a-4d79-8b94-b995024e1e82-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3ee657f4-e91a-4d79-8b94-b995024e1e82" (UID: "3ee657f4-e91a-4d79-8b94-b995024e1e82"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:54:33.973765 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:33.973743    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ee657f4-e91a-4d79-8b94-b995024e1e82-tmp-dir\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:54:33.973848 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:33.973769    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ee657f4-e91a-4d79-8b94-b995024e1e82-home\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:54:33.973848 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:33.973783    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ee657f4-e91a-4d79-8b94-b995024e1e82-model-cache\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:54:33.975454 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:33.975434    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ee657f4-e91a-4d79-8b94-b995024e1e82-dshm" (OuterVolumeSpecName: "dshm") pod "3ee657f4-e91a-4d79-8b94-b995024e1e82" (UID: "3ee657f4-e91a-4d79-8b94-b995024e1e82"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:54:33.975556 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:33.975493    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ee657f4-e91a-4d79-8b94-b995024e1e82-kube-api-access-9xswc" (OuterVolumeSpecName: "kube-api-access-9xswc") pod "3ee657f4-e91a-4d79-8b94-b995024e1e82" (UID: "3ee657f4-e91a-4d79-8b94-b995024e1e82"). InnerVolumeSpecName "kube-api-access-9xswc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:54:33.975556 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:33.975514    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ee657f4-e91a-4d79-8b94-b995024e1e82-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3ee657f4-e91a-4d79-8b94-b995024e1e82" (UID: "3ee657f4-e91a-4d79-8b94-b995024e1e82"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:54:34.075261 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:34.075166    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ee657f4-e91a-4d79-8b94-b995024e1e82-tls-certs\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:54:34.075261 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:34.075199    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ee657f4-e91a-4d79-8b94-b995024e1e82-dshm\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:54:34.075261 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:34.075211    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xswc\" (UniqueName: \"kubernetes.io/projected/3ee657f4-e91a-4d79-8b94-b995024e1e82-kube-api-access-9xswc\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:54:34.113279 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:34.113247    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:54:34.559627 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:34.559588    2560 generic.go:356] "Generic (PLEG): container finished" podID="3ee657f4-e91a-4d79-8b94-b995024e1e82" containerID="d07f16adc54a3eae97904d0700dcc652c771dcf42fdb7c87285442fac8be8e1d" exitCode=0
Jul 28 01:54:34.560120 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:34.559641    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-afe8f9/test-model-afe8f9-kserve-8594b6b4c9-5hxzf"
Jul 28 01:54:34.560120 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:34.559645    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-afe8f9/test-model-afe8f9-kserve-8594b6b4c9-5hxzf" event={"ID":"3ee657f4-e91a-4d79-8b94-b995024e1e82","Type":"ContainerDied","Data":"d07f16adc54a3eae97904d0700dcc652c771dcf42fdb7c87285442fac8be8e1d"}
Jul 28 01:54:34.560120 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:34.559679    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-afe8f9/test-model-afe8f9-kserve-8594b6b4c9-5hxzf" event={"ID":"3ee657f4-e91a-4d79-8b94-b995024e1e82","Type":"ContainerDied","Data":"440d74d21d29998f296bd8fd468429514d641a439280f48b0686913877a7c8c4"}
Jul 28 01:54:34.560120 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:34.559696    2560 scope.go:117] "RemoveContainer" containerID="d07f16adc54a3eae97904d0700dcc652c771dcf42fdb7c87285442fac8be8e1d"
Jul 28 01:54:34.569429 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:34.569403    2560 scope.go:117] "RemoveContainer" containerID="d07f16adc54a3eae97904d0700dcc652c771dcf42fdb7c87285442fac8be8e1d"
Jul 28 01:54:34.569691 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:54:34.569670    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d07f16adc54a3eae97904d0700dcc652c771dcf42fdb7c87285442fac8be8e1d\": container with ID starting with d07f16adc54a3eae97904d0700dcc652c771dcf42fdb7c87285442fac8be8e1d not found: ID does not exist" containerID="d07f16adc54a3eae97904d0700dcc652c771dcf42fdb7c87285442fac8be8e1d"
Jul 28 01:54:34.569737 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:34.569701    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d07f16adc54a3eae97904d0700dcc652c771dcf42fdb7c87285442fac8be8e1d"} err="failed to get container status \"d07f16adc54a3eae97904d0700dcc652c771dcf42fdb7c87285442fac8be8e1d\": rpc error: code = NotFound desc = could not find container \"d07f16adc54a3eae97904d0700dcc652c771dcf42fdb7c87285442fac8be8e1d\": container with ID starting with d07f16adc54a3eae97904d0700dcc652c771dcf42fdb7c87285442fac8be8e1d not found: ID does not exist"
Jul 28 01:54:34.580264 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:34.580236    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-afe8f9/test-model-afe8f9-kserve-8594b6b4c9-5hxzf"]
Jul 28 01:54:34.583815 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:34.583793    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-afe8f9/test-model-afe8f9-kserve-8594b6b4c9-5hxzf"]
Jul 28 01:54:35.461341 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:35.461300    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ee657f4-e91a-4d79-8b94-b995024e1e82" path="/var/lib/kubelet/pods/3ee657f4-e91a-4d79-8b94-b995024e1e82/volumes"
Jul 28 01:54:37.981369 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:37.981314    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:54:39.849096 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:39.849068    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:54:39.904201 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:39.904169    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:54:40.110704 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:40.110675    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:54:40.350301 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:40.350271    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:54:50.896485 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:50.896451    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:54:50.910179 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:50.910144    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-afe8f9-66566d9494-nmhtm"]
Jul 28 01:54:50.910556 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:50.910476    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-afe8f9-66566d9494-nmhtm" podUID="c1ab4455-fd74-4adc-a798-52bf271cbebf" containerName="payload-processing" containerID="cri-o://d4e1c81c8e15ef6f6f6207200dab23a9093fa8d433f75d7a79fcd376238f8188" gracePeriod=30
Jul 28 01:54:50.915691 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:50.915437    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-afe8f9-7679497464-qbsmz"]
Jul 28 01:54:50.915691 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:50.915646    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-afe8f9-7679497464-qbsmz" podUID="70ef6c62-218f-4873-91e6-2efbea589b1f" containerName="payload-pre-processing" containerID="cri-o://5e8a0436e9ccf0d9d9d35281ea843d61fc79ffda68344e7760086c74a7dd9e4b" gracePeriod=30
Jul 28 01:54:50.995943 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:50.995918    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:54:51.182836 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:51.182813    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-afe8f9-66566d9494-nmhtm"
Jul 28 01:54:51.185570 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:51.185553    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-afe8f9-7679497464-qbsmz"
Jul 28 01:54:51.239562 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:51.239537    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kt7hc\" (UniqueName: \"kubernetes.io/projected/c1ab4455-fd74-4adc-a798-52bf271cbebf-kube-api-access-kt7hc\") pod \"c1ab4455-fd74-4adc-a798-52bf271cbebf\" (UID: \"c1ab4455-fd74-4adc-a798-52bf271cbebf\") "
Jul 28 01:54:51.239681 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:51.239573    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1ab4455-fd74-4adc-a798-52bf271cbebf-plugins-config-volume\") pod \"c1ab4455-fd74-4adc-a798-52bf271cbebf\" (UID: \"c1ab4455-fd74-4adc-a798-52bf271cbebf\") "
Jul 28 01:54:51.239731 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:51.239697    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/70ef6c62-218f-4873-91e6-2efbea589b1f-plugins-config-volume\") pod \"70ef6c62-218f-4873-91e6-2efbea589b1f\" (UID: \"70ef6c62-218f-4873-91e6-2efbea589b1f\") "
Jul 28 01:54:51.239784 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:51.239773    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nks5z\" (UniqueName: \"kubernetes.io/projected/70ef6c62-218f-4873-91e6-2efbea589b1f-kube-api-access-nks5z\") pod \"70ef6c62-218f-4873-91e6-2efbea589b1f\" (UID: \"70ef6c62-218f-4873-91e6-2efbea589b1f\") "
Jul 28 01:54:51.240028 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:51.240002    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1ab4455-fd74-4adc-a798-52bf271cbebf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c1ab4455-fd74-4adc-a798-52bf271cbebf" (UID: "c1ab4455-fd74-4adc-a798-52bf271cbebf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:54:51.240139 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:51.240090    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70ef6c62-218f-4873-91e6-2efbea589b1f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "70ef6c62-218f-4873-91e6-2efbea589b1f" (UID: "70ef6c62-218f-4873-91e6-2efbea589b1f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:54:51.241699 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:51.241674    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70ef6c62-218f-4873-91e6-2efbea589b1f-kube-api-access-nks5z" (OuterVolumeSpecName: "kube-api-access-nks5z") pod "70ef6c62-218f-4873-91e6-2efbea589b1f" (UID: "70ef6c62-218f-4873-91e6-2efbea589b1f"). InnerVolumeSpecName "kube-api-access-nks5z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:54:51.241839 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:51.241820    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1ab4455-fd74-4adc-a798-52bf271cbebf-kube-api-access-kt7hc" (OuterVolumeSpecName: "kube-api-access-kt7hc") pod "c1ab4455-fd74-4adc-a798-52bf271cbebf" (UID: "c1ab4455-fd74-4adc-a798-52bf271cbebf"). InnerVolumeSpecName "kube-api-access-kt7hc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:54:51.340701 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:51.340671    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kt7hc\" (UniqueName: \"kubernetes.io/projected/c1ab4455-fd74-4adc-a798-52bf271cbebf-kube-api-access-kt7hc\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:54:51.340701 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:51.340702    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1ab4455-fd74-4adc-a798-52bf271cbebf-plugins-config-volume\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:54:51.340830 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:51.340717    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/70ef6c62-218f-4873-91e6-2efbea589b1f-plugins-config-volume\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:54:51.340830 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:51.340731    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nks5z\" (UniqueName: \"kubernetes.io/projected/70ef6c62-218f-4873-91e6-2efbea589b1f-kube-api-access-nks5z\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:54:51.644420 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:51.644380    2560 generic.go:356] "Generic (PLEG): container finished" podID="70ef6c62-218f-4873-91e6-2efbea589b1f" containerID="5e8a0436e9ccf0d9d9d35281ea843d61fc79ffda68344e7760086c74a7dd9e4b" exitCode=0
Jul 28 01:54:51.644420 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:51.644418    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-afe8f9-7679497464-qbsmz"
Jul 28 01:54:51.644654 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:51.644392    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-afe8f9-7679497464-qbsmz" event={"ID":"70ef6c62-218f-4873-91e6-2efbea589b1f","Type":"ContainerDied","Data":"5e8a0436e9ccf0d9d9d35281ea843d61fc79ffda68344e7760086c74a7dd9e4b"}
Jul 28 01:54:51.644654 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:51.644529    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-afe8f9-7679497464-qbsmz" event={"ID":"70ef6c62-218f-4873-91e6-2efbea589b1f","Type":"ContainerDied","Data":"6a8c563e7e28155b4a8829521340990bca55251c9803677bfe23020e45ee19a6"}
Jul 28 01:54:51.645510 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:51.644554    2560 scope.go:117] "RemoveContainer" containerID="5e8a0436e9ccf0d9d9d35281ea843d61fc79ffda68344e7760086c74a7dd9e4b"
Jul 28 01:54:51.646074 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:51.646048    2560 generic.go:356] "Generic (PLEG): container finished" podID="c1ab4455-fd74-4adc-a798-52bf271cbebf" containerID="d4e1c81c8e15ef6f6f6207200dab23a9093fa8d433f75d7a79fcd376238f8188" exitCode=0
Jul 28 01:54:51.646182 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:51.646080    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-afe8f9-66566d9494-nmhtm" event={"ID":"c1ab4455-fd74-4adc-a798-52bf271cbebf","Type":"ContainerDied","Data":"d4e1c81c8e15ef6f6f6207200dab23a9093fa8d433f75d7a79fcd376238f8188"}
Jul 28 01:54:51.646182 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:51.646131    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-afe8f9-66566d9494-nmhtm" event={"ID":"c1ab4455-fd74-4adc-a798-52bf271cbebf","Type":"ContainerDied","Data":"46443c531f08f21fe80b805e1a128fd2097d512e98470e2855bbc2d49465f002"}
Jul 28 01:54:51.646182 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:51.646088    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-afe8f9-66566d9494-nmhtm"
Jul 28 01:54:51.656169 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:51.656150    2560 scope.go:117] "RemoveContainer" containerID="5e8a0436e9ccf0d9d9d35281ea843d61fc79ffda68344e7760086c74a7dd9e4b"
Jul 28 01:54:51.656451 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:54:51.656432    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e8a0436e9ccf0d9d9d35281ea843d61fc79ffda68344e7760086c74a7dd9e4b\": container with ID starting with 5e8a0436e9ccf0d9d9d35281ea843d61fc79ffda68344e7760086c74a7dd9e4b not found: ID does not exist" containerID="5e8a0436e9ccf0d9d9d35281ea843d61fc79ffda68344e7760086c74a7dd9e4b"
Jul 28 01:54:51.656537 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:51.656463    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e8a0436e9ccf0d9d9d35281ea843d61fc79ffda68344e7760086c74a7dd9e4b"} err="failed to get container status \"5e8a0436e9ccf0d9d9d35281ea843d61fc79ffda68344e7760086c74a7dd9e4b\": rpc error: code = NotFound desc = could not find container \"5e8a0436e9ccf0d9d9d35281ea843d61fc79ffda68344e7760086c74a7dd9e4b\": container with ID starting with 5e8a0436e9ccf0d9d9d35281ea843d61fc79ffda68344e7760086c74a7dd9e4b not found: ID does not exist"
Jul 28 01:54:51.656537 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:51.656481    2560 scope.go:117] "RemoveContainer" containerID="d4e1c81c8e15ef6f6f6207200dab23a9093fa8d433f75d7a79fcd376238f8188"
Jul 28 01:54:51.664869 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:51.664844    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-afe8f9-7679497464-qbsmz"]
Jul 28 01:54:51.665093 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:51.665055    2560 scope.go:117] "RemoveContainer" containerID="d4e1c81c8e15ef6f6f6207200dab23a9093fa8d433f75d7a79fcd376238f8188"
Jul 28 01:54:51.665400 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:54:51.665379    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4e1c81c8e15ef6f6f6207200dab23a9093fa8d433f75d7a79fcd376238f8188\": container with ID starting with d4e1c81c8e15ef6f6f6207200dab23a9093fa8d433f75d7a79fcd376238f8188 not found: ID does not exist" containerID="d4e1c81c8e15ef6f6f6207200dab23a9093fa8d433f75d7a79fcd376238f8188"
Jul 28 01:54:51.665472 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:51.665408    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4e1c81c8e15ef6f6f6207200dab23a9093fa8d433f75d7a79fcd376238f8188"} err="failed to get container status \"d4e1c81c8e15ef6f6f6207200dab23a9093fa8d433f75d7a79fcd376238f8188\": rpc error: code = NotFound desc = could not find container \"d4e1c81c8e15ef6f6f6207200dab23a9093fa8d433f75d7a79fcd376238f8188\": container with ID starting with d4e1c81c8e15ef6f6f6207200dab23a9093fa8d433f75d7a79fcd376238f8188 not found: ID does not exist"
Jul 28 01:54:51.668664 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:51.668644    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-afe8f9-7679497464-qbsmz"]
Jul 28 01:54:51.677152 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:51.677132    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-afe8f9-66566d9494-nmhtm"]
Jul 28 01:54:51.680397 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:51.680378    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-afe8f9-66566d9494-nmhtm"]
Jul 28 01:54:53.460271 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:53.460239    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70ef6c62-218f-4873-91e6-2efbea589b1f" path="/var/lib/kubelet/pods/70ef6c62-218f-4873-91e6-2efbea589b1f/volumes"
Jul 28 01:54:53.460656 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:53.460588    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1ab4455-fd74-4adc-a798-52bf271cbebf" path="/var/lib/kubelet/pods/c1ab4455-fd74-4adc-a798-52bf271cbebf/volumes"
Jul 28 01:54:53.882912 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:53.882872    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:54:55.517482 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:55.517435    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:54:55.942996 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:54:55.942966    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:55:01.495989 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:01.495958    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:55:01.552796 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:01.552769    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:55:01.773279 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:01.773186    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:55:01.985324 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:01.985280    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:55:02.327453 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:02.327422    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:55:02.631398 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:02.631344    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:55:02.798056 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:02.798021    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:55:05.244454 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:05.244423    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:55:05.345609 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:05.345577    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:55:05.436689 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:05.436659    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:55:05.560005 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:05.559918    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:55:05.938197 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:05.938167    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:55:06.036677 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.036641    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:55:06.056014 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.055976    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-1bc912-9b9d5b788-492gf"]
Jul 28 01:55:06.056429 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.056410    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cca327e-fccb-4dd8-a794-933d9470ab45" containerName="payload-processing"
Jul 28 01:55:06.056515 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.056430    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cca327e-fccb-4dd8-a794-933d9470ab45" containerName="payload-processing"
Jul 28 01:55:06.056515 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.056457    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1ab4455-fd74-4adc-a798-52bf271cbebf" containerName="payload-processing"
Jul 28 01:55:06.056515 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.056466    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1ab4455-fd74-4adc-a798-52bf271cbebf" containerName="payload-processing"
Jul 28 01:55:06.056515 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.056480    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c478e559-ba8c-4f14-acb3-a48f094b0567" containerName="payload-pre-processing"
Jul 28 01:55:06.056515 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.056490    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c478e559-ba8c-4f14-acb3-a48f094b0567" containerName="payload-pre-processing"
Jul 28 01:55:06.056515 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.056509    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ee657f4-e91a-4d79-8b94-b995024e1e82" containerName="main"
Jul 28 01:55:06.056515 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.056517    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ee657f4-e91a-4d79-8b94-b995024e1e82" containerName="main"
Jul 28 01:55:06.056873 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.056532    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70ef6c62-218f-4873-91e6-2efbea589b1f" containerName="payload-pre-processing"
Jul 28 01:55:06.056873 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.056541    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="70ef6c62-218f-4873-91e6-2efbea589b1f" containerName="payload-pre-processing"
Jul 28 01:55:06.056873 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.056632    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ee657f4-e91a-4d79-8b94-b995024e1e82" containerName="main"
Jul 28 01:55:06.056873 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.056644    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c478e559-ba8c-4f14-acb3-a48f094b0567" containerName="payload-pre-processing"
Jul 28 01:55:06.056873 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.056653    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cca327e-fccb-4dd8-a794-933d9470ab45" containerName="payload-processing"
Jul 28 01:55:06.056873 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.056664    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="70ef6c62-218f-4873-91e6-2efbea589b1f" containerName="payload-pre-processing"
Jul 28 01:55:06.056873 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.056675    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1ab4455-fd74-4adc-a798-52bf271cbebf" containerName="payload-processing"
Jul 28 01:55:06.059867 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.059842    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-1bc912-9b9d5b788-492gf"
Jul 28 01:55:06.061617 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.061598    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-1bc912-dockercfg-dnsxp\""
Jul 28 01:55:06.061725 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.061633    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-1bc912\""
Jul 28 01:55:06.069562 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.069539    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-1bc912-9b9d5b788-492gf"]
Jul 28 01:55:06.100691 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.100658    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-1bc912-654c8888cb-9s9g4"]
Jul 28 01:55:06.104163 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.104145    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1bc912-654c8888cb-9s9g4"
Jul 28 01:55:06.113274 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.113249    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-1bc912-654c8888cb-9s9g4"]
Jul 28 01:55:06.173626 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.173589    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4svv\" (UniqueName: \"kubernetes.io/projected/2e2bc1d7-91bd-411c-89ae-c41d98105f85-kube-api-access-k4svv\") pod \"payload-pre-processing-e2e-api-a-1bc912-654c8888cb-9s9g4\" (UID: \"2e2bc1d7-91bd-411c-89ae-c41d98105f85\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-1bc912-654c8888cb-9s9g4"
Jul 28 01:55:06.173777 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.173701    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsjnh\" (UniqueName: \"kubernetes.io/projected/5f4757cd-9e63-48ab-b572-19ad7257a44d-kube-api-access-tsjnh\") pod \"payload-processing-e2e-api-a-1bc912-9b9d5b788-492gf\" (UID: \"5f4757cd-9e63-48ab-b572-19ad7257a44d\") " pod="openshift-ingress/payload-processing-e2e-api-a-1bc912-9b9d5b788-492gf"
Jul 28 01:55:06.173777 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.173730    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e2bc1d7-91bd-411c-89ae-c41d98105f85-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-1bc912-654c8888cb-9s9g4\" (UID: \"2e2bc1d7-91bd-411c-89ae-c41d98105f85\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-1bc912-654c8888cb-9s9g4"
Jul 28 01:55:06.173777 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.173757    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f4757cd-9e63-48ab-b572-19ad7257a44d-plugins-config-volume\") pod \"payload-processing-e2e-api-a-1bc912-9b9d5b788-492gf\" (UID: \"5f4757cd-9e63-48ab-b572-19ad7257a44d\") " pod="openshift-ingress/payload-processing-e2e-api-a-1bc912-9b9d5b788-492gf"
Jul 28 01:55:06.275250 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.275163    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e2bc1d7-91bd-411c-89ae-c41d98105f85-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-1bc912-654c8888cb-9s9g4\" (UID: \"2e2bc1d7-91bd-411c-89ae-c41d98105f85\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-1bc912-654c8888cb-9s9g4"
Jul 28 01:55:06.275250 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.275209    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f4757cd-9e63-48ab-b572-19ad7257a44d-plugins-config-volume\") pod \"payload-processing-e2e-api-a-1bc912-9b9d5b788-492gf\" (UID: \"5f4757cd-9e63-48ab-b572-19ad7257a44d\") " pod="openshift-ingress/payload-processing-e2e-api-a-1bc912-9b9d5b788-492gf"
Jul 28 01:55:06.275725 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.275281    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4svv\" (UniqueName: \"kubernetes.io/projected/2e2bc1d7-91bd-411c-89ae-c41d98105f85-kube-api-access-k4svv\") pod \"payload-pre-processing-e2e-api-a-1bc912-654c8888cb-9s9g4\" (UID: \"2e2bc1d7-91bd-411c-89ae-c41d98105f85\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-1bc912-654c8888cb-9s9g4"
Jul 28 01:55:06.275725 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.275376    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsjnh\" (UniqueName: \"kubernetes.io/projected/5f4757cd-9e63-48ab-b572-19ad7257a44d-kube-api-access-tsjnh\") pod \"payload-processing-e2e-api-a-1bc912-9b9d5b788-492gf\" (UID: \"5f4757cd-9e63-48ab-b572-19ad7257a44d\") " pod="openshift-ingress/payload-processing-e2e-api-a-1bc912-9b9d5b788-492gf"
Jul 28 01:55:06.275977 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.275954    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e2bc1d7-91bd-411c-89ae-c41d98105f85-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-1bc912-654c8888cb-9s9g4\" (UID: \"2e2bc1d7-91bd-411c-89ae-c41d98105f85\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-1bc912-654c8888cb-9s9g4"
Jul 28 01:55:06.275977 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.275968    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f4757cd-9e63-48ab-b572-19ad7257a44d-plugins-config-volume\") pod \"payload-processing-e2e-api-a-1bc912-9b9d5b788-492gf\" (UID: \"5f4757cd-9e63-48ab-b572-19ad7257a44d\") " pod="openshift-ingress/payload-processing-e2e-api-a-1bc912-9b9d5b788-492gf"
Jul 28 01:55:06.285530 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.285496    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsjnh\" (UniqueName: \"kubernetes.io/projected/5f4757cd-9e63-48ab-b572-19ad7257a44d-kube-api-access-tsjnh\") pod \"payload-processing-e2e-api-a-1bc912-9b9d5b788-492gf\" (UID: \"5f4757cd-9e63-48ab-b572-19ad7257a44d\") " pod="openshift-ingress/payload-processing-e2e-api-a-1bc912-9b9d5b788-492gf"
Jul 28 01:55:06.285817 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.285798    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4svv\" (UniqueName: \"kubernetes.io/projected/2e2bc1d7-91bd-411c-89ae-c41d98105f85-kube-api-access-k4svv\") pod \"payload-pre-processing-e2e-api-a-1bc912-654c8888cb-9s9g4\" (UID: \"2e2bc1d7-91bd-411c-89ae-c41d98105f85\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-1bc912-654c8888cb-9s9g4"
Jul 28 01:55:06.371029 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.370990    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-1bc912-9b9d5b788-492gf"
Jul 28 01:55:06.415443 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.415410    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1bc912-654c8888cb-9s9g4"
Jul 28 01:55:06.517177 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.517115    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-1bc912-9b9d5b788-492gf"]
Jul 28 01:55:06.520363 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:55:06.520313    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f4757cd_9e63_48ab_b572_19ad7257a44d.slice/crio-884d58e0084ac5e1a14546a61706e64966e8248f52bceefbf81f07401171da68 WatchSource:0}: Error finding container 884d58e0084ac5e1a14546a61706e64966e8248f52bceefbf81f07401171da68: Status 404 returned error can't find the container with id 884d58e0084ac5e1a14546a61706e64966e8248f52bceefbf81f07401171da68
Jul 28 01:55:06.566964 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.566935    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-1bc912-654c8888cb-9s9g4"]
Jul 28 01:55:06.568624 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:55:06.568599    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e2bc1d7_91bd_411c_89ae_c41d98105f85.slice/crio-ae78f2e18bae4955f9e8b5df20e816a1acf0a4ed490b93b54e7a21a0d7001fe1 WatchSource:0}: Error finding container ae78f2e18bae4955f9e8b5df20e816a1acf0a4ed490b93b54e7a21a0d7001fe1: Status 404 returned error can't find the container with id ae78f2e18bae4955f9e8b5df20e816a1acf0a4ed490b93b54e7a21a0d7001fe1
Jul 28 01:55:06.728434 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.728387    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1bc912-654c8888cb-9s9g4" event={"ID":"2e2bc1d7-91bd-411c-89ae-c41d98105f85","Type":"ContainerStarted","Data":"7f8f01d258094d0cf5974b25e627434c34c6fe48401ffba374c7f4d8ddc15866"}
Jul 28 01:55:06.728622 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.728453    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1bc912-654c8888cb-9s9g4" event={"ID":"2e2bc1d7-91bd-411c-89ae-c41d98105f85","Type":"ContainerStarted","Data":"ae78f2e18bae4955f9e8b5df20e816a1acf0a4ed490b93b54e7a21a0d7001fe1"}
Jul 28 01:55:06.728622 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.728482    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1bc912-654c8888cb-9s9g4"
Jul 28 01:55:06.729946 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.729919    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-1bc912-9b9d5b788-492gf" event={"ID":"5f4757cd-9e63-48ab-b572-19ad7257a44d","Type":"ContainerStarted","Data":"1457722e06e8ff09b6183d0690e05c68c25199b56e009aed4960d8e94b06db78"}
Jul 28 01:55:06.730073 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.729961    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-1bc912-9b9d5b788-492gf" event={"ID":"5f4757cd-9e63-48ab-b572-19ad7257a44d","Type":"ContainerStarted","Data":"884d58e0084ac5e1a14546a61706e64966e8248f52bceefbf81f07401171da68"}
Jul 28 01:55:06.730073 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.729979    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-1bc912-9b9d5b788-492gf"
Jul 28 01:55:06.744961 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.744917    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1bc912-654c8888cb-9s9g4" podStartSLOduration=0.744903671 podStartE2EDuration="744.903671ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:55:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:55:06.743257808 +0000 UTC m=+2357.777301202" watchObservedRunningTime="2026-07-28 01:55:06.744903671 +0000 UTC m=+2357.778947064"
Jul 28 01:55:06.759534 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:06.759487    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-1bc912-9b9d5b788-492gf" podStartSLOduration=0.759472422 podStartE2EDuration="759.472422ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:55:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:55:06.757755925 +0000 UTC m=+2357.791799331" watchObservedRunningTime="2026-07-28 01:55:06.759472422 +0000 UTC m=+2357.793515814"
Jul 28 01:55:09.726376 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:09.726326    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:55:10.180446 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:10.180410    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:55:10.474922 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:10.474841    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:55:10.642971 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:10.642942    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:55:13.254098 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:13.254064    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:55:13.290811 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:13.290776    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:55:13.340197 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:13.340162    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:55:13.410784 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:13.410748    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:55:13.656748 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:13.656702    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:55:13.941105 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:13.941020    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:55:14.048859 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:14.048823    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:55:14.053397 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:14.053370    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-4b0f72-78f9bb44b8-84h9w"]
Jul 28 01:55:14.057146 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:14.057123    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4b0f72-78f9bb44b8-84h9w"
Jul 28 01:55:14.059290 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:14.059269    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-4b0f72-dockercfg-w7r5f\""
Jul 28 01:55:14.059453 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:14.059272    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-4b0f72\""
Jul 28 01:55:14.066509 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:14.066483    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-4b0f72-78f9bb44b8-84h9w"]
Jul 28 01:55:14.075722 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:14.075694    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4b0f72-78864cccb-kbll2"]
Jul 28 01:55:14.079463 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:14.079442    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-4b0f72-78864cccb-kbll2"
Jul 28 01:55:14.089186 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:14.089163    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4b0f72-78864cccb-kbll2"]
Jul 28 01:55:14.148471 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:14.148436    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xkwm\" (UniqueName: \"kubernetes.io/projected/1a37f212-6569-4776-9dc5-187dfc2dd4de-kube-api-access-9xkwm\") pod \"payload-pre-processing-e2e-api-b-4b0f72-78f9bb44b8-84h9w\" (UID: \"1a37f212-6569-4776-9dc5-187dfc2dd4de\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-4b0f72-78f9bb44b8-84h9w"
Jul 28 01:55:14.148471 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:14.148479    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a37f212-6569-4776-9dc5-187dfc2dd4de-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-4b0f72-78f9bb44b8-84h9w\" (UID: \"1a37f212-6569-4776-9dc5-187dfc2dd4de\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-4b0f72-78f9bb44b8-84h9w"
Jul 28 01:55:14.249381 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:14.249278    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xkwm\" (UniqueName: \"kubernetes.io/projected/1a37f212-6569-4776-9dc5-187dfc2dd4de-kube-api-access-9xkwm\") pod \"payload-pre-processing-e2e-api-b-4b0f72-78f9bb44b8-84h9w\" (UID: \"1a37f212-6569-4776-9dc5-187dfc2dd4de\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-4b0f72-78f9bb44b8-84h9w"
Jul 28 01:55:14.249381 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:14.249320    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a37f212-6569-4776-9dc5-187dfc2dd4de-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-4b0f72-78f9bb44b8-84h9w\" (UID: \"1a37f212-6569-4776-9dc5-187dfc2dd4de\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-4b0f72-78f9bb44b8-84h9w"
Jul 28 01:55:14.249582 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:14.249403    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80dca445-73bd-4cc5-ba68-6b8bd061dd44-plugins-config-volume\") pod \"payload-processing-e2e-api-b-4b0f72-78864cccb-kbll2\" (UID: \"80dca445-73bd-4cc5-ba68-6b8bd061dd44\") " pod="openshift-ingress/payload-processing-e2e-api-b-4b0f72-78864cccb-kbll2"
Jul 28 01:55:14.249582 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:14.249424    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs2xx\" (UniqueName: \"kubernetes.io/projected/80dca445-73bd-4cc5-ba68-6b8bd061dd44-kube-api-access-hs2xx\") pod \"payload-processing-e2e-api-b-4b0f72-78864cccb-kbll2\" (UID: \"80dca445-73bd-4cc5-ba68-6b8bd061dd44\") " pod="openshift-ingress/payload-processing-e2e-api-b-4b0f72-78864cccb-kbll2"
Jul 28 01:55:14.250116 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:14.250095    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a37f212-6569-4776-9dc5-187dfc2dd4de-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-4b0f72-78f9bb44b8-84h9w\" (UID: \"1a37f212-6569-4776-9dc5-187dfc2dd4de\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-4b0f72-78f9bb44b8-84h9w"
Jul 28 01:55:14.258765 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:14.258735    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xkwm\" (UniqueName: \"kubernetes.io/projected/1a37f212-6569-4776-9dc5-187dfc2dd4de-kube-api-access-9xkwm\") pod \"payload-pre-processing-e2e-api-b-4b0f72-78f9bb44b8-84h9w\" (UID: \"1a37f212-6569-4776-9dc5-187dfc2dd4de\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-4b0f72-78f9bb44b8-84h9w"
Jul 28 01:55:14.350265 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:14.350229    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80dca445-73bd-4cc5-ba68-6b8bd061dd44-plugins-config-volume\") pod \"payload-processing-e2e-api-b-4b0f72-78864cccb-kbll2\" (UID: \"80dca445-73bd-4cc5-ba68-6b8bd061dd44\") " pod="openshift-ingress/payload-processing-e2e-api-b-4b0f72-78864cccb-kbll2"
Jul 28 01:55:14.350265 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:14.350272    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs2xx\" (UniqueName: \"kubernetes.io/projected/80dca445-73bd-4cc5-ba68-6b8bd061dd44-kube-api-access-hs2xx\") pod \"payload-processing-e2e-api-b-4b0f72-78864cccb-kbll2\" (UID: \"80dca445-73bd-4cc5-ba68-6b8bd061dd44\") " pod="openshift-ingress/payload-processing-e2e-api-b-4b0f72-78864cccb-kbll2"
Jul 28 01:55:14.350955 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:14.350935    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80dca445-73bd-4cc5-ba68-6b8bd061dd44-plugins-config-volume\") pod \"payload-processing-e2e-api-b-4b0f72-78864cccb-kbll2\" (UID: \"80dca445-73bd-4cc5-ba68-6b8bd061dd44\") " pod="openshift-ingress/payload-processing-e2e-api-b-4b0f72-78864cccb-kbll2"
Jul 28 01:55:14.357598 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:14.357554    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs2xx\" (UniqueName: \"kubernetes.io/projected/80dca445-73bd-4cc5-ba68-6b8bd061dd44-kube-api-access-hs2xx\") pod \"payload-processing-e2e-api-b-4b0f72-78864cccb-kbll2\" (UID: \"80dca445-73bd-4cc5-ba68-6b8bd061dd44\") " pod="openshift-ingress/payload-processing-e2e-api-b-4b0f72-78864cccb-kbll2"
Jul 28 01:55:14.369531 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:14.369490    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4b0f72-78f9bb44b8-84h9w"
Jul 28 01:55:14.390875 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:14.390843    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-4b0f72-78864cccb-kbll2"
Jul 28 01:55:14.515063 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:14.515023    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-4b0f72-78f9bb44b8-84h9w"]
Jul 28 01:55:14.517368 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:55:14.517315    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a37f212_6569_4776_9dc5_187dfc2dd4de.slice/crio-ebf762a63d3db63eb14f931bd2d33cde6e8fdb95a26c0c0c4586f54e608b07bd WatchSource:0}: Error finding container ebf762a63d3db63eb14f931bd2d33cde6e8fdb95a26c0c0c4586f54e608b07bd: Status 404 returned error can't find the container with id ebf762a63d3db63eb14f931bd2d33cde6e8fdb95a26c0c0c4586f54e608b07bd
Jul 28 01:55:14.538218 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:14.538192    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4b0f72-78864cccb-kbll2"]
Jul 28 01:55:14.551548 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:55:14.551524    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80dca445_73bd_4cc5_ba68_6b8bd061dd44.slice/crio-9bbfc78b973011d7beec5d717ba6b6038bcaf0a752ab8a396c5ebc5b07d59011 WatchSource:0}: Error finding container 9bbfc78b973011d7beec5d717ba6b6038bcaf0a752ab8a396c5ebc5b07d59011: Status 404 returned error can't find the container with id 9bbfc78b973011d7beec5d717ba6b6038bcaf0a752ab8a396c5ebc5b07d59011
Jul 28 01:55:14.774265 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:14.774176    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-4b0f72-78864cccb-kbll2" event={"ID":"80dca445-73bd-4cc5-ba68-6b8bd061dd44","Type":"ContainerStarted","Data":"ccf874a285f1c787ed1d108c46e3862e2a0c9fc3d2e204a513e0245dddcda4ff"}
Jul 28 01:55:14.774265 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:14.774239    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-4b0f72-78864cccb-kbll2" event={"ID":"80dca445-73bd-4cc5-ba68-6b8bd061dd44","Type":"ContainerStarted","Data":"9bbfc78b973011d7beec5d717ba6b6038bcaf0a752ab8a396c5ebc5b07d59011"}
Jul 28 01:55:14.774517 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:14.774337    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-4b0f72-78864cccb-kbll2"
Jul 28 01:55:14.775741 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:14.775719    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4b0f72-78f9bb44b8-84h9w" event={"ID":"1a37f212-6569-4776-9dc5-187dfc2dd4de","Type":"ContainerStarted","Data":"055f0e486b445189457a655d068dac587db5162b4c31feca14ba5d567334597a"}
Jul 28 01:55:14.775844 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:14.775756    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4b0f72-78f9bb44b8-84h9w" event={"ID":"1a37f212-6569-4776-9dc5-187dfc2dd4de","Type":"ContainerStarted","Data":"ebf762a63d3db63eb14f931bd2d33cde6e8fdb95a26c0c0c4586f54e608b07bd"}
Jul 28 01:55:14.775844 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:14.775777    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4b0f72-78f9bb44b8-84h9w"
Jul 28 01:55:14.788693 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:14.788637    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-4b0f72-78864cccb-kbll2" podStartSLOduration=0.788621082 podStartE2EDuration="788.621082ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:55:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:55:14.788109771 +0000 UTC m=+2365.822153199" watchObservedRunningTime="2026-07-28 01:55:14.788621082 +0000 UTC m=+2365.822664479"
Jul 28 01:55:14.803054 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:14.803013    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4b0f72-78f9bb44b8-84h9w" podStartSLOduration=0.803001465 podStartE2EDuration="803.001465ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:55:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:55:14.801072606 +0000 UTC m=+2365.835115999" watchObservedRunningTime="2026-07-28 01:55:14.803001465 +0000 UTC m=+2365.837044858"
Jul 28 01:55:17.737498 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:17.737467    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-1bc912-9b9d5b788-492gf"
Jul 28 01:55:17.737943 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:17.737552    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1bc912-654c8888cb-9s9g4"
Jul 28 01:55:17.764507 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:17.764475    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:55:25.789230 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:25.789193    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4b0f72-78f9bb44b8-84h9w"
Jul 28 01:55:25.789690 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:25.789377    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-4b0f72-78864cccb-kbll2"
Jul 28 01:55:28.479483 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:28.479449    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:55:40.943811 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:40.943775    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:55:40.967138 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:40.967088    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-1bc912-9b9d5b788-492gf"]
Jul 28 01:55:40.967409 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:40.967369    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-1bc912-9b9d5b788-492gf" podUID="5f4757cd-9e63-48ab-b572-19ad7257a44d" containerName="payload-processing" containerID="cri-o://1457722e06e8ff09b6183d0690e05c68c25199b56e009aed4960d8e94b06db78" gracePeriod=30
Jul 28 01:55:40.980214 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:40.979674    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-1bc912-654c8888cb-9s9g4"]
Jul 28 01:55:40.980713 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:40.980662    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1bc912-654c8888cb-9s9g4" podUID="2e2bc1d7-91bd-411c-89ae-c41d98105f85" containerName="payload-pre-processing" containerID="cri-o://7f8f01d258094d0cf5974b25e627434c34c6fe48401ffba374c7f4d8ddc15866" gracePeriod=30
Jul 28 01:55:41.015524 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:41.015488    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:55:41.070580 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:41.070548    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:55:41.266733 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:41.266707    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-1bc912-9b9d5b788-492gf"
Jul 28 01:55:41.269754 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:41.269730    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1bc912-654c8888cb-9s9g4"
Jul 28 01:55:41.405958 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:41.405924    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsjnh\" (UniqueName: \"kubernetes.io/projected/5f4757cd-9e63-48ab-b572-19ad7257a44d-kube-api-access-tsjnh\") pod \"5f4757cd-9e63-48ab-b572-19ad7257a44d\" (UID: \"5f4757cd-9e63-48ab-b572-19ad7257a44d\") "
Jul 28 01:55:41.405958 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:41.405965    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e2bc1d7-91bd-411c-89ae-c41d98105f85-plugins-config-volume\") pod \"2e2bc1d7-91bd-411c-89ae-c41d98105f85\" (UID: \"2e2bc1d7-91bd-411c-89ae-c41d98105f85\") "
Jul 28 01:55:41.406204 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:41.405996    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4svv\" (UniqueName: \"kubernetes.io/projected/2e2bc1d7-91bd-411c-89ae-c41d98105f85-kube-api-access-k4svv\") pod \"2e2bc1d7-91bd-411c-89ae-c41d98105f85\" (UID: \"2e2bc1d7-91bd-411c-89ae-c41d98105f85\") "
Jul 28 01:55:41.406204 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:41.406060    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f4757cd-9e63-48ab-b572-19ad7257a44d-plugins-config-volume\") pod \"5f4757cd-9e63-48ab-b572-19ad7257a44d\" (UID: \"5f4757cd-9e63-48ab-b572-19ad7257a44d\") "
Jul 28 01:55:41.406572 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:41.406542    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e2bc1d7-91bd-411c-89ae-c41d98105f85-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2e2bc1d7-91bd-411c-89ae-c41d98105f85" (UID: "2e2bc1d7-91bd-411c-89ae-c41d98105f85"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:55:41.406696 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:41.406602    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f4757cd-9e63-48ab-b572-19ad7257a44d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5f4757cd-9e63-48ab-b572-19ad7257a44d" (UID: "5f4757cd-9e63-48ab-b572-19ad7257a44d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:55:41.408149 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:41.408122    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e2bc1d7-91bd-411c-89ae-c41d98105f85-kube-api-access-k4svv" (OuterVolumeSpecName: "kube-api-access-k4svv") pod "2e2bc1d7-91bd-411c-89ae-c41d98105f85" (UID: "2e2bc1d7-91bd-411c-89ae-c41d98105f85"). InnerVolumeSpecName "kube-api-access-k4svv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:55:41.408234 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:41.408163    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f4757cd-9e63-48ab-b572-19ad7257a44d-kube-api-access-tsjnh" (OuterVolumeSpecName: "kube-api-access-tsjnh") pod "5f4757cd-9e63-48ab-b572-19ad7257a44d" (UID: "5f4757cd-9e63-48ab-b572-19ad7257a44d"). InnerVolumeSpecName "kube-api-access-tsjnh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:55:41.507623 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:41.507535    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4svv\" (UniqueName: \"kubernetes.io/projected/2e2bc1d7-91bd-411c-89ae-c41d98105f85-kube-api-access-k4svv\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:55:41.507623 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:41.507577    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f4757cd-9e63-48ab-b572-19ad7257a44d-plugins-config-volume\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:55:41.507623 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:41.507586    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tsjnh\" (UniqueName: \"kubernetes.io/projected/5f4757cd-9e63-48ab-b572-19ad7257a44d-kube-api-access-tsjnh\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:55:41.507623 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:41.507597    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e2bc1d7-91bd-411c-89ae-c41d98105f85-plugins-config-volume\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:55:41.918694 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:41.918655    2560 generic.go:356] "Generic (PLEG): container finished" podID="2e2bc1d7-91bd-411c-89ae-c41d98105f85" containerID="7f8f01d258094d0cf5974b25e627434c34c6fe48401ffba374c7f4d8ddc15866" exitCode=0
Jul 28 01:55:41.918890 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:41.918703    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1bc912-654c8888cb-9s9g4"
Jul 28 01:55:41.918890 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:41.918742    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1bc912-654c8888cb-9s9g4" event={"ID":"2e2bc1d7-91bd-411c-89ae-c41d98105f85","Type":"ContainerDied","Data":"7f8f01d258094d0cf5974b25e627434c34c6fe48401ffba374c7f4d8ddc15866"}
Jul 28 01:55:41.918890 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:41.918793    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1bc912-654c8888cb-9s9g4" event={"ID":"2e2bc1d7-91bd-411c-89ae-c41d98105f85","Type":"ContainerDied","Data":"ae78f2e18bae4955f9e8b5df20e816a1acf0a4ed490b93b54e7a21a0d7001fe1"}
Jul 28 01:55:41.918890 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:41.918823    2560 scope.go:117] "RemoveContainer" containerID="7f8f01d258094d0cf5974b25e627434c34c6fe48401ffba374c7f4d8ddc15866"
Jul 28 01:55:41.920244 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:41.920223    2560 generic.go:356] "Generic (PLEG): container finished" podID="5f4757cd-9e63-48ab-b572-19ad7257a44d" containerID="1457722e06e8ff09b6183d0690e05c68c25199b56e009aed4960d8e94b06db78" exitCode=0
Jul 28 01:55:41.920382 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:41.920276    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-1bc912-9b9d5b788-492gf" event={"ID":"5f4757cd-9e63-48ab-b572-19ad7257a44d","Type":"ContainerDied","Data":"1457722e06e8ff09b6183d0690e05c68c25199b56e009aed4960d8e94b06db78"}
Jul 28 01:55:41.920382 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:41.920326    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-1bc912-9b9d5b788-492gf" event={"ID":"5f4757cd-9e63-48ab-b572-19ad7257a44d","Type":"ContainerDied","Data":"884d58e0084ac5e1a14546a61706e64966e8248f52bceefbf81f07401171da68"}
Jul 28 01:55:41.920382 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:41.920280    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-1bc912-9b9d5b788-492gf"
Jul 28 01:55:41.927533 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:41.927514    2560 scope.go:117] "RemoveContainer" containerID="7f8f01d258094d0cf5974b25e627434c34c6fe48401ffba374c7f4d8ddc15866"
Jul 28 01:55:41.927827 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:55:41.927809    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f8f01d258094d0cf5974b25e627434c34c6fe48401ffba374c7f4d8ddc15866\": container with ID starting with 7f8f01d258094d0cf5974b25e627434c34c6fe48401ffba374c7f4d8ddc15866 not found: ID does not exist" containerID="7f8f01d258094d0cf5974b25e627434c34c6fe48401ffba374c7f4d8ddc15866"
Jul 28 01:55:41.927870 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:41.927837    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f8f01d258094d0cf5974b25e627434c34c6fe48401ffba374c7f4d8ddc15866"} err="failed to get container status \"7f8f01d258094d0cf5974b25e627434c34c6fe48401ffba374c7f4d8ddc15866\": rpc error: code = NotFound desc = could not find container \"7f8f01d258094d0cf5974b25e627434c34c6fe48401ffba374c7f4d8ddc15866\": container with ID starting with 7f8f01d258094d0cf5974b25e627434c34c6fe48401ffba374c7f4d8ddc15866 not found: ID does not exist"
Jul 28 01:55:41.927870 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:41.927855    2560 scope.go:117] "RemoveContainer" containerID="1457722e06e8ff09b6183d0690e05c68c25199b56e009aed4960d8e94b06db78"
Jul 28 01:55:41.935645 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:41.935621    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-1bc912-654c8888cb-9s9g4"]
Jul 28 01:55:41.935796 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:41.935781    2560 scope.go:117] "RemoveContainer" containerID="1457722e06e8ff09b6183d0690e05c68c25199b56e009aed4960d8e94b06db78"
Jul 28 01:55:41.936067 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:55:41.936051    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1457722e06e8ff09b6183d0690e05c68c25199b56e009aed4960d8e94b06db78\": container with ID starting with 1457722e06e8ff09b6183d0690e05c68c25199b56e009aed4960d8e94b06db78 not found: ID does not exist" containerID="1457722e06e8ff09b6183d0690e05c68c25199b56e009aed4960d8e94b06db78"
Jul 28 01:55:41.936105 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:41.936075    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1457722e06e8ff09b6183d0690e05c68c25199b56e009aed4960d8e94b06db78"} err="failed to get container status \"1457722e06e8ff09b6183d0690e05c68c25199b56e009aed4960d8e94b06db78\": rpc error: code = NotFound desc = could not find container \"1457722e06e8ff09b6183d0690e05c68c25199b56e009aed4960d8e94b06db78\": container with ID starting with 1457722e06e8ff09b6183d0690e05c68c25199b56e009aed4960d8e94b06db78 not found: ID does not exist"
Jul 28 01:55:41.940809 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:41.940788    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-1bc912-654c8888cb-9s9g4"]
Jul 28 01:55:41.949825 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:41.949803    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-1bc912-9b9d5b788-492gf"]
Jul 28 01:55:41.954012 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:41.953981    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-1bc912-9b9d5b788-492gf"]
Jul 28 01:55:43.461702 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:43.461667    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e2bc1d7-91bd-411c-89ae-c41d98105f85" path="/var/lib/kubelet/pods/2e2bc1d7-91bd-411c-89ae-c41d98105f85/volumes"
Jul 28 01:55:43.462053 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:43.462038    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f4757cd-9e63-48ab-b572-19ad7257a44d" path="/var/lib/kubelet/pods/5f4757cd-9e63-48ab-b572-19ad7257a44d/volumes"
Jul 28 01:55:45.891905 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:45.891872    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:55:45.917273 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:45.917245    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:55:46.279268 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:46.279191    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:55:49.582822 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:49.582786    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5f2zn_5311b0bc-9ad2-4e2f-bdde-81510c6d6b19/ovn-acl-logging/0.log"
Jul 28 01:55:49.585760 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:49.585736    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5f2zn_5311b0bc-9ad2-4e2f-bdde-81510c6d6b19/ovn-acl-logging/0.log"
Jul 28 01:55:51.851686 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:51.851647    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:55:51.920700 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:51.920670    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:55:52.122264 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:52.122236    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:55:52.332968 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:55:52.332935    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:56:08.139873 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:08.139838    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:56:08.169229 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:08.169200    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4b0f72-78864cccb-kbll2"]
Jul 28 01:56:08.169445 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:08.169418    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-4b0f72-78864cccb-kbll2" podUID="80dca445-73bd-4cc5-ba68-6b8bd061dd44" containerName="payload-processing" containerID="cri-o://ccf874a285f1c787ed1d108c46e3862e2a0c9fc3d2e204a513e0245dddcda4ff" gracePeriod=30
Jul 28 01:56:08.179471 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:08.179443    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-4b0f72-78f9bb44b8-84h9w"]
Jul 28 01:56:08.179882 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:08.179851    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4b0f72-78f9bb44b8-84h9w" podUID="1a37f212-6569-4776-9dc5-187dfc2dd4de" containerName="payload-pre-processing" containerID="cri-o://055f0e486b445189457a655d068dac587db5162b4c31feca14ba5d567334597a" gracePeriod=30
Jul 28 01:56:08.210771 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:08.210740    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:56:08.308853 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:08.308799    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:56:08.454510 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:08.454487    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-4b0f72-78864cccb-kbll2"
Jul 28 01:56:08.457411 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:08.457394    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4b0f72-78f9bb44b8-84h9w"
Jul 28 01:56:08.558122 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:08.558079    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80dca445-73bd-4cc5-ba68-6b8bd061dd44-plugins-config-volume\") pod \"80dca445-73bd-4cc5-ba68-6b8bd061dd44\" (UID: \"80dca445-73bd-4cc5-ba68-6b8bd061dd44\") "
Jul 28 01:56:08.558122 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:08.558124    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hs2xx\" (UniqueName: \"kubernetes.io/projected/80dca445-73bd-4cc5-ba68-6b8bd061dd44-kube-api-access-hs2xx\") pod \"80dca445-73bd-4cc5-ba68-6b8bd061dd44\" (UID: \"80dca445-73bd-4cc5-ba68-6b8bd061dd44\") "
Jul 28 01:56:08.558412 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:08.558144    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xkwm\" (UniqueName: \"kubernetes.io/projected/1a37f212-6569-4776-9dc5-187dfc2dd4de-kube-api-access-9xkwm\") pod \"1a37f212-6569-4776-9dc5-187dfc2dd4de\" (UID: \"1a37f212-6569-4776-9dc5-187dfc2dd4de\") "
Jul 28 01:56:08.558412 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:08.558179    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a37f212-6569-4776-9dc5-187dfc2dd4de-plugins-config-volume\") pod \"1a37f212-6569-4776-9dc5-187dfc2dd4de\" (UID: \"1a37f212-6569-4776-9dc5-187dfc2dd4de\") "
Jul 28 01:56:08.558672 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:08.558637    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80dca445-73bd-4cc5-ba68-6b8bd061dd44-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "80dca445-73bd-4cc5-ba68-6b8bd061dd44" (UID: "80dca445-73bd-4cc5-ba68-6b8bd061dd44"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:56:08.558672 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:08.558646    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a37f212-6569-4776-9dc5-187dfc2dd4de-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1a37f212-6569-4776-9dc5-187dfc2dd4de" (UID: "1a37f212-6569-4776-9dc5-187dfc2dd4de"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:56:08.560265 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:08.560244    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a37f212-6569-4776-9dc5-187dfc2dd4de-kube-api-access-9xkwm" (OuterVolumeSpecName: "kube-api-access-9xkwm") pod "1a37f212-6569-4776-9dc5-187dfc2dd4de" (UID: "1a37f212-6569-4776-9dc5-187dfc2dd4de"). InnerVolumeSpecName "kube-api-access-9xkwm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:56:08.560333 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:08.560248    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80dca445-73bd-4cc5-ba68-6b8bd061dd44-kube-api-access-hs2xx" (OuterVolumeSpecName: "kube-api-access-hs2xx") pod "80dca445-73bd-4cc5-ba68-6b8bd061dd44" (UID: "80dca445-73bd-4cc5-ba68-6b8bd061dd44"). InnerVolumeSpecName "kube-api-access-hs2xx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:56:08.659890 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:08.659863    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80dca445-73bd-4cc5-ba68-6b8bd061dd44-plugins-config-volume\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:56:08.659890 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:08.659888    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hs2xx\" (UniqueName: \"kubernetes.io/projected/80dca445-73bd-4cc5-ba68-6b8bd061dd44-kube-api-access-hs2xx\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:56:08.660052 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:08.659899    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xkwm\" (UniqueName: \"kubernetes.io/projected/1a37f212-6569-4776-9dc5-187dfc2dd4de-kube-api-access-9xkwm\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:56:08.660052 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:08.659907    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a37f212-6569-4776-9dc5-187dfc2dd4de-plugins-config-volume\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 01:56:09.057259 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:09.057221    2560 generic.go:356] "Generic (PLEG): container finished" podID="80dca445-73bd-4cc5-ba68-6b8bd061dd44" containerID="ccf874a285f1c787ed1d108c46e3862e2a0c9fc3d2e204a513e0245dddcda4ff" exitCode=0
Jul 28 01:56:09.057480 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:09.057269    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-4b0f72-78864cccb-kbll2"
Jul 28 01:56:09.057480 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:09.057306    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-4b0f72-78864cccb-kbll2" event={"ID":"80dca445-73bd-4cc5-ba68-6b8bd061dd44","Type":"ContainerDied","Data":"ccf874a285f1c787ed1d108c46e3862e2a0c9fc3d2e204a513e0245dddcda4ff"}
Jul 28 01:56:09.057480 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:09.057384    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-4b0f72-78864cccb-kbll2" event={"ID":"80dca445-73bd-4cc5-ba68-6b8bd061dd44","Type":"ContainerDied","Data":"9bbfc78b973011d7beec5d717ba6b6038bcaf0a752ab8a396c5ebc5b07d59011"}
Jul 28 01:56:09.057480 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:09.057418    2560 scope.go:117] "RemoveContainer" containerID="ccf874a285f1c787ed1d108c46e3862e2a0c9fc3d2e204a513e0245dddcda4ff"
Jul 28 01:56:09.058698 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:09.058664    2560 generic.go:356] "Generic (PLEG): container finished" podID="1a37f212-6569-4776-9dc5-187dfc2dd4de" containerID="055f0e486b445189457a655d068dac587db5162b4c31feca14ba5d567334597a" exitCode=0
Jul 28 01:56:09.058698 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:09.058690    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4b0f72-78f9bb44b8-84h9w" event={"ID":"1a37f212-6569-4776-9dc5-187dfc2dd4de","Type":"ContainerDied","Data":"055f0e486b445189457a655d068dac587db5162b4c31feca14ba5d567334597a"}
Jul 28 01:56:09.058876 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:09.058704    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4b0f72-78f9bb44b8-84h9w"
Jul 28 01:56:09.058876 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:09.058731    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4b0f72-78f9bb44b8-84h9w" event={"ID":"1a37f212-6569-4776-9dc5-187dfc2dd4de","Type":"ContainerDied","Data":"ebf762a63d3db63eb14f931bd2d33cde6e8fdb95a26c0c0c4586f54e608b07bd"}
Jul 28 01:56:09.075833 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:09.075809    2560 scope.go:117] "RemoveContainer" containerID="ccf874a285f1c787ed1d108c46e3862e2a0c9fc3d2e204a513e0245dddcda4ff"
Jul 28 01:56:09.076216 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:56:09.076193    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccf874a285f1c787ed1d108c46e3862e2a0c9fc3d2e204a513e0245dddcda4ff\": container with ID starting with ccf874a285f1c787ed1d108c46e3862e2a0c9fc3d2e204a513e0245dddcda4ff not found: ID does not exist" containerID="ccf874a285f1c787ed1d108c46e3862e2a0c9fc3d2e204a513e0245dddcda4ff"
Jul 28 01:56:09.076315 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:09.076226    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccf874a285f1c787ed1d108c46e3862e2a0c9fc3d2e204a513e0245dddcda4ff"} err="failed to get container status \"ccf874a285f1c787ed1d108c46e3862e2a0c9fc3d2e204a513e0245dddcda4ff\": rpc error: code = NotFound desc = could not find container \"ccf874a285f1c787ed1d108c46e3862e2a0c9fc3d2e204a513e0245dddcda4ff\": container with ID starting with ccf874a285f1c787ed1d108c46e3862e2a0c9fc3d2e204a513e0245dddcda4ff not found: ID does not exist"
Jul 28 01:56:09.076315 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:09.076245    2560 scope.go:117] "RemoveContainer" containerID="055f0e486b445189457a655d068dac587db5162b4c31feca14ba5d567334597a"
Jul 28 01:56:09.085142 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:09.085104    2560 scope.go:117] "RemoveContainer" containerID="055f0e486b445189457a655d068dac587db5162b4c31feca14ba5d567334597a"
Jul 28 01:56:09.085268 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:09.085182    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-4b0f72-78f9bb44b8-84h9w"]
Jul 28 01:56:09.085675 ip-10-0-131-213 kubenswrapper[2560]: E0728 01:56:09.085597    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"055f0e486b445189457a655d068dac587db5162b4c31feca14ba5d567334597a\": container with ID starting with 055f0e486b445189457a655d068dac587db5162b4c31feca14ba5d567334597a not found: ID does not exist" containerID="055f0e486b445189457a655d068dac587db5162b4c31feca14ba5d567334597a"
Jul 28 01:56:09.085675 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:09.085636    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"055f0e486b445189457a655d068dac587db5162b4c31feca14ba5d567334597a"} err="failed to get container status \"055f0e486b445189457a655d068dac587db5162b4c31feca14ba5d567334597a\": rpc error: code = NotFound desc = could not find container \"055f0e486b445189457a655d068dac587db5162b4c31feca14ba5d567334597a\": container with ID starting with 055f0e486b445189457a655d068dac587db5162b4c31feca14ba5d567334597a not found: ID does not exist"
Jul 28 01:56:09.087681 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:09.087659    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-4b0f72-78f9bb44b8-84h9w"]
Jul 28 01:56:09.098429 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:09.098406    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4b0f72-78864cccb-kbll2"]
Jul 28 01:56:09.104722 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:09.104703    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4b0f72-78864cccb-kbll2"]
Jul 28 01:56:09.462411 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:09.462378    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a37f212-6569-4776-9dc5-187dfc2dd4de" path="/var/lib/kubelet/pods/1a37f212-6569-4776-9dc5-187dfc2dd4de/volumes"
Jul 28 01:56:09.462916 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:09.462894    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80dca445-73bd-4cc5-ba68-6b8bd061dd44" path="/var/lib/kubelet/pods/80dca445-73bd-4cc5-ba68-6b8bd061dd44/volumes"
Jul 28 01:56:12.538576 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:12.538499    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:56:12.917765 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:12.917729    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:56:13.092724 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:13.092690    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:56:18.875327 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:18.875289    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:56:18.975477 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:18.975445    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:56:19.131597 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:19.131508    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:56:19.352595 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:19.352561    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:56:19.699857 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:19.699819    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:56:20.011299 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:20.011225    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:56:20.301225 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:20.301124    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:56:22.669629 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:22.669595    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:56:22.773010 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:22.772967    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:56:22.868460 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:22.868422    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:56:23.101655 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:23.101560    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:56:23.435210 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:23.435175    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:56:23.535785 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:23.535750    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:56:23.542424 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:23.542398    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-dfed9b-5894dc8fcb-g82dr"]
Jul 28 01:56:23.542786 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:23.542773    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e2bc1d7-91bd-411c-89ae-c41d98105f85" containerName="payload-pre-processing"
Jul 28 01:56:23.542830 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:23.542788    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e2bc1d7-91bd-411c-89ae-c41d98105f85" containerName="payload-pre-processing"
Jul 28 01:56:23.542830 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:23.542811    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80dca445-73bd-4cc5-ba68-6b8bd061dd44" containerName="payload-processing"
Jul 28 01:56:23.542830 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:23.542818    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="80dca445-73bd-4cc5-ba68-6b8bd061dd44" containerName="payload-processing"
Jul 28 01:56:23.542830 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:23.542828    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a37f212-6569-4776-9dc5-187dfc2dd4de" containerName="payload-pre-processing"
Jul 28 01:56:23.542955 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:23.542833    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a37f212-6569-4776-9dc5-187dfc2dd4de" containerName="payload-pre-processing"
Jul 28 01:56:23.542955 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:23.542850    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f4757cd-9e63-48ab-b572-19ad7257a44d" containerName="payload-processing"
Jul 28 01:56:23.542955 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:23.542859    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f4757cd-9e63-48ab-b572-19ad7257a44d" containerName="payload-processing"
Jul 28 01:56:23.542955 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:23.542919    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e2bc1d7-91bd-411c-89ae-c41d98105f85" containerName="payload-pre-processing"
Jul 28 01:56:23.542955 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:23.542930    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f4757cd-9e63-48ab-b572-19ad7257a44d" containerName="payload-processing"
Jul 28 01:56:23.542955 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:23.542940    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a37f212-6569-4776-9dc5-187dfc2dd4de" containerName="payload-pre-processing"
Jul 28 01:56:23.542955 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:23.542947    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="80dca445-73bd-4cc5-ba68-6b8bd061dd44" containerName="payload-processing"
Jul 28 01:56:23.547334 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:23.547317    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-dfed9b-5894dc8fcb-g82dr"
Jul 28 01:56:23.549198 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:23.549180    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-dfed9b\""
Jul 28 01:56:23.549304 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:23.549254    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-dfed9b-dockercfg-mk9hq\""
Jul 28 01:56:23.558086 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:23.558063    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-dfed9b-5894dc8fcb-g82dr"]
Jul 28 01:56:23.575034 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:23.575008    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-dfed9b-5d44bd4b5d-9qgj2"]
Jul 28 01:56:23.578525 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:23.578507    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-dfed9b-5d44bd4b5d-9qgj2"
Jul 28 01:56:23.591953 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:23.591924    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-dfed9b-5d44bd4b5d-9qgj2"]
Jul 28 01:56:23.685488 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:23.685406    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74vzt\" (UniqueName: \"kubernetes.io/projected/d6084f1f-5b88-4aa9-b041-341e9894a515-kube-api-access-74vzt\") pod \"payload-processing-e2e-shared-a-dfed9b-5d44bd4b5d-9qgj2\" (UID: \"d6084f1f-5b88-4aa9-b041-341e9894a515\") " pod="openshift-ingress/payload-processing-e2e-shared-a-dfed9b-5d44bd4b5d-9qgj2"
Jul 28 01:56:23.685864 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:23.685548    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c6b29f7-8e4b-410b-91ce-e30dbe1137e2-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-dfed9b-5894dc8fcb-g82dr\" (UID: \"4c6b29f7-8e4b-410b-91ce-e30dbe1137e2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-dfed9b-5894dc8fcb-g82dr"
Jul 28 01:56:23.685864 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:23.685586    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrfjj\" (UniqueName: \"kubernetes.io/projected/4c6b29f7-8e4b-410b-91ce-e30dbe1137e2-kube-api-access-hrfjj\") pod \"payload-pre-processing-e2e-shared-a-dfed9b-5894dc8fcb-g82dr\" (UID: \"4c6b29f7-8e4b-410b-91ce-e30dbe1137e2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-dfed9b-5894dc8fcb-g82dr"
Jul 28 01:56:23.685864 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:23.685709    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6084f1f-5b88-4aa9-b041-341e9894a515-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-dfed9b-5d44bd4b5d-9qgj2\" (UID: \"d6084f1f-5b88-4aa9-b041-341e9894a515\") " pod="openshift-ingress/payload-processing-e2e-shared-a-dfed9b-5d44bd4b5d-9qgj2"
Jul 28 01:56:23.786568 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:23.786531    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c6b29f7-8e4b-410b-91ce-e30dbe1137e2-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-dfed9b-5894dc8fcb-g82dr\" (UID: \"4c6b29f7-8e4b-410b-91ce-e30dbe1137e2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-dfed9b-5894dc8fcb-g82dr"
Jul 28 01:56:23.786568 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:23.786572    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrfjj\" (UniqueName: \"kubernetes.io/projected/4c6b29f7-8e4b-410b-91ce-e30dbe1137e2-kube-api-access-hrfjj\") pod \"payload-pre-processing-e2e-shared-a-dfed9b-5894dc8fcb-g82dr\" (UID: \"4c6b29f7-8e4b-410b-91ce-e30dbe1137e2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-dfed9b-5894dc8fcb-g82dr"
Jul 28 01:56:23.786822 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:23.786618    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6084f1f-5b88-4aa9-b041-341e9894a515-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-dfed9b-5d44bd4b5d-9qgj2\" (UID: \"d6084f1f-5b88-4aa9-b041-341e9894a515\") " pod="openshift-ingress/payload-processing-e2e-shared-a-dfed9b-5d44bd4b5d-9qgj2"
Jul 28 01:56:23.786822 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:23.786648    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74vzt\" (UniqueName: \"kubernetes.io/projected/d6084f1f-5b88-4aa9-b041-341e9894a515-kube-api-access-74vzt\") pod \"payload-processing-e2e-shared-a-dfed9b-5d44bd4b5d-9qgj2\" (UID: \"d6084f1f-5b88-4aa9-b041-341e9894a515\") " pod="openshift-ingress/payload-processing-e2e-shared-a-dfed9b-5d44bd4b5d-9qgj2"
Jul 28 01:56:23.787343 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:23.787317    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c6b29f7-8e4b-410b-91ce-e30dbe1137e2-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-dfed9b-5894dc8fcb-g82dr\" (UID: \"4c6b29f7-8e4b-410b-91ce-e30dbe1137e2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-dfed9b-5894dc8fcb-g82dr"
Jul 28 01:56:23.787343 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:23.787324    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6084f1f-5b88-4aa9-b041-341e9894a515-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-dfed9b-5d44bd4b5d-9qgj2\" (UID: \"d6084f1f-5b88-4aa9-b041-341e9894a515\") " pod="openshift-ingress/payload-processing-e2e-shared-a-dfed9b-5d44bd4b5d-9qgj2"
Jul 28 01:56:23.793606 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:23.793584    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrfjj\" (UniqueName: \"kubernetes.io/projected/4c6b29f7-8e4b-410b-91ce-e30dbe1137e2-kube-api-access-hrfjj\") pod \"payload-pre-processing-e2e-shared-a-dfed9b-5894dc8fcb-g82dr\" (UID: \"4c6b29f7-8e4b-410b-91ce-e30dbe1137e2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-dfed9b-5894dc8fcb-g82dr"
Jul 28 01:56:23.793724 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:23.793642    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74vzt\" (UniqueName: \"kubernetes.io/projected/d6084f1f-5b88-4aa9-b041-341e9894a515-kube-api-access-74vzt\") pod \"payload-processing-e2e-shared-a-dfed9b-5d44bd4b5d-9qgj2\" (UID: \"d6084f1f-5b88-4aa9-b041-341e9894a515\") " pod="openshift-ingress/payload-processing-e2e-shared-a-dfed9b-5d44bd4b5d-9qgj2"
Jul 28 01:56:23.858978 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:23.858939    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-dfed9b-5894dc8fcb-g82dr"
Jul 28 01:56:23.887798 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:23.887762    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-dfed9b-5d44bd4b5d-9qgj2"
Jul 28 01:56:24.006276 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:24.006238    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-dfed9b-5894dc8fcb-g82dr"]
Jul 28 01:56:24.010170 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:56:24.010057    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c6b29f7_8e4b_410b_91ce_e30dbe1137e2.slice/crio-e27e4f1102ec0a2069410c21845c5b22590b906bd0343bae0d226dedcf03d4e7 WatchSource:0}: Error finding container e27e4f1102ec0a2069410c21845c5b22590b906bd0343bae0d226dedcf03d4e7: Status 404 returned error can't find the container with id e27e4f1102ec0a2069410c21845c5b22590b906bd0343bae0d226dedcf03d4e7
Jul 28 01:56:24.135556 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:24.135523    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-dfed9b-5894dc8fcb-g82dr" event={"ID":"4c6b29f7-8e4b-410b-91ce-e30dbe1137e2","Type":"ContainerStarted","Data":"3b069376e6a7afb62329541afd945a4088f4bfe0ce66d66c3ca3d7fa8c806901"}
Jul 28 01:56:24.135734 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:24.135579    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-dfed9b-5894dc8fcb-g82dr" event={"ID":"4c6b29f7-8e4b-410b-91ce-e30dbe1137e2","Type":"ContainerStarted","Data":"e27e4f1102ec0a2069410c21845c5b22590b906bd0343bae0d226dedcf03d4e7"}
Jul 28 01:56:24.135734 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:24.135617    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-dfed9b-5894dc8fcb-g82dr"
Jul 28 01:56:24.166565 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:24.166518    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-dfed9b-5894dc8fcb-g82dr" podStartSLOduration=1.166503703 podStartE2EDuration="1.166503703s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:56:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:56:24.164629511 +0000 UTC m=+2435.198672904" watchObservedRunningTime="2026-07-28 01:56:24.166503703 +0000 UTC m=+2435.200547095"
Jul 28 01:56:24.243916 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:24.243834    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-dfed9b-5d44bd4b5d-9qgj2"]
Jul 28 01:56:24.247046 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:56:24.247020    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6084f1f_5b88_4aa9_b041_341e9894a515.slice/crio-34f8bd2b5ab26a1642df46450460b6f2df8a327c70d4c36d7af30ad07cba74a8 WatchSource:0}: Error finding container 34f8bd2b5ab26a1642df46450460b6f2df8a327c70d4c36d7af30ad07cba74a8: Status 404 returned error can't find the container with id 34f8bd2b5ab26a1642df46450460b6f2df8a327c70d4c36d7af30ad07cba74a8
Jul 28 01:56:25.143151 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:25.143103    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-dfed9b-5d44bd4b5d-9qgj2" event={"ID":"d6084f1f-5b88-4aa9-b041-341e9894a515","Type":"ContainerStarted","Data":"85895f2ac75b41c912c14ad70bee42c6c5f4e27fe01ec4aeaf66f67b8629b022"}
Jul 28 01:56:25.143653 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:25.143212    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-dfed9b-5d44bd4b5d-9qgj2" event={"ID":"d6084f1f-5b88-4aa9-b041-341e9894a515","Type":"ContainerStarted","Data":"34f8bd2b5ab26a1642df46450460b6f2df8a327c70d4c36d7af30ad07cba74a8"}
Jul 28 01:56:25.143653 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:25.143254    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-dfed9b-5d44bd4b5d-9qgj2"
Jul 28 01:56:25.159985 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:25.159934    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-dfed9b-5d44bd4b5d-9qgj2" podStartSLOduration=2.159916264 podStartE2EDuration="2.159916264s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:56:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:56:25.159085588 +0000 UTC m=+2436.193128981" watchObservedRunningTime="2026-07-28 01:56:25.159916264 +0000 UTC m=+2436.193959661"
Jul 28 01:56:27.187086 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:27.187044    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:56:27.524799 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:27.524712    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:56:27.818698 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:27.818611    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:56:28.066200 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:28.066165    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:56:28.208202 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:28.208165    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:56:30.993321 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:30.993286    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:56:31.109169 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:31.109136    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:56:31.205848 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:31.205815    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:56:31.553300 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:31.553266    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:56:32.030277 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:32.030243    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:56:32.180589 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:32.180552    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:56:32.250003 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:32.249967    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-de398f-86c69fd664-n59ns"]
Jul 28 01:56:32.253608 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:32.253592    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-de398f-86c69fd664-n59ns"
Jul 28 01:56:32.257602 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:32.257584    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-de398f\""
Jul 28 01:56:32.257720 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:32.257619    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-de398f-dockercfg-28vxv\""
Jul 28 01:56:32.265637 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:32.265615    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-de398f-86c69fd664-n59ns"]
Jul 28 01:56:32.294017 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:32.293953    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-de398f-75fbd6cf94-bgf4h"]
Jul 28 01:56:32.297502 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:32.297488    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-de398f-75fbd6cf94-bgf4h"
Jul 28 01:56:32.311197 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:32.311172    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-de398f-75fbd6cf94-bgf4h"]
Jul 28 01:56:32.366620 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:32.366591    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c493d4a-34a1-4910-b8da-312676256bac-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-de398f-86c69fd664-n59ns\" (UID: \"8c493d4a-34a1-4910-b8da-312676256bac\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-de398f-86c69fd664-n59ns"
Jul 28 01:56:32.366750 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:32.366623    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-469ff\" (UniqueName: \"kubernetes.io/projected/b7871313-1cef-499c-80cb-5aa6aed5f08e-kube-api-access-469ff\") pod \"payload-processing-e2e-shared-b-de398f-75fbd6cf94-bgf4h\" (UID: \"b7871313-1cef-499c-80cb-5aa6aed5f08e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-de398f-75fbd6cf94-bgf4h"
Jul 28 01:56:32.366750 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:32.366675    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7871313-1cef-499c-80cb-5aa6aed5f08e-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-de398f-75fbd6cf94-bgf4h\" (UID: \"b7871313-1cef-499c-80cb-5aa6aed5f08e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-de398f-75fbd6cf94-bgf4h"
Jul 28 01:56:32.366750 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:32.366703    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzw6r\" (UniqueName: \"kubernetes.io/projected/8c493d4a-34a1-4910-b8da-312676256bac-kube-api-access-mzw6r\") pod \"payload-pre-processing-e2e-shared-b-de398f-86c69fd664-n59ns\" (UID: \"8c493d4a-34a1-4910-b8da-312676256bac\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-de398f-86c69fd664-n59ns"
Jul 28 01:56:32.467335 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:32.467309    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzw6r\" (UniqueName: \"kubernetes.io/projected/8c493d4a-34a1-4910-b8da-312676256bac-kube-api-access-mzw6r\") pod \"payload-pre-processing-e2e-shared-b-de398f-86c69fd664-n59ns\" (UID: \"8c493d4a-34a1-4910-b8da-312676256bac\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-de398f-86c69fd664-n59ns"
Jul 28 01:56:32.467511 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:32.467391    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c493d4a-34a1-4910-b8da-312676256bac-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-de398f-86c69fd664-n59ns\" (UID: \"8c493d4a-34a1-4910-b8da-312676256bac\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-de398f-86c69fd664-n59ns"
Jul 28 01:56:32.467511 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:32.467425    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-469ff\" (UniqueName: \"kubernetes.io/projected/b7871313-1cef-499c-80cb-5aa6aed5f08e-kube-api-access-469ff\") pod \"payload-processing-e2e-shared-b-de398f-75fbd6cf94-bgf4h\" (UID: \"b7871313-1cef-499c-80cb-5aa6aed5f08e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-de398f-75fbd6cf94-bgf4h"
Jul 28 01:56:32.467511 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:32.467463    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7871313-1cef-499c-80cb-5aa6aed5f08e-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-de398f-75fbd6cf94-bgf4h\" (UID: \"b7871313-1cef-499c-80cb-5aa6aed5f08e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-de398f-75fbd6cf94-bgf4h"
Jul 28 01:56:32.468134 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:32.468113    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c493d4a-34a1-4910-b8da-312676256bac-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-de398f-86c69fd664-n59ns\" (UID: \"8c493d4a-34a1-4910-b8da-312676256bac\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-de398f-86c69fd664-n59ns"
Jul 28 01:56:32.468186 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:32.468123    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7871313-1cef-499c-80cb-5aa6aed5f08e-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-de398f-75fbd6cf94-bgf4h\" (UID: \"b7871313-1cef-499c-80cb-5aa6aed5f08e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-de398f-75fbd6cf94-bgf4h"
Jul 28 01:56:32.480347 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:32.480322    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzw6r\" (UniqueName: \"kubernetes.io/projected/8c493d4a-34a1-4910-b8da-312676256bac-kube-api-access-mzw6r\") pod \"payload-pre-processing-e2e-shared-b-de398f-86c69fd664-n59ns\" (UID: \"8c493d4a-34a1-4910-b8da-312676256bac\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-de398f-86c69fd664-n59ns"
Jul 28 01:56:32.481714 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:32.481695    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-469ff\" (UniqueName: \"kubernetes.io/projected/b7871313-1cef-499c-80cb-5aa6aed5f08e-kube-api-access-469ff\") pod \"payload-processing-e2e-shared-b-de398f-75fbd6cf94-bgf4h\" (UID: \"b7871313-1cef-499c-80cb-5aa6aed5f08e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-de398f-75fbd6cf94-bgf4h"
Jul 28 01:56:32.564731 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:32.564653    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-de398f-86c69fd664-n59ns"
Jul 28 01:56:32.607671 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:32.607633    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-de398f-75fbd6cf94-bgf4h"
Jul 28 01:56:32.713135 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:32.713107    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-de398f-86c69fd664-n59ns"]
Jul 28 01:56:32.716569 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:56:32.716540    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c493d4a_34a1_4910_b8da_312676256bac.slice/crio-40bc2f222274d1231f925924aface6908f6b8c55fd93c223b41031d1e6412855 WatchSource:0}: Error finding container 40bc2f222274d1231f925924aface6908f6b8c55fd93c223b41031d1e6412855: Status 404 returned error can't find the container with id 40bc2f222274d1231f925924aface6908f6b8c55fd93c223b41031d1e6412855
Jul 28 01:56:32.760401 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:32.760375    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-de398f-75fbd6cf94-bgf4h"]
Jul 28 01:56:32.762088 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:56:32.762065    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7871313_1cef_499c_80cb_5aa6aed5f08e.slice/crio-704e589071f5d9d7b2a58933eaa1e5283faabd1eea69166953040699048ac442 WatchSource:0}: Error finding container 704e589071f5d9d7b2a58933eaa1e5283faabd1eea69166953040699048ac442: Status 404 returned error can't find the container with id 704e589071f5d9d7b2a58933eaa1e5283faabd1eea69166953040699048ac442
Jul 28 01:56:33.182230 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:33.182196    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-de398f-86c69fd664-n59ns" event={"ID":"8c493d4a-34a1-4910-b8da-312676256bac","Type":"ContainerStarted","Data":"7561a6d98aec2b43e6347df8593177b32621520b2efe2b4f89515dc640cbb3bc"}
Jul 28 01:56:33.182751 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:33.182246    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-de398f-86c69fd664-n59ns" event={"ID":"8c493d4a-34a1-4910-b8da-312676256bac","Type":"ContainerStarted","Data":"40bc2f222274d1231f925924aface6908f6b8c55fd93c223b41031d1e6412855"}
Jul 28 01:56:33.182751 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:33.182291    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-de398f-86c69fd664-n59ns"
Jul 28 01:56:33.183986 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:33.183959    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-de398f-75fbd6cf94-bgf4h" event={"ID":"b7871313-1cef-499c-80cb-5aa6aed5f08e","Type":"ContainerStarted","Data":"06bcafa5f3702127ae7d8eb12dca4c6134248e0dfdbd1873630fd70e2e16c09f"}
Jul 28 01:56:33.184078 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:33.184008    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-de398f-75fbd6cf94-bgf4h"
Jul 28 01:56:33.184078 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:33.184027    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-de398f-75fbd6cf94-bgf4h" event={"ID":"b7871313-1cef-499c-80cb-5aa6aed5f08e","Type":"ContainerStarted","Data":"704e589071f5d9d7b2a58933eaa1e5283faabd1eea69166953040699048ac442"}
Jul 28 01:56:33.202904 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:33.202862    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-de398f-86c69fd664-n59ns" podStartSLOduration=1.202849206 podStartE2EDuration="1.202849206s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:56:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:56:33.200770011 +0000 UTC m=+2444.234813422" watchObservedRunningTime="2026-07-28 01:56:33.202849206 +0000 UTC m=+2444.236892602"
Jul 28 01:56:33.222567 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:33.222517    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-de398f-75fbd6cf94-bgf4h" podStartSLOduration=1.222501351 podStartE2EDuration="1.222501351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:56:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:56:33.221297037 +0000 UTC m=+2444.255340429" watchObservedRunningTime="2026-07-28 01:56:33.222501351 +0000 UTC m=+2444.256544951"
Jul 28 01:56:35.144856 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:35.144808    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-dfed9b-5894dc8fcb-g82dr" podUID="4c6b29f7-8e4b-410b-91ce-e30dbe1137e2" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.57:9004: connect: connection refused"
Jul 28 01:56:35.453240 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:35.453129    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:56:36.149551 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:36.149520    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-dfed9b-5d44bd4b5d-9qgj2"
Jul 28 01:56:43.303691 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:43.303655    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:56:44.191014 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:44.190983    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-de398f-75fbd6cf94-bgf4h"
Jul 28 01:56:44.191198 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:44.191051    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-de398f-86c69fd664-n59ns"
Jul 28 01:56:45.144818 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:45.144783    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-dfed9b-5894dc8fcb-g82dr"
Jul 28 01:56:47.601364 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:47.601311    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-dfed9b/auth-test-model-dfed9b-kserve-77ff7697d7-qrksh"]
Jul 28 01:56:47.605318 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:47.605293    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-dfed9b/auth-test-model-dfed9b-kserve-77ff7697d7-qrksh"
Jul 28 01:56:47.608607 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:47.608585    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-dfed9b\"/\"default-dockercfg-z25m2\""
Jul 28 01:56:47.608709 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:47.608617    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-dfed9b\"/\"openshift-service-ca.crt\""
Jul 28 01:56:47.608709 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:47.608701    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-dfed9b\"/\"auth-test-model-dfed9b-kserve-self-signed-certs\""
Jul 28 01:56:47.608837 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:47.608798    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-dfed9b\"/\"kube-root-ca.crt\""
Jul 28 01:56:47.613953 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:47.613935    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-dfed9b/auth-test-model-dfed9b-kserve-77ff7697d7-qrksh"]
Jul 28 01:56:47.631539 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:47.631496    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:56:47.710000 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:47.709963    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fc7220d-bb14-481b-ae25-834f8b4c57a7-tls-certs\") pod \"auth-test-model-dfed9b-kserve-77ff7697d7-qrksh\" (UID: \"0fc7220d-bb14-481b-ae25-834f8b4c57a7\") " pod="ai-tenant-e2e-shared-a-dfed9b/auth-test-model-dfed9b-kserve-77ff7697d7-qrksh"
Jul 28 01:56:47.710173 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:47.710017    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fc7220d-bb14-481b-ae25-834f8b4c57a7-model-cache\") pod \"auth-test-model-dfed9b-kserve-77ff7697d7-qrksh\" (UID: \"0fc7220d-bb14-481b-ae25-834f8b4c57a7\") " pod="ai-tenant-e2e-shared-a-dfed9b/auth-test-model-dfed9b-kserve-77ff7697d7-qrksh"
Jul 28 01:56:47.710173 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:47.710042    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67sc6\" (UniqueName: \"kubernetes.io/projected/0fc7220d-bb14-481b-ae25-834f8b4c57a7-kube-api-access-67sc6\") pod \"auth-test-model-dfed9b-kserve-77ff7697d7-qrksh\" (UID: \"0fc7220d-bb14-481b-ae25-834f8b4c57a7\") " pod="ai-tenant-e2e-shared-a-dfed9b/auth-test-model-dfed9b-kserve-77ff7697d7-qrksh"
Jul 28 01:56:47.710173 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:47.710073    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fc7220d-bb14-481b-ae25-834f8b4c57a7-home\") pod \"auth-test-model-dfed9b-kserve-77ff7697d7-qrksh\" (UID: \"0fc7220d-bb14-481b-ae25-834f8b4c57a7\") " pod="ai-tenant-e2e-shared-a-dfed9b/auth-test-model-dfed9b-kserve-77ff7697d7-qrksh"
Jul 28 01:56:47.710173 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:47.710110    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fc7220d-bb14-481b-ae25-834f8b4c57a7-tmp-dir\") pod \"auth-test-model-dfed9b-kserve-77ff7697d7-qrksh\" (UID: \"0fc7220d-bb14-481b-ae25-834f8b4c57a7\") " pod="ai-tenant-e2e-shared-a-dfed9b/auth-test-model-dfed9b-kserve-77ff7697d7-qrksh"
Jul 28 01:56:47.710173 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:47.710154    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fc7220d-bb14-481b-ae25-834f8b4c57a7-dshm\") pod \"auth-test-model-dfed9b-kserve-77ff7697d7-qrksh\" (UID: \"0fc7220d-bb14-481b-ae25-834f8b4c57a7\") " pod="ai-tenant-e2e-shared-a-dfed9b/auth-test-model-dfed9b-kserve-77ff7697d7-qrksh"
Jul 28 01:56:47.811260 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:47.811219    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fc7220d-bb14-481b-ae25-834f8b4c57a7-model-cache\") pod \"auth-test-model-dfed9b-kserve-77ff7697d7-qrksh\" (UID: \"0fc7220d-bb14-481b-ae25-834f8b4c57a7\") " pod="ai-tenant-e2e-shared-a-dfed9b/auth-test-model-dfed9b-kserve-77ff7697d7-qrksh"
Jul 28 01:56:47.811500 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:47.811265    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67sc6\" (UniqueName: \"kubernetes.io/projected/0fc7220d-bb14-481b-ae25-834f8b4c57a7-kube-api-access-67sc6\") pod \"auth-test-model-dfed9b-kserve-77ff7697d7-qrksh\" (UID: \"0fc7220d-bb14-481b-ae25-834f8b4c57a7\") " pod="ai-tenant-e2e-shared-a-dfed9b/auth-test-model-dfed9b-kserve-77ff7697d7-qrksh"
Jul 28 01:56:47.811500 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:47.811295    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fc7220d-bb14-481b-ae25-834f8b4c57a7-home\") pod \"auth-test-model-dfed9b-kserve-77ff7697d7-qrksh\" (UID: \"0fc7220d-bb14-481b-ae25-834f8b4c57a7\") " pod="ai-tenant-e2e-shared-a-dfed9b/auth-test-model-dfed9b-kserve-77ff7697d7-qrksh"
Jul 28 01:56:47.811500 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:47.811382    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fc7220d-bb14-481b-ae25-834f8b4c57a7-tmp-dir\") pod \"auth-test-model-dfed9b-kserve-77ff7697d7-qrksh\" (UID: \"0fc7220d-bb14-481b-ae25-834f8b4c57a7\") " pod="ai-tenant-e2e-shared-a-dfed9b/auth-test-model-dfed9b-kserve-77ff7697d7-qrksh"
Jul 28 01:56:47.811500 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:47.811414    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fc7220d-bb14-481b-ae25-834f8b4c57a7-dshm\") pod \"auth-test-model-dfed9b-kserve-77ff7697d7-qrksh\" (UID: \"0fc7220d-bb14-481b-ae25-834f8b4c57a7\") " pod="ai-tenant-e2e-shared-a-dfed9b/auth-test-model-dfed9b-kserve-77ff7697d7-qrksh"
Jul 28 01:56:47.811738 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:47.811506    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fc7220d-bb14-481b-ae25-834f8b4c57a7-tls-certs\") pod \"auth-test-model-dfed9b-kserve-77ff7697d7-qrksh\" (UID: \"0fc7220d-bb14-481b-ae25-834f8b4c57a7\") " pod="ai-tenant-e2e-shared-a-dfed9b/auth-test-model-dfed9b-kserve-77ff7697d7-qrksh"
Jul 28 01:56:47.811738 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:47.811671    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fc7220d-bb14-481b-ae25-834f8b4c57a7-model-cache\") pod \"auth-test-model-dfed9b-kserve-77ff7697d7-qrksh\" (UID: \"0fc7220d-bb14-481b-ae25-834f8b4c57a7\") " pod="ai-tenant-e2e-shared-a-dfed9b/auth-test-model-dfed9b-kserve-77ff7697d7-qrksh"
Jul 28 01:56:47.811738 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:47.811722    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fc7220d-bb14-481b-ae25-834f8b4c57a7-home\") pod \"auth-test-model-dfed9b-kserve-77ff7697d7-qrksh\" (UID: \"0fc7220d-bb14-481b-ae25-834f8b4c57a7\") " pod="ai-tenant-e2e-shared-a-dfed9b/auth-test-model-dfed9b-kserve-77ff7697d7-qrksh"
Jul 28 01:56:47.811901 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:47.811801    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fc7220d-bb14-481b-ae25-834f8b4c57a7-tmp-dir\") pod \"auth-test-model-dfed9b-kserve-77ff7697d7-qrksh\" (UID: \"0fc7220d-bb14-481b-ae25-834f8b4c57a7\") " pod="ai-tenant-e2e-shared-a-dfed9b/auth-test-model-dfed9b-kserve-77ff7697d7-qrksh"
Jul 28 01:56:47.813663 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:47.813639    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fc7220d-bb14-481b-ae25-834f8b4c57a7-dshm\") pod \"auth-test-model-dfed9b-kserve-77ff7697d7-qrksh\" (UID: \"0fc7220d-bb14-481b-ae25-834f8b4c57a7\") " pod="ai-tenant-e2e-shared-a-dfed9b/auth-test-model-dfed9b-kserve-77ff7697d7-qrksh"
Jul 28 01:56:47.814063 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:47.814044    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fc7220d-bb14-481b-ae25-834f8b4c57a7-tls-certs\") pod \"auth-test-model-dfed9b-kserve-77ff7697d7-qrksh\" (UID: \"0fc7220d-bb14-481b-ae25-834f8b4c57a7\") " pod="ai-tenant-e2e-shared-a-dfed9b/auth-test-model-dfed9b-kserve-77ff7697d7-qrksh"
Jul 28 01:56:47.819640 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:47.819622    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67sc6\" (UniqueName: \"kubernetes.io/projected/0fc7220d-bb14-481b-ae25-834f8b4c57a7-kube-api-access-67sc6\") pod \"auth-test-model-dfed9b-kserve-77ff7697d7-qrksh\" (UID: \"0fc7220d-bb14-481b-ae25-834f8b4c57a7\") " pod="ai-tenant-e2e-shared-a-dfed9b/auth-test-model-dfed9b-kserve-77ff7697d7-qrksh"
Jul 28 01:56:47.916651 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:47.916611    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-dfed9b/auth-test-model-dfed9b-kserve-77ff7697d7-qrksh"
Jul 28 01:56:48.049564 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:48.049540    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-dfed9b/auth-test-model-dfed9b-kserve-77ff7697d7-qrksh"]
Jul 28 01:56:48.051274 ip-10-0-131-213 kubenswrapper[2560]: W0728 01:56:48.051249    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0fc7220d_bb14_481b_ae25_834f8b4c57a7.slice/crio-2e2849e46b682d3c2ab7d572536cb0691d02b3bf8d565befa314a4987ea02562 WatchSource:0}: Error finding container 2e2849e46b682d3c2ab7d572536cb0691d02b3bf8d565befa314a4987ea02562: Status 404 returned error can't find the container with id 2e2849e46b682d3c2ab7d572536cb0691d02b3bf8d565befa314a4987ea02562
Jul 28 01:56:48.259458 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:48.259341    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-dfed9b/auth-test-model-dfed9b-kserve-77ff7697d7-qrksh" event={"ID":"0fc7220d-bb14-481b-ae25-834f8b4c57a7","Type":"ContainerStarted","Data":"2a73ab40eed438ea7c0b0556131c932e72a476b525aa914e921e8aea4d4771b3"}
Jul 28 01:56:48.259458 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:48.259410    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-dfed9b/auth-test-model-dfed9b-kserve-77ff7697d7-qrksh" event={"ID":"0fc7220d-bb14-481b-ae25-834f8b4c57a7","Type":"ContainerStarted","Data":"2e2849e46b682d3c2ab7d572536cb0691d02b3bf8d565befa314a4987ea02562"}
Jul 28 01:56:48.278760 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:48.278715    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-dfed9b/auth-test-model-dfed9b-kserve-77ff7697d7-qrksh" podStartSLOduration=1.278701082 podStartE2EDuration="1.278701082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:56:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:56:48.276175406 +0000 UTC m=+2459.310218798" watchObservedRunningTime="2026-07-28 01:56:48.278701082 +0000 UTC m=+2459.312744829"
Jul 28 01:56:51.693843 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:51.693808    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:56:57.916904 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:57.916863    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-dfed9b/auth-test-model-dfed9b-kserve-77ff7697d7-qrksh"
Jul 28 01:56:57.916904 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:57.916917    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-dfed9b/auth-test-model-dfed9b-kserve-77ff7697d7-qrksh"
Jul 28 01:56:57.929397 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:57.929373    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-dfed9b/auth-test-model-dfed9b-kserve-77ff7697d7-qrksh"
Jul 28 01:56:58.320124 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:56:58.320030    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-dfed9b/auth-test-model-dfed9b-kserve-77ff7697d7-qrksh"
Jul 28 01:57:08.776951 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:57:08.776914    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:57:12.404742 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:57:12.404708    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:57:15.643574 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:57:15.643544    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:57:46.988566 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:57:46.988486    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:57:55.550126 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:57:55.550080    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:58:08.291683 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:58:08.291645    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:58:13.421111 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:58:13.421077    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:58:19.012796 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:58:19.012761    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:58:19.108525 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:58:19.108491    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:58:21.708332 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:58:21.708300    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:58:42.215659 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:58:42.215621    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:58:49.725926 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:58:49.725895    2560 scope.go:117] "RemoveContainer" containerID="110de71574cb82b7962ef01d835b80ec28289f9c9f794e22f76f486cc375324c"
Jul 28 01:58:54.310152 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:58:54.310105    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:59:09.446019 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:59:09.445978    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 01:59:15.993020 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:59:15.992936    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:59:29.689457 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:59:29.689424    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 01:59:50.482543 ip-10-0-131-213 kubenswrapper[2560]: I0728 01:59:50.482504    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 02:00:03.694112 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:00:03.694072    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 02:00:15.988253 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:00:15.988214    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 02:00:35.004121 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:00:35.004082    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 02:00:49.614272 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:00:49.614197    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5f2zn_5311b0bc-9ad2-4e2f-bdde-81510c6d6b19/ovn-acl-logging/0.log"
Jul 28 02:00:49.618101 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:00:49.618079    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5f2zn_5311b0bc-9ad2-4e2f-bdde-81510c6d6b19/ovn-acl-logging/0.log"
Jul 28 02:00:50.536175 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:00:50.536136    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:00:50.979020 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:00:50.978991    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 02:01:13.690865 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:13.690825    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 02:01:18.173574 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:18.173537    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-dfed9b/auth-test-model-dfed9b-kserve-77ff7697d7-qrksh"]
Jul 28 02:01:18.195534 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:18.195505    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:01:19.091557 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:19.091522    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:01:29.683216 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:29.683182    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 02:01:33.192839 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:33.192788    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-dfed9b/auth-test-model-dfed9b-kserve-77ff7697d7-qrksh" podUID="0fc7220d-bb14-481b-ae25-834f8b4c57a7" containerName="main" containerID="cri-o://2a73ab40eed438ea7c0b0556131c932e72a476b525aa914e921e8aea4d4771b3" gracePeriod=45
Jul 28 02:01:33.449862 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:33.449799    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-dfed9b/auth-test-model-dfed9b-kserve-77ff7697d7-qrksh"
Jul 28 02:01:33.568073 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:33.568025    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fc7220d-bb14-481b-ae25-834f8b4c57a7-dshm\") pod \"0fc7220d-bb14-481b-ae25-834f8b4c57a7\" (UID: \"0fc7220d-bb14-481b-ae25-834f8b4c57a7\") "
Jul 28 02:01:33.568263 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:33.568103    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fc7220d-bb14-481b-ae25-834f8b4c57a7-tls-certs\") pod \"0fc7220d-bb14-481b-ae25-834f8b4c57a7\" (UID: \"0fc7220d-bb14-481b-ae25-834f8b4c57a7\") "
Jul 28 02:01:33.568263 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:33.568164    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fc7220d-bb14-481b-ae25-834f8b4c57a7-model-cache\") pod \"0fc7220d-bb14-481b-ae25-834f8b4c57a7\" (UID: \"0fc7220d-bb14-481b-ae25-834f8b4c57a7\") "
Jul 28 02:01:33.568263 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:33.568193    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67sc6\" (UniqueName: \"kubernetes.io/projected/0fc7220d-bb14-481b-ae25-834f8b4c57a7-kube-api-access-67sc6\") pod \"0fc7220d-bb14-481b-ae25-834f8b4c57a7\" (UID: \"0fc7220d-bb14-481b-ae25-834f8b4c57a7\") "
Jul 28 02:01:33.568263 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:33.568215    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fc7220d-bb14-481b-ae25-834f8b4c57a7-home\") pod \"0fc7220d-bb14-481b-ae25-834f8b4c57a7\" (UID: \"0fc7220d-bb14-481b-ae25-834f8b4c57a7\") "
Jul 28 02:01:33.568263 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:33.568241    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fc7220d-bb14-481b-ae25-834f8b4c57a7-tmp-dir\") pod \"0fc7220d-bb14-481b-ae25-834f8b4c57a7\" (UID: \"0fc7220d-bb14-481b-ae25-834f8b4c57a7\") "
Jul 28 02:01:33.568617 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:33.568465    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fc7220d-bb14-481b-ae25-834f8b4c57a7-model-cache" (OuterVolumeSpecName: "model-cache") pod "0fc7220d-bb14-481b-ae25-834f8b4c57a7" (UID: "0fc7220d-bb14-481b-ae25-834f8b4c57a7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:01:33.568617 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:33.568594    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fc7220d-bb14-481b-ae25-834f8b4c57a7-home" (OuterVolumeSpecName: "home") pod "0fc7220d-bb14-481b-ae25-834f8b4c57a7" (UID: "0fc7220d-bb14-481b-ae25-834f8b4c57a7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:01:33.568737 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:33.568688    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fc7220d-bb14-481b-ae25-834f8b4c57a7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0fc7220d-bb14-481b-ae25-834f8b4c57a7" (UID: "0fc7220d-bb14-481b-ae25-834f8b4c57a7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:01:33.568812 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:33.568785    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fc7220d-bb14-481b-ae25-834f8b4c57a7-model-cache\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 02:01:33.568873 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:33.568837    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fc7220d-bb14-481b-ae25-834f8b4c57a7-home\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 02:01:33.570540 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:33.570514    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fc7220d-bb14-481b-ae25-834f8b4c57a7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0fc7220d-bb14-481b-ae25-834f8b4c57a7" (UID: "0fc7220d-bb14-481b-ae25-834f8b4c57a7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 02:01:33.570694 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:33.570676    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fc7220d-bb14-481b-ae25-834f8b4c57a7-kube-api-access-67sc6" (OuterVolumeSpecName: "kube-api-access-67sc6") pod "0fc7220d-bb14-481b-ae25-834f8b4c57a7" (UID: "0fc7220d-bb14-481b-ae25-834f8b4c57a7"). InnerVolumeSpecName "kube-api-access-67sc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 02:01:33.570757 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:33.570677    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fc7220d-bb14-481b-ae25-834f8b4c57a7-dshm" (OuterVolumeSpecName: "dshm") pod "0fc7220d-bb14-481b-ae25-834f8b4c57a7" (UID: "0fc7220d-bb14-481b-ae25-834f8b4c57a7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:01:33.670244 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:33.670207    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fc7220d-bb14-481b-ae25-834f8b4c57a7-dshm\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 02:01:33.670244 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:33.670243    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fc7220d-bb14-481b-ae25-834f8b4c57a7-tls-certs\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 02:01:33.670463 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:33.670258    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67sc6\" (UniqueName: \"kubernetes.io/projected/0fc7220d-bb14-481b-ae25-834f8b4c57a7-kube-api-access-67sc6\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 02:01:33.670463 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:33.670294    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fc7220d-bb14-481b-ae25-834f8b4c57a7-tmp-dir\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 02:01:33.686396 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:33.686345    2560 generic.go:356] "Generic (PLEG): container finished" podID="0fc7220d-bb14-481b-ae25-834f8b4c57a7" containerID="2a73ab40eed438ea7c0b0556131c932e72a476b525aa914e921e8aea4d4771b3" exitCode=0
Jul 28 02:01:33.686553 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:33.686419    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-dfed9b/auth-test-model-dfed9b-kserve-77ff7697d7-qrksh"
Jul 28 02:01:33.686553 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:33.686455    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-dfed9b/auth-test-model-dfed9b-kserve-77ff7697d7-qrksh" event={"ID":"0fc7220d-bb14-481b-ae25-834f8b4c57a7","Type":"ContainerDied","Data":"2a73ab40eed438ea7c0b0556131c932e72a476b525aa914e921e8aea4d4771b3"}
Jul 28 02:01:33.686553 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:33.686499    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-dfed9b/auth-test-model-dfed9b-kserve-77ff7697d7-qrksh" event={"ID":"0fc7220d-bb14-481b-ae25-834f8b4c57a7","Type":"ContainerDied","Data":"2e2849e46b682d3c2ab7d572536cb0691d02b3bf8d565befa314a4987ea02562"}
Jul 28 02:01:33.686553 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:33.686522    2560 scope.go:117] "RemoveContainer" containerID="2a73ab40eed438ea7c0b0556131c932e72a476b525aa914e921e8aea4d4771b3"
Jul 28 02:01:33.695916 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:33.695894    2560 scope.go:117] "RemoveContainer" containerID="2a73ab40eed438ea7c0b0556131c932e72a476b525aa914e921e8aea4d4771b3"
Jul 28 02:01:33.696176 ip-10-0-131-213 kubenswrapper[2560]: E0728 02:01:33.696157    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a73ab40eed438ea7c0b0556131c932e72a476b525aa914e921e8aea4d4771b3\": container with ID starting with 2a73ab40eed438ea7c0b0556131c932e72a476b525aa914e921e8aea4d4771b3 not found: ID does not exist" containerID="2a73ab40eed438ea7c0b0556131c932e72a476b525aa914e921e8aea4d4771b3"
Jul 28 02:01:33.696254 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:33.696186    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a73ab40eed438ea7c0b0556131c932e72a476b525aa914e921e8aea4d4771b3"} err="failed to get container status \"2a73ab40eed438ea7c0b0556131c932e72a476b525aa914e921e8aea4d4771b3\": rpc error: code = NotFound desc = could not find container \"2a73ab40eed438ea7c0b0556131c932e72a476b525aa914e921e8aea4d4771b3\": container with ID starting with 2a73ab40eed438ea7c0b0556131c932e72a476b525aa914e921e8aea4d4771b3 not found: ID does not exist"
Jul 28 02:01:33.707472 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:33.707418    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-dfed9b/auth-test-model-dfed9b-kserve-77ff7697d7-qrksh"]
Jul 28 02:01:33.710874 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:33.710855    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-dfed9b/auth-test-model-dfed9b-kserve-77ff7697d7-qrksh"]
Jul 28 02:01:35.202692 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:35.202659    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-dfed9b/sub-test-model-dfed9b-kserve-7575f864c9-r5fzg"]
Jul 28 02:01:35.203090 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:35.203077    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fc7220d-bb14-481b-ae25-834f8b4c57a7" containerName="main"
Jul 28 02:01:35.203133 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:35.203091    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fc7220d-bb14-481b-ae25-834f8b4c57a7" containerName="main"
Jul 28 02:01:35.203178 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:35.203169    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fc7220d-bb14-481b-ae25-834f8b4c57a7" containerName="main"
Jul 28 02:01:35.207521 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:35.207502    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-dfed9b/sub-test-model-dfed9b-kserve-7575f864c9-r5fzg"
Jul 28 02:01:35.209817 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:35.209793    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-dfed9b\"/\"default-dockercfg-z25m2\""
Jul 28 02:01:35.210447 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:35.210429    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-dfed9b\"/\"openshift-service-ca.crt\""
Jul 28 02:01:35.210748 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:35.210715    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-dfed9b\"/\"kube-root-ca.crt\""
Jul 28 02:01:35.210818 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:35.210802    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-dfed9b\"/\"sub-test-model-dfed9b-kserve-self-signed-certs\""
Jul 28 02:01:35.218045 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:35.218024    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-dfed9b/sub-test-model-dfed9b-kserve-7575f864c9-r5fzg"]
Jul 28 02:01:35.229821 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:35.229793    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:01:35.286585 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:35.286557    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f12599f-a3a2-446c-9ac6-32fc3cc90ad6-tmp-dir\") pod \"sub-test-model-dfed9b-kserve-7575f864c9-r5fzg\" (UID: \"8f12599f-a3a2-446c-9ac6-32fc3cc90ad6\") " pod="ai-tenant-e2e-shared-a-dfed9b/sub-test-model-dfed9b-kserve-7575f864c9-r5fzg"
Jul 28 02:01:35.286785 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:35.286610    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f12599f-a3a2-446c-9ac6-32fc3cc90ad6-tls-certs\") pod \"sub-test-model-dfed9b-kserve-7575f864c9-r5fzg\" (UID: \"8f12599f-a3a2-446c-9ac6-32fc3cc90ad6\") " pod="ai-tenant-e2e-shared-a-dfed9b/sub-test-model-dfed9b-kserve-7575f864c9-r5fzg"
Jul 28 02:01:35.286785 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:35.286707    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f12599f-a3a2-446c-9ac6-32fc3cc90ad6-model-cache\") pod \"sub-test-model-dfed9b-kserve-7575f864c9-r5fzg\" (UID: \"8f12599f-a3a2-446c-9ac6-32fc3cc90ad6\") " pod="ai-tenant-e2e-shared-a-dfed9b/sub-test-model-dfed9b-kserve-7575f864c9-r5fzg"
Jul 28 02:01:35.286785 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:35.286750    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f12599f-a3a2-446c-9ac6-32fc3cc90ad6-home\") pod \"sub-test-model-dfed9b-kserve-7575f864c9-r5fzg\" (UID: \"8f12599f-a3a2-446c-9ac6-32fc3cc90ad6\") " pod="ai-tenant-e2e-shared-a-dfed9b/sub-test-model-dfed9b-kserve-7575f864c9-r5fzg"
Jul 28 02:01:35.286785 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:35.286778    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhsvz\" (UniqueName: \"kubernetes.io/projected/8f12599f-a3a2-446c-9ac6-32fc3cc90ad6-kube-api-access-lhsvz\") pod \"sub-test-model-dfed9b-kserve-7575f864c9-r5fzg\" (UID: \"8f12599f-a3a2-446c-9ac6-32fc3cc90ad6\") " pod="ai-tenant-e2e-shared-a-dfed9b/sub-test-model-dfed9b-kserve-7575f864c9-r5fzg"
Jul 28 02:01:35.286941 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:35.286863    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f12599f-a3a2-446c-9ac6-32fc3cc90ad6-dshm\") pod \"sub-test-model-dfed9b-kserve-7575f864c9-r5fzg\" (UID: \"8f12599f-a3a2-446c-9ac6-32fc3cc90ad6\") " pod="ai-tenant-e2e-shared-a-dfed9b/sub-test-model-dfed9b-kserve-7575f864c9-r5fzg"
Jul 28 02:01:35.388031 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:35.387992    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f12599f-a3a2-446c-9ac6-32fc3cc90ad6-model-cache\") pod \"sub-test-model-dfed9b-kserve-7575f864c9-r5fzg\" (UID: \"8f12599f-a3a2-446c-9ac6-32fc3cc90ad6\") " pod="ai-tenant-e2e-shared-a-dfed9b/sub-test-model-dfed9b-kserve-7575f864c9-r5fzg"
Jul 28 02:01:35.388211 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:35.388037    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f12599f-a3a2-446c-9ac6-32fc3cc90ad6-home\") pod \"sub-test-model-dfed9b-kserve-7575f864c9-r5fzg\" (UID: \"8f12599f-a3a2-446c-9ac6-32fc3cc90ad6\") " pod="ai-tenant-e2e-shared-a-dfed9b/sub-test-model-dfed9b-kserve-7575f864c9-r5fzg"
Jul 28 02:01:35.388211 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:35.388165    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhsvz\" (UniqueName: \"kubernetes.io/projected/8f12599f-a3a2-446c-9ac6-32fc3cc90ad6-kube-api-access-lhsvz\") pod \"sub-test-model-dfed9b-kserve-7575f864c9-r5fzg\" (UID: \"8f12599f-a3a2-446c-9ac6-32fc3cc90ad6\") " pod="ai-tenant-e2e-shared-a-dfed9b/sub-test-model-dfed9b-kserve-7575f864c9-r5fzg"
Jul 28 02:01:35.388329 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:35.388275    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f12599f-a3a2-446c-9ac6-32fc3cc90ad6-dshm\") pod \"sub-test-model-dfed9b-kserve-7575f864c9-r5fzg\" (UID: \"8f12599f-a3a2-446c-9ac6-32fc3cc90ad6\") " pod="ai-tenant-e2e-shared-a-dfed9b/sub-test-model-dfed9b-kserve-7575f864c9-r5fzg"
Jul 28 02:01:35.388409 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:35.388328    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f12599f-a3a2-446c-9ac6-32fc3cc90ad6-tmp-dir\") pod \"sub-test-model-dfed9b-kserve-7575f864c9-r5fzg\" (UID: \"8f12599f-a3a2-446c-9ac6-32fc3cc90ad6\") " pod="ai-tenant-e2e-shared-a-dfed9b/sub-test-model-dfed9b-kserve-7575f864c9-r5fzg"
Jul 28 02:01:35.388470 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:35.388426    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f12599f-a3a2-446c-9ac6-32fc3cc90ad6-tls-certs\") pod \"sub-test-model-dfed9b-kserve-7575f864c9-r5fzg\" (UID: \"8f12599f-a3a2-446c-9ac6-32fc3cc90ad6\") " pod="ai-tenant-e2e-shared-a-dfed9b/sub-test-model-dfed9b-kserve-7575f864c9-r5fzg"
Jul 28 02:01:35.388522 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:35.388501    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f12599f-a3a2-446c-9ac6-32fc3cc90ad6-home\") pod \"sub-test-model-dfed9b-kserve-7575f864c9-r5fzg\" (UID: \"8f12599f-a3a2-446c-9ac6-32fc3cc90ad6\") " pod="ai-tenant-e2e-shared-a-dfed9b/sub-test-model-dfed9b-kserve-7575f864c9-r5fzg"
Jul 28 02:01:35.388580 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:35.388529    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f12599f-a3a2-446c-9ac6-32fc3cc90ad6-model-cache\") pod \"sub-test-model-dfed9b-kserve-7575f864c9-r5fzg\" (UID: \"8f12599f-a3a2-446c-9ac6-32fc3cc90ad6\") " pod="ai-tenant-e2e-shared-a-dfed9b/sub-test-model-dfed9b-kserve-7575f864c9-r5fzg"
Jul 28 02:01:35.388717 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:35.388694    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f12599f-a3a2-446c-9ac6-32fc3cc90ad6-tmp-dir\") pod \"sub-test-model-dfed9b-kserve-7575f864c9-r5fzg\" (UID: \"8f12599f-a3a2-446c-9ac6-32fc3cc90ad6\") " pod="ai-tenant-e2e-shared-a-dfed9b/sub-test-model-dfed9b-kserve-7575f864c9-r5fzg"
Jul 28 02:01:35.390538 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:35.390514    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f12599f-a3a2-446c-9ac6-32fc3cc90ad6-dshm\") pod \"sub-test-model-dfed9b-kserve-7575f864c9-r5fzg\" (UID: \"8f12599f-a3a2-446c-9ac6-32fc3cc90ad6\") " pod="ai-tenant-e2e-shared-a-dfed9b/sub-test-model-dfed9b-kserve-7575f864c9-r5fzg"
Jul 28 02:01:35.390781 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:35.390764    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f12599f-a3a2-446c-9ac6-32fc3cc90ad6-tls-certs\") pod \"sub-test-model-dfed9b-kserve-7575f864c9-r5fzg\" (UID: \"8f12599f-a3a2-446c-9ac6-32fc3cc90ad6\") " pod="ai-tenant-e2e-shared-a-dfed9b/sub-test-model-dfed9b-kserve-7575f864c9-r5fzg"
Jul 28 02:01:35.396161 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:35.396143    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhsvz\" (UniqueName: \"kubernetes.io/projected/8f12599f-a3a2-446c-9ac6-32fc3cc90ad6-kube-api-access-lhsvz\") pod \"sub-test-model-dfed9b-kserve-7575f864c9-r5fzg\" (UID: \"8f12599f-a3a2-446c-9ac6-32fc3cc90ad6\") " pod="ai-tenant-e2e-shared-a-dfed9b/sub-test-model-dfed9b-kserve-7575f864c9-r5fzg"
Jul 28 02:01:35.460757 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:35.460678    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fc7220d-bb14-481b-ae25-834f8b4c57a7" path="/var/lib/kubelet/pods/0fc7220d-bb14-481b-ae25-834f8b4c57a7/volumes"
Jul 28 02:01:35.516808 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:35.516780    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-dfed9b/sub-test-model-dfed9b-kserve-7575f864c9-r5fzg"
Jul 28 02:01:35.649690 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:35.649659    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-dfed9b/sub-test-model-dfed9b-kserve-7575f864c9-r5fzg"]
Jul 28 02:01:35.652929 ip-10-0-131-213 kubenswrapper[2560]: W0728 02:01:35.652896    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f12599f_a3a2_446c_9ac6_32fc3cc90ad6.slice/crio-ac03f1e28772fbfbca6abca694574ac2f616ae053bf4d2bf7f7fcd5b1380cdc6 WatchSource:0}: Error finding container ac03f1e28772fbfbca6abca694574ac2f616ae053bf4d2bf7f7fcd5b1380cdc6: Status 404 returned error can't find the container with id ac03f1e28772fbfbca6abca694574ac2f616ae053bf4d2bf7f7fcd5b1380cdc6
Jul 28 02:01:35.698478 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:35.698449    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-dfed9b/sub-test-model-dfed9b-kserve-7575f864c9-r5fzg" event={"ID":"8f12599f-a3a2-446c-9ac6-32fc3cc90ad6","Type":"ContainerStarted","Data":"ac03f1e28772fbfbca6abca694574ac2f616ae053bf4d2bf7f7fcd5b1380cdc6"}
Jul 28 02:01:36.704525 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:36.704489    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-dfed9b/sub-test-model-dfed9b-kserve-7575f864c9-r5fzg" event={"ID":"8f12599f-a3a2-446c-9ac6-32fc3cc90ad6","Type":"ContainerStarted","Data":"2ed6e40905f06e01aae8a0c5eecc7edbaf5b4cfc35dfb536e43826d2cab1f3b3"}
Jul 28 02:01:36.722370 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:36.722308    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-dfed9b/sub-test-model-dfed9b-kserve-7575f864c9-r5fzg" podStartSLOduration=1.722291993 podStartE2EDuration="1.722291993s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 02:01:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 02:01:36.720460217 +0000 UTC m=+2747.754503612" watchObservedRunningTime="2026-07-28 02:01:36.722291993 +0000 UTC m=+2747.756335385"
Jul 28 02:01:40.192372 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:40.192324    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 02:01:45.517309 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:45.517270    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-dfed9b/sub-test-model-dfed9b-kserve-7575f864c9-r5fzg"
Jul 28 02:01:45.517309 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:45.517322    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-dfed9b/sub-test-model-dfed9b-kserve-7575f864c9-r5fzg"
Jul 28 02:01:45.529855 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:45.529834    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-dfed9b/sub-test-model-dfed9b-kserve-7575f864c9-r5fzg"
Jul 28 02:01:45.761365 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:01:45.761321    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-dfed9b/sub-test-model-dfed9b-kserve-7575f864c9-r5fzg"
Jul 28 02:02:17.562208 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:02:17.562105    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:02:21.313894 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:02:21.313864    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 02:02:53.495006 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:02:53.494973    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 02:03:12.208038 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:12.208006    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 02:03:18.690170 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:18.690128    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-dfed9b/sub-test-model-dfed9b-kserve-7575f864c9-r5fzg"]
Jul 28 02:03:18.718237 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:18.718193    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:03:20.539103 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:20.539074    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:03:29.785236 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:29.785201    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 02:03:33.709024 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:33.708978    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-dfed9b/sub-test-model-dfed9b-kserve-7575f864c9-r5fzg" podUID="8f12599f-a3a2-446c-9ac6-32fc3cc90ad6" containerName="main" containerID="cri-o://2ed6e40905f06e01aae8a0c5eecc7edbaf5b4cfc35dfb536e43826d2cab1f3b3" gracePeriod=45
Jul 28 02:03:33.959679 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:33.959622    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-dfed9b/sub-test-model-dfed9b-kserve-7575f864c9-r5fzg"
Jul 28 02:03:34.072853 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:34.072816    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhsvz\" (UniqueName: \"kubernetes.io/projected/8f12599f-a3a2-446c-9ac6-32fc3cc90ad6-kube-api-access-lhsvz\") pod \"8f12599f-a3a2-446c-9ac6-32fc3cc90ad6\" (UID: \"8f12599f-a3a2-446c-9ac6-32fc3cc90ad6\") "
Jul 28 02:03:34.073030 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:34.072880    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f12599f-a3a2-446c-9ac6-32fc3cc90ad6-home\") pod \"8f12599f-a3a2-446c-9ac6-32fc3cc90ad6\" (UID: \"8f12599f-a3a2-446c-9ac6-32fc3cc90ad6\") "
Jul 28 02:03:34.073030 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:34.072906    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f12599f-a3a2-446c-9ac6-32fc3cc90ad6-model-cache\") pod \"8f12599f-a3a2-446c-9ac6-32fc3cc90ad6\" (UID: \"8f12599f-a3a2-446c-9ac6-32fc3cc90ad6\") "
Jul 28 02:03:34.073030 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:34.072984    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f12599f-a3a2-446c-9ac6-32fc3cc90ad6-tls-certs\") pod \"8f12599f-a3a2-446c-9ac6-32fc3cc90ad6\" (UID: \"8f12599f-a3a2-446c-9ac6-32fc3cc90ad6\") "
Jul 28 02:03:34.073030 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:34.073008    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f12599f-a3a2-446c-9ac6-32fc3cc90ad6-dshm\") pod \"8f12599f-a3a2-446c-9ac6-32fc3cc90ad6\" (UID: \"8f12599f-a3a2-446c-9ac6-32fc3cc90ad6\") "
Jul 28 02:03:34.073254 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:34.073063    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f12599f-a3a2-446c-9ac6-32fc3cc90ad6-tmp-dir\") pod \"8f12599f-a3a2-446c-9ac6-32fc3cc90ad6\" (UID: \"8f12599f-a3a2-446c-9ac6-32fc3cc90ad6\") "
Jul 28 02:03:34.073254 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:34.073190    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f12599f-a3a2-446c-9ac6-32fc3cc90ad6-home" (OuterVolumeSpecName: "home") pod "8f12599f-a3a2-446c-9ac6-32fc3cc90ad6" (UID: "8f12599f-a3a2-446c-9ac6-32fc3cc90ad6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:03:34.073254 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:34.073230    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f12599f-a3a2-446c-9ac6-32fc3cc90ad6-model-cache" (OuterVolumeSpecName: "model-cache") pod "8f12599f-a3a2-446c-9ac6-32fc3cc90ad6" (UID: "8f12599f-a3a2-446c-9ac6-32fc3cc90ad6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:03:34.073453 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:34.073394    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f12599f-a3a2-446c-9ac6-32fc3cc90ad6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8f12599f-a3a2-446c-9ac6-32fc3cc90ad6" (UID: "8f12599f-a3a2-446c-9ac6-32fc3cc90ad6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:03:34.073453 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:34.073446    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f12599f-a3a2-446c-9ac6-32fc3cc90ad6-home\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 02:03:34.073542 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:34.073464    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f12599f-a3a2-446c-9ac6-32fc3cc90ad6-model-cache\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 02:03:34.075056 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:34.075032    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f12599f-a3a2-446c-9ac6-32fc3cc90ad6-kube-api-access-lhsvz" (OuterVolumeSpecName: "kube-api-access-lhsvz") pod "8f12599f-a3a2-446c-9ac6-32fc3cc90ad6" (UID: "8f12599f-a3a2-446c-9ac6-32fc3cc90ad6"). InnerVolumeSpecName "kube-api-access-lhsvz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 02:03:34.075177 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:34.075085    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f12599f-a3a2-446c-9ac6-32fc3cc90ad6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8f12599f-a3a2-446c-9ac6-32fc3cc90ad6" (UID: "8f12599f-a3a2-446c-9ac6-32fc3cc90ad6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 02:03:34.075177 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:34.075138    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f12599f-a3a2-446c-9ac6-32fc3cc90ad6-dshm" (OuterVolumeSpecName: "dshm") pod "8f12599f-a3a2-446c-9ac6-32fc3cc90ad6" (UID: "8f12599f-a3a2-446c-9ac6-32fc3cc90ad6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:03:34.173922 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:34.173895    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhsvz\" (UniqueName: \"kubernetes.io/projected/8f12599f-a3a2-446c-9ac6-32fc3cc90ad6-kube-api-access-lhsvz\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 02:03:34.173922 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:34.173920    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f12599f-a3a2-446c-9ac6-32fc3cc90ad6-tls-certs\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 02:03:34.173922 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:34.173929    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f12599f-a3a2-446c-9ac6-32fc3cc90ad6-dshm\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 02:03:34.174143 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:34.173938    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f12599f-a3a2-446c-9ac6-32fc3cc90ad6-tmp-dir\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 02:03:34.287234 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:34.287153    2560 generic.go:356] "Generic (PLEG): container finished" podID="8f12599f-a3a2-446c-9ac6-32fc3cc90ad6" containerID="2ed6e40905f06e01aae8a0c5eecc7edbaf5b4cfc35dfb536e43826d2cab1f3b3" exitCode=0
Jul 28 02:03:34.287234 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:34.287199    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-dfed9b/sub-test-model-dfed9b-kserve-7575f864c9-r5fzg"
Jul 28 02:03:34.287234 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:34.287218    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-dfed9b/sub-test-model-dfed9b-kserve-7575f864c9-r5fzg" event={"ID":"8f12599f-a3a2-446c-9ac6-32fc3cc90ad6","Type":"ContainerDied","Data":"2ed6e40905f06e01aae8a0c5eecc7edbaf5b4cfc35dfb536e43826d2cab1f3b3"}
Jul 28 02:03:34.287477 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:34.287257    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-dfed9b/sub-test-model-dfed9b-kserve-7575f864c9-r5fzg" event={"ID":"8f12599f-a3a2-446c-9ac6-32fc3cc90ad6","Type":"ContainerDied","Data":"ac03f1e28772fbfbca6abca694574ac2f616ae053bf4d2bf7f7fcd5b1380cdc6"}
Jul 28 02:03:34.287477 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:34.287279    2560 scope.go:117] "RemoveContainer" containerID="2ed6e40905f06e01aae8a0c5eecc7edbaf5b4cfc35dfb536e43826d2cab1f3b3"
Jul 28 02:03:34.296197 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:34.296180    2560 scope.go:117] "RemoveContainer" containerID="2ed6e40905f06e01aae8a0c5eecc7edbaf5b4cfc35dfb536e43826d2cab1f3b3"
Jul 28 02:03:34.296504 ip-10-0-131-213 kubenswrapper[2560]: E0728 02:03:34.296482    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ed6e40905f06e01aae8a0c5eecc7edbaf5b4cfc35dfb536e43826d2cab1f3b3\": container with ID starting with 2ed6e40905f06e01aae8a0c5eecc7edbaf5b4cfc35dfb536e43826d2cab1f3b3 not found: ID does not exist" containerID="2ed6e40905f06e01aae8a0c5eecc7edbaf5b4cfc35dfb536e43826d2cab1f3b3"
Jul 28 02:03:34.296592 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:34.296511    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ed6e40905f06e01aae8a0c5eecc7edbaf5b4cfc35dfb536e43826d2cab1f3b3"} err="failed to get container status \"2ed6e40905f06e01aae8a0c5eecc7edbaf5b4cfc35dfb536e43826d2cab1f3b3\": rpc error: code = NotFound desc = could not find container \"2ed6e40905f06e01aae8a0c5eecc7edbaf5b4cfc35dfb536e43826d2cab1f3b3\": container with ID starting with 2ed6e40905f06e01aae8a0c5eecc7edbaf5b4cfc35dfb536e43826d2cab1f3b3 not found: ID does not exist"
Jul 28 02:03:34.311516 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:34.311488    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-dfed9b/sub-test-model-dfed9b-kserve-7575f864c9-r5fzg"]
Jul 28 02:03:34.323929 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:34.323907    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-dfed9b/sub-test-model-dfed9b-kserve-7575f864c9-r5fzg"]
Jul 28 02:03:35.461213 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:35.461179    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f12599f-a3a2-446c-9ac6-32fc3cc90ad6" path="/var/lib/kubelet/pods/8f12599f-a3a2-446c-9ac6-32fc3cc90ad6/volumes"
Jul 28 02:03:44.922773 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:44.922696    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-dfed9b/rate-test-model-dfed9b-kserve-6dfccbb455-x5k44"]
Jul 28 02:03:44.923242 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:44.923192    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f12599f-a3a2-446c-9ac6-32fc3cc90ad6" containerName="main"
Jul 28 02:03:44.923242 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:44.923205    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f12599f-a3a2-446c-9ac6-32fc3cc90ad6" containerName="main"
Jul 28 02:03:44.923327 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:44.923278    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f12599f-a3a2-446c-9ac6-32fc3cc90ad6" containerName="main"
Jul 28 02:03:44.936249 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:44.936178    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-dfed9b/rate-test-model-dfed9b-kserve-6dfccbb455-x5k44"
Jul 28 02:03:44.938329 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:44.938303    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-dfed9b/rate-test-model-dfed9b-kserve-6dfccbb455-x5k44"]
Jul 28 02:03:44.939940 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:44.939912    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-dfed9b\"/\"default-dockercfg-z25m2\""
Jul 28 02:03:44.940208 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:44.940185    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-dfed9b\"/\"openshift-service-ca.crt\""
Jul 28 02:03:44.940379 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:44.940362    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-dfed9b\"/\"rate-test-model-dfed9b-kserve-self-signed-certs\""
Jul 28 02:03:44.940461 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:44.940421    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-dfed9b\"/\"kube-root-ca.crt\""
Jul 28 02:03:44.961294 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:44.961262    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:03:44.971260 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:44.971235    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b25be0ba-0d41-4677-ba02-87e9518d4196-model-cache\") pod \"rate-test-model-dfed9b-kserve-6dfccbb455-x5k44\" (UID: \"b25be0ba-0d41-4677-ba02-87e9518d4196\") " pod="ai-tenant-e2e-shared-a-dfed9b/rate-test-model-dfed9b-kserve-6dfccbb455-x5k44"
Jul 28 02:03:44.971416 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:44.971270    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b25be0ba-0d41-4677-ba02-87e9518d4196-tls-certs\") pod \"rate-test-model-dfed9b-kserve-6dfccbb455-x5k44\" (UID: \"b25be0ba-0d41-4677-ba02-87e9518d4196\") " pod="ai-tenant-e2e-shared-a-dfed9b/rate-test-model-dfed9b-kserve-6dfccbb455-x5k44"
Jul 28 02:03:44.971416 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:44.971289    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b25be0ba-0d41-4677-ba02-87e9518d4196-tmp-dir\") pod \"rate-test-model-dfed9b-kserve-6dfccbb455-x5k44\" (UID: \"b25be0ba-0d41-4677-ba02-87e9518d4196\") " pod="ai-tenant-e2e-shared-a-dfed9b/rate-test-model-dfed9b-kserve-6dfccbb455-x5k44"
Jul 28 02:03:44.971416 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:44.971346    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sqpc\" (UniqueName: \"kubernetes.io/projected/b25be0ba-0d41-4677-ba02-87e9518d4196-kube-api-access-4sqpc\") pod \"rate-test-model-dfed9b-kserve-6dfccbb455-x5k44\" (UID: \"b25be0ba-0d41-4677-ba02-87e9518d4196\") " pod="ai-tenant-e2e-shared-a-dfed9b/rate-test-model-dfed9b-kserve-6dfccbb455-x5k44"
Jul 28 02:03:44.971530 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:44.971429    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b25be0ba-0d41-4677-ba02-87e9518d4196-dshm\") pod \"rate-test-model-dfed9b-kserve-6dfccbb455-x5k44\" (UID: \"b25be0ba-0d41-4677-ba02-87e9518d4196\") " pod="ai-tenant-e2e-shared-a-dfed9b/rate-test-model-dfed9b-kserve-6dfccbb455-x5k44"
Jul 28 02:03:44.971530 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:44.971463    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b25be0ba-0d41-4677-ba02-87e9518d4196-home\") pod \"rate-test-model-dfed9b-kserve-6dfccbb455-x5k44\" (UID: \"b25be0ba-0d41-4677-ba02-87e9518d4196\") " pod="ai-tenant-e2e-shared-a-dfed9b/rate-test-model-dfed9b-kserve-6dfccbb455-x5k44"
Jul 28 02:03:45.072799 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:45.072762    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b25be0ba-0d41-4677-ba02-87e9518d4196-model-cache\") pod \"rate-test-model-dfed9b-kserve-6dfccbb455-x5k44\" (UID: \"b25be0ba-0d41-4677-ba02-87e9518d4196\") " pod="ai-tenant-e2e-shared-a-dfed9b/rate-test-model-dfed9b-kserve-6dfccbb455-x5k44"
Jul 28 02:03:45.072799 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:45.072804    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b25be0ba-0d41-4677-ba02-87e9518d4196-tls-certs\") pod \"rate-test-model-dfed9b-kserve-6dfccbb455-x5k44\" (UID: \"b25be0ba-0d41-4677-ba02-87e9518d4196\") " pod="ai-tenant-e2e-shared-a-dfed9b/rate-test-model-dfed9b-kserve-6dfccbb455-x5k44"
Jul 28 02:03:45.073030 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:45.072828    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b25be0ba-0d41-4677-ba02-87e9518d4196-tmp-dir\") pod \"rate-test-model-dfed9b-kserve-6dfccbb455-x5k44\" (UID: \"b25be0ba-0d41-4677-ba02-87e9518d4196\") " pod="ai-tenant-e2e-shared-a-dfed9b/rate-test-model-dfed9b-kserve-6dfccbb455-x5k44"
Jul 28 02:03:45.073030 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:45.072950    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sqpc\" (UniqueName: \"kubernetes.io/projected/b25be0ba-0d41-4677-ba02-87e9518d4196-kube-api-access-4sqpc\") pod \"rate-test-model-dfed9b-kserve-6dfccbb455-x5k44\" (UID: \"b25be0ba-0d41-4677-ba02-87e9518d4196\") " pod="ai-tenant-e2e-shared-a-dfed9b/rate-test-model-dfed9b-kserve-6dfccbb455-x5k44"
Jul 28 02:03:45.073131 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:45.073029    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b25be0ba-0d41-4677-ba02-87e9518d4196-dshm\") pod \"rate-test-model-dfed9b-kserve-6dfccbb455-x5k44\" (UID: \"b25be0ba-0d41-4677-ba02-87e9518d4196\") " pod="ai-tenant-e2e-shared-a-dfed9b/rate-test-model-dfed9b-kserve-6dfccbb455-x5k44"
Jul 28 02:03:45.073131 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:45.073085    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b25be0ba-0d41-4677-ba02-87e9518d4196-home\") pod \"rate-test-model-dfed9b-kserve-6dfccbb455-x5k44\" (UID: \"b25be0ba-0d41-4677-ba02-87e9518d4196\") " pod="ai-tenant-e2e-shared-a-dfed9b/rate-test-model-dfed9b-kserve-6dfccbb455-x5k44"
Jul 28 02:03:45.073250 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:45.073230    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b25be0ba-0d41-4677-ba02-87e9518d4196-tmp-dir\") pod \"rate-test-model-dfed9b-kserve-6dfccbb455-x5k44\" (UID: \"b25be0ba-0d41-4677-ba02-87e9518d4196\") " pod="ai-tenant-e2e-shared-a-dfed9b/rate-test-model-dfed9b-kserve-6dfccbb455-x5k44"
Jul 28 02:03:45.073306 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:45.073232    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b25be0ba-0d41-4677-ba02-87e9518d4196-model-cache\") pod \"rate-test-model-dfed9b-kserve-6dfccbb455-x5k44\" (UID: \"b25be0ba-0d41-4677-ba02-87e9518d4196\") " pod="ai-tenant-e2e-shared-a-dfed9b/rate-test-model-dfed9b-kserve-6dfccbb455-x5k44"
Jul 28 02:03:45.073461 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:45.073433    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b25be0ba-0d41-4677-ba02-87e9518d4196-home\") pod \"rate-test-model-dfed9b-kserve-6dfccbb455-x5k44\" (UID: \"b25be0ba-0d41-4677-ba02-87e9518d4196\") " pod="ai-tenant-e2e-shared-a-dfed9b/rate-test-model-dfed9b-kserve-6dfccbb455-x5k44"
Jul 28 02:03:45.075121 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:45.075102    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b25be0ba-0d41-4677-ba02-87e9518d4196-dshm\") pod \"rate-test-model-dfed9b-kserve-6dfccbb455-x5k44\" (UID: \"b25be0ba-0d41-4677-ba02-87e9518d4196\") " pod="ai-tenant-e2e-shared-a-dfed9b/rate-test-model-dfed9b-kserve-6dfccbb455-x5k44"
Jul 28 02:03:45.075508 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:45.075488    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b25be0ba-0d41-4677-ba02-87e9518d4196-tls-certs\") pod \"rate-test-model-dfed9b-kserve-6dfccbb455-x5k44\" (UID: \"b25be0ba-0d41-4677-ba02-87e9518d4196\") " pod="ai-tenant-e2e-shared-a-dfed9b/rate-test-model-dfed9b-kserve-6dfccbb455-x5k44"
Jul 28 02:03:45.083775 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:45.083756    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sqpc\" (UniqueName: \"kubernetes.io/projected/b25be0ba-0d41-4677-ba02-87e9518d4196-kube-api-access-4sqpc\") pod \"rate-test-model-dfed9b-kserve-6dfccbb455-x5k44\" (UID: \"b25be0ba-0d41-4677-ba02-87e9518d4196\") " pod="ai-tenant-e2e-shared-a-dfed9b/rate-test-model-dfed9b-kserve-6dfccbb455-x5k44"
Jul 28 02:03:45.246842 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:45.246744    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-dfed9b/rate-test-model-dfed9b-kserve-6dfccbb455-x5k44"
Jul 28 02:03:45.402253 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:45.402220    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-dfed9b/rate-test-model-dfed9b-kserve-6dfccbb455-x5k44"]
Jul 28 02:03:45.405461 ip-10-0-131-213 kubenswrapper[2560]: W0728 02:03:45.405431    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb25be0ba_0d41_4677_ba02_87e9518d4196.slice/crio-1ef5d0f702f816f9cc5be1354443b31acdf982a16df1f3639a1c768e2d925e1e WatchSource:0}: Error finding container 1ef5d0f702f816f9cc5be1354443b31acdf982a16df1f3639a1c768e2d925e1e: Status 404 returned error can't find the container with id 1ef5d0f702f816f9cc5be1354443b31acdf982a16df1f3639a1c768e2d925e1e
Jul 28 02:03:46.346853 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:46.346812    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-dfed9b/rate-test-model-dfed9b-kserve-6dfccbb455-x5k44" event={"ID":"b25be0ba-0d41-4677-ba02-87e9518d4196","Type":"ContainerStarted","Data":"9877691110accef3a3e02395d60f22d2c869c2e3b7ceacd63103ebe5e66ecdac"}
Jul 28 02:03:46.346853 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:46.346864    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-dfed9b/rate-test-model-dfed9b-kserve-6dfccbb455-x5k44" event={"ID":"b25be0ba-0d41-4677-ba02-87e9518d4196","Type":"ContainerStarted","Data":"1ef5d0f702f816f9cc5be1354443b31acdf982a16df1f3639a1c768e2d925e1e"}
Jul 28 02:03:46.369488 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:46.369440    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-dfed9b/rate-test-model-dfed9b-kserve-6dfccbb455-x5k44" podStartSLOduration=2.369426011 podStartE2EDuration="2.369426011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 02:03:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 02:03:46.366205227 +0000 UTC m=+2877.400248620" watchObservedRunningTime="2026-07-28 02:03:46.369426011 +0000 UTC m=+2877.403469458"
Jul 28 02:03:48.596270 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:48.596234    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 02:03:55.247465 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:55.247420    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-dfed9b/rate-test-model-dfed9b-kserve-6dfccbb455-x5k44"
Jul 28 02:03:55.247866 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:55.247485    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-dfed9b/rate-test-model-dfed9b-kserve-6dfccbb455-x5k44"
Jul 28 02:03:55.260193 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:55.260162    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-dfed9b/rate-test-model-dfed9b-kserve-6dfccbb455-x5k44"
Jul 28 02:03:55.402603 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:03:55.402574    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-dfed9b/rate-test-model-dfed9b-kserve-6dfccbb455-x5k44"
Jul 28 02:04:13.850873 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:04:13.850835    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:04:17.490692 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:04:17.490654    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 02:04:48.806656 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:04:48.806624    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 02:05:03.603645 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:03.603608    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:05:04.486757 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:04.486720    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 02:05:19.193243 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:19.193162    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 02:05:23.091624 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:23.091589    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-dfed9b/rate-test-model-dfed9b-kserve-6dfccbb455-x5k44"]
Jul 28 02:05:23.110210 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:23.110180    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:05:24.224805 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:24.224774    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:05:36.591697 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:36.591664    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 02:05:38.110700 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:38.110656    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-dfed9b/rate-test-model-dfed9b-kserve-6dfccbb455-x5k44" podUID="b25be0ba-0d41-4677-ba02-87e9518d4196" containerName="main" containerID="cri-o://9877691110accef3a3e02395d60f22d2c869c2e3b7ceacd63103ebe5e66ecdac" gracePeriod=45
Jul 28 02:05:38.354441 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:38.354417    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-dfed9b/rate-test-model-dfed9b-kserve-6dfccbb455-x5k44"
Jul 28 02:05:38.416496 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:38.416408    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b25be0ba-0d41-4677-ba02-87e9518d4196-home\") pod \"b25be0ba-0d41-4677-ba02-87e9518d4196\" (UID: \"b25be0ba-0d41-4677-ba02-87e9518d4196\") "
Jul 28 02:05:38.416496 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:38.416451    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b25be0ba-0d41-4677-ba02-87e9518d4196-dshm\") pod \"b25be0ba-0d41-4677-ba02-87e9518d4196\" (UID: \"b25be0ba-0d41-4677-ba02-87e9518d4196\") "
Jul 28 02:05:38.416496 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:38.416477    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4sqpc\" (UniqueName: \"kubernetes.io/projected/b25be0ba-0d41-4677-ba02-87e9518d4196-kube-api-access-4sqpc\") pod \"b25be0ba-0d41-4677-ba02-87e9518d4196\" (UID: \"b25be0ba-0d41-4677-ba02-87e9518d4196\") "
Jul 28 02:05:38.416805 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:38.416522    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b25be0ba-0d41-4677-ba02-87e9518d4196-tls-certs\") pod \"b25be0ba-0d41-4677-ba02-87e9518d4196\" (UID: \"b25be0ba-0d41-4677-ba02-87e9518d4196\") "
Jul 28 02:05:38.416805 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:38.416586    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b25be0ba-0d41-4677-ba02-87e9518d4196-tmp-dir\") pod \"b25be0ba-0d41-4677-ba02-87e9518d4196\" (UID: \"b25be0ba-0d41-4677-ba02-87e9518d4196\") "
Jul 28 02:05:38.416805 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:38.416627    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b25be0ba-0d41-4677-ba02-87e9518d4196-model-cache\") pod \"b25be0ba-0d41-4677-ba02-87e9518d4196\" (UID: \"b25be0ba-0d41-4677-ba02-87e9518d4196\") "
Jul 28 02:05:38.416805 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:38.416696    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b25be0ba-0d41-4677-ba02-87e9518d4196-home" (OuterVolumeSpecName: "home") pod "b25be0ba-0d41-4677-ba02-87e9518d4196" (UID: "b25be0ba-0d41-4677-ba02-87e9518d4196"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:05:38.416988 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:38.416887    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b25be0ba-0d41-4677-ba02-87e9518d4196-model-cache" (OuterVolumeSpecName: "model-cache") pod "b25be0ba-0d41-4677-ba02-87e9518d4196" (UID: "b25be0ba-0d41-4677-ba02-87e9518d4196"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:05:38.416988 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:38.416896    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b25be0ba-0d41-4677-ba02-87e9518d4196-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b25be0ba-0d41-4677-ba02-87e9518d4196" (UID: "b25be0ba-0d41-4677-ba02-87e9518d4196"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:05:38.416988 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:38.416964    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b25be0ba-0d41-4677-ba02-87e9518d4196-home\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 02:05:38.418625 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:38.418590    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b25be0ba-0d41-4677-ba02-87e9518d4196-dshm" (OuterVolumeSpecName: "dshm") pod "b25be0ba-0d41-4677-ba02-87e9518d4196" (UID: "b25be0ba-0d41-4677-ba02-87e9518d4196"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:05:38.418625 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:38.418602    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b25be0ba-0d41-4677-ba02-87e9518d4196-kube-api-access-4sqpc" (OuterVolumeSpecName: "kube-api-access-4sqpc") pod "b25be0ba-0d41-4677-ba02-87e9518d4196" (UID: "b25be0ba-0d41-4677-ba02-87e9518d4196"). InnerVolumeSpecName "kube-api-access-4sqpc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 02:05:38.418774 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:38.418689    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b25be0ba-0d41-4677-ba02-87e9518d4196-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b25be0ba-0d41-4677-ba02-87e9518d4196" (UID: "b25be0ba-0d41-4677-ba02-87e9518d4196"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 02:05:38.517784 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:38.517626    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b25be0ba-0d41-4677-ba02-87e9518d4196-model-cache\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 02:05:38.517784 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:38.517663    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b25be0ba-0d41-4677-ba02-87e9518d4196-dshm\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 02:05:38.517784 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:38.517679    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4sqpc\" (UniqueName: \"kubernetes.io/projected/b25be0ba-0d41-4677-ba02-87e9518d4196-kube-api-access-4sqpc\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 02:05:38.517784 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:38.517700    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b25be0ba-0d41-4677-ba02-87e9518d4196-tls-certs\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 02:05:38.517784 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:38.517717    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b25be0ba-0d41-4677-ba02-87e9518d4196-tmp-dir\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 02:05:38.897264 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:38.897231    2560 generic.go:356] "Generic (PLEG): container finished" podID="b25be0ba-0d41-4677-ba02-87e9518d4196" containerID="9877691110accef3a3e02395d60f22d2c869c2e3b7ceacd63103ebe5e66ecdac" exitCode=0
Jul 28 02:05:38.897456 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:38.897275    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-dfed9b/rate-test-model-dfed9b-kserve-6dfccbb455-x5k44"
Jul 28 02:05:38.897456 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:38.897275    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-dfed9b/rate-test-model-dfed9b-kserve-6dfccbb455-x5k44" event={"ID":"b25be0ba-0d41-4677-ba02-87e9518d4196","Type":"ContainerDied","Data":"9877691110accef3a3e02395d60f22d2c869c2e3b7ceacd63103ebe5e66ecdac"}
Jul 28 02:05:38.897456 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:38.897403    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-dfed9b/rate-test-model-dfed9b-kserve-6dfccbb455-x5k44" event={"ID":"b25be0ba-0d41-4677-ba02-87e9518d4196","Type":"ContainerDied","Data":"1ef5d0f702f816f9cc5be1354443b31acdf982a16df1f3639a1c768e2d925e1e"}
Jul 28 02:05:38.897456 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:38.897431    2560 scope.go:117] "RemoveContainer" containerID="9877691110accef3a3e02395d60f22d2c869c2e3b7ceacd63103ebe5e66ecdac"
Jul 28 02:05:38.907048 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:38.907029    2560 scope.go:117] "RemoveContainer" containerID="9877691110accef3a3e02395d60f22d2c869c2e3b7ceacd63103ebe5e66ecdac"
Jul 28 02:05:38.907317 ip-10-0-131-213 kubenswrapper[2560]: E0728 02:05:38.907294    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9877691110accef3a3e02395d60f22d2c869c2e3b7ceacd63103ebe5e66ecdac\": container with ID starting with 9877691110accef3a3e02395d60f22d2c869c2e3b7ceacd63103ebe5e66ecdac not found: ID does not exist" containerID="9877691110accef3a3e02395d60f22d2c869c2e3b7ceacd63103ebe5e66ecdac"
Jul 28 02:05:38.907406 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:38.907330    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9877691110accef3a3e02395d60f22d2c869c2e3b7ceacd63103ebe5e66ecdac"} err="failed to get container status \"9877691110accef3a3e02395d60f22d2c869c2e3b7ceacd63103ebe5e66ecdac\": rpc error: code = NotFound desc = could not find container \"9877691110accef3a3e02395d60f22d2c869c2e3b7ceacd63103ebe5e66ecdac\": container with ID starting with 9877691110accef3a3e02395d60f22d2c869c2e3b7ceacd63103ebe5e66ecdac not found: ID does not exist"
Jul 28 02:05:38.918818 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:38.918761    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-dfed9b/rate-test-model-dfed9b-kserve-6dfccbb455-x5k44"]
Jul 28 02:05:38.923157 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:38.923135    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-dfed9b/rate-test-model-dfed9b-kserve-6dfccbb455-x5k44"]
Jul 28 02:05:39.461458 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:39.461424    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b25be0ba-0d41-4677-ba02-87e9518d4196" path="/var/lib/kubelet/pods/b25be0ba-0d41-4677-ba02-87e9518d4196/volumes"
Jul 28 02:05:43.428688 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:43.428654    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:05:43.729628 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:43.729550    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:05:43.976373 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:43.976317    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:05:46.743876 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:46.743842    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:05:46.830127 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:46.830096    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:05:46.957193 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:46.957154    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:05:47.189026 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:47.188992    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:05:47.584546 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:47.584449    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:05:47.685137 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:47.685098    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:05:47.699907 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:47.699869    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-49ecf4-6dc5c87856-25m8b"]
Jul 28 02:05:47.700449 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:47.700427    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b25be0ba-0d41-4677-ba02-87e9518d4196" containerName="main"
Jul 28 02:05:47.700449 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:47.700448    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b25be0ba-0d41-4677-ba02-87e9518d4196" containerName="main"
Jul 28 02:05:47.700672 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:47.700569    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b25be0ba-0d41-4677-ba02-87e9518d4196" containerName="main"
Jul 28 02:05:47.705163 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:47.705143    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-49ecf4-6dc5c87856-25m8b"
Jul 28 02:05:47.707289 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:47.707268    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-49ecf4\""
Jul 28 02:05:47.707421 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:47.707288    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-49ecf4-dockercfg-mtkj7\""
Jul 28 02:05:47.714268 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:47.714245    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-49ecf4-5d4f7ddd7b-gdtb2"]
Jul 28 02:05:47.717616 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:47.717597    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-49ecf4-5d4f7ddd7b-gdtb2"
Jul 28 02:05:47.718668 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:47.718645    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-49ecf4-6dc5c87856-25m8b"]
Jul 28 02:05:47.727940 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:47.727918    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-49ecf4-5d4f7ddd7b-gdtb2"]
Jul 28 02:05:47.803707 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:47.803677    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmqrg\" (UniqueName: \"kubernetes.io/projected/37c61481-7609-4933-959f-0a7020bf51da-kube-api-access-cmqrg\") pod \"payload-processing-e2e-ipp-a-49ecf4-5d4f7ddd7b-gdtb2\" (UID: \"37c61481-7609-4933-959f-0a7020bf51da\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-49ecf4-5d4f7ddd7b-gdtb2"
Jul 28 02:05:47.804129 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:47.803731    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/112c8e27-0669-48ae-9306-a0ad31681434-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-49ecf4-6dc5c87856-25m8b\" (UID: \"112c8e27-0669-48ae-9306-a0ad31681434\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-49ecf4-6dc5c87856-25m8b"
Jul 28 02:05:47.804129 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:47.803810    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj8jq\" (UniqueName: \"kubernetes.io/projected/112c8e27-0669-48ae-9306-a0ad31681434-kube-api-access-qj8jq\") pod \"payload-pre-processing-e2e-ipp-a-49ecf4-6dc5c87856-25m8b\" (UID: \"112c8e27-0669-48ae-9306-a0ad31681434\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-49ecf4-6dc5c87856-25m8b"
Jul 28 02:05:47.804129 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:47.803907    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37c61481-7609-4933-959f-0a7020bf51da-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-49ecf4-5d4f7ddd7b-gdtb2\" (UID: \"37c61481-7609-4933-959f-0a7020bf51da\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-49ecf4-5d4f7ddd7b-gdtb2"
Jul 28 02:05:47.905175 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:47.905141    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37c61481-7609-4933-959f-0a7020bf51da-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-49ecf4-5d4f7ddd7b-gdtb2\" (UID: \"37c61481-7609-4933-959f-0a7020bf51da\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-49ecf4-5d4f7ddd7b-gdtb2"
Jul 28 02:05:47.905175 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:47.905183    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmqrg\" (UniqueName: \"kubernetes.io/projected/37c61481-7609-4933-959f-0a7020bf51da-kube-api-access-cmqrg\") pod \"payload-processing-e2e-ipp-a-49ecf4-5d4f7ddd7b-gdtb2\" (UID: \"37c61481-7609-4933-959f-0a7020bf51da\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-49ecf4-5d4f7ddd7b-gdtb2"
Jul 28 02:05:47.905445 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:47.905223    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/112c8e27-0669-48ae-9306-a0ad31681434-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-49ecf4-6dc5c87856-25m8b\" (UID: \"112c8e27-0669-48ae-9306-a0ad31681434\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-49ecf4-6dc5c87856-25m8b"
Jul 28 02:05:47.905445 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:47.905261    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj8jq\" (UniqueName: \"kubernetes.io/projected/112c8e27-0669-48ae-9306-a0ad31681434-kube-api-access-qj8jq\") pod \"payload-pre-processing-e2e-ipp-a-49ecf4-6dc5c87856-25m8b\" (UID: \"112c8e27-0669-48ae-9306-a0ad31681434\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-49ecf4-6dc5c87856-25m8b"
Jul 28 02:05:47.906127 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:47.906101    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/112c8e27-0669-48ae-9306-a0ad31681434-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-49ecf4-6dc5c87856-25m8b\" (UID: \"112c8e27-0669-48ae-9306-a0ad31681434\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-49ecf4-6dc5c87856-25m8b"
Jul 28 02:05:47.906199 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:47.906102    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37c61481-7609-4933-959f-0a7020bf51da-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-49ecf4-5d4f7ddd7b-gdtb2\" (UID: \"37c61481-7609-4933-959f-0a7020bf51da\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-49ecf4-5d4f7ddd7b-gdtb2"
Jul 28 02:05:47.913331 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:47.913299    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj8jq\" (UniqueName: \"kubernetes.io/projected/112c8e27-0669-48ae-9306-a0ad31681434-kube-api-access-qj8jq\") pod \"payload-pre-processing-e2e-ipp-a-49ecf4-6dc5c87856-25m8b\" (UID: \"112c8e27-0669-48ae-9306-a0ad31681434\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-49ecf4-6dc5c87856-25m8b"
Jul 28 02:05:47.913455 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:47.913433    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmqrg\" (UniqueName: \"kubernetes.io/projected/37c61481-7609-4933-959f-0a7020bf51da-kube-api-access-cmqrg\") pod \"payload-processing-e2e-ipp-a-49ecf4-5d4f7ddd7b-gdtb2\" (UID: \"37c61481-7609-4933-959f-0a7020bf51da\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-49ecf4-5d4f7ddd7b-gdtb2"
Jul 28 02:05:48.016632 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:48.016591    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-49ecf4-6dc5c87856-25m8b"
Jul 28 02:05:48.028844 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:48.028820    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-49ecf4-5d4f7ddd7b-gdtb2"
Jul 28 02:05:48.368758 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:48.368728    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-49ecf4-6dc5c87856-25m8b"]
Jul 28 02:05:48.371620 ip-10-0-131-213 kubenswrapper[2560]: W0728 02:05:48.371591    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod112c8e27_0669_48ae_9306_a0ad31681434.slice/crio-8873742613f5cee6bb97140a6bc642400a8e3c7c1cc00c64e1c6e90fe7163e47 WatchSource:0}: Error finding container 8873742613f5cee6bb97140a6bc642400a8e3c7c1cc00c64e1c6e90fe7163e47: Status 404 returned error can't find the container with id 8873742613f5cee6bb97140a6bc642400a8e3c7c1cc00c64e1c6e90fe7163e47
Jul 28 02:05:48.394414 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:48.394391    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-49ecf4-5d4f7ddd7b-gdtb2"]
Jul 28 02:05:48.401437 ip-10-0-131-213 kubenswrapper[2560]: W0728 02:05:48.401413    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37c61481_7609_4933_959f_0a7020bf51da.slice/crio-e0ef72489125f30bf11e986904467c28037b638506e5a96f7f87ae7ceebe4db5 WatchSource:0}: Error finding container e0ef72489125f30bf11e986904467c28037b638506e5a96f7f87ae7ceebe4db5: Status 404 returned error can't find the container with id e0ef72489125f30bf11e986904467c28037b638506e5a96f7f87ae7ceebe4db5
Jul 28 02:05:48.950229 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:48.950194    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-49ecf4-5d4f7ddd7b-gdtb2" event={"ID":"37c61481-7609-4933-959f-0a7020bf51da","Type":"ContainerStarted","Data":"451bbbab5919e519ad017d2b75cf97e853b1d21d2c1d37573361f2d13e48c2ae"}
Jul 28 02:05:48.950706 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:48.950382    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-49ecf4-5d4f7ddd7b-gdtb2"
Jul 28 02:05:48.950706 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:48.950420    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-49ecf4-5d4f7ddd7b-gdtb2" event={"ID":"37c61481-7609-4933-959f-0a7020bf51da","Type":"ContainerStarted","Data":"e0ef72489125f30bf11e986904467c28037b638506e5a96f7f87ae7ceebe4db5"}
Jul 28 02:05:48.951679 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:48.951653    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-49ecf4-6dc5c87856-25m8b" event={"ID":"112c8e27-0669-48ae-9306-a0ad31681434","Type":"ContainerStarted","Data":"27e59eb2c0c39fae5d2cfc27013425201e47906b61524b2a5091ddde525b00be"}
Jul 28 02:05:48.951813 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:48.951688    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-49ecf4-6dc5c87856-25m8b" event={"ID":"112c8e27-0669-48ae-9306-a0ad31681434","Type":"ContainerStarted","Data":"8873742613f5cee6bb97140a6bc642400a8e3c7c1cc00c64e1c6e90fe7163e47"}
Jul 28 02:05:48.951813 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:48.951707    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-49ecf4-6dc5c87856-25m8b"
Jul 28 02:05:48.966106 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:48.966057    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-49ecf4-5d4f7ddd7b-gdtb2" podStartSLOduration=1.966042171 podStartE2EDuration="1.966042171s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 02:05:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 02:05:48.964098314 +0000 UTC m=+2999.998141707" watchObservedRunningTime="2026-07-28 02:05:48.966042171 +0000 UTC m=+3000.000085564"
Jul 28 02:05:48.979527 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:48.979472    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-49ecf4-6dc5c87856-25m8b" podStartSLOduration=1.979459597 podStartE2EDuration="1.979459597s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 02:05:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 02:05:48.978043324 +0000 UTC m=+3000.012086716" watchObservedRunningTime="2026-07-28 02:05:48.979459597 +0000 UTC m=+3000.013502989"
Jul 28 02:05:49.653177 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:49.653150    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5f2zn_5311b0bc-9ad2-4e2f-bdde-81510c6d6b19/ovn-acl-logging/0.log"
Jul 28 02:05:49.654697 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:49.654676    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5f2zn_5311b0bc-9ad2-4e2f-bdde-81510c6d6b19/ovn-acl-logging/0.log"
Jul 28 02:05:51.231617 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:51.231576    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:05:55.792782 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:55.792745    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 02:05:59.960033 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:59.960002    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-49ecf4-5d4f7ddd7b-gdtb2"
Jul 28 02:05:59.960451 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:05:59.960274    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-49ecf4-6dc5c87856-25m8b"
Jul 28 02:06:02.128694 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:02.128660    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:06:02.431167 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:02.431090    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:06:02.763159 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:02.763076    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:06:04.576488 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:04.576457    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:06:05.889085 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:05.889051    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:06:05.970813 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:05.970775    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:06:06.044463 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:06.044425    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:06:06.429814 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:06.429776    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:06:06.673977 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:06.673945    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:06:06.773384 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:06.773288    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:06:06.801665 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:06.801636    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-e0a963-b48598fb-lxqxt"]
Jul 28 02:06:06.805321 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:06.805303    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e0a963-b48598fb-lxqxt"
Jul 28 02:06:06.807292 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:06.807275    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-e0a963\""
Jul 28 02:06:06.815203 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:06.815184    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-e0a963-b48598fb-lxqxt"]
Jul 28 02:06:06.935326 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:06.935297    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-e0a963-6f8fdb45bd-gv8nw"]
Jul 28 02:06:06.938799 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:06.938785    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-e0a963-6f8fdb45bd-gv8nw"
Jul 28 02:06:06.940534 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:06.940512    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-e0a963-dockercfg-sp25c\""
Jul 28 02:06:06.948425 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:06.948402    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-e0a963-6f8fdb45bd-gv8nw"]
Jul 28 02:06:06.988181 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:06.988151    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6244c388-de30-4e3a-81f6-6e795d4c7134-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-e0a963-b48598fb-lxqxt\" (UID: \"6244c388-de30-4e3a-81f6-6e795d4c7134\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e0a963-b48598fb-lxqxt"
Jul 28 02:06:06.988299 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:06.988236    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qnz6\" (UniqueName: \"kubernetes.io/projected/6244c388-de30-4e3a-81f6-6e795d4c7134-kube-api-access-5qnz6\") pod \"payload-pre-processing-e2e-ipp-b-e0a963-b48598fb-lxqxt\" (UID: \"6244c388-de30-4e3a-81f6-6e795d4c7134\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e0a963-b48598fb-lxqxt"
Jul 28 02:06:07.089031 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:07.088944    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qnz6\" (UniqueName: \"kubernetes.io/projected/6244c388-de30-4e3a-81f6-6e795d4c7134-kube-api-access-5qnz6\") pod \"payload-pre-processing-e2e-ipp-b-e0a963-b48598fb-lxqxt\" (UID: \"6244c388-de30-4e3a-81f6-6e795d4c7134\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e0a963-b48598fb-lxqxt"
Jul 28 02:06:07.089031 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:07.088984    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4766\" (UniqueName: \"kubernetes.io/projected/7c8aec96-4778-4044-b6a6-074f0c12071a-kube-api-access-k4766\") pod \"payload-processing-e2e-ipp-b-e0a963-6f8fdb45bd-gv8nw\" (UID: \"7c8aec96-4778-4044-b6a6-074f0c12071a\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-e0a963-6f8fdb45bd-gv8nw"
Jul 28 02:06:07.089031 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:07.089012    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c8aec96-4778-4044-b6a6-074f0c12071a-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-e0a963-6f8fdb45bd-gv8nw\" (UID: \"7c8aec96-4778-4044-b6a6-074f0c12071a\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-e0a963-6f8fdb45bd-gv8nw"
Jul 28 02:06:07.089247 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:07.089101    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6244c388-de30-4e3a-81f6-6e795d4c7134-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-e0a963-b48598fb-lxqxt\" (UID: \"6244c388-de30-4e3a-81f6-6e795d4c7134\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e0a963-b48598fb-lxqxt"
Jul 28 02:06:07.089808 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:07.089791    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6244c388-de30-4e3a-81f6-6e795d4c7134-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-e0a963-b48598fb-lxqxt\" (UID: \"6244c388-de30-4e3a-81f6-6e795d4c7134\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e0a963-b48598fb-lxqxt"
Jul 28 02:06:07.100818 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:07.100787    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qnz6\" (UniqueName: \"kubernetes.io/projected/6244c388-de30-4e3a-81f6-6e795d4c7134-kube-api-access-5qnz6\") pod \"payload-pre-processing-e2e-ipp-b-e0a963-b48598fb-lxqxt\" (UID: \"6244c388-de30-4e3a-81f6-6e795d4c7134\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e0a963-b48598fb-lxqxt"
Jul 28 02:06:07.116645 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:07.116620    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e0a963-b48598fb-lxqxt"
Jul 28 02:06:07.190251 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:07.190217    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c8aec96-4778-4044-b6a6-074f0c12071a-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-e0a963-6f8fdb45bd-gv8nw\" (UID: \"7c8aec96-4778-4044-b6a6-074f0c12071a\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-e0a963-6f8fdb45bd-gv8nw"
Jul 28 02:06:07.190432 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:07.190364    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4766\" (UniqueName: \"kubernetes.io/projected/7c8aec96-4778-4044-b6a6-074f0c12071a-kube-api-access-k4766\") pod \"payload-processing-e2e-ipp-b-e0a963-6f8fdb45bd-gv8nw\" (UID: \"7c8aec96-4778-4044-b6a6-074f0c12071a\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-e0a963-6f8fdb45bd-gv8nw"
Jul 28 02:06:07.190995 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:07.190976    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c8aec96-4778-4044-b6a6-074f0c12071a-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-e0a963-6f8fdb45bd-gv8nw\" (UID: \"7c8aec96-4778-4044-b6a6-074f0c12071a\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-e0a963-6f8fdb45bd-gv8nw"
Jul 28 02:06:07.201593 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:07.201493    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4766\" (UniqueName: \"kubernetes.io/projected/7c8aec96-4778-4044-b6a6-074f0c12071a-kube-api-access-k4766\") pod \"payload-processing-e2e-ipp-b-e0a963-6f8fdb45bd-gv8nw\" (UID: \"7c8aec96-4778-4044-b6a6-074f0c12071a\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-e0a963-6f8fdb45bd-gv8nw"
Jul 28 02:06:07.250296 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:07.250271    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-e0a963-6f8fdb45bd-gv8nw"
Jul 28 02:06:07.250594 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:07.250522    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-e0a963-b48598fb-lxqxt"]
Jul 28 02:06:07.253023 ip-10-0-131-213 kubenswrapper[2560]: W0728 02:06:07.252998    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6244c388_de30_4e3a_81f6_6e795d4c7134.slice/crio-fdf0984da4324582b5d521f374d226c379804c970ad606ea0127583ea31f321e WatchSource:0}: Error finding container fdf0984da4324582b5d521f374d226c379804c970ad606ea0127583ea31f321e: Status 404 returned error can't find the container with id fdf0984da4324582b5d521f374d226c379804c970ad606ea0127583ea31f321e
Jul 28 02:06:07.388260 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:07.388232    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-e0a963-6f8fdb45bd-gv8nw"]
Jul 28 02:06:07.389586 ip-10-0-131-213 kubenswrapper[2560]: W0728 02:06:07.389558    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c8aec96_4778_4044_b6a6_074f0c12071a.slice/crio-37e464f08df05916d5b21251e1b850410bcbeb78fd96cc0f8d1c248843a3c064 WatchSource:0}: Error finding container 37e464f08df05916d5b21251e1b850410bcbeb78fd96cc0f8d1c248843a3c064: Status 404 returned error can't find the container with id 37e464f08df05916d5b21251e1b850410bcbeb78fd96cc0f8d1c248843a3c064
Jul 28 02:06:08.049913 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:08.049875    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-e0a963-6f8fdb45bd-gv8nw" event={"ID":"7c8aec96-4778-4044-b6a6-074f0c12071a","Type":"ContainerStarted","Data":"b3792d0273a4ef677717088756d505535a35ff16a9ac28ba89e382e957826dd6"}
Jul 28 02:06:08.050421 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:08.050048    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-e0a963-6f8fdb45bd-gv8nw"
Jul 28 02:06:08.050421 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:08.050086    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-e0a963-6f8fdb45bd-gv8nw" event={"ID":"7c8aec96-4778-4044-b6a6-074f0c12071a","Type":"ContainerStarted","Data":"37e464f08df05916d5b21251e1b850410bcbeb78fd96cc0f8d1c248843a3c064"}
Jul 28 02:06:08.051458 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:08.051437    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e0a963-b48598fb-lxqxt" event={"ID":"6244c388-de30-4e3a-81f6-6e795d4c7134","Type":"ContainerStarted","Data":"b9c38ba080eecffa08cc66f26f010fbaf932cf142206774163cfc415236cd5ff"}
Jul 28 02:06:08.051546 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:08.051474    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e0a963-b48598fb-lxqxt" event={"ID":"6244c388-de30-4e3a-81f6-6e795d4c7134","Type":"ContainerStarted","Data":"fdf0984da4324582b5d521f374d226c379804c970ad606ea0127583ea31f321e"}
Jul 28 02:06:08.051546 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:08.051510    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e0a963-b48598fb-lxqxt"
Jul 28 02:06:08.068452 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:08.068335    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-e0a963-6f8fdb45bd-gv8nw" podStartSLOduration=2.068320948 podStartE2EDuration="2.068320948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 02:06:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 02:06:08.066306633 +0000 UTC m=+3019.100350026" watchObservedRunningTime="2026-07-28 02:06:08.068320948 +0000 UTC m=+3019.102364341"
Jul 28 02:06:08.080323 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:08.080222    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e0a963-b48598fb-lxqxt" podStartSLOduration=2.0802056 podStartE2EDuration="2.0802056s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 02:06:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 02:06:08.079839184 +0000 UTC m=+3019.113882579" watchObservedRunningTime="2026-07-28 02:06:08.0802056 +0000 UTC m=+3019.114248993"
Jul 28 02:06:10.380599 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:10.380556    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:06:10.902023 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:10.901978    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 02:06:19.059501 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:19.059419    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e0a963-b48598fb-lxqxt"
Jul 28 02:06:19.059501 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:19.059499    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-e0a963-6f8fdb45bd-gv8nw"
Jul 28 02:06:27.450169 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:27.450139    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-npbcz_d87f77ac-c168-4475-a294-e7e43ec47f36/payload-processing/0.log"
Jul 28 02:06:27.567946 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:27.567917    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-e0a963-6f8fdb45bd-gv8nw_7c8aec96-4778-4044-b6a6-074f0c12071a/payload-processing/0.log"
Jul 28 02:06:35.099777 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:35.099736    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:06:39.584375 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:39.584325    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 02:06:48.758392 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:06:48.758297    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:07:08.089217 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:08.089174    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 02:07:19.474362 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:19.474322    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-49ecf4-5d4f7ddd7b-gdtb2_37c61481-7609-4933-959f-0a7020bf51da/payload-processing/0.log"
Jul 28 02:07:19.594372 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:19.590505    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-npbcz_d87f77ac-c168-4475-a294-e7e43ec47f36/payload-processing/0.log"
Jul 28 02:07:19.715003 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:19.714973    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-e0a963-6f8fdb45bd-gv8nw_7c8aec96-4778-4044-b6a6-074f0c12071a/payload-processing/0.log"
Jul 28 02:07:19.985193 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:19.985156    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:07:20.333866 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:20.333788    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:07:20.518047 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:20.518006    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:07:23.263688 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:23.263652    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:07:23.368683 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:23.368645    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:07:25.017056 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:25.017028    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:07:25.411516 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:25.411483    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:07:25.521051 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:25.521021    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:07:25.610711 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:25.610681    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:07:25.615808 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:25.615784    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e78415-dbd555756-mvb6k"]
Jul 28 02:07:25.619503 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:25.619484    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e78415-dbd555756-mvb6k"
Jul 28 02:07:25.623021 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:25.623005    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-e78415-dockercfg-nwdng\""
Jul 28 02:07:25.623270 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:25.623253    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-e78415\""
Jul 28 02:07:25.634638 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:25.634613    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e78415-dbd555756-mvb6k"]
Jul 28 02:07:25.636804 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:25.636776    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-e78415-589d4f96b8-7slz4"]
Jul 28 02:07:25.640824 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:25.640798    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e78415-589d4f96b8-7slz4"
Jul 28 02:07:25.646697 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:25.646675    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-e78415-589d4f96b8-7slz4"]
Jul 28 02:07:25.726264 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:25.726190    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw2lt\" (UniqueName: \"kubernetes.io/projected/89a0bf11-342b-43d4-b931-dc14d3a7ac68-kube-api-access-qw2lt\") pod \"payload-processing-e2e-ipp-cleanup-e78415-589d4f96b8-7slz4\" (UID: \"89a0bf11-342b-43d4-b931-dc14d3a7ac68\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e78415-589d4f96b8-7slz4"
Jul 28 02:07:25.726264 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:25.726234    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/504854a0-91b2-4128-8ef9-00bc10263820-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-e78415-dbd555756-mvb6k\" (UID: \"504854a0-91b2-4128-8ef9-00bc10263820\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e78415-dbd555756-mvb6k"
Jul 28 02:07:25.726448 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:25.726381    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/89a0bf11-342b-43d4-b931-dc14d3a7ac68-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-e78415-589d4f96b8-7slz4\" (UID: \"89a0bf11-342b-43d4-b931-dc14d3a7ac68\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e78415-589d4f96b8-7slz4"
Jul 28 02:07:25.726448 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:25.726419    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2fkh\" (UniqueName: \"kubernetes.io/projected/504854a0-91b2-4128-8ef9-00bc10263820-kube-api-access-d2fkh\") pod \"payload-pre-processing-e2e-ipp-cleanup-e78415-dbd555756-mvb6k\" (UID: \"504854a0-91b2-4128-8ef9-00bc10263820\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e78415-dbd555756-mvb6k"
Jul 28 02:07:25.827499 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:25.827471    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/89a0bf11-342b-43d4-b931-dc14d3a7ac68-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-e78415-589d4f96b8-7slz4\" (UID: \"89a0bf11-342b-43d4-b931-dc14d3a7ac68\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e78415-589d4f96b8-7slz4"
Jul 28 02:07:25.827684 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:25.827509    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2fkh\" (UniqueName: \"kubernetes.io/projected/504854a0-91b2-4128-8ef9-00bc10263820-kube-api-access-d2fkh\") pod \"payload-pre-processing-e2e-ipp-cleanup-e78415-dbd555756-mvb6k\" (UID: \"504854a0-91b2-4128-8ef9-00bc10263820\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e78415-dbd555756-mvb6k"
Jul 28 02:07:25.827684 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:25.827561    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw2lt\" (UniqueName: \"kubernetes.io/projected/89a0bf11-342b-43d4-b931-dc14d3a7ac68-kube-api-access-qw2lt\") pod \"payload-processing-e2e-ipp-cleanup-e78415-589d4f96b8-7slz4\" (UID: \"89a0bf11-342b-43d4-b931-dc14d3a7ac68\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e78415-589d4f96b8-7slz4"
Jul 28 02:07:25.827808 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:25.827710    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/504854a0-91b2-4128-8ef9-00bc10263820-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-e78415-dbd555756-mvb6k\" (UID: \"504854a0-91b2-4128-8ef9-00bc10263820\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e78415-dbd555756-mvb6k"
Jul 28 02:07:25.828296 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:25.828272    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/89a0bf11-342b-43d4-b931-dc14d3a7ac68-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-e78415-589d4f96b8-7slz4\" (UID: \"89a0bf11-342b-43d4-b931-dc14d3a7ac68\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e78415-589d4f96b8-7slz4"
Jul 28 02:07:25.828431 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:25.828392    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/504854a0-91b2-4128-8ef9-00bc10263820-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-e78415-dbd555756-mvb6k\" (UID: \"504854a0-91b2-4128-8ef9-00bc10263820\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e78415-dbd555756-mvb6k"
Jul 28 02:07:25.836157 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:25.836137    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2fkh\" (UniqueName: \"kubernetes.io/projected/504854a0-91b2-4128-8ef9-00bc10263820-kube-api-access-d2fkh\") pod \"payload-pre-processing-e2e-ipp-cleanup-e78415-dbd555756-mvb6k\" (UID: \"504854a0-91b2-4128-8ef9-00bc10263820\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e78415-dbd555756-mvb6k"
Jul 28 02:07:25.836392 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:25.836372    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw2lt\" (UniqueName: \"kubernetes.io/projected/89a0bf11-342b-43d4-b931-dc14d3a7ac68-kube-api-access-qw2lt\") pod \"payload-processing-e2e-ipp-cleanup-e78415-589d4f96b8-7slz4\" (UID: \"89a0bf11-342b-43d4-b931-dc14d3a7ac68\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e78415-589d4f96b8-7slz4"
Jul 28 02:07:25.930060 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:25.930023    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e78415-dbd555756-mvb6k"
Jul 28 02:07:25.952342 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:25.952315    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e78415-589d4f96b8-7slz4"
Jul 28 02:07:26.083708 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:26.083020    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e78415-dbd555756-mvb6k"]
Jul 28 02:07:26.111412 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:26.111387    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-e78415-589d4f96b8-7slz4"]
Jul 28 02:07:26.113909 ip-10-0-131-213 kubenswrapper[2560]: W0728 02:07:26.113878    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89a0bf11_342b_43d4_b931_dc14d3a7ac68.slice/crio-a6a888be9934bfd70e9e47192a30476c6d454b150d2ef7e330e1073740cbd1c2 WatchSource:0}: Error finding container a6a888be9934bfd70e9e47192a30476c6d454b150d2ef7e330e1073740cbd1c2: Status 404 returned error can't find the container with id a6a888be9934bfd70e9e47192a30476c6d454b150d2ef7e330e1073740cbd1c2
Jul 28 02:07:26.460033 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:26.460003    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e78415-dbd555756-mvb6k" event={"ID":"504854a0-91b2-4128-8ef9-00bc10263820","Type":"ContainerStarted","Data":"3e97f13a91cbe40b37716fc49b583a5c3ff2060c3c402798140afc173da7966f"}
Jul 28 02:07:26.460289 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:26.460269    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e78415-dbd555756-mvb6k"
Jul 28 02:07:26.460411 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:26.460334    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e78415-dbd555756-mvb6k" event={"ID":"504854a0-91b2-4128-8ef9-00bc10263820","Type":"ContainerStarted","Data":"0ec59ae81f1214b03b56c5c87cd22405df27b9d5ff3b635e8dd3cadbe71ce380"}
Jul 28 02:07:26.461753 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:26.461731    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e78415-589d4f96b8-7slz4" event={"ID":"89a0bf11-342b-43d4-b931-dc14d3a7ac68","Type":"ContainerStarted","Data":"5d777a9fa5537d726e8d176d805f913ca4be452b6221b42c6a69d0f625fc2334"}
Jul 28 02:07:26.461853 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:26.461772    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e78415-589d4f96b8-7slz4" event={"ID":"89a0bf11-342b-43d4-b931-dc14d3a7ac68","Type":"ContainerStarted","Data":"a6a888be9934bfd70e9e47192a30476c6d454b150d2ef7e330e1073740cbd1c2"}
Jul 28 02:07:26.461853 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:26.461798    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e78415-589d4f96b8-7slz4"
Jul 28 02:07:26.475322 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:26.475283    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e78415-dbd555756-mvb6k" podStartSLOduration=1.475270386 podStartE2EDuration="1.475270386s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 02:07:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 02:07:26.473865097 +0000 UTC m=+3097.507908491" watchObservedRunningTime="2026-07-28 02:07:26.475270386 +0000 UTC m=+3097.509313777"
Jul 28 02:07:26.489793 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:26.489750    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e78415-589d4f96b8-7slz4" podStartSLOduration=1.48973804 podStartE2EDuration="1.48973804s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 02:07:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 02:07:26.488562941 +0000 UTC m=+3097.522606332" watchObservedRunningTime="2026-07-28 02:07:26.48973804 +0000 UTC m=+3097.523781441"
Jul 28 02:07:27.769154 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:27.769120    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:07:34.496965 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:34.496932    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 02:07:37.227405 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:37.227369    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:07:37.328121 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:37.328085    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:07:37.468393 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:37.468366    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e78415-589d4f96b8-7slz4"
Jul 28 02:07:38.474443 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:38.474413    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e78415-dbd555756-mvb6k"
Jul 28 02:07:55.989538 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:55.989508    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:07:56.021514 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:56.021484    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-e78415-589d4f96b8-7slz4"]
Jul 28 02:07:56.021730 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:56.021699    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e78415-589d4f96b8-7slz4" podUID="89a0bf11-342b-43d4-b931-dc14d3a7ac68" containerName="payload-processing" containerID="cri-o://5d777a9fa5537d726e8d176d805f913ca4be452b6221b42c6a69d0f625fc2334" gracePeriod=30
Jul 28 02:07:56.030218 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:56.030188    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e78415-dbd555756-mvb6k"]
Jul 28 02:07:56.030459 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:56.030430    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e78415-dbd555756-mvb6k" podUID="504854a0-91b2-4128-8ef9-00bc10263820" containerName="payload-pre-processing" containerID="cri-o://3e97f13a91cbe40b37716fc49b583a5c3ff2060c3c402798140afc173da7966f" gracePeriod=30
Jul 28 02:07:56.091544 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:56.091491    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:07:56.190242 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:56.190194    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:07:56.303003 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:56.302982    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e78415-589d4f96b8-7slz4"
Jul 28 02:07:56.306821 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:56.306799    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e78415-dbd555756-mvb6k"
Jul 28 02:07:56.391902 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:56.391868    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/504854a0-91b2-4128-8ef9-00bc10263820-plugins-config-volume\") pod \"504854a0-91b2-4128-8ef9-00bc10263820\" (UID: \"504854a0-91b2-4128-8ef9-00bc10263820\") "
Jul 28 02:07:56.392092 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:56.391946    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qw2lt\" (UniqueName: \"kubernetes.io/projected/89a0bf11-342b-43d4-b931-dc14d3a7ac68-kube-api-access-qw2lt\") pod \"89a0bf11-342b-43d4-b931-dc14d3a7ac68\" (UID: \"89a0bf11-342b-43d4-b931-dc14d3a7ac68\") "
Jul 28 02:07:56.392092 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:56.392050    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d2fkh\" (UniqueName: \"kubernetes.io/projected/504854a0-91b2-4128-8ef9-00bc10263820-kube-api-access-d2fkh\") pod \"504854a0-91b2-4128-8ef9-00bc10263820\" (UID: \"504854a0-91b2-4128-8ef9-00bc10263820\") "
Jul 28 02:07:56.392220 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:56.392153    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/89a0bf11-342b-43d4-b931-dc14d3a7ac68-plugins-config-volume\") pod \"89a0bf11-342b-43d4-b931-dc14d3a7ac68\" (UID: \"89a0bf11-342b-43d4-b931-dc14d3a7ac68\") "
Jul 28 02:07:56.392335 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:56.392312    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/504854a0-91b2-4128-8ef9-00bc10263820-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "504854a0-91b2-4128-8ef9-00bc10263820" (UID: "504854a0-91b2-4128-8ef9-00bc10263820"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 02:07:56.392598 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:56.392570    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89a0bf11-342b-43d4-b931-dc14d3a7ac68-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "89a0bf11-342b-43d4-b931-dc14d3a7ac68" (UID: "89a0bf11-342b-43d4-b931-dc14d3a7ac68"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 02:07:56.392680 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:56.392639    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/504854a0-91b2-4128-8ef9-00bc10263820-plugins-config-volume\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 02:07:56.394194 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:56.394169    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89a0bf11-342b-43d4-b931-dc14d3a7ac68-kube-api-access-qw2lt" (OuterVolumeSpecName: "kube-api-access-qw2lt") pod "89a0bf11-342b-43d4-b931-dc14d3a7ac68" (UID: "89a0bf11-342b-43d4-b931-dc14d3a7ac68"). InnerVolumeSpecName "kube-api-access-qw2lt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 02:07:56.394276 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:56.394191    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/504854a0-91b2-4128-8ef9-00bc10263820-kube-api-access-d2fkh" (OuterVolumeSpecName: "kube-api-access-d2fkh") pod "504854a0-91b2-4128-8ef9-00bc10263820" (UID: "504854a0-91b2-4128-8ef9-00bc10263820"). InnerVolumeSpecName "kube-api-access-d2fkh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 02:07:56.493750 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:56.493716    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qw2lt\" (UniqueName: \"kubernetes.io/projected/89a0bf11-342b-43d4-b931-dc14d3a7ac68-kube-api-access-qw2lt\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 02:07:56.493750 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:56.493742    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2fkh\" (UniqueName: \"kubernetes.io/projected/504854a0-91b2-4128-8ef9-00bc10263820-kube-api-access-d2fkh\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 02:07:56.493750 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:56.493752    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/89a0bf11-342b-43d4-b931-dc14d3a7ac68-plugins-config-volume\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 02:07:56.615913 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:56.615881    2560 generic.go:356] "Generic (PLEG): container finished" podID="89a0bf11-342b-43d4-b931-dc14d3a7ac68" containerID="5d777a9fa5537d726e8d176d805f913ca4be452b6221b42c6a69d0f625fc2334" exitCode=0
Jul 28 02:07:56.616099 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:56.615925    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e78415-589d4f96b8-7slz4"
Jul 28 02:07:56.616099 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:56.615962    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e78415-589d4f96b8-7slz4" event={"ID":"89a0bf11-342b-43d4-b931-dc14d3a7ac68","Type":"ContainerDied","Data":"5d777a9fa5537d726e8d176d805f913ca4be452b6221b42c6a69d0f625fc2334"}
Jul 28 02:07:56.616099 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:56.616020    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e78415-589d4f96b8-7slz4" event={"ID":"89a0bf11-342b-43d4-b931-dc14d3a7ac68","Type":"ContainerDied","Data":"a6a888be9934bfd70e9e47192a30476c6d454b150d2ef7e330e1073740cbd1c2"}
Jul 28 02:07:56.616099 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:56.616051    2560 scope.go:117] "RemoveContainer" containerID="5d777a9fa5537d726e8d176d805f913ca4be452b6221b42c6a69d0f625fc2334"
Jul 28 02:07:56.617439 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:56.617407    2560 generic.go:356] "Generic (PLEG): container finished" podID="504854a0-91b2-4128-8ef9-00bc10263820" containerID="3e97f13a91cbe40b37716fc49b583a5c3ff2060c3c402798140afc173da7966f" exitCode=0
Jul 28 02:07:56.617570 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:56.617464    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e78415-dbd555756-mvb6k"
Jul 28 02:07:56.617570 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:56.617473    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e78415-dbd555756-mvb6k" event={"ID":"504854a0-91b2-4128-8ef9-00bc10263820","Type":"ContainerDied","Data":"3e97f13a91cbe40b37716fc49b583a5c3ff2060c3c402798140afc173da7966f"}
Jul 28 02:07:56.617570 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:56.617519    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e78415-dbd555756-mvb6k" event={"ID":"504854a0-91b2-4128-8ef9-00bc10263820","Type":"ContainerDied","Data":"0ec59ae81f1214b03b56c5c87cd22405df27b9d5ff3b635e8dd3cadbe71ce380"}
Jul 28 02:07:56.626458 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:56.626439    2560 scope.go:117] "RemoveContainer" containerID="5d777a9fa5537d726e8d176d805f913ca4be452b6221b42c6a69d0f625fc2334"
Jul 28 02:07:56.626762 ip-10-0-131-213 kubenswrapper[2560]: E0728 02:07:56.626741    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d777a9fa5537d726e8d176d805f913ca4be452b6221b42c6a69d0f625fc2334\": container with ID starting with 5d777a9fa5537d726e8d176d805f913ca4be452b6221b42c6a69d0f625fc2334 not found: ID does not exist" containerID="5d777a9fa5537d726e8d176d805f913ca4be452b6221b42c6a69d0f625fc2334"
Jul 28 02:07:56.626815 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:56.626771    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d777a9fa5537d726e8d176d805f913ca4be452b6221b42c6a69d0f625fc2334"} err="failed to get container status \"5d777a9fa5537d726e8d176d805f913ca4be452b6221b42c6a69d0f625fc2334\": rpc error: code = NotFound desc = could not find container \"5d777a9fa5537d726e8d176d805f913ca4be452b6221b42c6a69d0f625fc2334\": container with ID starting with 5d777a9fa5537d726e8d176d805f913ca4be452b6221b42c6a69d0f625fc2334 not found: ID does not exist"
Jul 28 02:07:56.626815 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:56.626789    2560 scope.go:117] "RemoveContainer" containerID="3e97f13a91cbe40b37716fc49b583a5c3ff2060c3c402798140afc173da7966f"
Jul 28 02:07:56.634946 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:56.634931    2560 scope.go:117] "RemoveContainer" containerID="3e97f13a91cbe40b37716fc49b583a5c3ff2060c3c402798140afc173da7966f"
Jul 28 02:07:56.635213 ip-10-0-131-213 kubenswrapper[2560]: E0728 02:07:56.635188    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e97f13a91cbe40b37716fc49b583a5c3ff2060c3c402798140afc173da7966f\": container with ID starting with 3e97f13a91cbe40b37716fc49b583a5c3ff2060c3c402798140afc173da7966f not found: ID does not exist" containerID="3e97f13a91cbe40b37716fc49b583a5c3ff2060c3c402798140afc173da7966f"
Jul 28 02:07:56.635279 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:56.635225    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e97f13a91cbe40b37716fc49b583a5c3ff2060c3c402798140afc173da7966f"} err="failed to get container status \"3e97f13a91cbe40b37716fc49b583a5c3ff2060c3c402798140afc173da7966f\": rpc error: code = NotFound desc = could not find container \"3e97f13a91cbe40b37716fc49b583a5c3ff2060c3c402798140afc173da7966f\": container with ID starting with 3e97f13a91cbe40b37716fc49b583a5c3ff2060c3c402798140afc173da7966f not found: ID does not exist"
Jul 28 02:07:56.639784 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:56.639763    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-e78415-589d4f96b8-7slz4"]
Jul 28 02:07:56.643453 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:56.643431    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-e78415-589d4f96b8-7slz4"]
Jul 28 02:07:56.651754 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:56.651733    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e78415-dbd555756-mvb6k"]
Jul 28 02:07:56.655494 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:56.655473    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e78415-dbd555756-mvb6k"]
Jul 28 02:07:57.461825 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:57.461793    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="504854a0-91b2-4128-8ef9-00bc10263820" path="/var/lib/kubelet/pods/504854a0-91b2-4128-8ef9-00bc10263820/volumes"
Jul 28 02:07:57.462217 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:57.462161    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89a0bf11-342b-43d4-b931-dc14d3a7ac68" path="/var/lib/kubelet/pods/89a0bf11-342b-43d4-b931-dc14d3a7ac68/volumes"
Jul 28 02:07:58.896597 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:58.896562    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:07:59.346486 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:59.346410    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:07:59.421131 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:07:59.421098    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 02:08:05.464545 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:05.464510    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:08:05.566471 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:05.566442    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:08:05.681800 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:05.681770    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:08:05.894792 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:05.894760    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:08:20.373940 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:20.373864    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:08:26.289343 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:26.289305    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 02:08:28.837683 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:28.837649    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:08:28.864818 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:28.864790    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-49ecf4-5d4f7ddd7b-gdtb2"]
Jul 28 02:08:28.865030 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:28.864987    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-49ecf4-5d4f7ddd7b-gdtb2" podUID="37c61481-7609-4933-959f-0a7020bf51da" containerName="payload-processing" containerID="cri-o://451bbbab5919e519ad017d2b75cf97e853b1d21d2c1d37573361f2d13e48c2ae" gracePeriod=30
Jul 28 02:08:28.875193 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:28.875171    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-49ecf4-6dc5c87856-25m8b"]
Jul 28 02:08:28.875400 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:28.875376    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-49ecf4-6dc5c87856-25m8b" podUID="112c8e27-0669-48ae-9306-a0ad31681434" containerName="payload-pre-processing" containerID="cri-o://27e59eb2c0c39fae5d2cfc27013425201e47906b61524b2a5091ddde525b00be" gracePeriod=30
Jul 28 02:08:29.170726 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:29.170704    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-49ecf4-5d4f7ddd7b-gdtb2"
Jul 28 02:08:29.173816 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:29.173796    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-49ecf4-6dc5c87856-25m8b"
Jul 28 02:08:29.184815 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:29.184789    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmqrg\" (UniqueName: \"kubernetes.io/projected/37c61481-7609-4933-959f-0a7020bf51da-kube-api-access-cmqrg\") pod \"37c61481-7609-4933-959f-0a7020bf51da\" (UID: \"37c61481-7609-4933-959f-0a7020bf51da\") "
Jul 28 02:08:29.184919 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:29.184823    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qj8jq\" (UniqueName: \"kubernetes.io/projected/112c8e27-0669-48ae-9306-a0ad31681434-kube-api-access-qj8jq\") pod \"112c8e27-0669-48ae-9306-a0ad31681434\" (UID: \"112c8e27-0669-48ae-9306-a0ad31681434\") "
Jul 28 02:08:29.184919 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:29.184857    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37c61481-7609-4933-959f-0a7020bf51da-plugins-config-volume\") pod \"37c61481-7609-4933-959f-0a7020bf51da\" (UID: \"37c61481-7609-4933-959f-0a7020bf51da\") "
Jul 28 02:08:29.185040 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:29.184927    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/112c8e27-0669-48ae-9306-a0ad31681434-plugins-config-volume\") pod \"112c8e27-0669-48ae-9306-a0ad31681434\" (UID: \"112c8e27-0669-48ae-9306-a0ad31681434\") "
Jul 28 02:08:29.185248 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:29.185217    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37c61481-7609-4933-959f-0a7020bf51da-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "37c61481-7609-4933-959f-0a7020bf51da" (UID: "37c61481-7609-4933-959f-0a7020bf51da"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 02:08:29.185347 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:29.185266    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/112c8e27-0669-48ae-9306-a0ad31681434-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "112c8e27-0669-48ae-9306-a0ad31681434" (UID: "112c8e27-0669-48ae-9306-a0ad31681434"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 02:08:29.187167 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:29.187044    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/112c8e27-0669-48ae-9306-a0ad31681434-kube-api-access-qj8jq" (OuterVolumeSpecName: "kube-api-access-qj8jq") pod "112c8e27-0669-48ae-9306-a0ad31681434" (UID: "112c8e27-0669-48ae-9306-a0ad31681434"). InnerVolumeSpecName "kube-api-access-qj8jq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 02:08:29.187291 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:29.187268    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37c61481-7609-4933-959f-0a7020bf51da-kube-api-access-cmqrg" (OuterVolumeSpecName: "kube-api-access-cmqrg") pod "37c61481-7609-4933-959f-0a7020bf51da" (UID: "37c61481-7609-4933-959f-0a7020bf51da"). InnerVolumeSpecName "kube-api-access-cmqrg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 02:08:29.285765 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:29.285730    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/37c61481-7609-4933-959f-0a7020bf51da-plugins-config-volume\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 02:08:29.285765 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:29.285757    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/112c8e27-0669-48ae-9306-a0ad31681434-plugins-config-volume\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 02:08:29.285765 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:29.285773    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmqrg\" (UniqueName: \"kubernetes.io/projected/37c61481-7609-4933-959f-0a7020bf51da-kube-api-access-cmqrg\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 02:08:29.285989 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:29.285787    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qj8jq\" (UniqueName: \"kubernetes.io/projected/112c8e27-0669-48ae-9306-a0ad31681434-kube-api-access-qj8jq\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 02:08:29.793252 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:29.793158    2560 generic.go:356] "Generic (PLEG): container finished" podID="37c61481-7609-4933-959f-0a7020bf51da" containerID="451bbbab5919e519ad017d2b75cf97e853b1d21d2c1d37573361f2d13e48c2ae" exitCode=0
Jul 28 02:08:29.793252 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:29.793218    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-49ecf4-5d4f7ddd7b-gdtb2"
Jul 28 02:08:29.793482 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:29.793259    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-49ecf4-5d4f7ddd7b-gdtb2" event={"ID":"37c61481-7609-4933-959f-0a7020bf51da","Type":"ContainerDied","Data":"451bbbab5919e519ad017d2b75cf97e853b1d21d2c1d37573361f2d13e48c2ae"}
Jul 28 02:08:29.793482 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:29.793312    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-49ecf4-5d4f7ddd7b-gdtb2" event={"ID":"37c61481-7609-4933-959f-0a7020bf51da","Type":"ContainerDied","Data":"e0ef72489125f30bf11e986904467c28037b638506e5a96f7f87ae7ceebe4db5"}
Jul 28 02:08:29.793482 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:29.793342    2560 scope.go:117] "RemoveContainer" containerID="451bbbab5919e519ad017d2b75cf97e853b1d21d2c1d37573361f2d13e48c2ae"
Jul 28 02:08:29.794665 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:29.794644    2560 generic.go:356] "Generic (PLEG): container finished" podID="112c8e27-0669-48ae-9306-a0ad31681434" containerID="27e59eb2c0c39fae5d2cfc27013425201e47906b61524b2a5091ddde525b00be" exitCode=0
Jul 28 02:08:29.794769 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:29.794705    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-49ecf4-6dc5c87856-25m8b" event={"ID":"112c8e27-0669-48ae-9306-a0ad31681434","Type":"ContainerDied","Data":"27e59eb2c0c39fae5d2cfc27013425201e47906b61524b2a5091ddde525b00be"}
Jul 28 02:08:29.794769 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:29.794753    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-49ecf4-6dc5c87856-25m8b" event={"ID":"112c8e27-0669-48ae-9306-a0ad31681434","Type":"ContainerDied","Data":"8873742613f5cee6bb97140a6bc642400a8e3c7c1cc00c64e1c6e90fe7163e47"}
Jul 28 02:08:29.794890 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:29.794710    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-49ecf4-6dc5c87856-25m8b"
Jul 28 02:08:29.802278 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:29.802259    2560 scope.go:117] "RemoveContainer" containerID="451bbbab5919e519ad017d2b75cf97e853b1d21d2c1d37573361f2d13e48c2ae"
Jul 28 02:08:29.802550 ip-10-0-131-213 kubenswrapper[2560]: E0728 02:08:29.802525    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"451bbbab5919e519ad017d2b75cf97e853b1d21d2c1d37573361f2d13e48c2ae\": container with ID starting with 451bbbab5919e519ad017d2b75cf97e853b1d21d2c1d37573361f2d13e48c2ae not found: ID does not exist" containerID="451bbbab5919e519ad017d2b75cf97e853b1d21d2c1d37573361f2d13e48c2ae"
Jul 28 02:08:29.802647 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:29.802555    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"451bbbab5919e519ad017d2b75cf97e853b1d21d2c1d37573361f2d13e48c2ae"} err="failed to get container status \"451bbbab5919e519ad017d2b75cf97e853b1d21d2c1d37573361f2d13e48c2ae\": rpc error: code = NotFound desc = could not find container \"451bbbab5919e519ad017d2b75cf97e853b1d21d2c1d37573361f2d13e48c2ae\": container with ID starting with 451bbbab5919e519ad017d2b75cf97e853b1d21d2c1d37573361f2d13e48c2ae not found: ID does not exist"
Jul 28 02:08:29.802647 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:29.802571    2560 scope.go:117] "RemoveContainer" containerID="27e59eb2c0c39fae5d2cfc27013425201e47906b61524b2a5091ddde525b00be"
Jul 28 02:08:29.810750 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:29.810727    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-49ecf4-5d4f7ddd7b-gdtb2"]
Jul 28 02:08:29.811362 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:29.811337    2560 scope.go:117] "RemoveContainer" containerID="27e59eb2c0c39fae5d2cfc27013425201e47906b61524b2a5091ddde525b00be"
Jul 28 02:08:29.811603 ip-10-0-131-213 kubenswrapper[2560]: E0728 02:08:29.811587    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27e59eb2c0c39fae5d2cfc27013425201e47906b61524b2a5091ddde525b00be\": container with ID starting with 27e59eb2c0c39fae5d2cfc27013425201e47906b61524b2a5091ddde525b00be not found: ID does not exist" containerID="27e59eb2c0c39fae5d2cfc27013425201e47906b61524b2a5091ddde525b00be"
Jul 28 02:08:29.811685 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:29.811609    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27e59eb2c0c39fae5d2cfc27013425201e47906b61524b2a5091ddde525b00be"} err="failed to get container status \"27e59eb2c0c39fae5d2cfc27013425201e47906b61524b2a5091ddde525b00be\": rpc error: code = NotFound desc = could not find container \"27e59eb2c0c39fae5d2cfc27013425201e47906b61524b2a5091ddde525b00be\": container with ID starting with 27e59eb2c0c39fae5d2cfc27013425201e47906b61524b2a5091ddde525b00be not found: ID does not exist"
Jul 28 02:08:29.816706 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:29.816682    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-49ecf4-5d4f7ddd7b-gdtb2"]
Jul 28 02:08:29.832776 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:29.832755    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-49ecf4-6dc5c87856-25m8b"]
Jul 28 02:08:29.836480 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:29.836454    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-49ecf4-6dc5c87856-25m8b"]
Jul 28 02:08:30.100919 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:30.100826    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:08:31.460895 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:31.460864    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="112c8e27-0669-48ae-9306-a0ad31681434" path="/var/lib/kubelet/pods/112c8e27-0669-48ae-9306-a0ad31681434/volumes"
Jul 28 02:08:31.461281 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:31.461233    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37c61481-7609-4933-959f-0a7020bf51da" path="/var/lib/kubelet/pods/37c61481-7609-4933-959f-0a7020bf51da/volumes"
Jul 28 02:08:34.913390 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:34.913338    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:08:40.999994 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:08:40.999963    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 02:09:11.885555 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:11.885522    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:09:12.200629 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:12.200535    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:09:17.974279 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:17.974239    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:09:18.075256 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:18.075217    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:09:18.260880 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:18.260799    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:09:18.493750 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:18.493716    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:09:29.278523 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:29.278486    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:09:29.315971 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:29.315940    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-e0a963-6f8fdb45bd-gv8nw"]
Jul 28 02:09:29.316218 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:29.316188    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-e0a963-6f8fdb45bd-gv8nw" podUID="7c8aec96-4778-4044-b6a6-074f0c12071a" containerName="payload-processing" containerID="cri-o://b3792d0273a4ef677717088756d505535a35ff16a9ac28ba89e382e957826dd6" gracePeriod=30
Jul 28 02:09:29.322482 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:29.322456    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-e0a963-b48598fb-lxqxt"]
Jul 28 02:09:29.322706 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:29.322679    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e0a963-b48598fb-lxqxt" podUID="6244c388-de30-4e3a-81f6-6e795d4c7134" containerName="payload-pre-processing" containerID="cri-o://b9c38ba080eecffa08cc66f26f010fbaf932cf142206774163cfc415236cd5ff" gracePeriod=30
Jul 28 02:09:29.356514 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:29.356483    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:09:29.413177 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:29.413144    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:09:29.582633 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:29.582609    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-e0a963-6f8fdb45bd-gv8nw"
Jul 28 02:09:29.605822 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:29.605799    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e0a963-b48598fb-lxqxt"
Jul 28 02:09:29.628744 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:29.628717    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4766\" (UniqueName: \"kubernetes.io/projected/7c8aec96-4778-4044-b6a6-074f0c12071a-kube-api-access-k4766\") pod \"7c8aec96-4778-4044-b6a6-074f0c12071a\" (UID: \"7c8aec96-4778-4044-b6a6-074f0c12071a\") "
Jul 28 02:09:29.628902 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:29.628758    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c8aec96-4778-4044-b6a6-074f0c12071a-plugins-config-volume\") pod \"7c8aec96-4778-4044-b6a6-074f0c12071a\" (UID: \"7c8aec96-4778-4044-b6a6-074f0c12071a\") "
Jul 28 02:09:29.629133 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:29.629111    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c8aec96-4778-4044-b6a6-074f0c12071a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7c8aec96-4778-4044-b6a6-074f0c12071a" (UID: "7c8aec96-4778-4044-b6a6-074f0c12071a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 02:09:29.630819 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:29.630799    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c8aec96-4778-4044-b6a6-074f0c12071a-kube-api-access-k4766" (OuterVolumeSpecName: "kube-api-access-k4766") pod "7c8aec96-4778-4044-b6a6-074f0c12071a" (UID: "7c8aec96-4778-4044-b6a6-074f0c12071a"). InnerVolumeSpecName "kube-api-access-k4766". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 02:09:29.729882 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:29.729848    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qnz6\" (UniqueName: \"kubernetes.io/projected/6244c388-de30-4e3a-81f6-6e795d4c7134-kube-api-access-5qnz6\") pod \"6244c388-de30-4e3a-81f6-6e795d4c7134\" (UID: \"6244c388-de30-4e3a-81f6-6e795d4c7134\") "
Jul 28 02:09:29.730052 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:29.729984    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6244c388-de30-4e3a-81f6-6e795d4c7134-plugins-config-volume\") pod \"6244c388-de30-4e3a-81f6-6e795d4c7134\" (UID: \"6244c388-de30-4e3a-81f6-6e795d4c7134\") "
Jul 28 02:09:29.730248 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:29.730230    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4766\" (UniqueName: \"kubernetes.io/projected/7c8aec96-4778-4044-b6a6-074f0c12071a-kube-api-access-k4766\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 02:09:29.730312 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:29.730253    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c8aec96-4778-4044-b6a6-074f0c12071a-plugins-config-volume\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 02:09:29.730374 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:29.730307    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6244c388-de30-4e3a-81f6-6e795d4c7134-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6244c388-de30-4e3a-81f6-6e795d4c7134" (UID: "6244c388-de30-4e3a-81f6-6e795d4c7134"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 02:09:29.731824 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:29.731805    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6244c388-de30-4e3a-81f6-6e795d4c7134-kube-api-access-5qnz6" (OuterVolumeSpecName: "kube-api-access-5qnz6") pod "6244c388-de30-4e3a-81f6-6e795d4c7134" (UID: "6244c388-de30-4e3a-81f6-6e795d4c7134"). InnerVolumeSpecName "kube-api-access-5qnz6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 02:09:29.831698 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:29.831612    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6244c388-de30-4e3a-81f6-6e795d4c7134-plugins-config-volume\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 02:09:29.831698 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:29.831643    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qnz6\" (UniqueName: \"kubernetes.io/projected/6244c388-de30-4e3a-81f6-6e795d4c7134-kube-api-access-5qnz6\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 02:09:30.096799 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:30.096707    2560 generic.go:356] "Generic (PLEG): container finished" podID="7c8aec96-4778-4044-b6a6-074f0c12071a" containerID="b3792d0273a4ef677717088756d505535a35ff16a9ac28ba89e382e957826dd6" exitCode=0
Jul 28 02:09:30.096799 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:30.096751    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-e0a963-6f8fdb45bd-gv8nw"
Jul 28 02:09:30.097038 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:30.096796    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-e0a963-6f8fdb45bd-gv8nw" event={"ID":"7c8aec96-4778-4044-b6a6-074f0c12071a","Type":"ContainerDied","Data":"b3792d0273a4ef677717088756d505535a35ff16a9ac28ba89e382e957826dd6"}
Jul 28 02:09:30.097038 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:30.096890    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-e0a963-6f8fdb45bd-gv8nw" event={"ID":"7c8aec96-4778-4044-b6a6-074f0c12071a","Type":"ContainerDied","Data":"37e464f08df05916d5b21251e1b850410bcbeb78fd96cc0f8d1c248843a3c064"}
Jul 28 02:09:30.097038 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:30.096923    2560 scope.go:117] "RemoveContainer" containerID="b3792d0273a4ef677717088756d505535a35ff16a9ac28ba89e382e957826dd6"
Jul 28 02:09:30.098163 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:30.098141    2560 generic.go:356] "Generic (PLEG): container finished" podID="6244c388-de30-4e3a-81f6-6e795d4c7134" containerID="b9c38ba080eecffa08cc66f26f010fbaf932cf142206774163cfc415236cd5ff" exitCode=0
Jul 28 02:09:30.098260 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:30.098180    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e0a963-b48598fb-lxqxt"
Jul 28 02:09:30.098260 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:30.098179    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e0a963-b48598fb-lxqxt" event={"ID":"6244c388-de30-4e3a-81f6-6e795d4c7134","Type":"ContainerDied","Data":"b9c38ba080eecffa08cc66f26f010fbaf932cf142206774163cfc415236cd5ff"}
Jul 28 02:09:30.098345 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:30.098300    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-e0a963-b48598fb-lxqxt" event={"ID":"6244c388-de30-4e3a-81f6-6e795d4c7134","Type":"ContainerDied","Data":"fdf0984da4324582b5d521f374d226c379804c970ad606ea0127583ea31f321e"}
Jul 28 02:09:30.106306 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:30.106286    2560 scope.go:117] "RemoveContainer" containerID="b3792d0273a4ef677717088756d505535a35ff16a9ac28ba89e382e957826dd6"
Jul 28 02:09:30.106595 ip-10-0-131-213 kubenswrapper[2560]: E0728 02:09:30.106577    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3792d0273a4ef677717088756d505535a35ff16a9ac28ba89e382e957826dd6\": container with ID starting with b3792d0273a4ef677717088756d505535a35ff16a9ac28ba89e382e957826dd6 not found: ID does not exist" containerID="b3792d0273a4ef677717088756d505535a35ff16a9ac28ba89e382e957826dd6"
Jul 28 02:09:30.106659 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:30.106604    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3792d0273a4ef677717088756d505535a35ff16a9ac28ba89e382e957826dd6"} err="failed to get container status \"b3792d0273a4ef677717088756d505535a35ff16a9ac28ba89e382e957826dd6\": rpc error: code = NotFound desc = could not find container \"b3792d0273a4ef677717088756d505535a35ff16a9ac28ba89e382e957826dd6\": container with ID starting with b3792d0273a4ef677717088756d505535a35ff16a9ac28ba89e382e957826dd6 not found: ID does not exist"
Jul 28 02:09:30.106659 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:30.106623    2560 scope.go:117] "RemoveContainer" containerID="b9c38ba080eecffa08cc66f26f010fbaf932cf142206774163cfc415236cd5ff"
Jul 28 02:09:30.114577 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:30.114549    2560 scope.go:117] "RemoveContainer" containerID="b9c38ba080eecffa08cc66f26f010fbaf932cf142206774163cfc415236cd5ff"
Jul 28 02:09:30.114808 ip-10-0-131-213 kubenswrapper[2560]: E0728 02:09:30.114790    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9c38ba080eecffa08cc66f26f010fbaf932cf142206774163cfc415236cd5ff\": container with ID starting with b9c38ba080eecffa08cc66f26f010fbaf932cf142206774163cfc415236cd5ff not found: ID does not exist" containerID="b9c38ba080eecffa08cc66f26f010fbaf932cf142206774163cfc415236cd5ff"
Jul 28 02:09:30.114857 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:30.114817    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9c38ba080eecffa08cc66f26f010fbaf932cf142206774163cfc415236cd5ff"} err="failed to get container status \"b9c38ba080eecffa08cc66f26f010fbaf932cf142206774163cfc415236cd5ff\": rpc error: code = NotFound desc = could not find container \"b9c38ba080eecffa08cc66f26f010fbaf932cf142206774163cfc415236cd5ff\": container with ID starting with b9c38ba080eecffa08cc66f26f010fbaf932cf142206774163cfc415236cd5ff not found: ID does not exist"
Jul 28 02:09:30.122453 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:30.122423    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-e0a963-6f8fdb45bd-gv8nw"]
Jul 28 02:09:30.124196 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:30.124177    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-e0a963-6f8fdb45bd-gv8nw"]
Jul 28 02:09:30.139220 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:30.139197    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-e0a963-b48598fb-lxqxt"]
Jul 28 02:09:30.141780 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:30.141760    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-e0a963-b48598fb-lxqxt"]
Jul 28 02:09:31.460980 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:31.460953    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6244c388-de30-4e3a-81f6-6e795d4c7134" path="/var/lib/kubelet/pods/6244c388-de30-4e3a-81f6-6e795d4c7134/volumes"
Jul 28 02:09:31.461370 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:31.461289    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c8aec96-4778-4044-b6a6-074f0c12071a" path="/var/lib/kubelet/pods/7c8aec96-4778-4044-b6a6-074f0c12071a/volumes"
Jul 28 02:09:32.780161 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:32.780119    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 02:09:33.738987 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:33.738953    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:09:34.112846 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:34.112812    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:09:41.490719 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:41.490634    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:09:41.590625 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:41.590588    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:09:52.906631 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:52.906599    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:09:52.934175 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:52.934141    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-dfed9b-5d44bd4b5d-9qgj2"]
Jul 28 02:09:52.934438 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:52.934408    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-dfed9b-5d44bd4b5d-9qgj2" podUID="d6084f1f-5b88-4aa9-b041-341e9894a515" containerName="payload-processing" containerID="cri-o://85895f2ac75b41c912c14ad70bee42c6c5f4e27fe01ec4aeaf66f67b8629b022" gracePeriod=30
Jul 28 02:09:52.942917 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:52.942883    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-dfed9b-5894dc8fcb-g82dr"]
Jul 28 02:09:52.943189 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:52.943116    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-dfed9b-5894dc8fcb-g82dr" podUID="4c6b29f7-8e4b-410b-91ce-e30dbe1137e2" containerName="payload-pre-processing" containerID="cri-o://3b069376e6a7afb62329541afd945a4088f4bfe0ce66d66c3ca3d7fa8c806901" gracePeriod=30
Jul 28 02:09:52.978726 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:52.978693    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:09:53.038386 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:53.038333    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:09:53.213674 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:53.213648    2560 generic.go:356] "Generic (PLEG): container finished" podID="4c6b29f7-8e4b-410b-91ce-e30dbe1137e2" containerID="3b069376e6a7afb62329541afd945a4088f4bfe0ce66d66c3ca3d7fa8c806901" exitCode=0
Jul 28 02:09:53.213806 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:53.213717    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-dfed9b-5894dc8fcb-g82dr" event={"ID":"4c6b29f7-8e4b-410b-91ce-e30dbe1137e2","Type":"ContainerDied","Data":"3b069376e6a7afb62329541afd945a4088f4bfe0ce66d66c3ca3d7fa8c806901"}
Jul 28 02:09:53.213806 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:53.213775    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-dfed9b-5894dc8fcb-g82dr" event={"ID":"4c6b29f7-8e4b-410b-91ce-e30dbe1137e2","Type":"ContainerDied","Data":"e27e4f1102ec0a2069410c21845c5b22590b906bd0343bae0d226dedcf03d4e7"}
Jul 28 02:09:53.213806 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:53.213799    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e27e4f1102ec0a2069410c21845c5b22590b906bd0343bae0d226dedcf03d4e7"
Jul 28 02:09:53.214765 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:53.214737    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-dfed9b-5d44bd4b5d-9qgj2"
Jul 28 02:09:53.215027 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:53.215008    2560 generic.go:356] "Generic (PLEG): container finished" podID="d6084f1f-5b88-4aa9-b041-341e9894a515" containerID="85895f2ac75b41c912c14ad70bee42c6c5f4e27fe01ec4aeaf66f67b8629b022" exitCode=0
Jul 28 02:09:53.215133 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:53.215039    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-dfed9b-5d44bd4b5d-9qgj2" event={"ID":"d6084f1f-5b88-4aa9-b041-341e9894a515","Type":"ContainerDied","Data":"85895f2ac75b41c912c14ad70bee42c6c5f4e27fe01ec4aeaf66f67b8629b022"}
Jul 28 02:09:53.215133 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:53.215078    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-dfed9b-5d44bd4b5d-9qgj2" event={"ID":"d6084f1f-5b88-4aa9-b041-341e9894a515","Type":"ContainerDied","Data":"34f8bd2b5ab26a1642df46450460b6f2df8a327c70d4c36d7af30ad07cba74a8"}
Jul 28 02:09:53.215133 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:53.215105    2560 scope.go:117] "RemoveContainer" containerID="85895f2ac75b41c912c14ad70bee42c6c5f4e27fe01ec4aeaf66f67b8629b022"
Jul 28 02:09:53.217951 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:53.217935    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-dfed9b-5894dc8fcb-g82dr"
Jul 28 02:09:53.226587 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:53.226569    2560 scope.go:117] "RemoveContainer" containerID="85895f2ac75b41c912c14ad70bee42c6c5f4e27fe01ec4aeaf66f67b8629b022"
Jul 28 02:09:53.226880 ip-10-0-131-213 kubenswrapper[2560]: E0728 02:09:53.226856    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85895f2ac75b41c912c14ad70bee42c6c5f4e27fe01ec4aeaf66f67b8629b022\": container with ID starting with 85895f2ac75b41c912c14ad70bee42c6c5f4e27fe01ec4aeaf66f67b8629b022 not found: ID does not exist" containerID="85895f2ac75b41c912c14ad70bee42c6c5f4e27fe01ec4aeaf66f67b8629b022"
Jul 28 02:09:53.226962 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:53.226901    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85895f2ac75b41c912c14ad70bee42c6c5f4e27fe01ec4aeaf66f67b8629b022"} err="failed to get container status \"85895f2ac75b41c912c14ad70bee42c6c5f4e27fe01ec4aeaf66f67b8629b022\": rpc error: code = NotFound desc = could not find container \"85895f2ac75b41c912c14ad70bee42c6c5f4e27fe01ec4aeaf66f67b8629b022\": container with ID starting with 85895f2ac75b41c912c14ad70bee42c6c5f4e27fe01ec4aeaf66f67b8629b022 not found: ID does not exist"
Jul 28 02:09:53.348307 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:53.348271    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c6b29f7-8e4b-410b-91ce-e30dbe1137e2-plugins-config-volume\") pod \"4c6b29f7-8e4b-410b-91ce-e30dbe1137e2\" (UID: \"4c6b29f7-8e4b-410b-91ce-e30dbe1137e2\") "
Jul 28 02:09:53.348514 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:53.348327    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6084f1f-5b88-4aa9-b041-341e9894a515-plugins-config-volume\") pod \"d6084f1f-5b88-4aa9-b041-341e9894a515\" (UID: \"d6084f1f-5b88-4aa9-b041-341e9894a515\") "
Jul 28 02:09:53.348514 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:53.348457    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrfjj\" (UniqueName: \"kubernetes.io/projected/4c6b29f7-8e4b-410b-91ce-e30dbe1137e2-kube-api-access-hrfjj\") pod \"4c6b29f7-8e4b-410b-91ce-e30dbe1137e2\" (UID: \"4c6b29f7-8e4b-410b-91ce-e30dbe1137e2\") "
Jul 28 02:09:53.348514 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:53.348501    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-74vzt\" (UniqueName: \"kubernetes.io/projected/d6084f1f-5b88-4aa9-b041-341e9894a515-kube-api-access-74vzt\") pod \"d6084f1f-5b88-4aa9-b041-341e9894a515\" (UID: \"d6084f1f-5b88-4aa9-b041-341e9894a515\") "
Jul 28 02:09:53.348703 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:53.348678    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c6b29f7-8e4b-410b-91ce-e30dbe1137e2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4c6b29f7-8e4b-410b-91ce-e30dbe1137e2" (UID: "4c6b29f7-8e4b-410b-91ce-e30dbe1137e2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 02:09:53.348765 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:53.348713    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6084f1f-5b88-4aa9-b041-341e9894a515-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d6084f1f-5b88-4aa9-b041-341e9894a515" (UID: "d6084f1f-5b88-4aa9-b041-341e9894a515"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 02:09:53.350611 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:53.350586    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c6b29f7-8e4b-410b-91ce-e30dbe1137e2-kube-api-access-hrfjj" (OuterVolumeSpecName: "kube-api-access-hrfjj") pod "4c6b29f7-8e4b-410b-91ce-e30dbe1137e2" (UID: "4c6b29f7-8e4b-410b-91ce-e30dbe1137e2"). InnerVolumeSpecName "kube-api-access-hrfjj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 02:09:53.350710 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:53.350693    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6084f1f-5b88-4aa9-b041-341e9894a515-kube-api-access-74vzt" (OuterVolumeSpecName: "kube-api-access-74vzt") pod "d6084f1f-5b88-4aa9-b041-341e9894a515" (UID: "d6084f1f-5b88-4aa9-b041-341e9894a515"). InnerVolumeSpecName "kube-api-access-74vzt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 02:09:53.449712 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:53.449633    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrfjj\" (UniqueName: \"kubernetes.io/projected/4c6b29f7-8e4b-410b-91ce-e30dbe1137e2-kube-api-access-hrfjj\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 02:09:53.449712 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:53.449660    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74vzt\" (UniqueName: \"kubernetes.io/projected/d6084f1f-5b88-4aa9-b041-341e9894a515-kube-api-access-74vzt\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 02:09:53.449712 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:53.449671    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c6b29f7-8e4b-410b-91ce-e30dbe1137e2-plugins-config-volume\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 02:09:53.449712 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:53.449681    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6084f1f-5b88-4aa9-b041-341e9894a515-plugins-config-volume\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 02:09:54.221505 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:54.221476    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-dfed9b-5d44bd4b5d-9qgj2"
Jul 28 02:09:54.221973 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:54.221476    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-dfed9b-5894dc8fcb-g82dr"
Jul 28 02:09:54.240996 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:54.240972    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-dfed9b-5894dc8fcb-g82dr"]
Jul 28 02:09:54.244889 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:54.244869    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-dfed9b-5894dc8fcb-g82dr"]
Jul 28 02:09:54.254606 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:54.254584    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-dfed9b-5d44bd4b5d-9qgj2"]
Jul 28 02:09:54.256120 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:54.256109    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-dfed9b-5d44bd4b5d-9qgj2"]
Jul 28 02:09:55.461190 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:55.461159    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c6b29f7-8e4b-410b-91ce-e30dbe1137e2" path="/var/lib/kubelet/pods/4c6b29f7-8e4b-410b-91ce-e30dbe1137e2/volumes"
Jul 28 02:09:55.461590 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:55.461558    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6084f1f-5b88-4aa9-b041-341e9894a515" path="/var/lib/kubelet/pods/d6084f1f-5b88-4aa9-b041-341e9894a515/volumes"
Jul 28 02:09:56.280388 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:56.280346    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 02:09:56.351819 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:56.351788    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:09:56.703459 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:09:56.703430    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:10:02.789424 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:02.789373    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:10:02.853416 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:02.853387    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:10:03.066473 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:03.066396    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:10:03.275383 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:03.275333    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:10:13.845707 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:13.845665    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:10:13.868722 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:13.868687    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-de398f-75fbd6cf94-bgf4h"]
Jul 28 02:10:13.868959 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:13.868914    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-de398f-75fbd6cf94-bgf4h" podUID="b7871313-1cef-499c-80cb-5aa6aed5f08e" containerName="payload-processing" containerID="cri-o://06bcafa5f3702127ae7d8eb12dca4c6134248e0dfdbd1873630fd70e2e16c09f" gracePeriod=30
Jul 28 02:10:13.879196 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:13.879170    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-de398f-86c69fd664-n59ns"]
Jul 28 02:10:13.879489 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:13.879458    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-de398f-86c69fd664-n59ns" podUID="8c493d4a-34a1-4910-b8da-312676256bac" containerName="payload-pre-processing" containerID="cri-o://7561a6d98aec2b43e6347df8593177b32621520b2efe2b4f89515dc640cbb3bc" gracePeriod=30
Jul 28 02:10:13.943481 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:13.943454    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:10:14.042773 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:14.042702    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:10:14.120841 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:14.120816    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-de398f-75fbd6cf94-bgf4h"
Jul 28 02:10:14.146751 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:14.146729    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-de398f-86c69fd664-n59ns"
Jul 28 02:10:14.233159 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:14.233130    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzw6r\" (UniqueName: \"kubernetes.io/projected/8c493d4a-34a1-4910-b8da-312676256bac-kube-api-access-mzw6r\") pod \"8c493d4a-34a1-4910-b8da-312676256bac\" (UID: \"8c493d4a-34a1-4910-b8da-312676256bac\") "
Jul 28 02:10:14.233298 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:14.233198    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-469ff\" (UniqueName: \"kubernetes.io/projected/b7871313-1cef-499c-80cb-5aa6aed5f08e-kube-api-access-469ff\") pod \"b7871313-1cef-499c-80cb-5aa6aed5f08e\" (UID: \"b7871313-1cef-499c-80cb-5aa6aed5f08e\") "
Jul 28 02:10:14.233398 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:14.233380    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7871313-1cef-499c-80cb-5aa6aed5f08e-plugins-config-volume\") pod \"b7871313-1cef-499c-80cb-5aa6aed5f08e\" (UID: \"b7871313-1cef-499c-80cb-5aa6aed5f08e\") "
Jul 28 02:10:14.233451 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:14.233440    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c493d4a-34a1-4910-b8da-312676256bac-plugins-config-volume\") pod \"8c493d4a-34a1-4910-b8da-312676256bac\" (UID: \"8c493d4a-34a1-4910-b8da-312676256bac\") "
Jul 28 02:10:14.233804 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:14.233772    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7871313-1cef-499c-80cb-5aa6aed5f08e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b7871313-1cef-499c-80cb-5aa6aed5f08e" (UID: "b7871313-1cef-499c-80cb-5aa6aed5f08e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 02:10:14.233804 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:14.233794    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c493d4a-34a1-4910-b8da-312676256bac-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8c493d4a-34a1-4910-b8da-312676256bac" (UID: "8c493d4a-34a1-4910-b8da-312676256bac"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 02:10:14.235333 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:14.235312    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7871313-1cef-499c-80cb-5aa6aed5f08e-kube-api-access-469ff" (OuterVolumeSpecName: "kube-api-access-469ff") pod "b7871313-1cef-499c-80cb-5aa6aed5f08e" (UID: "b7871313-1cef-499c-80cb-5aa6aed5f08e"). InnerVolumeSpecName "kube-api-access-469ff". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 02:10:14.235434 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:14.235370    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c493d4a-34a1-4910-b8da-312676256bac-kube-api-access-mzw6r" (OuterVolumeSpecName: "kube-api-access-mzw6r") pod "8c493d4a-34a1-4910-b8da-312676256bac" (UID: "8c493d4a-34a1-4910-b8da-312676256bac"). InnerVolumeSpecName "kube-api-access-mzw6r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 02:10:14.319246 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:14.319215    2560 generic.go:356] "Generic (PLEG): container finished" podID="b7871313-1cef-499c-80cb-5aa6aed5f08e" containerID="06bcafa5f3702127ae7d8eb12dca4c6134248e0dfdbd1873630fd70e2e16c09f" exitCode=0
Jul 28 02:10:14.319382 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:14.319254    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-de398f-75fbd6cf94-bgf4h"
Jul 28 02:10:14.319382 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:14.319306    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-de398f-75fbd6cf94-bgf4h" event={"ID":"b7871313-1cef-499c-80cb-5aa6aed5f08e","Type":"ContainerDied","Data":"06bcafa5f3702127ae7d8eb12dca4c6134248e0dfdbd1873630fd70e2e16c09f"}
Jul 28 02:10:14.319382 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:14.319372    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-de398f-75fbd6cf94-bgf4h" event={"ID":"b7871313-1cef-499c-80cb-5aa6aed5f08e","Type":"ContainerDied","Data":"704e589071f5d9d7b2a58933eaa1e5283faabd1eea69166953040699048ac442"}
Jul 28 02:10:14.319537 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:14.319408    2560 scope.go:117] "RemoveContainer" containerID="06bcafa5f3702127ae7d8eb12dca4c6134248e0dfdbd1873630fd70e2e16c09f"
Jul 28 02:10:14.320732 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:14.320707    2560 generic.go:356] "Generic (PLEG): container finished" podID="8c493d4a-34a1-4910-b8da-312676256bac" containerID="7561a6d98aec2b43e6347df8593177b32621520b2efe2b4f89515dc640cbb3bc" exitCode=0
Jul 28 02:10:14.320833 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:14.320739    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-de398f-86c69fd664-n59ns"
Jul 28 02:10:14.320833 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:14.320784    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-de398f-86c69fd664-n59ns" event={"ID":"8c493d4a-34a1-4910-b8da-312676256bac","Type":"ContainerDied","Data":"7561a6d98aec2b43e6347df8593177b32621520b2efe2b4f89515dc640cbb3bc"}
Jul 28 02:10:14.320833 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:14.320826    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-de398f-86c69fd664-n59ns" event={"ID":"8c493d4a-34a1-4910-b8da-312676256bac","Type":"ContainerDied","Data":"40bc2f222274d1231f925924aface6908f6b8c55fd93c223b41031d1e6412855"}
Jul 28 02:10:14.328194 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:14.328175    2560 scope.go:117] "RemoveContainer" containerID="06bcafa5f3702127ae7d8eb12dca4c6134248e0dfdbd1873630fd70e2e16c09f"
Jul 28 02:10:14.328453 ip-10-0-131-213 kubenswrapper[2560]: E0728 02:10:14.328435    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06bcafa5f3702127ae7d8eb12dca4c6134248e0dfdbd1873630fd70e2e16c09f\": container with ID starting with 06bcafa5f3702127ae7d8eb12dca4c6134248e0dfdbd1873630fd70e2e16c09f not found: ID does not exist" containerID="06bcafa5f3702127ae7d8eb12dca4c6134248e0dfdbd1873630fd70e2e16c09f"
Jul 28 02:10:14.328542 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:14.328461    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06bcafa5f3702127ae7d8eb12dca4c6134248e0dfdbd1873630fd70e2e16c09f"} err="failed to get container status \"06bcafa5f3702127ae7d8eb12dca4c6134248e0dfdbd1873630fd70e2e16c09f\": rpc error: code = NotFound desc = could not find container \"06bcafa5f3702127ae7d8eb12dca4c6134248e0dfdbd1873630fd70e2e16c09f\": container with ID starting with 06bcafa5f3702127ae7d8eb12dca4c6134248e0dfdbd1873630fd70e2e16c09f not found: ID does not exist"
Jul 28 02:10:14.328542 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:14.328476    2560 scope.go:117] "RemoveContainer" containerID="7561a6d98aec2b43e6347df8593177b32621520b2efe2b4f89515dc640cbb3bc"
Jul 28 02:10:14.335261 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:14.334277    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzw6r\" (UniqueName: \"kubernetes.io/projected/8c493d4a-34a1-4910-b8da-312676256bac-kube-api-access-mzw6r\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 02:10:14.335261 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:14.334583    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-469ff\" (UniqueName: \"kubernetes.io/projected/b7871313-1cef-499c-80cb-5aa6aed5f08e-kube-api-access-469ff\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 02:10:14.339531 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:14.337468    2560 scope.go:117] "RemoveContainer" containerID="7561a6d98aec2b43e6347df8593177b32621520b2efe2b4f89515dc640cbb3bc"
Jul 28 02:10:14.339531 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:14.337505    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7871313-1cef-499c-80cb-5aa6aed5f08e-plugins-config-volume\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 02:10:14.339531 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:14.337532    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c493d4a-34a1-4910-b8da-312676256bac-plugins-config-volume\") on node \"ip-10-0-131-213.ec2.internal\" DevicePath \"\""
Jul 28 02:10:14.339531 ip-10-0-131-213 kubenswrapper[2560]: E0728 02:10:14.337850    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7561a6d98aec2b43e6347df8593177b32621520b2efe2b4f89515dc640cbb3bc\": container with ID starting with 7561a6d98aec2b43e6347df8593177b32621520b2efe2b4f89515dc640cbb3bc not found: ID does not exist" containerID="7561a6d98aec2b43e6347df8593177b32621520b2efe2b4f89515dc640cbb3bc"
Jul 28 02:10:14.339531 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:14.337886    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7561a6d98aec2b43e6347df8593177b32621520b2efe2b4f89515dc640cbb3bc"} err="failed to get container status \"7561a6d98aec2b43e6347df8593177b32621520b2efe2b4f89515dc640cbb3bc\": rpc error: code = NotFound desc = could not find container \"7561a6d98aec2b43e6347df8593177b32621520b2efe2b4f89515dc640cbb3bc\": container with ID starting with 7561a6d98aec2b43e6347df8593177b32621520b2efe2b4f89515dc640cbb3bc not found: ID does not exist"
Jul 28 02:10:14.343949 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:14.343920    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-de398f-75fbd6cf94-bgf4h"]
Jul 28 02:10:14.349884 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:14.349839    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-de398f-75fbd6cf94-bgf4h"]
Jul 28 02:10:14.358894 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:14.358874    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-de398f-86c69fd664-n59ns"]
Jul 28 02:10:14.360637 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:14.360618    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-de398f-86c69fd664-n59ns"]
Jul 28 02:10:15.460217 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:15.460180    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c493d4a-34a1-4910-b8da-312676256bac" path="/var/lib/kubelet/pods/8c493d4a-34a1-4910-b8da-312676256bac/volumes"
Jul 28 02:10:15.460740 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:15.460716    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7871313-1cef-499c-80cb-5aa6aed5f08e" path="/var/lib/kubelet/pods/b7871313-1cef-499c-80cb-5aa6aed5f08e/volumes"
Jul 28 02:10:16.791653 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:16.791611    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pbnq6"]
Jul 28 02:10:18.461458 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:18.461423    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:10:18.835589 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:18.835506    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:10:25.115081 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:25.115046    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:10:25.218033 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:25.217990    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:10:25.374369 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:25.374260    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:10:25.582308 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:25.582281    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:10:25.998595 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:25.998565    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6685467ff7-xh25m_ae2203b8-0a0c-48f2-a975-4a275fc2a061/authorino/0.log"
Jul 28 02:10:31.977805 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:31.977779    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8699bb9d7c-d2zjj_a25965c3-6fb0-49c5-8687-71e8bc483e6a/copy-manifests/0.log"
Jul 28 02:10:31.983842 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:31.983817    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8699bb9d7c-d2zjj_a25965c3-6fb0-49c5-8687-71e8bc483e6a/manager/0.log"
Jul 28 02:10:34.176810 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:34.176779    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6685467ff7-xh25m_ae2203b8-0a0c-48f2-a975-4a275fc2a061/authorino/0.log"
Jul 28 02:10:34.539706 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:34.539622    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-bk8hr_72d18935-5198-4027-9740-a188149598c1/kuadrant-console-plugin/0.log"
Jul 28 02:10:34.894413 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:34.894383    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-pbnq6_6b897c57-2c1f-4d64-986f-d9a5131d2a96/limitador/0.log"
Jul 28 02:10:35.599837 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:35.599807    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78d7d88cc5-jzlr2_b9d52f05-40b4-4104-aecd-b67ed7c54515/kube-auth-proxy/0.log"
Jul 28 02:10:36.049029 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:36.048996    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-npbcz_d87f77ac-c168-4475-a294-e7e43ec47f36/payload-processing/0.log"
Jul 28 02:10:36.613503 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:36.613474    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-4gsrl_373f5530-d48a-4a5d-8961-c3ddccd2d559/main/0.log"
Jul 28 02:10:37.050877 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:37.050788    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-nlrwf_55e57455-0c67-4b50-aeca-83acd5ebe77f/main/0.log"
Jul 28 02:10:37.258176 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:37.258143    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:10:42.197287 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:42.197252    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:10:42.290853 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:42.290823    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:10:44.879967 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:44.879938    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6zht5_4ce4b7c0-28ad-45a2-9fac-0f0704533f48/global-pull-secret-syncer/0.log"
Jul 28 02:10:45.018586 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:45.018557    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log"
Jul 28 02:10:45.128630 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:45.128600    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-213.ec2.internal_c993073e538500ccbf54eb02b12e7dc3/haproxy/0.log"
Jul 28 02:10:49.683982 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:49.683954    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5f2zn_5311b0bc-9ad2-4e2f-bdde-81510c6d6b19/ovn-acl-logging/0.log"
Jul 28 02:10:49.686189 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:49.686167    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5f2zn_5311b0bc-9ad2-4e2f-bdde-81510c6d6b19/ovn-acl-logging/0.log"
Jul 28 02:10:49.869388 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:49.869362    2560 scope.go:117] "RemoveContainer" containerID="3b069376e6a7afb62329541afd945a4088f4bfe0ce66d66c3ca3d7fa8c806901"
Jul 28 02:10:50.188638 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:50.188539    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6685467ff7-xh25m_ae2203b8-0a0c-48f2-a975-4a275fc2a061/authorino/0.log"
Jul 28 02:10:50.275197 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:50.275165    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-bk8hr_72d18935-5198-4027-9740-a188149598c1/kuadrant-console-plugin/0.log"
Jul 28 02:10:50.510104 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:50.510020    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-pbnq6_6b897c57-2c1f-4d64-986f-d9a5131d2a96/limitador/0.log"
Jul 28 02:10:52.375419 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:52.375390    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-b6plq_abc77241-2511-4272-9761-d7e5bd2e6280/kube-state-metrics/0.log"
Jul 28 02:10:52.402184 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:52.402143    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-b6plq_abc77241-2511-4272-9761-d7e5bd2e6280/kube-rbac-proxy-main/0.log"
Jul 28 02:10:52.431748 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:52.431727    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-b6plq_abc77241-2511-4272-9761-d7e5bd2e6280/kube-rbac-proxy-self/0.log"
Jul 28 02:10:52.489518 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:52.489491    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-vdkbt_de8abb0f-f052-4e21-9063-c9028515ad06/monitoring-plugin/0.log"
Jul 28 02:10:52.636464 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:52.636432    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2ftgf_75e27e38-737c-43d8-a1dc-2aec23e71b72/node-exporter/0.log"
Jul 28 02:10:52.661396 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:52.661366    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2ftgf_75e27e38-737c-43d8-a1dc-2aec23e71b72/kube-rbac-proxy/0.log"
Jul 28 02:10:52.684417 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:52.684385    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2ftgf_75e27e38-737c-43d8-a1dc-2aec23e71b72/init-textfile/0.log"
Jul 28 02:10:52.789195 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:52.789169    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-kjcxs_8b1f5138-d6e1-4185-8f07-4e9617e71e7c/kube-rbac-proxy-main/0.log"
Jul 28 02:10:52.810779 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:52.810756    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-kjcxs_8b1f5138-d6e1-4185-8f07-4e9617e71e7c/kube-rbac-proxy-self/0.log"
Jul 28 02:10:52.832064 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:52.832043    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-kjcxs_8b1f5138-d6e1-4185-8f07-4e9617e71e7c/openshift-state-metrics/0.log"
Jul 28 02:10:52.876603 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:52.876576    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_00355b7b-d25e-4adb-86f2-eb1a8733b531/prometheus/0.log"
Jul 28 02:10:52.900406 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:52.900334    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_00355b7b-d25e-4adb-86f2-eb1a8733b531/config-reloader/0.log"
Jul 28 02:10:52.921192 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:52.921170    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_00355b7b-d25e-4adb-86f2-eb1a8733b531/thanos-sidecar/0.log"
Jul 28 02:10:52.941418 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:52.941398    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_00355b7b-d25e-4adb-86f2-eb1a8733b531/kube-rbac-proxy-web/0.log"
Jul 28 02:10:52.963182 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:52.963161    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_00355b7b-d25e-4adb-86f2-eb1a8733b531/kube-rbac-proxy/0.log"
Jul 28 02:10:52.984558 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:52.984537    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_00355b7b-d25e-4adb-86f2-eb1a8733b531/kube-rbac-proxy-thanos/0.log"
Jul 28 02:10:53.006241 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:53.006221    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_00355b7b-d25e-4adb-86f2-eb1a8733b531/init-config-reloader/0.log"
Jul 28 02:10:53.044723 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:53.044700    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-7f4dh_fc1a76fa-db9a-4d4d-904c-e4b8bee35b5d/prometheus-operator/0.log"
Jul 28 02:10:53.066817 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:53.066793    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-7f4dh_fc1a76fa-db9a-4d4d-904c-e4b8bee35b5d/kube-rbac-proxy/0.log"
Jul 28 02:10:53.095772 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:53.095750    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-x5k2b_943b150c-4c16-46d2-bd0c-bd1e4764f073/prometheus-operator-admission-webhook/0.log"
Jul 28 02:10:53.128989 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:53.128965    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6b9546bd79-psxfj_c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c/telemeter-client/0.log"
Jul 28 02:10:53.149259 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:53.149233    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6b9546bd79-psxfj_c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c/reload/0.log"
Jul 28 02:10:53.172974 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:53.172901    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6b9546bd79-psxfj_c2d9500d-0a43-4b3b-a9a6-3bbfc132c73c/kube-rbac-proxy/0.log"
Jul 28 02:10:53.204246 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:53.204219    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d8499cbb6-njhz5_772b4205-7a9a-4667-b44a-52e86906e46b/thanos-query/0.log"
Jul 28 02:10:53.230341 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:53.230306    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d8499cbb6-njhz5_772b4205-7a9a-4667-b44a-52e86906e46b/kube-rbac-proxy-web/0.log"
Jul 28 02:10:53.252219 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:53.252192    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d8499cbb6-njhz5_772b4205-7a9a-4667-b44a-52e86906e46b/kube-rbac-proxy/0.log"
Jul 28 02:10:53.274135 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:53.274109    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d8499cbb6-njhz5_772b4205-7a9a-4667-b44a-52e86906e46b/prom-label-proxy/0.log"
Jul 28 02:10:53.298360 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:53.298322    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d8499cbb6-njhz5_772b4205-7a9a-4667-b44a-52e86906e46b/kube-rbac-proxy-rules/0.log"
Jul 28 02:10:53.330907 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:53.330865    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5d8499cbb6-njhz5_772b4205-7a9a-4667-b44a-52e86906e46b/kube-rbac-proxy-metrics/0.log"
Jul 28 02:10:54.952567 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:54.952535    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wvjdf/perf-node-gather-daemonset-nhfqm"]
Jul 28 02:10:54.952931 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:54.952903    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37c61481-7609-4933-959f-0a7020bf51da" containerName="payload-processing"
Jul 28 02:10:54.952931 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:54.952916    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="37c61481-7609-4933-959f-0a7020bf51da" containerName="payload-processing"
Jul 28 02:10:54.952931 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:54.952925    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="504854a0-91b2-4128-8ef9-00bc10263820" containerName="payload-pre-processing"
Jul 28 02:10:54.952931 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:54.952931    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="504854a0-91b2-4128-8ef9-00bc10263820" containerName="payload-pre-processing"
Jul 28 02:10:54.953114 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:54.952942    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c6b29f7-8e4b-410b-91ce-e30dbe1137e2" containerName="payload-pre-processing"
Jul 28 02:10:54.953114 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:54.952949    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c6b29f7-8e4b-410b-91ce-e30dbe1137e2" containerName="payload-pre-processing"
Jul 28 02:10:54.953114 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:54.952956    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6084f1f-5b88-4aa9-b041-341e9894a515" containerName="payload-processing"
Jul 28 02:10:54.953114 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:54.952962    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6084f1f-5b88-4aa9-b041-341e9894a515" containerName="payload-processing"
Jul 28 02:10:54.953114 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:54.952969    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7871313-1cef-499c-80cb-5aa6aed5f08e" containerName="payload-processing"
Jul 28 02:10:54.953114 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:54.952975    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7871313-1cef-499c-80cb-5aa6aed5f08e" containerName="payload-processing"
Jul 28 02:10:54.953114 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:54.952993    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89a0bf11-342b-43d4-b931-dc14d3a7ac68" containerName="payload-processing"
Jul 28 02:10:54.953114 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:54.952998    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="89a0bf11-342b-43d4-b931-dc14d3a7ac68" containerName="payload-processing"
Jul 28 02:10:54.953114 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:54.953006    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c493d4a-34a1-4910-b8da-312676256bac" containerName="payload-pre-processing"
Jul 28 02:10:54.953114 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:54.953011    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c493d4a-34a1-4910-b8da-312676256bac" containerName="payload-pre-processing"
Jul 28 02:10:54.953114 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:54.953018    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="112c8e27-0669-48ae-9306-a0ad31681434" containerName="payload-pre-processing"
Jul 28 02:10:54.953114 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:54.953024    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="112c8e27-0669-48ae-9306-a0ad31681434" containerName="payload-pre-processing"
Jul 28 02:10:54.953114 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:54.953031    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c8aec96-4778-4044-b6a6-074f0c12071a" containerName="payload-processing"
Jul 28 02:10:54.953114 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:54.953036    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c8aec96-4778-4044-b6a6-074f0c12071a" containerName="payload-processing"
Jul 28 02:10:54.953114 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:54.953042    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6244c388-de30-4e3a-81f6-6e795d4c7134" containerName="payload-pre-processing"
Jul 28 02:10:54.953114 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:54.953047    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6244c388-de30-4e3a-81f6-6e795d4c7134" containerName="payload-pre-processing"
Jul 28 02:10:54.953114 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:54.953100    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c8aec96-4778-4044-b6a6-074f0c12071a" containerName="payload-processing"
Jul 28 02:10:54.953114 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:54.953110    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="37c61481-7609-4933-959f-0a7020bf51da" containerName="payload-processing"
Jul 28 02:10:54.953114 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:54.953115    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="504854a0-91b2-4128-8ef9-00bc10263820" containerName="payload-pre-processing"
Jul 28 02:10:54.953114 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:54.953121    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c6b29f7-8e4b-410b-91ce-e30dbe1137e2" containerName="payload-pre-processing"
Jul 28 02:10:54.954224 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:54.953127    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6244c388-de30-4e3a-81f6-6e795d4c7134" containerName="payload-pre-processing"
Jul 28 02:10:54.954224 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:54.953132    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="89a0bf11-342b-43d4-b931-dc14d3a7ac68" containerName="payload-processing"
Jul 28 02:10:54.954224 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:54.953138    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7871313-1cef-499c-80cb-5aa6aed5f08e" containerName="payload-processing"
Jul 28 02:10:54.954224 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:54.953146    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="112c8e27-0669-48ae-9306-a0ad31681434" containerName="payload-pre-processing"
Jul 28 02:10:54.954224 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:54.953153    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6084f1f-5b88-4aa9-b041-341e9894a515" containerName="payload-processing"
Jul 28 02:10:54.954224 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:54.953166    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c493d4a-34a1-4910-b8da-312676256bac" containerName="payload-pre-processing"
Jul 28 02:10:54.957834 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:54.957816    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-nhfqm"
Jul 28 02:10:54.959722 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:54.959704    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wvjdf\"/\"default-dockercfg-njkfq\""
Jul 28 02:10:54.960160 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:54.960134    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wvjdf\"/\"openshift-service-ca.crt\""
Jul 28 02:10:54.960160 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:54.960145    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wvjdf\"/\"kube-root-ca.crt\""
Jul 28 02:10:54.966954 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:54.966931    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wvjdf/perf-node-gather-daemonset-nhfqm"]
Jul 28 02:10:54.996401 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:54.996376    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/58be68eb-6872-4006-97e9-0ddf0e414a14-proc\") pod \"perf-node-gather-daemonset-nhfqm\" (UID: \"58be68eb-6872-4006-97e9-0ddf0e414a14\") " pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-nhfqm"
Jul 28 02:10:54.996501 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:54.996417    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/58be68eb-6872-4006-97e9-0ddf0e414a14-lib-modules\") pod \"perf-node-gather-daemonset-nhfqm\" (UID: \"58be68eb-6872-4006-97e9-0ddf0e414a14\") " pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-nhfqm"
Jul 28 02:10:54.996501 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:54.996444    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/58be68eb-6872-4006-97e9-0ddf0e414a14-podres\") pod \"perf-node-gather-daemonset-nhfqm\" (UID: \"58be68eb-6872-4006-97e9-0ddf0e414a14\") " pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-nhfqm"
Jul 28 02:10:54.996580 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:54.996518    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58be68eb-6872-4006-97e9-0ddf0e414a14-sys\") pod \"perf-node-gather-daemonset-nhfqm\" (UID: \"58be68eb-6872-4006-97e9-0ddf0e414a14\") " pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-nhfqm"
Jul 28 02:10:54.996580 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:54.996560    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzzx6\" (UniqueName: \"kubernetes.io/projected/58be68eb-6872-4006-97e9-0ddf0e414a14-kube-api-access-zzzx6\") pod \"perf-node-gather-daemonset-nhfqm\" (UID: \"58be68eb-6872-4006-97e9-0ddf0e414a14\") " pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-nhfqm"
Jul 28 02:10:55.097224 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:55.097201    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzzx6\" (UniqueName: \"kubernetes.io/projected/58be68eb-6872-4006-97e9-0ddf0e414a14-kube-api-access-zzzx6\") pod \"perf-node-gather-daemonset-nhfqm\" (UID: \"58be68eb-6872-4006-97e9-0ddf0e414a14\") " pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-nhfqm"
Jul 28 02:10:55.097384 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:55.097247    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/58be68eb-6872-4006-97e9-0ddf0e414a14-proc\") pod \"perf-node-gather-daemonset-nhfqm\" (UID: \"58be68eb-6872-4006-97e9-0ddf0e414a14\") " pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-nhfqm"
Jul 28 02:10:55.097384 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:55.097264    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/58be68eb-6872-4006-97e9-0ddf0e414a14-lib-modules\") pod \"perf-node-gather-daemonset-nhfqm\" (UID: \"58be68eb-6872-4006-97e9-0ddf0e414a14\") " pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-nhfqm"
Jul 28 02:10:55.097384 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:55.097289    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/58be68eb-6872-4006-97e9-0ddf0e414a14-podres\") pod \"perf-node-gather-daemonset-nhfqm\" (UID: \"58be68eb-6872-4006-97e9-0ddf0e414a14\") " pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-nhfqm"
Jul 28 02:10:55.097384 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:55.097345    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/58be68eb-6872-4006-97e9-0ddf0e414a14-proc\") pod \"perf-node-gather-daemonset-nhfqm\" (UID: \"58be68eb-6872-4006-97e9-0ddf0e414a14\") " pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-nhfqm"
Jul 28 02:10:55.097384 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:55.097381    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58be68eb-6872-4006-97e9-0ddf0e414a14-sys\") pod \"perf-node-gather-daemonset-nhfqm\" (UID: \"58be68eb-6872-4006-97e9-0ddf0e414a14\") " pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-nhfqm"
Jul 28 02:10:55.097575 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:55.097423    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/58be68eb-6872-4006-97e9-0ddf0e414a14-lib-modules\") pod \"perf-node-gather-daemonset-nhfqm\" (UID: \"58be68eb-6872-4006-97e9-0ddf0e414a14\") " pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-nhfqm"
Jul 28 02:10:55.097575 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:55.097426    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58be68eb-6872-4006-97e9-0ddf0e414a14-sys\") pod \"perf-node-gather-daemonset-nhfqm\" (UID: \"58be68eb-6872-4006-97e9-0ddf0e414a14\") " pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-nhfqm"
Jul 28 02:10:55.097575 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:55.097463    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/58be68eb-6872-4006-97e9-0ddf0e414a14-podres\") pod \"perf-node-gather-daemonset-nhfqm\" (UID: \"58be68eb-6872-4006-97e9-0ddf0e414a14\") " pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-nhfqm"
Jul 28 02:10:55.105382 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:55.105363    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzzx6\" (UniqueName: \"kubernetes.io/projected/58be68eb-6872-4006-97e9-0ddf0e414a14-kube-api-access-zzzx6\") pod \"perf-node-gather-daemonset-nhfqm\" (UID: \"58be68eb-6872-4006-97e9-0ddf0e414a14\") " pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-nhfqm"
Jul 28 02:10:55.268611 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:55.268525    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-nhfqm"
Jul 28 02:10:55.392843 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:55.392817    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wvjdf/perf-node-gather-daemonset-nhfqm"]
Jul 28 02:10:55.394885 ip-10-0-131-213 kubenswrapper[2560]: W0728 02:10:55.394856    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod58be68eb_6872_4006_97e9_0ddf0e414a14.slice/crio-5797083c07b3bbdfa9fdd16ddceed63060791ddfab64b15d87d12b769207fe95 WatchSource:0}: Error finding container 5797083c07b3bbdfa9fdd16ddceed63060791ddfab64b15d87d12b769207fe95: Status 404 returned error can't find the container with id 5797083c07b3bbdfa9fdd16ddceed63060791ddfab64b15d87d12b769207fe95
Jul 28 02:10:55.525839 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:55.525811    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-nhfqm" event={"ID":"58be68eb-6872-4006-97e9-0ddf0e414a14","Type":"ContainerStarted","Data":"5797083c07b3bbdfa9fdd16ddceed63060791ddfab64b15d87d12b769207fe95"}
Jul 28 02:10:55.756318 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:55.756275    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-55b684c997-2x47v_2a4466dc-70e5-4937-850d-5d319ac57e09/console/0.log"
Jul 28 02:10:55.789403 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:55.789327    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-9w2lz_6c595db5-126c-4167-b469-79b610bf05d6/download-server/0.log"
Jul 28 02:10:55.943253 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:55.943220    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:10:56.043195 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:56.043112    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8qwdd_130e33f6-0aa5-4931-9754-8cbfef50cd05/konnectivity-agent/0.log" limit=1024
Jul 28 02:10:56.532495 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:56.532461    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-nhfqm" event={"ID":"58be68eb-6872-4006-97e9-0ddf0e414a14","Type":"ContainerStarted","Data":"f804d15357712158246eaf51d9e830a547925ce07985f0b949a54d0883b01af2"}
Jul 28 02:10:56.532801 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:56.532581    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-nhfqm"
Jul 28 02:10:56.549443 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:56.549387    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-nhfqm" podStartSLOduration=2.549372144 podStartE2EDuration="2.549372144s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 02:10:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 02:10:56.54706463 +0000 UTC m=+3307.581108022" watchObservedRunningTime="2026-07-28 02:10:56.549372144 +0000 UTC m=+3307.583415515"
Jul 28 02:10:57.520848 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:57.520790    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4c79m_42b07623-989a-4062-b97d-17321ae05e82/dns/0.log"
Jul 28 02:10:57.544639 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:57.544610    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4c79m_42b07623-989a-4062-b97d-17321ae05e82/kube-rbac-proxy/0.log"
Jul 28 02:10:57.663705 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:57.663674    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q6x4f_acb1d898-a0fc-45e9-a715-67dc3301b622/dns-node-resolver/0.log"
Jul 28 02:10:58.297466 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:58.297434    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l6jcf_ee785053-e88b-44ef-a5cb-659eaa15ed7b/node-ca/0.log"
Jul 28 02:10:59.585994 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:59.585955    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78d7d88cc5-jzlr2_b9d52f05-40b4-4104-aecd-b67ed7c54515/kube-auth-proxy/0.log"
Jul 28 02:10:59.758925 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:10:59.758899    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-npbcz_d87f77ac-c168-4475-a294-e7e43ec47f36/payload-processing/0.log"
Jul 28 02:11:00.590389 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:11:00.590361    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d4gsq_a5a1bd68-3c13-4064-88cd-176ad3ef9e5f/serve-healthcheck-canary/0.log"
Jul 28 02:11:01.155917 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:11:01.155886    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qth82_94293167-f740-4904-8546-ba172bfc26c9/kube-rbac-proxy/0.log"
Jul 28 02:11:01.179283 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:11:01.179256    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qth82_94293167-f740-4904-8546-ba172bfc26c9/exporter/0.log"
Jul 28 02:11:01.207997 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:11:01.207970    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qth82_94293167-f740-4904-8546-ba172bfc26c9/extractor/0.log"
Jul 28 02:11:02.546697 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:11:02.546671    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wvjdf/perf-node-gather-daemonset-nhfqm"
Jul 28 02:11:04.406707 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:11:04.406680    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8699bb9d7c-d2zjj_a25965c3-6fb0-49c5-8687-71e8bc483e6a/manager/0.log"
Jul 28 02:11:04.429664 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:11:04.429640    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8699bb9d7c-d2zjj_a25965c3-6fb0-49c5-8687-71e8bc483e6a/copy-manifests/0.log"
Jul 28 02:11:05.607890 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:11:05.607859    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78d7d88cc5-jzlr2_b9d52f05-40b4-4104-aecd-b67ed7c54515/kube-auth-proxy/0.log"
Jul 28 02:11:05.724997 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:11:05.724956    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-npbcz_d87f77ac-c168-4475-a294-e7e43ec47f36/payload-processing/0.log"
Jul 28 02:11:05.790403 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:11:05.790378    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7d7cccf554-vd84j_596d9057-fbd0-4e06-be07-d386998f654f/manager/0.log"
Jul 28 02:11:05.819476 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:11:05.819451    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-649qs_4702e965-7060-44d2-a557-24b09dbac2c9/openshift-lws-operator/0.log"
Jul 28 02:11:07.428334 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:11:07.428293    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78d7d88cc5-jzlr2_b9d52f05-40b4-4104-aecd-b67ed7c54515/kube-auth-proxy/0.log"
Jul 28 02:11:07.563001 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:11:07.562965    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-npbcz_d87f77ac-c168-4475-a294-e7e43ec47f36/payload-processing/0.log"
Jul 28 02:11:12.374185 ip-10-0-131-213 kubenswrapper[2560]: I0728 02:11:12.374152    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bjmmc_4543a9b5-cb95-4e16-8239-6dac004c306d/kube-multus-additional-cni-plugins/0.log"