Jul 24 17:03:29.053986 ip-10-0-134-152 systemd[1]: Starting Kubernetes Kubelet...
Jul 24 17:03:29.491778 ip-10-0-134-152 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 17:03:29.491778 ip-10-0-134-152 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 24 17:03:29.491778 ip-10-0-134-152 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 17:03:29.491778 ip-10-0-134-152 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 24 17:03:29.491778 ip-10-0-134-152 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 17:03:29.493242 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.493148    2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 24 17:03:29.499273 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499249    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 17:03:29.499273 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499268    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 17:03:29.499273 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499273    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 17:03:29.499273 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499278    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 17:03:29.499273 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499282    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 17:03:29.499567 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499286    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 17:03:29.499567 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499290    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 17:03:29.499567 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499294    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 17:03:29.499567 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499298    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 17:03:29.499567 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499302    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 17:03:29.499567 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499305    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 17:03:29.499567 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499309    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 17:03:29.499567 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499312    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 17:03:29.499567 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499316    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 17:03:29.499567 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499320    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 17:03:29.499567 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499324    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 17:03:29.499567 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499328    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 17:03:29.499567 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499332    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 17:03:29.499567 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499335    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 17:03:29.499567 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499339    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 17:03:29.499567 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499350    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 17:03:29.499567 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499356    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 17:03:29.499567 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499359    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 17:03:29.499567 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499363    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 17:03:29.499567 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499368    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 17:03:29.500416 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499372    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 17:03:29.500416 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499376    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 17:03:29.500416 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499380    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 17:03:29.500416 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499384    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 17:03:29.500416 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499388    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 17:03:29.500416 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499392    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 17:03:29.500416 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499396    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 17:03:29.500416 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499400    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 17:03:29.500416 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499404    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 17:03:29.500416 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499408    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 17:03:29.500416 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499412    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 17:03:29.500416 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499419    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 17:03:29.500416 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499423    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 17:03:29.500416 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499427    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 17:03:29.500416 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499432    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 17:03:29.500416 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499436    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 17:03:29.500416 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499440    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 17:03:29.500416 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499444    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 17:03:29.500416 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499449    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 17:03:29.500416 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499453    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 17:03:29.501336 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499458    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 17:03:29.501336 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499462    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 17:03:29.501336 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499469    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 17:03:29.501336 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499476    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 17:03:29.501336 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499481    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 17:03:29.501336 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499485    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 17:03:29.501336 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499490    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 17:03:29.501336 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499494    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 17:03:29.501336 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499499    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 17:03:29.501336 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499504    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 17:03:29.501336 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499508    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 17:03:29.501336 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499513    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 17:03:29.501336 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499517    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 17:03:29.501336 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499524    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 17:03:29.501336 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499530    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 17:03:29.501336 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499535    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 17:03:29.501336 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499540    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 17:03:29.501336 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499544    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 17:03:29.501336 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499549    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 17:03:29.502157 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499554    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 17:03:29.502157 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499559    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 17:03:29.502157 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499564    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 17:03:29.502157 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499568    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 17:03:29.502157 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499573    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 17:03:29.502157 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499578    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 17:03:29.502157 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499583    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 17:03:29.502157 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499587    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 17:03:29.502157 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499592    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 17:03:29.502157 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499596    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 17:03:29.502157 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499600    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 17:03:29.502157 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499604    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 17:03:29.502157 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499609    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 17:03:29.502157 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499613    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 17:03:29.502157 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499617    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 17:03:29.502157 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499622    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 17:03:29.502157 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499626    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 17:03:29.502157 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499630    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 17:03:29.502157 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499642    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 17:03:29.503016 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499646    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 17:03:29.503016 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499651    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 17:03:29.503016 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499655    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 17:03:29.503016 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499659    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 17:03:29.503016 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499663    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 17:03:29.503016 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499682    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 17:03:29.503016 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499686    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 17:03:29.503016 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499690    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 17:03:29.503016 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499694    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 17:03:29.503016 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499698    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 17:03:29.503016 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499703    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 17:03:29.503016 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499707    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 17:03:29.503016 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499710    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 17:03:29.503016 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499717    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 17:03:29.503016 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499722    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 17:03:29.503016 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.499728    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 17:03:29.503016 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.500881    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 17:03:29.503016 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.500892    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 17:03:29.503016 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.500896    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 17:03:29.503016 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.500902    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 17:03:29.503737 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.500906    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 17:03:29.503737 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.500913    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 17:03:29.503737 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.500919    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 17:03:29.503737 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.500924    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 17:03:29.503737 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.500930    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 17:03:29.503737 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.500935    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 17:03:29.503737 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.500939    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 17:03:29.503737 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.500943    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 17:03:29.503737 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.500947    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 17:03:29.503737 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.500953    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 17:03:29.503737 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.500957    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 17:03:29.503737 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.500962    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 17:03:29.503737 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.500966    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 17:03:29.503737 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.500970    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 17:03:29.503737 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.500974    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 17:03:29.503737 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.500978    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 17:03:29.503737 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.500985    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 17:03:29.503737 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.500990    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 17:03:29.503737 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.500995    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 17:03:29.504223 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.500999    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 17:03:29.504223 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501003    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 17:03:29.504223 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501007    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 17:03:29.504223 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501011    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 17:03:29.504223 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501015    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 17:03:29.504223 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501019    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 17:03:29.504223 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501023    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 17:03:29.504223 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501030    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 17:03:29.504223 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501036    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 17:03:29.504223 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501041    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 17:03:29.504223 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501046    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 17:03:29.504223 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501050    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 17:03:29.504223 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501055    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 17:03:29.504223 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501059    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 17:03:29.504223 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501063    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 17:03:29.504223 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501067    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 17:03:29.504223 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501073    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 17:03:29.504223 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501077    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 17:03:29.504223 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501081    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 17:03:29.504724 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501086    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 17:03:29.504724 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501091    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 17:03:29.504724 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501096    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 17:03:29.504724 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501100    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 17:03:29.504724 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501106    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 17:03:29.504724 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501110    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 17:03:29.504724 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501142    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 17:03:29.504724 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501149    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 17:03:29.504724 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501153    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 17:03:29.504724 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501158    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 17:03:29.504724 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501166    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 17:03:29.504724 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501172    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 17:03:29.504724 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501176    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 17:03:29.504724 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501180    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 17:03:29.504724 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501185    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 17:03:29.504724 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501189    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 17:03:29.504724 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501193    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 17:03:29.504724 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501197    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 17:03:29.504724 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501201    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 17:03:29.505193 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501205    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 17:03:29.505193 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501209    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 17:03:29.505193 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501213    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 17:03:29.505193 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501218    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 17:03:29.505193 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501223    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 17:03:29.505193 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501227    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 17:03:29.505193 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501231    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 17:03:29.505193 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501235    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 17:03:29.505193 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501238    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 17:03:29.505193 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501242    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 17:03:29.505193 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501247    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 17:03:29.505193 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501251    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 17:03:29.505193 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501255    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 17:03:29.505193 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501259    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 17:03:29.505193 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501263    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 17:03:29.505193 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501267    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 17:03:29.505193 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501271    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 17:03:29.505193 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501274    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 17:03:29.505193 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501279    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 17:03:29.505193 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501284    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 17:03:29.505698 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501288    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 17:03:29.505698 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501293    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 17:03:29.505698 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501297    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 17:03:29.505698 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501306    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 17:03:29.505698 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501310    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 17:03:29.505698 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501314    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 17:03:29.505698 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501318    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 17:03:29.505698 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501323    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 17:03:29.505698 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501327    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 17:03:29.505698 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501331    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 17:03:29.505698 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501335    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 17:03:29.505698 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501338    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 17:03:29.505698 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501343    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 17:03:29.505698 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501349    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 17:03:29.505698 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501353    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 17:03:29.505698 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501357    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 17:03:29.505698 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501361    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 17:03:29.505698 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501365    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 17:03:29.505698 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501971    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 17:03:29.505698 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501980    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 17:03:29.506187 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501984    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 17:03:29.506187 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501988    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 17:03:29.506187 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501993    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 17:03:29.506187 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.501997    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 17:03:29.506187 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502001    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 17:03:29.506187 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502005    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 17:03:29.506187 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502009    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 17:03:29.506187 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502014    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 17:03:29.506187 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502018    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 17:03:29.506187 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502023    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 17:03:29.506187 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502028    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 17:03:29.506187 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502032    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 17:03:29.506187 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502036    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 17:03:29.506187 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502040    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 17:03:29.506187 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502045    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 17:03:29.506187 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502051    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 17:03:29.506187 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502055    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 17:03:29.506187 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502059    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 17:03:29.506187 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502064    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 17:03:29.506187 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502068    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 17:03:29.506717 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502072    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 17:03:29.506717 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502076    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 17:03:29.506717 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502080    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 17:03:29.506717 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502084    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 17:03:29.506717 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502089    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 17:03:29.506717 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502093    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 17:03:29.506717 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502098    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 17:03:29.506717 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502103    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 17:03:29.506717 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502107    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 17:03:29.506717 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502111    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 17:03:29.506717 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502115    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 17:03:29.506717 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502119    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 17:03:29.506717 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502123    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 17:03:29.506717 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502127    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 17:03:29.506717 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502132    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 17:03:29.506717 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502136    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 17:03:29.506717 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502140    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 17:03:29.506717 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502144    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 17:03:29.506717 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502148    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 17:03:29.506717 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502152    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 17:03:29.507249 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502156    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 17:03:29.507249 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502160    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 17:03:29.507249 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502164    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 17:03:29.507249 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502168    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 17:03:29.507249 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502172    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 17:03:29.507249 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502176    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 17:03:29.507249 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502180    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 17:03:29.507249 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502186    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 17:03:29.507249 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502190    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 17:03:29.507249 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502194    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 17:03:29.507249 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502198    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 17:03:29.507249 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502202    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 17:03:29.507249 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502207    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 17:03:29.507249 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502211    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 17:03:29.507249 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502215    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 17:03:29.507249 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502219    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 17:03:29.507249 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502223    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 17:03:29.507249 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502227    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 17:03:29.507249 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502231    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 17:03:29.507249 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502235    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 17:03:29.507772 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502239    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 17:03:29.507772 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502244    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 17:03:29.507772 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502248    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 17:03:29.507772 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502252    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 17:03:29.507772 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502256    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 17:03:29.507772 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502260    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 17:03:29.507772 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502266    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 17:03:29.507772 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502270    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 17:03:29.507772 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502274    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 17:03:29.507772 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502278    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 17:03:29.507772 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502282    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 17:03:29.507772 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502287    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 17:03:29.507772 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502291    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 17:03:29.507772 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502299    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 17:03:29.507772 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502305    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 17:03:29.507772 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502309    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 17:03:29.507772 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502315    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 17:03:29.507772 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502320    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 17:03:29.507772 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502324    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 17:03:29.508236 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502330    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 17:03:29.508236 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502334    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 17:03:29.508236 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502339    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 17:03:29.508236 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502343    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 17:03:29.508236 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502347    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 17:03:29.508236 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502351    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 17:03:29.508236 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502357    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 17:03:29.508236 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502362    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 17:03:29.508236 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502367    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 17:03:29.508236 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502374    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 17:03:29.508236 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502379    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 17:03:29.508236 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502384    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 17:03:29.508236 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502388    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 17:03:29.508236 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502392    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 17:03:29.508236 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502397    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 17:03:29.508236 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502400    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 17:03:29.508236 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502405    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 17:03:29.508236 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.502411    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 17:03:29.508236 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502537    2582 flags.go:64] FLAG: --address="0.0.0.0"
Jul 24 17:03:29.508236 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502548    2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 24 17:03:29.508750 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502557    2582 flags.go:64] FLAG: --anonymous-auth="true"
Jul 24 17:03:29.508750 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502564    2582 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 24 17:03:29.508750 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502570    2582 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 24 17:03:29.508750 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502576    2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 24 17:03:29.508750 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502582    2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 24 17:03:29.508750 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502589    2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 24 17:03:29.508750 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502594    2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 24 17:03:29.508750 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502599    2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 24 17:03:29.508750 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502605    2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 24 17:03:29.508750 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502610    2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 24 17:03:29.508750 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502616    2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 24 17:03:29.508750 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502621    2582 flags.go:64] FLAG: --cgroup-root=""
Jul 24 17:03:29.508750 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502628    2582 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 24 17:03:29.508750 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502633    2582 flags.go:64] FLAG: --client-ca-file=""
Jul 24 17:03:29.508750 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502638    2582 flags.go:64] FLAG: --cloud-provider="external"
Jul 24 17:03:29.508750 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502643    2582 flags.go:64] FLAG: --cluster-dns="[]"
Jul 24 17:03:29.508750 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502654    2582 flags.go:64] FLAG: --cluster-domain=""
Jul 24 17:03:29.508750 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502658    2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 24 17:03:29.508750 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502664    2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 24 17:03:29.508750 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502687    2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 24 17:03:29.508750 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502693    2582 flags.go:64] FLAG: --container-log-max-files="5"
Jul 24 17:03:29.508750 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502701    2582 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 24 17:03:29.508750 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502705    2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 24 17:03:29.509305 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502710    2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 24 17:03:29.509305 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502715    2582 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 24 17:03:29.509305 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502720    2582 flags.go:64] FLAG: --contention-profiling="false"
Jul 24 17:03:29.509305 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502725    2582 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 24 17:03:29.509305 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502730    2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 24 17:03:29.509305 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502735    2582 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 24 17:03:29.509305 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502739    2582 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 24 17:03:29.509305 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502746    2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 24 17:03:29.509305 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502751    2582 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 24 17:03:29.509305 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502756    2582 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 24 17:03:29.509305 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502760    2582 flags.go:64] FLAG: --enable-load-reader="false"
Jul 24 17:03:29.509305 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502765    2582 flags.go:64] FLAG: --enable-server="true"
Jul 24 17:03:29.509305 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502770    2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 24 17:03:29.509305 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502781    2582 flags.go:64] FLAG: --event-burst="100"
Jul 24 17:03:29.509305 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502786    2582 flags.go:64] FLAG: --event-qps="50"
Jul 24 17:03:29.509305 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502791    2582 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 24 17:03:29.509305 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502796    2582 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 24 17:03:29.509305 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502800    2582 flags.go:64] FLAG: --eviction-hard=""
Jul 24 17:03:29.509305 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502807    2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 24 17:03:29.509305 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502812    2582 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 24 17:03:29.509305 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502820    2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 24 17:03:29.509305 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502827    2582 flags.go:64] FLAG: --eviction-soft=""
Jul 24 17:03:29.509305 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502832    2582 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 24 17:03:29.509305 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502837    2582 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 24 17:03:29.509305 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502841    2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 24 17:03:29.509960 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502846    2582 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 24 17:03:29.509960 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502851    2582 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 24 17:03:29.509960 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502856    2582 flags.go:64] FLAG: --fail-swap-on="true"
Jul 24 17:03:29.509960 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502861    2582 flags.go:64] FLAG: --feature-gates=""
Jul 24 17:03:29.509960 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502867    2582 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 24 17:03:29.509960 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502873    2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 24 17:03:29.509960 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502878    2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 24 17:03:29.509960 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502883    2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 24 17:03:29.509960 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502888    2582 flags.go:64] FLAG: --healthz-port="10248"
Jul 24 17:03:29.509960 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502893    2582 flags.go:64] FLAG: --help="false"
Jul 24 17:03:29.509960 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502897    2582 flags.go:64] FLAG: --hostname-override="ip-10-0-134-152.ec2.internal"
Jul 24 17:03:29.509960 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502903    2582 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 24 17:03:29.509960 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502908    2582 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 24 17:03:29.509960 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502913    2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 24 17:03:29.509960 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502918    2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 24 17:03:29.509960 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502924    2582 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 24 17:03:29.509960 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502928    2582 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 24 17:03:29.509960 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502933    2582 flags.go:64] FLAG: --image-service-endpoint=""
Jul 24 17:03:29.509960 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502938    2582 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 24 17:03:29.509960 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502942    2582 flags.go:64] FLAG: --kube-api-burst="100"
Jul 24 17:03:29.509960 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502947    2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 24 17:03:29.509960 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502952    2582 flags.go:64] FLAG: --kube-api-qps="50"
Jul 24 17:03:29.509960 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502957    2582 flags.go:64] FLAG: --kube-reserved=""
Jul 24 17:03:29.509960 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502962    2582 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 24 17:03:29.510600 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502967    2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 24 17:03:29.510600 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502971    2582 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 24 17:03:29.510600 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502976    2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 24 17:03:29.510600 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502980    2582 flags.go:64] FLAG: --lock-file=""
Jul 24 17:03:29.510600 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502988    2582 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 24 17:03:29.510600 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502993    2582 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 24 17:03:29.510600 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.502998    2582 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 24 17:03:29.510600 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503007    2582 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 24 17:03:29.510600 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503011    2582 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 24 17:03:29.510600 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503015    2582 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 24 17:03:29.510600 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503020    2582 flags.go:64] FLAG: --logging-format="text"
Jul 24 17:03:29.510600 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503024    2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 24 17:03:29.510600 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503030    2582 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 24 17:03:29.510600 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503036    2582 flags.go:64] FLAG: --manifest-url=""
Jul 24 17:03:29.510600 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503040    2582 flags.go:64] FLAG: --manifest-url-header=""
Jul 24 17:03:29.510600 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503047    2582 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 24 17:03:29.510600 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503052    2582 flags.go:64] FLAG: --max-open-files="1000000"
Jul 24 17:03:29.510600 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503059    2582 flags.go:64] FLAG: --max-pods="110"
Jul 24 17:03:29.510600 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503064    2582 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 24 17:03:29.510600 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503069    2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 24 17:03:29.510600 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503074    2582 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 24 17:03:29.510600 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503079    2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 24 17:03:29.510600 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503083    2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 24 17:03:29.510600 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503088    2582 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 24 17:03:29.510600 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503093    2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 24 17:03:29.511259 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503104    2582 flags.go:64] FLAG: --node-status-max-images="50"
Jul 24 17:03:29.511259 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503109    2582 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 24 17:03:29.511259 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503114    2582 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 24 17:03:29.511259 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503119    2582 flags.go:64] FLAG: --pod-cidr=""
Jul 24 17:03:29.511259 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503123    2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 24 17:03:29.511259 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503132    2582 flags.go:64] FLAG: --pod-manifest-path=""
Jul 24 17:03:29.511259 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503136    2582 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 24 17:03:29.511259 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503142    2582 flags.go:64] FLAG: --pods-per-core="0"
Jul 24 17:03:29.511259 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503147    2582 flags.go:64] FLAG: --port="10250"
Jul 24 17:03:29.511259 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503152    2582 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 24 17:03:29.511259 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503157    2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0db4b7136f0b669f1"
Jul 24 17:03:29.511259 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503162    2582 flags.go:64] FLAG: --qos-reserved=""
Jul 24 17:03:29.511259 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503168    2582 flags.go:64] FLAG: --read-only-port="10255"
Jul 24 17:03:29.511259 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503173    2582 flags.go:64] FLAG: --register-node="true"
Jul 24 17:03:29.511259 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503177    2582 flags.go:64] FLAG: --register-with-taints=""
Jul 24 17:03:29.511259 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503183    2582 flags.go:64] FLAG: --registry-burst="10"
Jul 24 17:03:29.511259 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503188    2582 flags.go:64] FLAG: --registry-qps="5"
Jul 24 17:03:29.511259 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503193    2582 flags.go:64] FLAG: --reserved-cpus=""
Jul 24 17:03:29.511259 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503197    2582 flags.go:64] FLAG: --reserved-memory=""
Jul 24 17:03:29.511259 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503203    2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 24 17:03:29.511259 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503209    2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 24 17:03:29.511259 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503214    2582 flags.go:64] FLAG: --rotate-certificates="false"
Jul 24 17:03:29.511259 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503219    2582 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 24 17:03:29.511259 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503223    2582 flags.go:64] FLAG: --runonce="false"
Jul 24 17:03:29.511259 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503228    2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 24 17:03:29.511976 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503233    2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 24 17:03:29.511976 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503238    2582 flags.go:64] FLAG: --seccomp-default="false"
Jul 24 17:03:29.511976 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503242    2582 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 24 17:03:29.511976 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503247    2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 24 17:03:29.511976 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503252    2582 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 24 17:03:29.511976 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503256    2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 24 17:03:29.511976 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503262    2582 flags.go:64] FLAG: --storage-driver-password="root"
Jul 24 17:03:29.511976 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503266    2582 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 24 17:03:29.511976 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503271    2582 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 24 17:03:29.511976 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503276    2582 flags.go:64] FLAG: --storage-driver-user="root"
Jul 24 17:03:29.511976 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503280    2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 24 17:03:29.511976 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503285    2582 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 24 17:03:29.511976 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503290    2582 flags.go:64] FLAG: --system-cgroups=""
Jul 24 17:03:29.511976 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503295    2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 24 17:03:29.511976 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503303    2582 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 24 17:03:29.511976 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503308    2582 flags.go:64] FLAG: --tls-cert-file=""
Jul 24 17:03:29.511976 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503313    2582 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 24 17:03:29.511976 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503321    2582 flags.go:64] FLAG: --tls-min-version=""
Jul 24 17:03:29.511976 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503325    2582 flags.go:64] FLAG: --tls-private-key-file=""
Jul 24 17:03:29.511976 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503330    2582 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 24 17:03:29.511976 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503335    2582 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 24 17:03:29.511976 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503340    2582 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 24 17:03:29.511976 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503346    2582 flags.go:64] FLAG: --v="2"
Jul 24 17:03:29.511976 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503352    2582 flags.go:64] FLAG: --version="false"
Jul 24 17:03:29.511976 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503358    2582 flags.go:64] FLAG: --vmodule=""
Jul 24 17:03:29.512590 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503364    2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 24 17:03:29.512590 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.503369    2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 24 17:03:29.512590 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503558    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 17:03:29.512590 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503573    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 17:03:29.512590 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503576    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 17:03:29.512590 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503580    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 17:03:29.512590 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503584    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 17:03:29.512590 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503587    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 17:03:29.512590 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503592    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 17:03:29.512590 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503597    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 17:03:29.512590 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503600    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 17:03:29.512590 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503603    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 17:03:29.512590 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503606    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 17:03:29.512590 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503609    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 17:03:29.512590 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503612    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 17:03:29.512590 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503614    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 17:03:29.512590 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503618    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 17:03:29.512590 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503622    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 17:03:29.512590 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503625    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 17:03:29.513087 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503628    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 17:03:29.513087 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503631    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 17:03:29.513087 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503633    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 17:03:29.513087 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503644    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 17:03:29.513087 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503647    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 17:03:29.513087 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503650    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 17:03:29.513087 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503652    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 17:03:29.513087 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503656    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 17:03:29.513087 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503659    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 17:03:29.513087 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503661    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 17:03:29.513087 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503664    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 17:03:29.513087 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503680    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 17:03:29.513087 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503683    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 17:03:29.513087 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503686    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 17:03:29.513087 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503688    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 17:03:29.513087 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503691    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 17:03:29.513087 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503696    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 17:03:29.513087 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503699    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 17:03:29.513087 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503702    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 17:03:29.513087 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503705    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 17:03:29.513579 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503709    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 17:03:29.513579 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503712    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 17:03:29.513579 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503715    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 17:03:29.513579 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503718    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 17:03:29.513579 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503722    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 17:03:29.513579 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503724    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 17:03:29.513579 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503727    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 17:03:29.513579 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503730    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 17:03:29.513579 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503732    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 17:03:29.513579 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503735    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 17:03:29.513579 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503738    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 17:03:29.513579 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503741    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 17:03:29.513579 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503744    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 17:03:29.513579 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503746    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 17:03:29.513579 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503749    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 17:03:29.513579 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503752    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 17:03:29.513579 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503755    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 17:03:29.513579 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503757    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 17:03:29.513579 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503760    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 17:03:29.514111 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503762    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 17:03:29.514111 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503765    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 17:03:29.514111 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503768    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 17:03:29.514111 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503770    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 17:03:29.514111 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503773    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 17:03:29.514111 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503776    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 17:03:29.514111 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503778    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 17:03:29.514111 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503781    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 17:03:29.514111 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503783    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 17:03:29.514111 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503786    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 17:03:29.514111 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503790    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 17:03:29.514111 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503792    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 17:03:29.514111 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503795    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 17:03:29.514111 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503798    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 17:03:29.514111 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503800    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 17:03:29.514111 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503802    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 17:03:29.514111 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503805    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 17:03:29.514111 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503808    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 17:03:29.514111 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503810    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 17:03:29.514111 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503812    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 17:03:29.514599 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503815    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 17:03:29.514599 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503818    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 17:03:29.514599 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503820    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 17:03:29.514599 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503823    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 17:03:29.514599 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503826    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 17:03:29.514599 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503828    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 17:03:29.514599 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503831    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 17:03:29.514599 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503834    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 17:03:29.514599 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503836    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 17:03:29.514599 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503839    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 17:03:29.514599 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503841    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 17:03:29.514599 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503844    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 17:03:29.514599 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503846    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 17:03:29.514599 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503849    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 17:03:29.514599 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503851    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 17:03:29.514599 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503854    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 17:03:29.514599 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503856    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 17:03:29.514599 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503859    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 17:03:29.514599 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503861    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 17:03:29.514599 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503864    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 17:03:29.515114 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503867    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 17:03:29.515114 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503870    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 17:03:29.515114 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.503873    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 17:03:29.515114 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.504526    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 17:03:29.515114 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.511372    2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 24 17:03:29.515114 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.511390    2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 24 17:03:29.515114 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.512293    2582 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 24 17:03:29.515114 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.512305    2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 24 17:03:29.515114 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512362    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 17:03:29.515114 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512368    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 17:03:29.515114 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512371    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 17:03:29.515114 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512374    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 17:03:29.515114 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512377    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 17:03:29.515114 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512380    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 17:03:29.515506 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512382    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 17:03:29.515506 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512385    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 17:03:29.515506 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512388    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 17:03:29.515506 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512390    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 17:03:29.515506 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512393    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 17:03:29.515506 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512396    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 17:03:29.515506 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512399    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 17:03:29.515506 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512402    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 17:03:29.515506 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512404    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 17:03:29.515506 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512407    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 17:03:29.515506 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512409    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 17:03:29.515506 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512413    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 17:03:29.515506 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512417    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 17:03:29.515506 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512420    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 17:03:29.515506 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512423    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 17:03:29.515506 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512425    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 17:03:29.515506 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512428    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 17:03:29.515506 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512431    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 17:03:29.515506 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512433    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 17:03:29.516002 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512436    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 17:03:29.516002 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512438    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 17:03:29.516002 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512442    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 17:03:29.516002 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512445    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 17:03:29.516002 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512448    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 17:03:29.516002 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512452    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 17:03:29.516002 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512454    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 17:03:29.516002 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512457    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 17:03:29.516002 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512460    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 17:03:29.516002 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512462    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 17:03:29.516002 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512465    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 17:03:29.516002 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512468    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 17:03:29.516002 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512470    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 17:03:29.516002 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512473    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 17:03:29.516002 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512475    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 17:03:29.516002 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512478    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 17:03:29.516002 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512480    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 17:03:29.516002 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512484    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 17:03:29.516002 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512488    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 17:03:29.516474 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512491    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 17:03:29.516474 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512494    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 17:03:29.516474 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512496    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 17:03:29.516474 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512499    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 17:03:29.516474 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512501    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 17:03:29.516474 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512504    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 17:03:29.516474 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512507    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 17:03:29.516474 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512510    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 17:03:29.516474 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512513    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 17:03:29.516474 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512517    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 17:03:29.516474 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512520    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 17:03:29.516474 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512523    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 17:03:29.516474 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512526    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 17:03:29.516474 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512528    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 17:03:29.516474 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512531    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 17:03:29.516474 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512534    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 17:03:29.516474 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512537    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 17:03:29.516474 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512540    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 17:03:29.516474 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512542    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 17:03:29.517020 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512545    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 17:03:29.517020 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512548    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 17:03:29.517020 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512550    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 17:03:29.517020 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512553    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 17:03:29.517020 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512556    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 17:03:29.517020 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512558    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 17:03:29.517020 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512561    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 17:03:29.517020 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512563    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 17:03:29.517020 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512566    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 17:03:29.517020 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512569    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 17:03:29.517020 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512571    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 17:03:29.517020 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512574    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 17:03:29.517020 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512576    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 17:03:29.517020 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512579    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 17:03:29.517020 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512582    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 17:03:29.517020 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512584    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 17:03:29.517020 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512586    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 17:03:29.517020 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512590    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 17:03:29.517020 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512592    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 17:03:29.517020 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512595    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 17:03:29.517512 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512598    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 17:03:29.517512 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512601    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 17:03:29.517512 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512603    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 17:03:29.517512 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512606    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 17:03:29.517512 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512609    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 17:03:29.517512 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512612    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 17:03:29.517512 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512614    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 17:03:29.517512 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512616    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 17:03:29.517512 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512619    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 17:03:29.517512 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512622    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 17:03:29.517512 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512626    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 17:03:29.517512 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512629    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 17:03:29.517512 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512631    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 17:03:29.517512 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512634    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 17:03:29.517512 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512636    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 17:03:29.517512 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512639    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 17:03:29.517908 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.512644    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 17:03:29.517908 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512764    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 17:03:29.517908 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512769    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 17:03:29.517908 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512772    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 17:03:29.517908 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512775    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 17:03:29.517908 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512777    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 17:03:29.517908 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512780    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 17:03:29.517908 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512783    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 17:03:29.517908 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512786    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 17:03:29.517908 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512788    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 17:03:29.517908 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512791    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 17:03:29.517908 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512794    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 17:03:29.517908 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512796    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 17:03:29.517908 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512799    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 17:03:29.517908 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512802    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 17:03:29.518272 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512804    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 17:03:29.518272 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512807    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 17:03:29.518272 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512810    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 17:03:29.518272 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512812    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 17:03:29.518272 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512815    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 17:03:29.518272 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512817    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 17:03:29.518272 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512820    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 17:03:29.518272 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512822    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 17:03:29.518272 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512824    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 17:03:29.518272 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512827    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 17:03:29.518272 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512830    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 17:03:29.518272 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512832    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 17:03:29.518272 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512836    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 17:03:29.518272 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512838    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 17:03:29.518272 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512841    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 17:03:29.518272 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512844    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 17:03:29.518272 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512846    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 17:03:29.518272 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512849    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 17:03:29.518272 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512853    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 17:03:29.518872 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512856    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 17:03:29.518872 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512859    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 17:03:29.518872 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512861    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 17:03:29.518872 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512863    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 17:03:29.518872 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512866    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 17:03:29.518872 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512869    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 17:03:29.518872 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512871    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 17:03:29.518872 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512873    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 17:03:29.518872 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512876    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 17:03:29.518872 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512878    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 17:03:29.518872 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512881    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 17:03:29.518872 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512883    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 17:03:29.518872 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512886    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 17:03:29.518872 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512888    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 17:03:29.518872 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512892    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 17:03:29.518872 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512895    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 17:03:29.518872 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512899    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 17:03:29.518872 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512901    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 17:03:29.518872 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512905    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 17:03:29.519334 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512907    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 17:03:29.519334 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512910    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 17:03:29.519334 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512912    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 17:03:29.519334 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512915    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 17:03:29.519334 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512917    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 17:03:29.519334 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512920    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 17:03:29.519334 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512922    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 17:03:29.519334 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512925    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 17:03:29.519334 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512928    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 17:03:29.519334 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512930    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 17:03:29.519334 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512933    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 17:03:29.519334 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512935    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 17:03:29.519334 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512938    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 17:03:29.519334 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512940    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 17:03:29.519334 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512942    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 17:03:29.519334 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512945    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 17:03:29.519334 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512947    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 17:03:29.519334 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512950    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 17:03:29.519334 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512952    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 17:03:29.519334 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512955    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 17:03:29.519857 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512957    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 17:03:29.519857 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512960    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 17:03:29.519857 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512962    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 17:03:29.519857 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512965    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 17:03:29.519857 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512967    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 17:03:29.519857 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512970    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 17:03:29.519857 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512972    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 17:03:29.519857 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512975    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 17:03:29.519857 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512977    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 17:03:29.519857 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512980    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 17:03:29.519857 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512983    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 17:03:29.519857 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512985    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 17:03:29.519857 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512988    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 17:03:29.519857 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512992    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 17:03:29.519857 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512994    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 17:03:29.519857 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512997    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 17:03:29.519857 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.512999    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 17:03:29.519857 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.513002    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 17:03:29.519857 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.513005    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 17:03:29.519857 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.513007    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 17:03:29.520379 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.513010    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 17:03:29.520379 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.513012    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 17:03:29.520379 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.513015    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 17:03:29.520379 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.513018    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 17:03:29.520379 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.513020    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 17:03:29.520379 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.513022    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 17:03:29.520379 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:29.513025    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 17:03:29.520379 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.513030    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 17:03:29.520379 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.513139    2582 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 24 17:03:29.520379 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.515016    2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 24 17:03:29.520379 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.516612    2582 server.go:1019] "Starting client certificate rotation"
Jul 24 17:03:29.520379 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.516695    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 17:03:29.520379 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.516727    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 17:03:29.520711 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.519731    2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 17:03:29.522904 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.522880    2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 17:03:29.533305 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.533291    2582 log.go:25] "Validated CRI v1 runtime API"
Jul 24 17:03:29.536918 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.536906    2582 log.go:25] "Validated CRI v1 image API"
Jul 24 17:03:29.537657 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.537644    2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 24 17:03:29.540694 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.540661    2582 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9fcb9e2c-9deb-4b14-b857-5346a0c36466:/dev/nvme0n1p4 a8c1ed37-55b3-438a-a9b5-4c4a76040720:/dev/nvme0n1p3]
Jul 24 17:03:29.540732 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.540694    2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 24 17:03:29.546481 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.546383    2582 manager.go:216] Machine: {Timestamp:2026-07-24 17:03:29.5448949 +0000 UTC m=+0.360869505 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3061076 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a4a47a1cb17c78432620275ef443e SystemUUID:ec2a4a47-a1cb-17c7-8432-620275ef443e BootID:f110aafd-f2f6-4218-9499-6799bcd164fe Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:bc:0a:2b:63:97 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:bc:0a:2b:63:97 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9a:45:84:ac:67:df Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 24 17:03:29.546481 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.546478    2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 24 17:03:29.546594 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.546582    2582 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 24 17:03:29.549814 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.549785    2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 24 17:03:29.549948 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.549817    2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-152.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 24 17:03:29.550188 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.550173    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 17:03:29.551114 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.551102    2582 topology_manager.go:138] "Creating topology manager with none policy"
Jul 24 17:03:29.551159 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.551117    2582 container_manager_linux.go:309] "Creating device plugin manager"
Jul 24 17:03:29.551159 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.551125    2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 17:03:29.551758 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.551748    2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 17:03:29.552585 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.552574    2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 24 17:03:29.554474 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.554463    2582 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 17:03:29.554592 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.554583    2582 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 24 17:03:29.554621 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.554612    2582 kubelet.go:486] "Attempting to sync node with API server"
Jul 24 17:03:29.554649 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.554622    2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 24 17:03:29.554649 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.554641    2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 24 17:03:29.554717 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.554650    2582 kubelet.go:398] "Adding apiserver pod source"
Jul 24 17:03:29.554717 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.554659    2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 24 17:03:29.555018 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.555007    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 17:03:29.555053 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.555027    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 17:03:29.557497 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.557483    2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 24 17:03:29.559150 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.559136    2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 24 17:03:29.559223 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.559164    2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 24 17:03:29.560621 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.560609    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 24 17:03:29.560688 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.560626    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 24 17:03:29.560688 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.560632    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 24 17:03:29.560688 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.560640    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 24 17:03:29.560688 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.560654    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 24 17:03:29.560688 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.560662    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 24 17:03:29.560826 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.560718    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 24 17:03:29.560826 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.560724    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 24 17:03:29.560826 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.560730    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 24 17:03:29.560826 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.560736    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 24 17:03:29.560826 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.560750    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 24 17:03:29.560826 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.560755    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 24 17:03:29.561385 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.561376    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 24 17:03:29.561413 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.561386    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 24 17:03:29.564430 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.564402    2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-152.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 17:03:29.564505 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:29.564478    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-152.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 17:03:29.564580 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:29.564519    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 17:03:29.564735 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.564723    2582 server.go:1268] "Started kubelet"
Jul 24 17:03:29.564822 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.564795    2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 24 17:03:29.564874 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.564791    2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 24 17:03:29.564874 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.564851    2582 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 24 17:03:29.565554 ip-10-0-134-152 systemd[1]: Started Kubernetes Kubelet.
Jul 24 17:03:29.569384 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.569360    2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 24 17:03:29.570967 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.570948    2582 server.go:310] "Adding debug handlers to kubelet server"
Jul 24 17:03:29.571093 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:29.571074    2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 24 17:03:29.576148 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:29.575146    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-152.ec2.internal.18c5488fc0382a5a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-152.ec2.internal,UID:ip-10-0-134-152.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-152.ec2.internal,},FirstTimestamp:2026-07-24 17:03:29.564699226 +0000 UTC m=+0.380673831,LastTimestamp:2026-07-24 17:03:29.564699226 +0000 UTC m=+0.380673831,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-152.ec2.internal,}"
Jul 24 17:03:29.576798 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.576785    2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 24 17:03:29.576798 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.576792    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 24 17:03:29.576983 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.576954    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4j7pg"
Jul 24 17:03:29.577056 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:29.576988    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-152.ec2.internal\" not found"
Jul 24 17:03:29.577480 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.577464    2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 24 17:03:29.577620 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.577472    2582 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 24 17:03:29.577620 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.577617    2582 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 24 17:03:29.577780 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.577730    2582 reconstruct.go:97] "Volume reconstruction finished"
Jul 24 17:03:29.577780 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.577736    2582 reconciler.go:29] "Reconciler: start to sync state"
Jul 24 17:03:29.577780 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.577754    2582 factory.go:55] Registering systemd factory
Jul 24 17:03:29.577780 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.577769    2582 factory.go:223] Registration of the systemd container factory successfully
Jul 24 17:03:29.577980 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.577969    2582 factory.go:153] Registering CRI-O factory
Jul 24 17:03:29.578035 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.577982    2582 factory.go:223] Registration of the crio container factory successfully
Jul 24 17:03:29.578035 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.578026    2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 24 17:03:29.578135 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.578044    2582 factory.go:103] Registering Raw factory
Jul 24 17:03:29.578135 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.578055    2582 manager.go:1196] Started watching for new ooms in manager
Jul 24 17:03:29.579109 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.578943    2582 manager.go:349] Starting recovery of all containers
Jul 24 17:03:29.582249 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:29.582221    2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-152.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 24 17:03:29.582373 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:29.582351    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 24 17:03:29.582451 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.582374    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4j7pg"
Jul 24 17:03:29.589487 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.589474    2582 manager.go:354] Recovery completed
Jul 24 17:03:29.594510 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.594105    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:03:29.596605 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.596579    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:03:29.596711 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.596624    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:03:29.596711 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.596645    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:03:29.597172 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.597158    2582 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 24 17:03:29.597172 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.597172    2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 24 17:03:29.597295 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.597185    2582 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 17:03:29.597295 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.597164    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:03:29.598481 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.598469    2582 policy_none.go:49] "None policy: Start"
Jul 24 17:03:29.598544 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.598485    2582 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 24 17:03:29.598544 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.598496    2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 24 17:03:29.598808 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:29.598746    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-152.ec2.internal.18c5488fc21f059d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-152.ec2.internal,UID:ip-10-0-134-152.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-152.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-152.ec2.internal,},FirstTimestamp:2026-07-24 17:03:29.596605853 +0000 UTC m=+0.412580478,LastTimestamp:2026-07-24 17:03:29.596605853 +0000 UTC m=+0.412580478,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-152.ec2.internal,}"
Jul 24 17:03:29.598899 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.598848    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:03:29.598899 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.598871    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:03:29.598899 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.598880    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:03:29.599324 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.599312    2582 policy_none.go:47] "Start"
Jul 24 17:03:29.632823 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.632684    2582 manager.go:337] "Starting Device Plugin manager"
Jul 24 17:03:29.632899 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:29.632847    2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 24 17:03:29.632899 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.632862    2582 server.go:87] "Starting device plugin registration server"
Jul 24 17:03:29.633101 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.633088    2582 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 24 17:03:29.633159 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.633102    2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 24 17:03:29.633221 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.633202    2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 24 17:03:29.633294 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.633282    2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 24 17:03:29.633340 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.633295    2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 24 17:03:29.633789 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:29.633768    2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 24 17:03:29.633844 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:29.633822    2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-152.ec2.internal\" not found"
Jul 24 17:03:29.733877 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.733858    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:03:29.734726 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.734640    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:03:29.734726 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.734685    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:03:29.734726 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.734697    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:03:29.734726 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.734721    2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-152.ec2.internal"
Jul 24 17:03:29.742770 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.742735    2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-152.ec2.internal"
Jul 24 17:03:29.742770 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:29.742754    2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-152.ec2.internal\": node \"ip-10-0-134-152.ec2.internal\" not found"
Jul 24 17:03:29.756317 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.756293    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 24 17:03:29.757062 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:29.757044    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-152.ec2.internal\" not found"
Jul 24 17:03:29.757378 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.757364    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 24 17:03:29.757425 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.757400    2582 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 24 17:03:29.757425 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.757418    2582 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 24 17:03:29.757494 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:29.757453    2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 24 17:03:29.759639 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.759617    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 17:03:29.858180 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:29.858145    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-152.ec2.internal\" not found"
Jul 24 17:03:29.858180 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.858166    2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-152.ec2.internal"]
Jul 24 17:03:29.858367 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.858244    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:03:29.859845 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.859825    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:03:29.859912 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.859857    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:03:29.859912 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.859868    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:03:29.861013 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.861000    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:03:29.861152 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.861136    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal"
Jul 24 17:03:29.861192 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.861180    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:03:29.861828 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.861811    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:03:29.861897 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.861840    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:03:29.861897 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.861851    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:03:29.861972 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.861818    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:03:29.861972 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.861925    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:03:29.861972 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.861940    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:03:29.863196 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.863181    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-152.ec2.internal"
Jul 24 17:03:29.863252 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.863213    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:03:29.863871 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.863855    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:03:29.863941 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.863885    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:03:29.863941 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.863898    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:03:29.879229 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.879206    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c6eecdeb9041331a4921846ff748148-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal\" (UID: \"2c6eecdeb9041331a4921846ff748148\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal"
Jul 24 17:03:29.879328 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.879232    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5769d40c696eb94e1a1746849e9cb1ff-config\") pod \"kube-apiserver-proxy-ip-10-0-134-152.ec2.internal\" (UID: \"5769d40c696eb94e1a1746849e9cb1ff\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-152.ec2.internal"
Jul 24 17:03:29.879328 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.879251    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2c6eecdeb9041331a4921846ff748148-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal\" (UID: \"2c6eecdeb9041331a4921846ff748148\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal"
Jul 24 17:03:29.890631 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:29.890614    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-152.ec2.internal\" not found" node="ip-10-0-134-152.ec2.internal"
Jul 24 17:03:29.895319 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:29.895305    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-152.ec2.internal\" not found" node="ip-10-0-134-152.ec2.internal"
Jul 24 17:03:29.958816 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:29.958793    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-152.ec2.internal\" not found"
Jul 24 17:03:29.979656 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.979633    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2c6eecdeb9041331a4921846ff748148-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal\" (UID: \"2c6eecdeb9041331a4921846ff748148\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal"
Jul 24 17:03:29.979759 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.979664    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c6eecdeb9041331a4921846ff748148-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal\" (UID: \"2c6eecdeb9041331a4921846ff748148\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal"
Jul 24 17:03:29.979759 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.979704    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5769d40c696eb94e1a1746849e9cb1ff-config\") pod \"kube-apiserver-proxy-ip-10-0-134-152.ec2.internal\" (UID: \"5769d40c696eb94e1a1746849e9cb1ff\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-152.ec2.internal"
Jul 24 17:03:29.979759 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.979747    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5769d40c696eb94e1a1746849e9cb1ff-config\") pod \"kube-apiserver-proxy-ip-10-0-134-152.ec2.internal\" (UID: \"5769d40c696eb94e1a1746849e9cb1ff\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-152.ec2.internal"
Jul 24 17:03:29.979861 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.979751    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2c6eecdeb9041331a4921846ff748148-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal\" (UID: \"2c6eecdeb9041331a4921846ff748148\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal"
Jul 24 17:03:29.979861 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:29.979754    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c6eecdeb9041331a4921846ff748148-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal\" (UID: \"2c6eecdeb9041331a4921846ff748148\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal"
Jul 24 17:03:30.059688 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:30.059586    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-152.ec2.internal\" not found"
Jul 24 17:03:30.164170 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:30.164114    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-152.ec2.internal\" not found"
Jul 24 17:03:30.192709 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.192661    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal"
Jul 24 17:03:30.198977 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.198953    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-152.ec2.internal"
Jul 24 17:03:30.264924 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:30.264887    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-152.ec2.internal\" not found"
Jul 24 17:03:30.367449 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:30.367366    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-152.ec2.internal\" not found"
Jul 24 17:03:30.417041 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.417004    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 17:03:30.471221 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:30.471183    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-152.ec2.internal\" not found"
Jul 24 17:03:30.515629 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.515581    2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 24 17:03:30.516097 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.515789    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 17:03:30.516097 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.515798    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 17:03:30.528220 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.528199    2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 17:03:30.556877 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.556847    2582 apiserver.go:52] "Watching apiserver"
Jul 24 17:03:30.566100 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.566072    2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 24 17:03:30.566467 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.566443    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-2fpd4","openshift-network-operator/iptables-alerter-9qz26","kube-system/konnectivity-agent-npqrh","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg79k","openshift-dns/node-resolver-6jbmb","openshift-multus/multus-228jg","openshift-multus/multus-additional-cni-plugins-2zx5f","openshift-network-diagnostics/network-check-target-s8m4l","openshift-ovn-kubernetes/ovnkube-node-d6w2m","kube-system/global-pull-secret-syncer-mhjb8","openshift-cluster-node-tuning-operator/tuned-fhlm5","openshift-image-registry/node-ca-5sgm4"]
Jul 24 17:03:30.567910 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.567890    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fpd4"
Jul 24 17:03:30.567994 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:30.567975    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fpd4" podUID="ec08480c-1bcc-4c15-8daa-095f89d01ec1"
Jul 24 17:03:30.569016 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.569000    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9qz26"
Jul 24 17:03:30.570014 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.569996    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-npqrh"
Jul 24 17:03:30.571316 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.571282    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qm6pz\""
Jul 24 17:03:30.572775 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.571480    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 24 17:03:30.572775 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.571522    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 24 17:03:30.572775 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.571533    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 24 17:03:30.572775 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.571742    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg79k"
Jul 24 17:03:30.572775 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.572323    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kq2xt\""
Jul 24 17:03:30.572775 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.572373    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 24 17:03:30.573155 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.572918    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6jbmb"
Jul 24 17:03:30.573602 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.573581    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 24 17:03:30.573930 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.573894    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 24 17:03:30.574491 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.574337    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 24 17:03:30.574491 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.574368    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.574646 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.574443    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2494t\""
Jul 24 17:03:30.575511 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.575476    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 24 17:03:30.575607 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.575491    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9rd98\""
Jul 24 17:03:30.575607 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.575527    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 24 17:03:30.575726 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.575607    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 24 17:03:30.575983 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.575967    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2zx5f"
Jul 24 17:03:30.576924 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.576908    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 24 17:03:30.577010 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.576975    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-152.ec2.internal"
Jul 24 17:03:30.577010 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.576990    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 24 17:03:30.577357 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.577342    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8m4l"
Jul 24 17:03:30.577432 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:30.577413    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8m4l" podUID="e066d7db-af43-4c57-b832-3936cecdb3bc"
Jul 24 17:03:30.577736 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.577697    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 24 17:03:30.577736 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.577714    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5tpmz\""
Jul 24 17:03:30.577736 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.577729    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 24 17:03:30.577946 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.577706    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 24 17:03:30.577946 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.577832    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 24 17:03:30.578146 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.578129    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mv8zt\""
Jul 24 17:03:30.578209 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.578175    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 24 17:03:30.578810 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.578788    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.580238 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.580221    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhjb8"
Jul 24 17:03:30.580333 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:30.580278    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhjb8" podUID="3cced35a-4cd2-4520-a5c4-9e0f5e0e891b"
Jul 24 17:03:30.581347 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.581286    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 24 17:03:30.581347 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.581294    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 24 17:03:30.581347 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.581291    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 24 17:03:30.581521 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.581311    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 24 17:03:30.581521 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.581443    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 24 17:03:30.581715 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.581695    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bbf5x\""
Jul 24 17:03:30.581808 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.581766    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:30.581864 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.581819    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 24 17:03:30.582076 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.582046    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcj24\" (UniqueName: \"kubernetes.io/projected/071318f4-f26f-4eb9-8bd9-027146a171a4-kube-api-access-rcj24\") pod \"multus-additional-cni-plugins-2zx5f\" (UID: \"071318f4-f26f-4eb9-8bd9-027146a171a4\") " pod="openshift-multus/multus-additional-cni-plugins-2zx5f"
Jul 24 17:03:30.582124 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.582084    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-run-ovn\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.582124 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.582102    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5j55\" (UniqueName: \"kubernetes.io/projected/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-kube-api-access-k5j55\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.582199 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.582145    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-cni-binary-copy\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.582199 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.582183    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.582280 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.582213    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/47bd6299-1889-4b65-90a3-15caf9a6cae4-sys-fs\") pod \"aws-ebs-csi-driver-node-lg79k\" (UID: \"47bd6299-1889-4b65-90a3-15caf9a6cae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg79k"
Jul 24 17:03:30.582280 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.582232    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcz8g\" (UniqueName: \"kubernetes.io/projected/ec08480c-1bcc-4c15-8daa-095f89d01ec1-kube-api-access-fcz8g\") pod \"network-metrics-daemon-2fpd4\" (UID: \"ec08480c-1bcc-4c15-8daa-095f89d01ec1\") " pod="openshift-multus/network-metrics-daemon-2fpd4"
Jul 24 17:03:30.582280 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.582251    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwbln\" (UniqueName: \"kubernetes.io/projected/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-kube-api-access-pwbln\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.582397 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.582285    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-multus-cni-dir\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.582397 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.582309    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/071318f4-f26f-4eb9-8bd9-027146a171a4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2zx5f\" (UID: \"071318f4-f26f-4eb9-8bd9-027146a171a4\") " pod="openshift-multus/multus-additional-cni-plugins-2zx5f"
Jul 24 17:03:30.582397 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.582327    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/47bd6299-1889-4b65-90a3-15caf9a6cae4-device-dir\") pod \"aws-ebs-csi-driver-node-lg79k\" (UID: \"47bd6299-1889-4b65-90a3-15caf9a6cae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg79k"
Jul 24 17:03:30.582397 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.582343    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-host-run-netns\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.582397 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.582361    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/071318f4-f26f-4eb9-8bd9-027146a171a4-system-cni-dir\") pod \"multus-additional-cni-plugins-2zx5f\" (UID: \"071318f4-f26f-4eb9-8bd9-027146a171a4\") " pod="openshift-multus/multus-additional-cni-plugins-2zx5f"
Jul 24 17:03:30.582397 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.582376    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/47bd6299-1889-4b65-90a3-15caf9a6cae4-etc-selinux\") pod \"aws-ebs-csi-driver-node-lg79k\" (UID: \"47bd6299-1889-4b65-90a3-15caf9a6cae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg79k"
Jul 24 17:03:30.582397 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.582398    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzb28\" (UniqueName: \"kubernetes.io/projected/e066d7db-af43-4c57-b832-3936cecdb3bc-kube-api-access-nzb28\") pod \"network-check-target-s8m4l\" (UID: \"e066d7db-af43-4c57-b832-3936cecdb3bc\") " pod="openshift-network-diagnostics/network-check-target-s8m4l"
Jul 24 17:03:30.582687 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.582416    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-host-kubelet\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.582687 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.582430    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-host-slash\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.582687 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.582444    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-host-cni-netd\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.582687 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.582461    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjqvd\" (UniqueName: \"kubernetes.io/projected/6f6b0a05-6bb5-48ac-915e-19c48fc03100-kube-api-access-rjqvd\") pod \"iptables-alerter-9qz26\" (UID: \"6f6b0a05-6bb5-48ac-915e-19c48fc03100\") " pod="openshift-network-operator/iptables-alerter-9qz26"
Jul 24 17:03:30.582687 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.582483    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-hostroot\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.582687 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.582523    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/071318f4-f26f-4eb9-8bd9-027146a171a4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2zx5f\" (UID: \"071318f4-f26f-4eb9-8bd9-027146a171a4\") " pod="openshift-multus/multus-additional-cni-plugins-2zx5f"
Jul 24 17:03:30.582687 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.582569    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-ovn-node-metrics-cert\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.582687 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.582587    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/70860e4d-6426-4b8d-9034-20447104e662-hosts-file\") pod \"node-resolver-6jbmb\" (UID: \"70860e4d-6426-4b8d-9034-20447104e662\") " pod="openshift-dns/node-resolver-6jbmb"
Jul 24 17:03:30.582687 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.582603    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec08480c-1bcc-4c15-8daa-095f89d01ec1-metrics-certs\") pod \"network-metrics-daemon-2fpd4\" (UID: \"ec08480c-1bcc-4c15-8daa-095f89d01ec1\") " pod="openshift-multus/network-metrics-daemon-2fpd4"
Jul 24 17:03:30.582687 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.582618    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-host-run-netns\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.582687 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.582640    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/911b3acf-4ae2-46c1-a53d-c59027fa44c5-konnectivity-ca\") pod \"konnectivity-agent-npqrh\" (UID: \"911b3acf-4ae2-46c1-a53d-c59027fa44c5\") " pod="kube-system/konnectivity-agent-npqrh"
Jul 24 17:03:30.582687 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.582657    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q77mb\" (UniqueName: \"kubernetes.io/projected/47bd6299-1889-4b65-90a3-15caf9a6cae4-kube-api-access-q77mb\") pod \"aws-ebs-csi-driver-node-lg79k\" (UID: \"47bd6299-1889-4b65-90a3-15caf9a6cae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg79k"
Jul 24 17:03:30.582687 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.582689    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-host-var-lib-cni-multus\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.583167 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.582707    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-cnibin\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.583167 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.582722    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-multus-socket-dir-parent\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.583167 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.582739    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-host-run-k8s-cni-cncf-io\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.583167 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.582774    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-host-var-lib-kubelet\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.583167 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.582794    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-multus-conf-dir\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.583167 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.582809    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-node-log\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.583167 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.582823    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-run-systemd\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.583167 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.582838    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-host-cni-bin\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.583167 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.582853    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-env-overrides\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.583167 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.582881    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f6b0a05-6bb5-48ac-915e-19c48fc03100-host-slash\") pod \"iptables-alerter-9qz26\" (UID: \"6f6b0a05-6bb5-48ac-915e-19c48fc03100\") " pod="openshift-network-operator/iptables-alerter-9qz26"
Jul 24 17:03:30.583167 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.582895    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70860e4d-6426-4b8d-9034-20447104e662-tmp-dir\") pod \"node-resolver-6jbmb\" (UID: \"70860e4d-6426-4b8d-9034-20447104e662\") " pod="openshift-dns/node-resolver-6jbmb"
Jul 24 17:03:30.583167 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.582909    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6f6b0a05-6bb5-48ac-915e-19c48fc03100-iptables-alerter-script\") pod \"iptables-alerter-9qz26\" (UID: \"6f6b0a05-6bb5-48ac-915e-19c48fc03100\") " pod="openshift-network-operator/iptables-alerter-9qz26"
Jul 24 17:03:30.583167 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.582923    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/071318f4-f26f-4eb9-8bd9-027146a171a4-cnibin\") pod \"multus-additional-cni-plugins-2zx5f\" (UID: \"071318f4-f26f-4eb9-8bd9-027146a171a4\") " pod="openshift-multus/multus-additional-cni-plugins-2zx5f"
Jul 24 17:03:30.583167 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.582988    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-var-lib-openvswitch\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.583167 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.583013    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-run-openvswitch\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.583167 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.583028    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-ovnkube-config\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.583167 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.583042    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/47bd6299-1889-4b65-90a3-15caf9a6cae4-socket-dir\") pod \"aws-ebs-csi-driver-node-lg79k\" (UID: \"47bd6299-1889-4b65-90a3-15caf9a6cae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg79k"
Jul 24 17:03:30.583840 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.583060    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/47bd6299-1889-4b65-90a3-15caf9a6cae4-registration-dir\") pod \"aws-ebs-csi-driver-node-lg79k\" (UID: \"47bd6299-1889-4b65-90a3-15caf9a6cae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg79k"
Jul 24 17:03:30.583840 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.583075    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-host-run-multus-certs\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.583840 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.583114    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/071318f4-f26f-4eb9-8bd9-027146a171a4-os-release\") pod \"multus-additional-cni-plugins-2zx5f\" (UID: \"071318f4-f26f-4eb9-8bd9-027146a171a4\") " pod="openshift-multus/multus-additional-cni-plugins-2zx5f"
Jul 24 17:03:30.583840 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.583136    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/071318f4-f26f-4eb9-8bd9-027146a171a4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2zx5f\" (UID: \"071318f4-f26f-4eb9-8bd9-027146a171a4\") " pod="openshift-multus/multus-additional-cni-plugins-2zx5f"
Jul 24 17:03:30.583840 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.583153    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-log-socket\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.583840 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.583187    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5sgm4"
Jul 24 17:03:30.583840 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.583186    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-host-run-ovn-kubernetes\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.583840 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.583215    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/911b3acf-4ae2-46c1-a53d-c59027fa44c5-agent-certs\") pod \"konnectivity-agent-npqrh\" (UID: \"911b3acf-4ae2-46c1-a53d-c59027fa44c5\") " pod="kube-system/konnectivity-agent-npqrh"
Jul 24 17:03:30.583840 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.583232    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/47bd6299-1889-4b65-90a3-15caf9a6cae4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lg79k\" (UID: \"47bd6299-1889-4b65-90a3-15caf9a6cae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg79k"
Jul 24 17:03:30.583840 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.583255    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-system-cni-dir\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.583840 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.583284    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-host-var-lib-cni-bin\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.583840 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.583309    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-multus-daemon-config\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.583840 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.583332    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-etc-kubernetes\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.583840 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.583356    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-systemd-units\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.583840 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.583384    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pknrl\" (UniqueName: \"kubernetes.io/projected/70860e4d-6426-4b8d-9034-20447104e662-kube-api-access-pknrl\") pod \"node-resolver-6jbmb\" (UID: \"70860e4d-6426-4b8d-9034-20447104e662\") " pod="openshift-dns/node-resolver-6jbmb"
Jul 24 17:03:30.583840 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.583410    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-os-release\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.583840 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.583425    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/071318f4-f26f-4eb9-8bd9-027146a171a4-cni-binary-copy\") pod \"multus-additional-cni-plugins-2zx5f\" (UID: \"071318f4-f26f-4eb9-8bd9-027146a171a4\") " pod="openshift-multus/multus-additional-cni-plugins-2zx5f"
Jul 24 17:03:30.584340 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.583448    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-etc-openvswitch\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.584340 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.583472    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-ovnkube-script-lib\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.584340 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.584070    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 24 17:03:30.584431 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.584344    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 24 17:03:30.584598 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.584583    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kg2bh\""
Jul 24 17:03:30.585182 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.585168    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 24 17:03:30.585223 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.585197    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 24 17:03:30.585293 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.585267    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 24 17:03:30.585385 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.585369    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ckwgn\""
Jul 24 17:03:30.586123 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.586083    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 16:58:30 +0000 UTC" deadline="2028-05-08 21:35:48.76901882 +0000 UTC"
Jul 24 17:03:30.586173 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.586123    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15700h32m18.182898338s"
Jul 24 17:03:30.586712 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.586698    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 17:03:30.586793 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.586774    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal"
Jul 24 17:03:30.586887 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.586871    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-134-152.ec2.internal"]
Jul 24 17:03:30.597894 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.597869    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 17:03:30.599375 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.599361    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 17:03:30.599521 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.599503    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal"]
Jul 24 17:03:30.612192 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.612176    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-496gd"
Jul 24 17:03:30.620272 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.620257    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-496gd"
Jul 24 17:03:30.677996 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.677976    2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 24 17:03:30.684650 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.684628    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts5lk\" (UniqueName: \"kubernetes.io/projected/de52b146-c409-4006-8e66-c7425fd2ca34-kube-api-access-ts5lk\") pod \"tuned-fhlm5\" (UID: \"de52b146-c409-4006-8e66-c7425fd2ca34\") " pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:30.684773 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.684657    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/08370467-8020-420e-a2e1-16dd3fb5ec66-serviceca\") pod \"node-ca-5sgm4\" (UID: \"08370467-8020-420e-a2e1-16dd3fb5ec66\") " pod="openshift-image-registry/node-ca-5sgm4"
Jul 24 17:03:30.684773 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.684691    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcj24\" (UniqueName: \"kubernetes.io/projected/071318f4-f26f-4eb9-8bd9-027146a171a4-kube-api-access-rcj24\") pod \"multus-additional-cni-plugins-2zx5f\" (UID: \"071318f4-f26f-4eb9-8bd9-027146a171a4\") " pod="openshift-multus/multus-additional-cni-plugins-2zx5f"
Jul 24 17:03:30.684773 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.684709    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-run-ovn\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.684773 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.684726    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5j55\" (UniqueName: \"kubernetes.io/projected/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-kube-api-access-k5j55\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.684773 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.684740    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de52b146-c409-4006-8e66-c7425fd2ca34-tmp\") pod \"tuned-fhlm5\" (UID: \"de52b146-c409-4006-8e66-c7425fd2ca34\") " pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:30.684773 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.684771    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqr87\" (UniqueName: \"kubernetes.io/projected/08370467-8020-420e-a2e1-16dd3fb5ec66-kube-api-access-jqr87\") pod \"node-ca-5sgm4\" (UID: \"08370467-8020-420e-a2e1-16dd3fb5ec66\") " pod="openshift-image-registry/node-ca-5sgm4"
Jul 24 17:03:30.685076 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.684820    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-cni-binary-copy\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.685076 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.684875    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-run-ovn\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.685076 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.684926    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.685076 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.685018    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/47bd6299-1889-4b65-90a3-15caf9a6cae4-sys-fs\") pod \"aws-ebs-csi-driver-node-lg79k\" (UID: \"47bd6299-1889-4b65-90a3-15caf9a6cae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg79k"
Jul 24 17:03:30.685076 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.685029    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.685076 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.685068    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcz8g\" (UniqueName: \"kubernetes.io/projected/ec08480c-1bcc-4c15-8daa-095f89d01ec1-kube-api-access-fcz8g\") pod \"network-metrics-daemon-2fpd4\" (UID: \"ec08480c-1bcc-4c15-8daa-095f89d01ec1\") " pod="openshift-multus/network-metrics-daemon-2fpd4"
Jul 24 17:03:30.685076 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.685078    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/47bd6299-1889-4b65-90a3-15caf9a6cae4-sys-fs\") pod \"aws-ebs-csi-driver-node-lg79k\" (UID: \"47bd6299-1889-4b65-90a3-15caf9a6cae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg79k"
Jul 24 17:03:30.685437 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.685109    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3cced35a-4cd2-4520-a5c4-9e0f5e0e891b-kubelet-config\") pod \"global-pull-secret-syncer-mhjb8\" (UID: \"3cced35a-4cd2-4520-a5c4-9e0f5e0e891b\") " pod="kube-system/global-pull-secret-syncer-mhjb8"
Jul 24 17:03:30.685437 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.685198    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3cced35a-4cd2-4520-a5c4-9e0f5e0e891b-original-pull-secret\") pod \"global-pull-secret-syncer-mhjb8\" (UID: \"3cced35a-4cd2-4520-a5c4-9e0f5e0e891b\") " pod="kube-system/global-pull-secret-syncer-mhjb8"
Jul 24 17:03:30.685437 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.685234    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwbln\" (UniqueName: \"kubernetes.io/projected/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-kube-api-access-pwbln\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.685437 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.685257    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-multus-cni-dir\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.685437 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.685276    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/071318f4-f26f-4eb9-8bd9-027146a171a4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2zx5f\" (UID: \"071318f4-f26f-4eb9-8bd9-027146a171a4\") " pod="openshift-multus/multus-additional-cni-plugins-2zx5f"
Jul 24 17:03:30.685437 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.685295    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de52b146-c409-4006-8e66-c7425fd2ca34-sys\") pod \"tuned-fhlm5\" (UID: \"de52b146-c409-4006-8e66-c7425fd2ca34\") " pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:30.685437 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.685317    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/47bd6299-1889-4b65-90a3-15caf9a6cae4-device-dir\") pod \"aws-ebs-csi-driver-node-lg79k\" (UID: \"47bd6299-1889-4b65-90a3-15caf9a6cae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg79k"
Jul 24 17:03:30.685437 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.685334    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-host-run-netns\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.685437 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.685350    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/071318f4-f26f-4eb9-8bd9-027146a171a4-system-cni-dir\") pod \"multus-additional-cni-plugins-2zx5f\" (UID: \"071318f4-f26f-4eb9-8bd9-027146a171a4\") " pod="openshift-multus/multus-additional-cni-plugins-2zx5f"
Jul 24 17:03:30.685437 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.685364    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3cced35a-4cd2-4520-a5c4-9e0f5e0e891b-dbus\") pod \"global-pull-secret-syncer-mhjb8\" (UID: \"3cced35a-4cd2-4520-a5c4-9e0f5e0e891b\") " pod="kube-system/global-pull-secret-syncer-mhjb8"
Jul 24 17:03:30.685437 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.685388    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/47bd6299-1889-4b65-90a3-15caf9a6cae4-etc-selinux\") pod \"aws-ebs-csi-driver-node-lg79k\" (UID: \"47bd6299-1889-4b65-90a3-15caf9a6cae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg79k"
Jul 24 17:03:30.685437 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.685405    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/47bd6299-1889-4b65-90a3-15caf9a6cae4-device-dir\") pod \"aws-ebs-csi-driver-node-lg79k\" (UID: \"47bd6299-1889-4b65-90a3-15caf9a6cae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg79k"
Jul 24 17:03:30.685437 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.685411    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-host-run-netns\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.685437 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.685414    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzb28\" (UniqueName: \"kubernetes.io/projected/e066d7db-af43-4c57-b832-3936cecdb3bc-kube-api-access-nzb28\") pod \"network-check-target-s8m4l\" (UID: \"e066d7db-af43-4c57-b832-3936cecdb3bc\") " pod="openshift-network-diagnostics/network-check-target-s8m4l"
Jul 24 17:03:30.686106 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.685479    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-multus-cni-dir\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.686106 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.685485    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/071318f4-f26f-4eb9-8bd9-027146a171a4-system-cni-dir\") pod \"multus-additional-cni-plugins-2zx5f\" (UID: \"071318f4-f26f-4eb9-8bd9-027146a171a4\") " pod="openshift-multus/multus-additional-cni-plugins-2zx5f"
Jul 24 17:03:30.686106 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.685513    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/47bd6299-1889-4b65-90a3-15caf9a6cae4-etc-selinux\") pod \"aws-ebs-csi-driver-node-lg79k\" (UID: \"47bd6299-1889-4b65-90a3-15caf9a6cae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg79k"
Jul 24 17:03:30.686106 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.685517    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/de52b146-c409-4006-8e66-c7425fd2ca34-etc-modprobe-d\") pod \"tuned-fhlm5\" (UID: \"de52b146-c409-4006-8e66-c7425fd2ca34\") " pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:30.686106 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.685557    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-host-kubelet\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.686106 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.685561    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-cni-binary-copy\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.686106 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.685580    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-host-slash\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.686106 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.685606    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-host-cni-netd\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.686106 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.685622    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-host-kubelet\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.686106 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.685633    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjqvd\" (UniqueName: \"kubernetes.io/projected/6f6b0a05-6bb5-48ac-915e-19c48fc03100-kube-api-access-rjqvd\") pod \"iptables-alerter-9qz26\" (UID: \"6f6b0a05-6bb5-48ac-915e-19c48fc03100\") " pod="openshift-network-operator/iptables-alerter-9qz26"
Jul 24 17:03:30.686106 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.685642    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-host-slash\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.686106 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.685660    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-host-cni-netd\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.686106 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.685702    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-hostroot\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.686106 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.685740    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/071318f4-f26f-4eb9-8bd9-027146a171a4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2zx5f\" (UID: \"071318f4-f26f-4eb9-8bd9-027146a171a4\") " pod="openshift-multus/multus-additional-cni-plugins-2zx5f"
Jul 24 17:03:30.686106 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.685760    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/de52b146-c409-4006-8e66-c7425fd2ca34-etc-sysconfig\") pod \"tuned-fhlm5\" (UID: \"de52b146-c409-4006-8e66-c7425fd2ca34\") " pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:30.686106 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.685795    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/071318f4-f26f-4eb9-8bd9-027146a171a4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2zx5f\" (UID: \"071318f4-f26f-4eb9-8bd9-027146a171a4\") " pod="openshift-multus/multus-additional-cni-plugins-2zx5f"
Jul 24 17:03:30.686106 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.685800    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-hostroot\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.686943 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.685787    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-ovn-node-metrics-cert\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.686943 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.685862    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/70860e4d-6426-4b8d-9034-20447104e662-hosts-file\") pod \"node-resolver-6jbmb\" (UID: \"70860e4d-6426-4b8d-9034-20447104e662\") " pod="openshift-dns/node-resolver-6jbmb"
Jul 24 17:03:30.686943 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.685888    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec08480c-1bcc-4c15-8daa-095f89d01ec1-metrics-certs\") pod \"network-metrics-daemon-2fpd4\" (UID: \"ec08480c-1bcc-4c15-8daa-095f89d01ec1\") " pod="openshift-multus/network-metrics-daemon-2fpd4"
Jul 24 17:03:30.686943 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.685897    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/071318f4-f26f-4eb9-8bd9-027146a171a4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2zx5f\" (UID: \"071318f4-f26f-4eb9-8bd9-027146a171a4\") " pod="openshift-multus/multus-additional-cni-plugins-2zx5f"
Jul 24 17:03:30.686943 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.685913    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/de52b146-c409-4006-8e66-c7425fd2ca34-run\") pod \"tuned-fhlm5\" (UID: \"de52b146-c409-4006-8e66-c7425fd2ca34\") " pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:30.686943 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.685925    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/70860e4d-6426-4b8d-9034-20447104e662-hosts-file\") pod \"node-resolver-6jbmb\" (UID: \"70860e4d-6426-4b8d-9034-20447104e662\") " pod="openshift-dns/node-resolver-6jbmb"
Jul 24 17:03:30.686943 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.686019    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/08370467-8020-420e-a2e1-16dd3fb5ec66-host\") pod \"node-ca-5sgm4\" (UID: \"08370467-8020-420e-a2e1-16dd3fb5ec66\") " pod="openshift-image-registry/node-ca-5sgm4"
Jul 24 17:03:30.686943 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.686039    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-host-run-netns\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.686943 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:30.686046    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:30.686943 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.686056    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/911b3acf-4ae2-46c1-a53d-c59027fa44c5-konnectivity-ca\") pod \"konnectivity-agent-npqrh\" (UID: \"911b3acf-4ae2-46c1-a53d-c59027fa44c5\") " pod="kube-system/konnectivity-agent-npqrh"
Jul 24 17:03:30.686943 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.686075    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q77mb\" (UniqueName: \"kubernetes.io/projected/47bd6299-1889-4b65-90a3-15caf9a6cae4-kube-api-access-q77mb\") pod \"aws-ebs-csi-driver-node-lg79k\" (UID: \"47bd6299-1889-4b65-90a3-15caf9a6cae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg79k"
Jul 24 17:03:30.686943 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.686100    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-host-var-lib-cni-multus\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.686943 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:30.686133    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec08480c-1bcc-4c15-8daa-095f89d01ec1-metrics-certs podName:ec08480c-1bcc-4c15-8daa-095f89d01ec1 nodeName:}" failed. No retries permitted until 2026-07-24 17:03:31.186110321 +0000 UTC m=+2.002084926 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec08480c-1bcc-4c15-8daa-095f89d01ec1-metrics-certs") pod "network-metrics-daemon-2fpd4" (UID: "ec08480c-1bcc-4c15-8daa-095f89d01ec1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:30.686943 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.686140    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-host-var-lib-cni-multus\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.686943 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.686141    2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 24 17:03:30.686943 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.686180    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-host-run-netns\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.686943 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.686184    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de52b146-c409-4006-8e66-c7425fd2ca34-etc-kubernetes\") pod \"tuned-fhlm5\" (UID: \"de52b146-c409-4006-8e66-c7425fd2ca34\") " pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:30.687831 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.686224    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/de52b146-c409-4006-8e66-c7425fd2ca34-lib-modules\") pod \"tuned-fhlm5\" (UID: \"de52b146-c409-4006-8e66-c7425fd2ca34\") " pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:30.687831 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.686260    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-cnibin\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.687831 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.686286    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-multus-socket-dir-parent\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.687831 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.686313    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-host-run-k8s-cni-cncf-io\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.687831 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.686361    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-host-run-k8s-cni-cncf-io\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.687831 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.686382    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-cnibin\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.687831 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.686386    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-multus-socket-dir-parent\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.687831 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.686434    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-host-var-lib-kubelet\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.687831 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.686467    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-multus-conf-dir\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.687831 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.686515    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-node-log\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.687831 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.686521    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-host-var-lib-kubelet\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.687831 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.686540    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-run-systemd\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.687831 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.686567    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-multus-conf-dir\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.687831 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.686572    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-host-cni-bin\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.687831 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.686599    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-env-overrides\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.687831 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.686605    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-run-systemd\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.687831 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.686605    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-node-log\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.687831 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.686631    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f6b0a05-6bb5-48ac-915e-19c48fc03100-host-slash\") pod \"iptables-alerter-9qz26\" (UID: \"6f6b0a05-6bb5-48ac-915e-19c48fc03100\") " pod="openshift-network-operator/iptables-alerter-9qz26"
Jul 24 17:03:30.688615 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.686660    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70860e4d-6426-4b8d-9034-20447104e662-tmp-dir\") pod \"node-resolver-6jbmb\" (UID: \"70860e4d-6426-4b8d-9034-20447104e662\") " pod="openshift-dns/node-resolver-6jbmb"
Jul 24 17:03:30.688615 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.686667    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-host-cni-bin\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.688615 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.686605    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/911b3acf-4ae2-46c1-a53d-c59027fa44c5-konnectivity-ca\") pod \"konnectivity-agent-npqrh\" (UID: \"911b3acf-4ae2-46c1-a53d-c59027fa44c5\") " pod="kube-system/konnectivity-agent-npqrh"
Jul 24 17:03:30.688615 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.686695    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6f6b0a05-6bb5-48ac-915e-19c48fc03100-iptables-alerter-script\") pod \"iptables-alerter-9qz26\" (UID: \"6f6b0a05-6bb5-48ac-915e-19c48fc03100\") " pod="openshift-network-operator/iptables-alerter-9qz26"
Jul 24 17:03:30.688615 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.686704    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f6b0a05-6bb5-48ac-915e-19c48fc03100-host-slash\") pod \"iptables-alerter-9qz26\" (UID: \"6f6b0a05-6bb5-48ac-915e-19c48fc03100\") " pod="openshift-network-operator/iptables-alerter-9qz26"
Jul 24 17:03:30.688615 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.686719    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/071318f4-f26f-4eb9-8bd9-027146a171a4-cnibin\") pod \"multus-additional-cni-plugins-2zx5f\" (UID: \"071318f4-f26f-4eb9-8bd9-027146a171a4\") " pod="openshift-multus/multus-additional-cni-plugins-2zx5f"
Jul 24 17:03:30.688615 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.686746    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de52b146-c409-4006-8e66-c7425fd2ca34-var-lib-kubelet\") pod \"tuned-fhlm5\" (UID: \"de52b146-c409-4006-8e66-c7425fd2ca34\") " pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:30.688615 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.686767    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/de52b146-c409-4006-8e66-c7425fd2ca34-host\") pod \"tuned-fhlm5\" (UID: \"de52b146-c409-4006-8e66-c7425fd2ca34\") " pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:30.688615 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.686790    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-var-lib-openvswitch\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.688615 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.686814    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-run-openvswitch\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.688615 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.686866    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-run-openvswitch\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.688615 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.686911    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/071318f4-f26f-4eb9-8bd9-027146a171a4-cnibin\") pod \"multus-additional-cni-plugins-2zx5f\" (UID: \"071318f4-f26f-4eb9-8bd9-027146a171a4\") " pod="openshift-multus/multus-additional-cni-plugins-2zx5f"
Jul 24 17:03:30.688615 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.686946    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-ovnkube-config\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.688615 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.686973    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/47bd6299-1889-4b65-90a3-15caf9a6cae4-socket-dir\") pod \"aws-ebs-csi-driver-node-lg79k\" (UID: \"47bd6299-1889-4b65-90a3-15caf9a6cae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg79k"
Jul 24 17:03:30.688615 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.687005    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-var-lib-openvswitch\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.688615 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.687022    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/47bd6299-1889-4b65-90a3-15caf9a6cae4-registration-dir\") pod \"aws-ebs-csi-driver-node-lg79k\" (UID: \"47bd6299-1889-4b65-90a3-15caf9a6cae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg79k"
Jul 24 17:03:30.688615 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.687040    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70860e4d-6426-4b8d-9034-20447104e662-tmp-dir\") pod \"node-resolver-6jbmb\" (UID: \"70860e4d-6426-4b8d-9034-20447104e662\") " pod="openshift-dns/node-resolver-6jbmb"
Jul 24 17:03:30.689187 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.687058    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-host-run-multus-certs\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.689187 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.687088    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/071318f4-f26f-4eb9-8bd9-027146a171a4-os-release\") pod \"multus-additional-cni-plugins-2zx5f\" (UID: \"071318f4-f26f-4eb9-8bd9-027146a171a4\") " pod="openshift-multus/multus-additional-cni-plugins-2zx5f"
Jul 24 17:03:30.689187 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.687065    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-env-overrides\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.689187 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.687111    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/47bd6299-1889-4b65-90a3-15caf9a6cae4-socket-dir\") pod \"aws-ebs-csi-driver-node-lg79k\" (UID: \"47bd6299-1889-4b65-90a3-15caf9a6cae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg79k"
Jul 24 17:03:30.689187 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.687117    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/071318f4-f26f-4eb9-8bd9-027146a171a4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2zx5f\" (UID: \"071318f4-f26f-4eb9-8bd9-027146a171a4\") " pod="openshift-multus/multus-additional-cni-plugins-2zx5f"
Jul 24 17:03:30.689187 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.687135    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/47bd6299-1889-4b65-90a3-15caf9a6cae4-registration-dir\") pod \"aws-ebs-csi-driver-node-lg79k\" (UID: \"47bd6299-1889-4b65-90a3-15caf9a6cae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg79k"
Jul 24 17:03:30.689187 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.687144    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-host-run-multus-certs\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.689187 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.687151    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-log-socket\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.689187 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.687185    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-host-run-ovn-kubernetes\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.689187 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.687210    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/071318f4-f26f-4eb9-8bd9-027146a171a4-os-release\") pod \"multus-additional-cni-plugins-2zx5f\" (UID: \"071318f4-f26f-4eb9-8bd9-027146a171a4\") " pod="openshift-multus/multus-additional-cni-plugins-2zx5f"
Jul 24 17:03:30.689187 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.687213    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/911b3acf-4ae2-46c1-a53d-c59027fa44c5-agent-certs\") pod \"konnectivity-agent-npqrh\" (UID: \"911b3acf-4ae2-46c1-a53d-c59027fa44c5\") " pod="kube-system/konnectivity-agent-npqrh"
Jul 24 17:03:30.689187 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.687219    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-host-run-ovn-kubernetes\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.689187 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.687187    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-log-socket\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.689187 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.687249    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/47bd6299-1889-4b65-90a3-15caf9a6cae4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lg79k\" (UID: \"47bd6299-1889-4b65-90a3-15caf9a6cae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg79k"
Jul 24 17:03:30.689187 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.687275    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-system-cni-dir\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.689187 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.687304    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-host-var-lib-cni-bin\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.689187 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.687329    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-multus-daemon-config\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.689805 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.687353    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/47bd6299-1889-4b65-90a3-15caf9a6cae4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lg79k\" (UID: \"47bd6299-1889-4b65-90a3-15caf9a6cae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg79k"
Jul 24 17:03:30.689805 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.687357    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-etc-kubernetes\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.689805 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.687390    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-systemd-units\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.689805 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.687406    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6f6b0a05-6bb5-48ac-915e-19c48fc03100-iptables-alerter-script\") pod \"iptables-alerter-9qz26\" (UID: \"6f6b0a05-6bb5-48ac-915e-19c48fc03100\") " pod="openshift-network-operator/iptables-alerter-9qz26"
Jul 24 17:03:30.689805 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.687420    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pknrl\" (UniqueName: \"kubernetes.io/projected/70860e4d-6426-4b8d-9034-20447104e662-kube-api-access-pknrl\") pod \"node-resolver-6jbmb\" (UID: \"70860e4d-6426-4b8d-9034-20447104e662\") " pod="openshift-dns/node-resolver-6jbmb"
Jul 24 17:03:30.689805 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.687436    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-system-cni-dir\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.689805 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.687446    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-ovnkube-config\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.689805 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.687460    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-os-release\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.689805 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.687471    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-host-var-lib-cni-bin\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.689805 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.687491    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/071318f4-f26f-4eb9-8bd9-027146a171a4-cni-binary-copy\") pod \"multus-additional-cni-plugins-2zx5f\" (UID: \"071318f4-f26f-4eb9-8bd9-027146a171a4\") " pod="openshift-multus/multus-additional-cni-plugins-2zx5f"
Jul 24 17:03:30.689805 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.687521    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/de52b146-c409-4006-8e66-c7425fd2ca34-etc-sysctl-d\") pod \"tuned-fhlm5\" (UID: \"de52b146-c409-4006-8e66-c7425fd2ca34\") " pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:30.689805 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.687527    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-systemd-units\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.689805 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.687394    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-etc-kubernetes\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.689805 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.687546    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/de52b146-c409-4006-8e66-c7425fd2ca34-etc-sysctl-conf\") pod \"tuned-fhlm5\" (UID: \"de52b146-c409-4006-8e66-c7425fd2ca34\") " pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:30.689805 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.687571    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/de52b146-c409-4006-8e66-c7425fd2ca34-etc-systemd\") pod \"tuned-fhlm5\" (UID: \"de52b146-c409-4006-8e66-c7425fd2ca34\") " pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:30.689805 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.687595    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/de52b146-c409-4006-8e66-c7425fd2ca34-etc-tuned\") pod \"tuned-fhlm5\" (UID: \"de52b146-c409-4006-8e66-c7425fd2ca34\") " pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:30.689805 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.687648    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-etc-openvswitch\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.690356 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.687677    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-ovnkube-script-lib\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.690356 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.687737    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-etc-openvswitch\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.690356 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.687645    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-os-release\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.690356 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.687946    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-multus-daemon-config\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.690356 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.688063    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/071318f4-f26f-4eb9-8bd9-027146a171a4-cni-binary-copy\") pod \"multus-additional-cni-plugins-2zx5f\" (UID: \"071318f4-f26f-4eb9-8bd9-027146a171a4\") " pod="openshift-multus/multus-additional-cni-plugins-2zx5f"
Jul 24 17:03:30.690356 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.688168    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/071318f4-f26f-4eb9-8bd9-027146a171a4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2zx5f\" (UID: \"071318f4-f26f-4eb9-8bd9-027146a171a4\") " pod="openshift-multus/multus-additional-cni-plugins-2zx5f"
Jul 24 17:03:30.690356 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.688299    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-ovnkube-script-lib\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.690356 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.689789    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-ovn-node-metrics-cert\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.690356 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.689812    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/911b3acf-4ae2-46c1-a53d-c59027fa44c5-agent-certs\") pod \"konnectivity-agent-npqrh\" (UID: \"911b3acf-4ae2-46c1-a53d-c59027fa44c5\") " pod="kube-system/konnectivity-agent-npqrh"
Jul 24 17:03:30.695055 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:30.695034    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:03:30.695178 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:30.695060    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:03:30.695178 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:30.695075    2582 projected.go:196] Error preparing data for projected volume kube-api-access-nzb28 for pod openshift-network-diagnostics/network-check-target-s8m4l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:30.695178 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:30.695152    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e066d7db-af43-4c57-b832-3936cecdb3bc-kube-api-access-nzb28 podName:e066d7db-af43-4c57-b832-3936cecdb3bc nodeName:}" failed. No retries permitted until 2026-07-24 17:03:31.19513365 +0000 UTC m=+2.011108246 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nzb28" (UniqueName: "kubernetes.io/projected/e066d7db-af43-4c57-b832-3936cecdb3bc-kube-api-access-nzb28") pod "network-check-target-s8m4l" (UID: "e066d7db-af43-4c57-b832-3936cecdb3bc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:30.696865 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.696837    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcj24\" (UniqueName: \"kubernetes.io/projected/071318f4-f26f-4eb9-8bd9-027146a171a4-kube-api-access-rcj24\") pod \"multus-additional-cni-plugins-2zx5f\" (UID: \"071318f4-f26f-4eb9-8bd9-027146a171a4\") " pod="openshift-multus/multus-additional-cni-plugins-2zx5f"
Jul 24 17:03:30.697049 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.697025    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcz8g\" (UniqueName: \"kubernetes.io/projected/ec08480c-1bcc-4c15-8daa-095f89d01ec1-kube-api-access-fcz8g\") pod \"network-metrics-daemon-2fpd4\" (UID: \"ec08480c-1bcc-4c15-8daa-095f89d01ec1\") " pod="openshift-multus/network-metrics-daemon-2fpd4"
Jul 24 17:03:30.697501 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.697476    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q77mb\" (UniqueName: \"kubernetes.io/projected/47bd6299-1889-4b65-90a3-15caf9a6cae4-kube-api-access-q77mb\") pod \"aws-ebs-csi-driver-node-lg79k\" (UID: \"47bd6299-1889-4b65-90a3-15caf9a6cae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg79k"
Jul 24 17:03:30.698445 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.698423    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwbln\" (UniqueName: \"kubernetes.io/projected/9f3e23c6-31a7-4e7b-83df-d6eee1335b7a-kube-api-access-pwbln\") pod \"ovnkube-node-d6w2m\" (UID: \"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:30.698610 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.698594    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjqvd\" (UniqueName: \"kubernetes.io/projected/6f6b0a05-6bb5-48ac-915e-19c48fc03100-kube-api-access-rjqvd\") pod \"iptables-alerter-9qz26\" (UID: \"6f6b0a05-6bb5-48ac-915e-19c48fc03100\") " pod="openshift-network-operator/iptables-alerter-9qz26"
Jul 24 17:03:30.698998 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.698977    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5j55\" (UniqueName: \"kubernetes.io/projected/a2a54d49-4912-4cf3-8f17-4d20ef08a9e2-kube-api-access-k5j55\") pod \"multus-228jg\" (UID: \"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2\") " pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.700844 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.700827    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pknrl\" (UniqueName: \"kubernetes.io/projected/70860e4d-6426-4b8d-9034-20447104e662-kube-api-access-pknrl\") pod \"node-resolver-6jbmb\" (UID: \"70860e4d-6426-4b8d-9034-20447104e662\") " pod="openshift-dns/node-resolver-6jbmb"
Jul 24 17:03:30.788215 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.788175    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de52b146-c409-4006-8e66-c7425fd2ca34-var-lib-kubelet\") pod \"tuned-fhlm5\" (UID: \"de52b146-c409-4006-8e66-c7425fd2ca34\") " pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:30.788478 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.788228    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/de52b146-c409-4006-8e66-c7425fd2ca34-host\") pod \"tuned-fhlm5\" (UID: \"de52b146-c409-4006-8e66-c7425fd2ca34\") " pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:30.788478 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.788260    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de52b146-c409-4006-8e66-c7425fd2ca34-var-lib-kubelet\") pod \"tuned-fhlm5\" (UID: \"de52b146-c409-4006-8e66-c7425fd2ca34\") " pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:30.788478 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.788285    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/de52b146-c409-4006-8e66-c7425fd2ca34-etc-sysctl-d\") pod \"tuned-fhlm5\" (UID: \"de52b146-c409-4006-8e66-c7425fd2ca34\") " pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:30.788478 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.788309    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/de52b146-c409-4006-8e66-c7425fd2ca34-etc-sysctl-conf\") pod \"tuned-fhlm5\" (UID: \"de52b146-c409-4006-8e66-c7425fd2ca34\") " pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:30.788478 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.788335    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/de52b146-c409-4006-8e66-c7425fd2ca34-etc-systemd\") pod \"tuned-fhlm5\" (UID: \"de52b146-c409-4006-8e66-c7425fd2ca34\") " pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:30.788478 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.788337    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/de52b146-c409-4006-8e66-c7425fd2ca34-host\") pod \"tuned-fhlm5\" (UID: \"de52b146-c409-4006-8e66-c7425fd2ca34\") " pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:30.788478 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.788362    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/de52b146-c409-4006-8e66-c7425fd2ca34-etc-tuned\") pod \"tuned-fhlm5\" (UID: \"de52b146-c409-4006-8e66-c7425fd2ca34\") " pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:30.788478 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.788408    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts5lk\" (UniqueName: \"kubernetes.io/projected/de52b146-c409-4006-8e66-c7425fd2ca34-kube-api-access-ts5lk\") pod \"tuned-fhlm5\" (UID: \"de52b146-c409-4006-8e66-c7425fd2ca34\") " pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:30.788478 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.788433    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/08370467-8020-420e-a2e1-16dd3fb5ec66-serviceca\") pod \"node-ca-5sgm4\" (UID: \"08370467-8020-420e-a2e1-16dd3fb5ec66\") " pod="openshift-image-registry/node-ca-5sgm4"
Jul 24 17:03:30.788478 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.788461    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de52b146-c409-4006-8e66-c7425fd2ca34-tmp\") pod \"tuned-fhlm5\" (UID: \"de52b146-c409-4006-8e66-c7425fd2ca34\") " pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:30.788478 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.788469    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/de52b146-c409-4006-8e66-c7425fd2ca34-etc-sysctl-d\") pod \"tuned-fhlm5\" (UID: \"de52b146-c409-4006-8e66-c7425fd2ca34\") " pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:30.788478 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.788469    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/de52b146-c409-4006-8e66-c7425fd2ca34-etc-systemd\") pod \"tuned-fhlm5\" (UID: \"de52b146-c409-4006-8e66-c7425fd2ca34\") " pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:30.789102 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.788479    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/de52b146-c409-4006-8e66-c7425fd2ca34-etc-sysctl-conf\") pod \"tuned-fhlm5\" (UID: \"de52b146-c409-4006-8e66-c7425fd2ca34\") " pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:30.789102 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.788487    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqr87\" (UniqueName: \"kubernetes.io/projected/08370467-8020-420e-a2e1-16dd3fb5ec66-kube-api-access-jqr87\") pod \"node-ca-5sgm4\" (UID: \"08370467-8020-420e-a2e1-16dd3fb5ec66\") " pod="openshift-image-registry/node-ca-5sgm4"
Jul 24 17:03:30.789102 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.788729    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3cced35a-4cd2-4520-a5c4-9e0f5e0e891b-kubelet-config\") pod \"global-pull-secret-syncer-mhjb8\" (UID: \"3cced35a-4cd2-4520-a5c4-9e0f5e0e891b\") " pod="kube-system/global-pull-secret-syncer-mhjb8"
Jul 24 17:03:30.789102 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.788813    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3cced35a-4cd2-4520-a5c4-9e0f5e0e891b-kubelet-config\") pod \"global-pull-secret-syncer-mhjb8\" (UID: \"3cced35a-4cd2-4520-a5c4-9e0f5e0e891b\") " pod="kube-system/global-pull-secret-syncer-mhjb8"
Jul 24 17:03:30.789102 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.788874    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3cced35a-4cd2-4520-a5c4-9e0f5e0e891b-original-pull-secret\") pod \"global-pull-secret-syncer-mhjb8\" (UID: \"3cced35a-4cd2-4520-a5c4-9e0f5e0e891b\") " pod="kube-system/global-pull-secret-syncer-mhjb8"
Jul 24 17:03:30.789102 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.788923    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de52b146-c409-4006-8e66-c7425fd2ca34-sys\") pod \"tuned-fhlm5\" (UID: \"de52b146-c409-4006-8e66-c7425fd2ca34\") " pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:30.789102 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.789006    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3cced35a-4cd2-4520-a5c4-9e0f5e0e891b-dbus\") pod \"global-pull-secret-syncer-mhjb8\" (UID: \"3cced35a-4cd2-4520-a5c4-9e0f5e0e891b\") " pod="kube-system/global-pull-secret-syncer-mhjb8"
Jul 24 17:03:30.789102 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.789071    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/de52b146-c409-4006-8e66-c7425fd2ca34-etc-modprobe-d\") pod \"tuned-fhlm5\" (UID: \"de52b146-c409-4006-8e66-c7425fd2ca34\") " pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:30.789102 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.789074    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3cced35a-4cd2-4520-a5c4-9e0f5e0e891b-dbus\") pod \"global-pull-secret-syncer-mhjb8\" (UID: \"3cced35a-4cd2-4520-a5c4-9e0f5e0e891b\") " pod="kube-system/global-pull-secret-syncer-mhjb8"
Jul 24 17:03:30.789102 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.789104    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/de52b146-c409-4006-8e66-c7425fd2ca34-etc-sysconfig\") pod \"tuned-fhlm5\" (UID: \"de52b146-c409-4006-8e66-c7425fd2ca34\") " pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:30.789471 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.789156    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/de52b146-c409-4006-8e66-c7425fd2ca34-run\") pod \"tuned-fhlm5\" (UID: \"de52b146-c409-4006-8e66-c7425fd2ca34\") " pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:30.789471 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.789182    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/08370467-8020-420e-a2e1-16dd3fb5ec66-host\") pod \"node-ca-5sgm4\" (UID: \"08370467-8020-420e-a2e1-16dd3fb5ec66\") " pod="openshift-image-registry/node-ca-5sgm4"
Jul 24 17:03:30.789471 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.789184    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/de52b146-c409-4006-8e66-c7425fd2ca34-etc-modprobe-d\") pod \"tuned-fhlm5\" (UID: \"de52b146-c409-4006-8e66-c7425fd2ca34\") " pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:30.789471 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:30.789016    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:30.789471 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.789210    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de52b146-c409-4006-8e66-c7425fd2ca34-etc-kubernetes\") pod \"tuned-fhlm5\" (UID: \"de52b146-c409-4006-8e66-c7425fd2ca34\") " pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:30.789471 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.789235    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/de52b146-c409-4006-8e66-c7425fd2ca34-lib-modules\") pod \"tuned-fhlm5\" (UID: \"de52b146-c409-4006-8e66-c7425fd2ca34\") " pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:30.789471 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:30.789255    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cced35a-4cd2-4520-a5c4-9e0f5e0e891b-original-pull-secret podName:3cced35a-4cd2-4520-a5c4-9e0f5e0e891b nodeName:}" failed. No retries permitted until 2026-07-24 17:03:31.289233057 +0000 UTC m=+2.105207661 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3cced35a-4cd2-4520-a5c4-9e0f5e0e891b-original-pull-secret") pod "global-pull-secret-syncer-mhjb8" (UID: "3cced35a-4cd2-4520-a5c4-9e0f5e0e891b") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:30.789471 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.789387    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/de52b146-c409-4006-8e66-c7425fd2ca34-lib-modules\") pod \"tuned-fhlm5\" (UID: \"de52b146-c409-4006-8e66-c7425fd2ca34\") " pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:30.789471 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.789014    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de52b146-c409-4006-8e66-c7425fd2ca34-sys\") pod \"tuned-fhlm5\" (UID: \"de52b146-c409-4006-8e66-c7425fd2ca34\") " pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:30.789471 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.789446    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/de52b146-c409-4006-8e66-c7425fd2ca34-run\") pod \"tuned-fhlm5\" (UID: \"de52b146-c409-4006-8e66-c7425fd2ca34\") " pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:30.789471 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.789452    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/de52b146-c409-4006-8e66-c7425fd2ca34-etc-sysconfig\") pod \"tuned-fhlm5\" (UID: \"de52b146-c409-4006-8e66-c7425fd2ca34\") " pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:30.789967 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.789488    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/08370467-8020-420e-a2e1-16dd3fb5ec66-host\") pod \"node-ca-5sgm4\" (UID: \"08370467-8020-420e-a2e1-16dd3fb5ec66\") " pod="openshift-image-registry/node-ca-5sgm4"
Jul 24 17:03:30.789967 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.789519    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de52b146-c409-4006-8e66-c7425fd2ca34-etc-kubernetes\") pod \"tuned-fhlm5\" (UID: \"de52b146-c409-4006-8e66-c7425fd2ca34\") " pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:30.789967 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.789702    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/08370467-8020-420e-a2e1-16dd3fb5ec66-serviceca\") pod \"node-ca-5sgm4\" (UID: \"08370467-8020-420e-a2e1-16dd3fb5ec66\") " pod="openshift-image-registry/node-ca-5sgm4"
Jul 24 17:03:30.790951 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.790929    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de52b146-c409-4006-8e66-c7425fd2ca34-tmp\") pod \"tuned-fhlm5\" (UID: \"de52b146-c409-4006-8e66-c7425fd2ca34\") " pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:30.791081 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.790975    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/de52b146-c409-4006-8e66-c7425fd2ca34-etc-tuned\") pod \"tuned-fhlm5\" (UID: \"de52b146-c409-4006-8e66-c7425fd2ca34\") " pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:30.797862 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.797840    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts5lk\" (UniqueName: \"kubernetes.io/projected/de52b146-c409-4006-8e66-c7425fd2ca34-kube-api-access-ts5lk\") pod \"tuned-fhlm5\" (UID: \"de52b146-c409-4006-8e66-c7425fd2ca34\") " pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:30.797978 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.797944    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqr87\" (UniqueName: \"kubernetes.io/projected/08370467-8020-420e-a2e1-16dd3fb5ec66-kube-api-access-jqr87\") pod \"node-ca-5sgm4\" (UID: \"08370467-8020-420e-a2e1-16dd3fb5ec66\") " pod="openshift-image-registry/node-ca-5sgm4"
Jul 24 17:03:30.878187 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:30.878150    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5769d40c696eb94e1a1746849e9cb1ff.slice/crio-f29abde7c380690a05c130542ebcb34f26a7d27675556b6e2e275fc94e2c9fba WatchSource:0}: Error finding container f29abde7c380690a05c130542ebcb34f26a7d27675556b6e2e275fc94e2c9fba: Status 404 returned error can't find the container with id f29abde7c380690a05c130542ebcb34f26a7d27675556b6e2e275fc94e2c9fba
Jul 24 17:03:30.878825 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:30.878799    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c6eecdeb9041331a4921846ff748148.slice/crio-a93eb07d2908ed5d477bf4381fc35b761217605dd75a29c8ebcf1a9429a711a1 WatchSource:0}: Error finding container a93eb07d2908ed5d477bf4381fc35b761217605dd75a29c8ebcf1a9429a711a1: Status 404 returned error can't find the container with id a93eb07d2908ed5d477bf4381fc35b761217605dd75a29c8ebcf1a9429a711a1
Jul 24 17:03:30.884128 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.884111    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 17:03:30.898371 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.898341    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9qz26"
Jul 24 17:03:30.906409 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:30.906383    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f6b0a05_6bb5_48ac_915e_19c48fc03100.slice/crio-0d1cccb7f6184b10e338130644e9dbfdfb7457bbc43ea90a37fb3fbfac70eea0 WatchSource:0}: Error finding container 0d1cccb7f6184b10e338130644e9dbfdfb7457bbc43ea90a37fb3fbfac70eea0: Status 404 returned error can't find the container with id 0d1cccb7f6184b10e338130644e9dbfdfb7457bbc43ea90a37fb3fbfac70eea0
Jul 24 17:03:30.917764 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.917733    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-npqrh"
Jul 24 17:03:30.925836 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:30.925805    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod911b3acf_4ae2_46c1_a53d_c59027fa44c5.slice/crio-827ae7e1a9354958b5a10d62b734d135b88d88a549f65dc1ef8fcecf0a95345a WatchSource:0}: Error finding container 827ae7e1a9354958b5a10d62b734d135b88d88a549f65dc1ef8fcecf0a95345a: Status 404 returned error can't find the container with id 827ae7e1a9354958b5a10d62b734d135b88d88a549f65dc1ef8fcecf0a95345a
Jul 24 17:03:30.935381 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.935363    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg79k"
Jul 24 17:03:30.942641 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:30.942617    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47bd6299_1889_4b65_90a3_15caf9a6cae4.slice/crio-40269ea45628d6e3a7108560c10dc572ba7729da464646122d1f44c9acb884a0 WatchSource:0}: Error finding container 40269ea45628d6e3a7108560c10dc572ba7729da464646122d1f44c9acb884a0: Status 404 returned error can't find the container with id 40269ea45628d6e3a7108560c10dc572ba7729da464646122d1f44c9acb884a0
Jul 24 17:03:30.946819 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.946801    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6jbmb"
Jul 24 17:03:30.953716 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.953694    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-228jg"
Jul 24 17:03:30.955217 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:30.955193    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70860e4d_6426_4b8d_9034_20447104e662.slice/crio-cd14bdd1dbcb99a939f6b304d7bf687e0266884d079d1d205cb779949d6b3ddc WatchSource:0}: Error finding container cd14bdd1dbcb99a939f6b304d7bf687e0266884d079d1d205cb779949d6b3ddc: Status 404 returned error can't find the container with id cd14bdd1dbcb99a939f6b304d7bf687e0266884d079d1d205cb779949d6b3ddc
Jul 24 17:03:30.960781 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:30.960761    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2a54d49_4912_4cf3_8f17_4d20ef08a9e2.slice/crio-092fbb70ca091162cf5410c5c3b55dbe8d609055e5870ae598cb7148df533c4f WatchSource:0}: Error finding container 092fbb70ca091162cf5410c5c3b55dbe8d609055e5870ae598cb7148df533c4f: Status 404 returned error can't find the container with id 092fbb70ca091162cf5410c5c3b55dbe8d609055e5870ae598cb7148df533c4f
Jul 24 17:03:30.978899 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.978877    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2zx5f"
Jul 24 17:03:30.985748 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:30.985721    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod071318f4_f26f_4eb9_8bd9_027146a171a4.slice/crio-6a369c7a8f5a3791141b539d0b458f04f57fa8c886237aab9ad2945a2d812cda WatchSource:0}: Error finding container 6a369c7a8f5a3791141b539d0b458f04f57fa8c886237aab9ad2945a2d812cda: Status 404 returned error can't find the container with id 6a369c7a8f5a3791141b539d0b458f04f57fa8c886237aab9ad2945a2d812cda
Jul 24 17:03:30.989474 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.989455    2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 17:03:30.998384 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:30.998366    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:31.005437 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:31.005415    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f3e23c6_31a7_4e7b_83df_d6eee1335b7a.slice/crio-1b742ce230a61c9ddfe980f22afb4db6a8809e6a6d1ba8cc7aa6faaad252538b WatchSource:0}: Error finding container 1b742ce230a61c9ddfe980f22afb4db6a8809e6a6d1ba8cc7aa6faaad252538b: Status 404 returned error can't find the container with id 1b742ce230a61c9ddfe980f22afb4db6a8809e6a6d1ba8cc7aa6faaad252538b
Jul 24 17:03:31.013027 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:31.013007    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fhlm5"
Jul 24 17:03:31.016903 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:31.016883    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5sgm4"
Jul 24 17:03:31.020545 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:31.020509    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde52b146_c409_4006_8e66_c7425fd2ca34.slice/crio-bdc393af1999e5625f78a7f89576e12af59f096f19d994ca875e0c5ec2cb6800 WatchSource:0}: Error finding container bdc393af1999e5625f78a7f89576e12af59f096f19d994ca875e0c5ec2cb6800: Status 404 returned error can't find the container with id bdc393af1999e5625f78a7f89576e12af59f096f19d994ca875e0c5ec2cb6800
Jul 24 17:03:31.025340 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:03:31.025314    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08370467_8020_420e_a2e1_16dd3fb5ec66.slice/crio-3615f4a8a7f71582290f4290374ab9a85eaa229c36f013ac99af16572b79cb32 WatchSource:0}: Error finding container 3615f4a8a7f71582290f4290374ab9a85eaa229c36f013ac99af16572b79cb32: Status 404 returned error can't find the container with id 3615f4a8a7f71582290f4290374ab9a85eaa229c36f013ac99af16572b79cb32
Jul 24 17:03:31.027072 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:31.027053    2582 kuberuntime_manager.go:1459] "Unhandled Error" err="container node-ca start failed in pod node-ca-5sgm4_openshift-image-registry(08370467-8020-420e-a2e1-16dd3fb5ec66): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Jul 24 17:03:31.027151 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:31.027085    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"node-ca\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-image-registry/node-ca-5sgm4" podUID="08370467-8020-420e-a2e1-16dd3fb5ec66"
Jul 24 17:03:31.192805 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:31.192720    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec08480c-1bcc-4c15-8daa-095f89d01ec1-metrics-certs\") pod \"network-metrics-daemon-2fpd4\" (UID: \"ec08480c-1bcc-4c15-8daa-095f89d01ec1\") " pod="openshift-multus/network-metrics-daemon-2fpd4"
Jul 24 17:03:31.192968 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:31.192821    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:31.192968 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:31.192872    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec08480c-1bcc-4c15-8daa-095f89d01ec1-metrics-certs podName:ec08480c-1bcc-4c15-8daa-095f89d01ec1 nodeName:}" failed. No retries permitted until 2026-07-24 17:03:32.192858355 +0000 UTC m=+3.008832950 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec08480c-1bcc-4c15-8daa-095f89d01ec1-metrics-certs") pod "network-metrics-daemon-2fpd4" (UID: "ec08480c-1bcc-4c15-8daa-095f89d01ec1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:31.293934 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:31.293898    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3cced35a-4cd2-4520-a5c4-9e0f5e0e891b-original-pull-secret\") pod \"global-pull-secret-syncer-mhjb8\" (UID: \"3cced35a-4cd2-4520-a5c4-9e0f5e0e891b\") " pod="kube-system/global-pull-secret-syncer-mhjb8"
Jul 24 17:03:31.293934 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:31.293945    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzb28\" (UniqueName: \"kubernetes.io/projected/e066d7db-af43-4c57-b832-3936cecdb3bc-kube-api-access-nzb28\") pod \"network-check-target-s8m4l\" (UID: \"e066d7db-af43-4c57-b832-3936cecdb3bc\") " pod="openshift-network-diagnostics/network-check-target-s8m4l"
Jul 24 17:03:31.294247 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:31.294080    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:31.294247 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:31.294137    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:03:31.294247 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:31.294154    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:03:31.294247 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:31.294165    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cced35a-4cd2-4520-a5c4-9e0f5e0e891b-original-pull-secret podName:3cced35a-4cd2-4520-a5c4-9e0f5e0e891b nodeName:}" failed. No retries permitted until 2026-07-24 17:03:32.294139153 +0000 UTC m=+3.110113757 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3cced35a-4cd2-4520-a5c4-9e0f5e0e891b-original-pull-secret") pod "global-pull-secret-syncer-mhjb8" (UID: "3cced35a-4cd2-4520-a5c4-9e0f5e0e891b") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:31.294247 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:31.294168    2582 projected.go:196] Error preparing data for projected volume kube-api-access-nzb28 for pod openshift-network-diagnostics/network-check-target-s8m4l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:31.294247 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:31.294220    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e066d7db-af43-4c57-b832-3936cecdb3bc-kube-api-access-nzb28 podName:e066d7db-af43-4c57-b832-3936cecdb3bc nodeName:}" failed. No retries permitted until 2026-07-24 17:03:32.294204161 +0000 UTC m=+3.110178756 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nzb28" (UniqueName: "kubernetes.io/projected/e066d7db-af43-4c57-b832-3936cecdb3bc-kube-api-access-nzb28") pod "network-check-target-s8m4l" (UID: "e066d7db-af43-4c57-b832-3936cecdb3bc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:31.358169 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:31.357908    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 17:03:31.622404 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:31.622261    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 16:58:31 +0000 UTC" deadline="2028-01-26 15:20:35.34080991 +0000 UTC"
Jul 24 17:03:31.622404 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:31.622322    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13222h17m3.718492446s"
Jul 24 17:03:31.767405 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:31.767375    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fpd4"
Jul 24 17:03:31.767577 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:31.767522    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fpd4" podUID="ec08480c-1bcc-4c15-8daa-095f89d01ec1"
Jul 24 17:03:31.772970 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:31.772879    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2zx5f" event={"ID":"071318f4-f26f-4eb9-8bd9-027146a171a4","Type":"ContainerStarted","Data":"6a369c7a8f5a3791141b539d0b458f04f57fa8c886237aab9ad2945a2d812cda"}
Jul 24 17:03:31.775651 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:31.775572    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-228jg" event={"ID":"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2","Type":"ContainerStarted","Data":"092fbb70ca091162cf5410c5c3b55dbe8d609055e5870ae598cb7148df533c4f"}
Jul 24 17:03:31.777815 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:31.777696    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg79k" event={"ID":"47bd6299-1889-4b65-90a3-15caf9a6cae4","Type":"ContainerStarted","Data":"40269ea45628d6e3a7108560c10dc572ba7729da464646122d1f44c9acb884a0"}
Jul 24 17:03:31.790397 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:31.790362    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-npqrh" event={"ID":"911b3acf-4ae2-46c1-a53d-c59027fa44c5","Type":"ContainerStarted","Data":"827ae7e1a9354958b5a10d62b734d135b88d88a549f65dc1ef8fcecf0a95345a"}
Jul 24 17:03:31.794739 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:31.794704    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9qz26" event={"ID":"6f6b0a05-6bb5-48ac-915e-19c48fc03100","Type":"ContainerStarted","Data":"0d1cccb7f6184b10e338130644e9dbfdfb7457bbc43ea90a37fb3fbfac70eea0"}
Jul 24 17:03:31.802310 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:31.802276    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fhlm5" event={"ID":"de52b146-c409-4006-8e66-c7425fd2ca34","Type":"ContainerStarted","Data":"bdc393af1999e5625f78a7f89576e12af59f096f19d994ca875e0c5ec2cb6800"}
Jul 24 17:03:31.815810 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:31.815772    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m" event={"ID":"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a","Type":"ContainerStarted","Data":"1b742ce230a61c9ddfe980f22afb4db6a8809e6a6d1ba8cc7aa6faaad252538b"}
Jul 24 17:03:31.817847 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:31.817820    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6jbmb" event={"ID":"70860e4d-6426-4b8d-9034-20447104e662","Type":"ContainerStarted","Data":"cd14bdd1dbcb99a939f6b304d7bf687e0266884d079d1d205cb779949d6b3ddc"}
Jul 24 17:03:31.825993 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:31.825967    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal" event={"ID":"2c6eecdeb9041331a4921846ff748148","Type":"ContainerStarted","Data":"a93eb07d2908ed5d477bf4381fc35b761217605dd75a29c8ebcf1a9429a711a1"}
Jul 24 17:03:31.836985 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:31.836941    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-152.ec2.internal" event={"ID":"5769d40c696eb94e1a1746849e9cb1ff","Type":"ContainerStarted","Data":"f29abde7c380690a05c130542ebcb34f26a7d27675556b6e2e275fc94e2c9fba"}
Jul 24 17:03:31.842474 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:31.842447    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5sgm4" event={"ID":"08370467-8020-420e-a2e1-16dd3fb5ec66","Type":"ContainerStarted","Data":"3615f4a8a7f71582290f4290374ab9a85eaa229c36f013ac99af16572b79cb32"}
Jul 24 17:03:31.846619 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:31.846587    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"node-ca\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-image-registry/node-ca-5sgm4" podUID="08370467-8020-420e-a2e1-16dd3fb5ec66"
Jul 24 17:03:32.201796 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:32.201754    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec08480c-1bcc-4c15-8daa-095f89d01ec1-metrics-certs\") pod \"network-metrics-daemon-2fpd4\" (UID: \"ec08480c-1bcc-4c15-8daa-095f89d01ec1\") " pod="openshift-multus/network-metrics-daemon-2fpd4"
Jul 24 17:03:32.202008 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:32.201974    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:32.202081 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:32.202046    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec08480c-1bcc-4c15-8daa-095f89d01ec1-metrics-certs podName:ec08480c-1bcc-4c15-8daa-095f89d01ec1 nodeName:}" failed. No retries permitted until 2026-07-24 17:03:34.202024163 +0000 UTC m=+5.017998777 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec08480c-1bcc-4c15-8daa-095f89d01ec1-metrics-certs") pod "network-metrics-daemon-2fpd4" (UID: "ec08480c-1bcc-4c15-8daa-095f89d01ec1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:32.303150 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:32.303087    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3cced35a-4cd2-4520-a5c4-9e0f5e0e891b-original-pull-secret\") pod \"global-pull-secret-syncer-mhjb8\" (UID: \"3cced35a-4cd2-4520-a5c4-9e0f5e0e891b\") " pod="kube-system/global-pull-secret-syncer-mhjb8"
Jul 24 17:03:32.303150 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:32.303154    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzb28\" (UniqueName: \"kubernetes.io/projected/e066d7db-af43-4c57-b832-3936cecdb3bc-kube-api-access-nzb28\") pod \"network-check-target-s8m4l\" (UID: \"e066d7db-af43-4c57-b832-3936cecdb3bc\") " pod="openshift-network-diagnostics/network-check-target-s8m4l"
Jul 24 17:03:32.303401 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:32.303335    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:03:32.303401 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:32.303354    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:03:32.303401 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:32.303367    2582 projected.go:196] Error preparing data for projected volume kube-api-access-nzb28 for pod openshift-network-diagnostics/network-check-target-s8m4l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:32.303573 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:32.303428    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e066d7db-af43-4c57-b832-3936cecdb3bc-kube-api-access-nzb28 podName:e066d7db-af43-4c57-b832-3936cecdb3bc nodeName:}" failed. No retries permitted until 2026-07-24 17:03:34.303409778 +0000 UTC m=+5.119384375 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nzb28" (UniqueName: "kubernetes.io/projected/e066d7db-af43-4c57-b832-3936cecdb3bc-kube-api-access-nzb28") pod "network-check-target-s8m4l" (UID: "e066d7db-af43-4c57-b832-3936cecdb3bc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:32.304033 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:32.304011    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:32.304146 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:32.304070    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cced35a-4cd2-4520-a5c4-9e0f5e0e891b-original-pull-secret podName:3cced35a-4cd2-4520-a5c4-9e0f5e0e891b nodeName:}" failed. No retries permitted until 2026-07-24 17:03:34.304057518 +0000 UTC m=+5.120032114 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3cced35a-4cd2-4520-a5c4-9e0f5e0e891b-original-pull-secret") pod "global-pull-secret-syncer-mhjb8" (UID: "3cced35a-4cd2-4520-a5c4-9e0f5e0e891b") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:32.623021 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:32.622922    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 16:58:31 +0000 UTC" deadline="2028-02-12 01:06:47.17036696 +0000 UTC"
Jul 24 17:03:32.623021 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:32.622965    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13616h3m14.547406253s"
Jul 24 17:03:32.680683 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:32.679705    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 17:03:32.758393 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:32.758358    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhjb8"
Jul 24 17:03:32.758573 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:32.758358    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8m4l"
Jul 24 17:03:32.758573 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:32.758510    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhjb8" podUID="3cced35a-4cd2-4520-a5c4-9e0f5e0e891b"
Jul 24 17:03:32.758711 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:32.758597    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8m4l" podUID="e066d7db-af43-4c57-b832-3936cecdb3bc"
Jul 24 17:03:33.766846 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:33.765026    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fpd4"
Jul 24 17:03:33.766846 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:33.765174    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fpd4" podUID="ec08480c-1bcc-4c15-8daa-095f89d01ec1"
Jul 24 17:03:34.221134 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:34.221049    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec08480c-1bcc-4c15-8daa-095f89d01ec1-metrics-certs\") pod \"network-metrics-daemon-2fpd4\" (UID: \"ec08480c-1bcc-4c15-8daa-095f89d01ec1\") " pod="openshift-multus/network-metrics-daemon-2fpd4"
Jul 24 17:03:34.221306 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:34.221271    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:34.221381 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:34.221343    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec08480c-1bcc-4c15-8daa-095f89d01ec1-metrics-certs podName:ec08480c-1bcc-4c15-8daa-095f89d01ec1 nodeName:}" failed. No retries permitted until 2026-07-24 17:03:38.221323032 +0000 UTC m=+9.037297645 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec08480c-1bcc-4c15-8daa-095f89d01ec1-metrics-certs") pod "network-metrics-daemon-2fpd4" (UID: "ec08480c-1bcc-4c15-8daa-095f89d01ec1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:34.321861 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:34.321822    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3cced35a-4cd2-4520-a5c4-9e0f5e0e891b-original-pull-secret\") pod \"global-pull-secret-syncer-mhjb8\" (UID: \"3cced35a-4cd2-4520-a5c4-9e0f5e0e891b\") " pod="kube-system/global-pull-secret-syncer-mhjb8"
Jul 24 17:03:34.322054 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:34.321881    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzb28\" (UniqueName: \"kubernetes.io/projected/e066d7db-af43-4c57-b832-3936cecdb3bc-kube-api-access-nzb28\") pod \"network-check-target-s8m4l\" (UID: \"e066d7db-af43-4c57-b832-3936cecdb3bc\") " pod="openshift-network-diagnostics/network-check-target-s8m4l"
Jul 24 17:03:34.322054 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:34.322048    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:03:34.322176 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:34.322066    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:03:34.322176 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:34.322080    2582 projected.go:196] Error preparing data for projected volume kube-api-access-nzb28 for pod openshift-network-diagnostics/network-check-target-s8m4l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:34.322176 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:34.322142    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e066d7db-af43-4c57-b832-3936cecdb3bc-kube-api-access-nzb28 podName:e066d7db-af43-4c57-b832-3936cecdb3bc nodeName:}" failed. No retries permitted until 2026-07-24 17:03:38.322121416 +0000 UTC m=+9.138096010 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nzb28" (UniqueName: "kubernetes.io/projected/e066d7db-af43-4c57-b832-3936cecdb3bc-kube-api-access-nzb28") pod "network-check-target-s8m4l" (UID: "e066d7db-af43-4c57-b832-3936cecdb3bc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:34.322783 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:34.322563    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:34.322783 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:34.322622    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cced35a-4cd2-4520-a5c4-9e0f5e0e891b-original-pull-secret podName:3cced35a-4cd2-4520-a5c4-9e0f5e0e891b nodeName:}" failed. No retries permitted until 2026-07-24 17:03:38.322604822 +0000 UTC m=+9.138579417 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3cced35a-4cd2-4520-a5c4-9e0f5e0e891b-original-pull-secret") pod "global-pull-secret-syncer-mhjb8" (UID: "3cced35a-4cd2-4520-a5c4-9e0f5e0e891b") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:34.762765 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:34.761967    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8m4l"
Jul 24 17:03:34.762765 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:34.762168    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8m4l" podUID="e066d7db-af43-4c57-b832-3936cecdb3bc"
Jul 24 17:03:34.762765 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:34.762610    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhjb8"
Jul 24 17:03:34.762765 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:34.762710    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhjb8" podUID="3cced35a-4cd2-4520-a5c4-9e0f5e0e891b"
Jul 24 17:03:35.762896 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:35.762303    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fpd4"
Jul 24 17:03:35.762896 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:35.762470    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fpd4" podUID="ec08480c-1bcc-4c15-8daa-095f89d01ec1"
Jul 24 17:03:36.757979 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:36.757940    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8m4l"
Jul 24 17:03:36.758243 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:36.758075    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8m4l" podUID="e066d7db-af43-4c57-b832-3936cecdb3bc"
Jul 24 17:03:36.758243 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:36.757940    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhjb8"
Jul 24 17:03:36.758243 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:36.758212    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhjb8" podUID="3cced35a-4cd2-4520-a5c4-9e0f5e0e891b"
Jul 24 17:03:37.758334 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:37.758291    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fpd4"
Jul 24 17:03:37.758938 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:37.758449    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fpd4" podUID="ec08480c-1bcc-4c15-8daa-095f89d01ec1"
Jul 24 17:03:38.257515 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:38.257440    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec08480c-1bcc-4c15-8daa-095f89d01ec1-metrics-certs\") pod \"network-metrics-daemon-2fpd4\" (UID: \"ec08480c-1bcc-4c15-8daa-095f89d01ec1\") " pod="openshift-multus/network-metrics-daemon-2fpd4"
Jul 24 17:03:38.257739 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:38.257627    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:38.257739 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:38.257727    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec08480c-1bcc-4c15-8daa-095f89d01ec1-metrics-certs podName:ec08480c-1bcc-4c15-8daa-095f89d01ec1 nodeName:}" failed. No retries permitted until 2026-07-24 17:03:46.257702833 +0000 UTC m=+17.073677430 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec08480c-1bcc-4c15-8daa-095f89d01ec1-metrics-certs") pod "network-metrics-daemon-2fpd4" (UID: "ec08480c-1bcc-4c15-8daa-095f89d01ec1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:38.358299 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:38.358260    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3cced35a-4cd2-4520-a5c4-9e0f5e0e891b-original-pull-secret\") pod \"global-pull-secret-syncer-mhjb8\" (UID: \"3cced35a-4cd2-4520-a5c4-9e0f5e0e891b\") " pod="kube-system/global-pull-secret-syncer-mhjb8"
Jul 24 17:03:38.358502 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:38.358315    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzb28\" (UniqueName: \"kubernetes.io/projected/e066d7db-af43-4c57-b832-3936cecdb3bc-kube-api-access-nzb28\") pod \"network-check-target-s8m4l\" (UID: \"e066d7db-af43-4c57-b832-3936cecdb3bc\") " pod="openshift-network-diagnostics/network-check-target-s8m4l"
Jul 24 17:03:38.358502 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:38.358460    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:38.358639 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:38.358541    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cced35a-4cd2-4520-a5c4-9e0f5e0e891b-original-pull-secret podName:3cced35a-4cd2-4520-a5c4-9e0f5e0e891b nodeName:}" failed. No retries permitted until 2026-07-24 17:03:46.358520174 +0000 UTC m=+17.174494772 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3cced35a-4cd2-4520-a5c4-9e0f5e0e891b-original-pull-secret") pod "global-pull-secret-syncer-mhjb8" (UID: "3cced35a-4cd2-4520-a5c4-9e0f5e0e891b") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:38.358755 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:38.358469    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:03:38.358755 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:38.358711    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:03:38.358755 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:38.358730    2582 projected.go:196] Error preparing data for projected volume kube-api-access-nzb28 for pod openshift-network-diagnostics/network-check-target-s8m4l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:38.358923 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:38.358801    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e066d7db-af43-4c57-b832-3936cecdb3bc-kube-api-access-nzb28 podName:e066d7db-af43-4c57-b832-3936cecdb3bc nodeName:}" failed. No retries permitted until 2026-07-24 17:03:46.358784024 +0000 UTC m=+17.174758633 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nzb28" (UniqueName: "kubernetes.io/projected/e066d7db-af43-4c57-b832-3936cecdb3bc-kube-api-access-nzb28") pod "network-check-target-s8m4l" (UID: "e066d7db-af43-4c57-b832-3936cecdb3bc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:38.757943 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:38.757909    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8m4l"
Jul 24 17:03:38.758102 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:38.758047    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8m4l" podUID="e066d7db-af43-4c57-b832-3936cecdb3bc"
Jul 24 17:03:38.758102 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:38.758085    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhjb8"
Jul 24 17:03:38.758226 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:38.758161    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhjb8" podUID="3cced35a-4cd2-4520-a5c4-9e0f5e0e891b"
Jul 24 17:03:39.759898 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:39.759861    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fpd4"
Jul 24 17:03:39.760365 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:39.760009    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fpd4" podUID="ec08480c-1bcc-4c15-8daa-095f89d01ec1"
Jul 24 17:03:40.758448 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:40.758418    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhjb8"
Jul 24 17:03:40.758642 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:40.758418    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8m4l"
Jul 24 17:03:40.758642 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:40.758540    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhjb8" podUID="3cced35a-4cd2-4520-a5c4-9e0f5e0e891b"
Jul 24 17:03:40.758768 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:40.758639    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8m4l" podUID="e066d7db-af43-4c57-b832-3936cecdb3bc"
Jul 24 17:03:41.758752 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:41.758720    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fpd4"
Jul 24 17:03:41.759212 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:41.758858    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fpd4" podUID="ec08480c-1bcc-4c15-8daa-095f89d01ec1"
Jul 24 17:03:42.758081 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:42.758040    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhjb8"
Jul 24 17:03:42.758081 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:42.758063    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8m4l"
Jul 24 17:03:42.758322 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:42.758173    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8m4l" podUID="e066d7db-af43-4c57-b832-3936cecdb3bc"
Jul 24 17:03:42.758379 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:42.758348    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhjb8" podUID="3cced35a-4cd2-4520-a5c4-9e0f5e0e891b"
Jul 24 17:03:43.758101 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:43.758057    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fpd4"
Jul 24 17:03:43.758523 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:43.758183    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fpd4" podUID="ec08480c-1bcc-4c15-8daa-095f89d01ec1"
Jul 24 17:03:44.758636 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:44.758599    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8m4l"
Jul 24 17:03:44.758636 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:44.758599    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhjb8"
Jul 24 17:03:44.759163 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:44.758897    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8m4l" podUID="e066d7db-af43-4c57-b832-3936cecdb3bc"
Jul 24 17:03:44.759163 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:44.758952    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhjb8" podUID="3cced35a-4cd2-4520-a5c4-9e0f5e0e891b"
Jul 24 17:03:45.758422 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:45.758384    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fpd4"
Jul 24 17:03:45.758611 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:45.758516    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fpd4" podUID="ec08480c-1bcc-4c15-8daa-095f89d01ec1"
Jul 24 17:03:46.318646 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:46.318614    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec08480c-1bcc-4c15-8daa-095f89d01ec1-metrics-certs\") pod \"network-metrics-daemon-2fpd4\" (UID: \"ec08480c-1bcc-4c15-8daa-095f89d01ec1\") " pod="openshift-multus/network-metrics-daemon-2fpd4"
Jul 24 17:03:46.319076 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:46.318749    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:46.319076 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:46.318805    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec08480c-1bcc-4c15-8daa-095f89d01ec1-metrics-certs podName:ec08480c-1bcc-4c15-8daa-095f89d01ec1 nodeName:}" failed. No retries permitted until 2026-07-24 17:04:02.31879103 +0000 UTC m=+33.134765623 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec08480c-1bcc-4c15-8daa-095f89d01ec1-metrics-certs") pod "network-metrics-daemon-2fpd4" (UID: "ec08480c-1bcc-4c15-8daa-095f89d01ec1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:46.419957 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:46.419870    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3cced35a-4cd2-4520-a5c4-9e0f5e0e891b-original-pull-secret\") pod \"global-pull-secret-syncer-mhjb8\" (UID: \"3cced35a-4cd2-4520-a5c4-9e0f5e0e891b\") " pod="kube-system/global-pull-secret-syncer-mhjb8"
Jul 24 17:03:46.419957 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:46.419937    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzb28\" (UniqueName: \"kubernetes.io/projected/e066d7db-af43-4c57-b832-3936cecdb3bc-kube-api-access-nzb28\") pod \"network-check-target-s8m4l\" (UID: \"e066d7db-af43-4c57-b832-3936cecdb3bc\") " pod="openshift-network-diagnostics/network-check-target-s8m4l"
Jul 24 17:03:46.420198 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:46.420000    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:46.420198 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:46.420072    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cced35a-4cd2-4520-a5c4-9e0f5e0e891b-original-pull-secret podName:3cced35a-4cd2-4520-a5c4-9e0f5e0e891b nodeName:}" failed. No retries permitted until 2026-07-24 17:04:02.420053396 +0000 UTC m=+33.236027989 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3cced35a-4cd2-4520-a5c4-9e0f5e0e891b-original-pull-secret") pod "global-pull-secret-syncer-mhjb8" (UID: "3cced35a-4cd2-4520-a5c4-9e0f5e0e891b") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:46.420198 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:46.420084    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:03:46.420198 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:46.420102    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:03:46.420198 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:46.420113    2582 projected.go:196] Error preparing data for projected volume kube-api-access-nzb28 for pod openshift-network-diagnostics/network-check-target-s8m4l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:46.420198 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:46.420183    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e066d7db-af43-4c57-b832-3936cecdb3bc-kube-api-access-nzb28 podName:e066d7db-af43-4c57-b832-3936cecdb3bc nodeName:}" failed. No retries permitted until 2026-07-24 17:04:02.420156509 +0000 UTC m=+33.236131107 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nzb28" (UniqueName: "kubernetes.io/projected/e066d7db-af43-4c57-b832-3936cecdb3bc-kube-api-access-nzb28") pod "network-check-target-s8m4l" (UID: "e066d7db-af43-4c57-b832-3936cecdb3bc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:46.758207 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:46.758128    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhjb8"
Jul 24 17:03:46.758361 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:46.758139    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8m4l"
Jul 24 17:03:46.758361 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:46.758246    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhjb8" podUID="3cced35a-4cd2-4520-a5c4-9e0f5e0e891b"
Jul 24 17:03:46.758361 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:46.758303    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8m4l" podUID="e066d7db-af43-4c57-b832-3936cecdb3bc"
Jul 24 17:03:47.758535 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:47.758477    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fpd4"
Jul 24 17:03:47.758977 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:47.758612    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fpd4" podUID="ec08480c-1bcc-4c15-8daa-095f89d01ec1"
Jul 24 17:03:48.758126 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:48.758093    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8m4l"
Jul 24 17:03:48.758321 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:48.758093    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhjb8"
Jul 24 17:03:48.758321 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:48.758213    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8m4l" podUID="e066d7db-af43-4c57-b832-3936cecdb3bc"
Jul 24 17:03:48.758321 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:48.758305    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhjb8" podUID="3cced35a-4cd2-4520-a5c4-9e0f5e0e891b"
Jul 24 17:03:49.761150 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:49.761118    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fpd4"
Jul 24 17:03:49.761577 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:49.761252    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fpd4" podUID="ec08480c-1bcc-4c15-8daa-095f89d01ec1"
Jul 24 17:03:50.758294 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:50.758269    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhjb8"
Jul 24 17:03:50.758421 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:50.758398    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhjb8" podUID="3cced35a-4cd2-4520-a5c4-9e0f5e0e891b"
Jul 24 17:03:50.758485 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:50.758446    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8m4l"
Jul 24 17:03:50.758548 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:50.758532    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8m4l" podUID="e066d7db-af43-4c57-b832-3936cecdb3bc"
Jul 24 17:03:50.907943 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:50.907659    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fhlm5" event={"ID":"de52b146-c409-4006-8e66-c7425fd2ca34","Type":"ContainerStarted","Data":"c25a763a414472d31389545849ddd63993f07b068e874977117690e051adae65"}
Jul 24 17:03:50.912152 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:50.912128    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d6w2m_9f3e23c6-31a7-4e7b-83df-d6eee1335b7a/ovn-acl-logging/0.log"
Jul 24 17:03:50.913499 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:50.913471    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m" event={"ID":"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a","Type":"ContainerStarted","Data":"b8d4e06b3a56a126a816d2744f70894e2824acd087e34b83859aaf705937157b"}
Jul 24 17:03:50.913602 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:50.913560    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m" event={"ID":"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a","Type":"ContainerStarted","Data":"4f62ea9c48a155e0293133db4085a6469f2eb4edb5ee74342b24c6581793888e"}
Jul 24 17:03:50.913658 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:50.913611    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m" event={"ID":"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a","Type":"ContainerStarted","Data":"1178c2bbabb795b2a1c7684e9cf0ee0acb69e2d930a25f998fc419c6f77e59a3"}
Jul 24 17:03:50.920601 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:50.920267    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-152.ec2.internal" event={"ID":"5769d40c696eb94e1a1746849e9cb1ff","Type":"ContainerStarted","Data":"6f54009d34d7a1ad6c058ddd6a9a6168ecd653f9c9b002c8bf1c34650864d3d3"}
Jul 24 17:03:50.936347 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:50.935971    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fhlm5" podStartSLOduration=1.5198483600000001 podStartE2EDuration="20.935949396s" totalImagesPullingTime="19.416101036s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:03:50.935111391 +0000 UTC m=+21.751086005" watchObservedRunningTime="2026-07-24 17:03:50.935949396 +0000 UTC m=+21.751924011"
Jul 24 17:03:51.758328 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:51.758299    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fpd4"
Jul 24 17:03:51.758482 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:51.758408    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fpd4" podUID="ec08480c-1bcc-4c15-8daa-095f89d01ec1"
Jul 24 17:03:51.923258 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:51.923217    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-npqrh" event={"ID":"911b3acf-4ae2-46c1-a53d-c59027fa44c5","Type":"ContainerStarted","Data":"8f6f7c8c2f0a37e3fc0e22fd6f7cc8502170a9dea926eb90216108eefa81e6ae"}
Jul 24 17:03:51.924615 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:51.924588    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9qz26" event={"ID":"6f6b0a05-6bb5-48ac-915e-19c48fc03100","Type":"ContainerStarted","Data":"c394895df86ff5cb0d1a27ffbd85629fc019508c09313b6df460618fd66a841c"}
Jul 24 17:03:51.927273 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:51.927255    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d6w2m_9f3e23c6-31a7-4e7b-83df-d6eee1335b7a/ovn-acl-logging/0.log"
Jul 24 17:03:51.927572 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:51.927555    2582 generic.go:356] "Generic (PLEG): container finished" podID="9f3e23c6-31a7-4e7b-83df-d6eee1335b7a" containerID="4f62ea9c48a155e0293133db4085a6469f2eb4edb5ee74342b24c6581793888e" exitCode=1
Jul 24 17:03:51.927643 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:51.927613    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m" event={"ID":"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a","Type":"ContainerDied","Data":"4f62ea9c48a155e0293133db4085a6469f2eb4edb5ee74342b24c6581793888e"}
Jul 24 17:03:51.927707 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:51.927681    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m" event={"ID":"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a","Type":"ContainerStarted","Data":"675e4900efbf8b849d0b4277b7805318a03258ea492b9921690c19c8962f36a3"}
Jul 24 17:03:51.927755 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:51.927722    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m" event={"ID":"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a","Type":"ContainerStarted","Data":"39df0959b8835036f0c32f12c4fd2ae964a3e235a25753aa14e92b8f6d452d14"}
Jul 24 17:03:51.927755 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:51.927752    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m" event={"ID":"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a","Type":"ContainerStarted","Data":"65cc7960c144733fe14cce1f9c85d7043f14eadbd933fd9f1f89148d294bc510"}
Jul 24 17:03:51.928799 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:51.928776    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6jbmb" event={"ID":"70860e4d-6426-4b8d-9034-20447104e662","Type":"ContainerStarted","Data":"5a8699522b79b9013bda2b934403cd3a7d926892455ae6aff74cb0739de0ac78"}
Jul 24 17:03:51.930056 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:51.930035    2582 generic.go:356] "Generic (PLEG): container finished" podID="2c6eecdeb9041331a4921846ff748148" containerID="c402d1b964d2e9e15a056bccb64a1e5f6fab3d9157c47908d1f6d29177edf4fb" exitCode=0
Jul 24 17:03:51.930152 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:51.930087    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal" event={"ID":"2c6eecdeb9041331a4921846ff748148","Type":"ContainerDied","Data":"c402d1b964d2e9e15a056bccb64a1e5f6fab3d9157c47908d1f6d29177edf4fb"}
Jul 24 17:03:51.931604 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:51.931578    2582 generic.go:356] "Generic (PLEG): container finished" podID="071318f4-f26f-4eb9-8bd9-027146a171a4" containerID="9cce0a7af74894c8da4c401f6df5522847d15fb873ff3a983f2c1a79f1395367" exitCode=0
Jul 24 17:03:51.931711 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:51.931646    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2zx5f" event={"ID":"071318f4-f26f-4eb9-8bd9-027146a171a4","Type":"ContainerDied","Data":"9cce0a7af74894c8da4c401f6df5522847d15fb873ff3a983f2c1a79f1395367"}
Jul 24 17:03:51.933153 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:51.933097    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-228jg" event={"ID":"a2a54d49-4912-4cf3-8f17-4d20ef08a9e2","Type":"ContainerStarted","Data":"b3e9dab0aa1c41b94fd025e83ce07f1e46853f44c9b86d186a89fa675d320244"}
Jul 24 17:03:51.934458 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:51.934437    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg79k" event={"ID":"47bd6299-1889-4b65-90a3-15caf9a6cae4","Type":"ContainerStarted","Data":"142d22d49e7c232c2e4c92ad4431dd74ce824b3c24b661f4ee9238f9056d01fc"}
Jul 24 17:03:51.939538 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:51.939502    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-152.ec2.internal" podStartSLOduration=20.939490825 podStartE2EDuration="20.939490825s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:03:50.954793159 +0000 UTC m=+21.770767778" watchObservedRunningTime="2026-07-24 17:03:51.939490825 +0000 UTC m=+22.755465441"
Jul 24 17:03:51.939641 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:51.939559    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-npqrh" podStartSLOduration=2.4322317 podStartE2EDuration="21.93955547s" totalImagesPullingTime="19.50732377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:03:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:03:51.939251691 +0000 UTC m=+22.755226306" watchObservedRunningTime="2026-07-24 17:03:51.93955547 +0000 UTC m=+22.755530084"
Jul 24 17:03:51.974342 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:51.974296    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9qz26" podStartSLOduration=2.447879723 podStartE2EDuration="21.974277439s" totalImagesPullingTime="19.526397716s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:03:51.97395035 +0000 UTC m=+22.789924971" watchObservedRunningTime="2026-07-24 17:03:51.974277439 +0000 UTC m=+22.790252059"
Jul 24 17:03:52.014889 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:52.014840    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6jbmb" podStartSLOduration=2.5375480230000003 podStartE2EDuration="22.014824283s" totalImagesPullingTime="19.47727626s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:03:51.990904791 +0000 UTC m=+22.806879407" watchObservedRunningTime="2026-07-24 17:03:52.014824283 +0000 UTC m=+22.830798898"
Jul 24 17:03:52.042159 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:52.042113    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-228jg" podStartSLOduration=2.113086133 podStartE2EDuration="22.042097601s" totalImagesPullingTime="19.929011468s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:03:52.041884641 +0000 UTC m=+22.857859252" watchObservedRunningTime="2026-07-24 17:03:52.042097601 +0000 UTC m=+22.858072217"
Jul 24 17:03:52.758160 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:52.758136    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhjb8"
Jul 24 17:03:52.758277 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:52.758155    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8m4l"
Jul 24 17:03:52.758277 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:52.758260    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhjb8" podUID="3cced35a-4cd2-4520-a5c4-9e0f5e0e891b"
Jul 24 17:03:52.758457 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:52.758425    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8m4l" podUID="e066d7db-af43-4c57-b832-3936cecdb3bc"
Jul 24 17:03:52.875503 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:52.875467    2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 24 17:03:52.941243 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:52.941205    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg79k" event={"ID":"47bd6299-1889-4b65-90a3-15caf9a6cae4","Type":"ContainerStarted","Data":"3404d230407571b42d4c810724a58744d6c3ad04132506f456ea6cc93f5bc319"}
Jul 24 17:03:52.943299 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:52.943257    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal" event={"ID":"2c6eecdeb9041331a4921846ff748148","Type":"ContainerStarted","Data":"63ca78cf0b5b034796d0808944fce7e21aa6c256b78aed3aa1abc70baf04db31"}
Jul 24 17:03:52.944906 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:52.944856    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5sgm4" event={"ID":"08370467-8020-420e-a2e1-16dd3fb5ec66","Type":"ContainerStarted","Data":"53faf81733bbe0167e3f8378068eb83eabeaa5353d58ab215eca98bd8a1df3ca"}
Jul 24 17:03:52.958437 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:52.958374    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-152.ec2.internal" podStartSLOduration=21.958354786 podStartE2EDuration="21.958354786s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:03:52.957524753 +0000 UTC m=+23.773499368" watchObservedRunningTime="2026-07-24 17:03:52.958354786 +0000 UTC m=+23.774329406"
Jul 24 17:03:52.971358 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:52.971303    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5sgm4" podStartSLOduration=1.902045766 podStartE2EDuration="22.971285814s" totalImagesPullingTime="21.069240048s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-24 17:03:52.970695206 +0000 UTC m=+23.786669820" watchObservedRunningTime="2026-07-24 17:03:52.971285814 +0000 UTC m=+23.787260428"
Jul 24 17:03:53.644018 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:53.643870    2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T17:03:52.875499426Z","UUID":"a3af4871-17f9-4a47-a8d1-2732bb2205e2","Handler":null,"Name":"","Endpoint":""}
Jul 24 17:03:53.646051 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:53.646023    2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 24 17:03:53.646196 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:53.646062    2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 24 17:03:53.758150 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:53.758119    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fpd4"
Jul 24 17:03:53.758408 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:53.758255    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fpd4" podUID="ec08480c-1bcc-4c15-8daa-095f89d01ec1"
Jul 24 17:03:53.950950 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:53.950881    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d6w2m_9f3e23c6-31a7-4e7b-83df-d6eee1335b7a/ovn-acl-logging/0.log"
Jul 24 17:03:53.951481 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:53.951314    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m" event={"ID":"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a","Type":"ContainerStarted","Data":"61a3ed7693d79b1a4a4010659d7ab146f779e64420e0dd12bffe6e6f424d2773"}
Jul 24 17:03:54.757943 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:54.757899    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhjb8"
Jul 24 17:03:54.757943 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:54.757937    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8m4l"
Jul 24 17:03:54.758197 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:54.758040    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhjb8" podUID="3cced35a-4cd2-4520-a5c4-9e0f5e0e891b"
Jul 24 17:03:54.758197 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:54.758139    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8m4l" podUID="e066d7db-af43-4c57-b832-3936cecdb3bc"
Jul 24 17:03:54.955888 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:54.955849    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg79k" event={"ID":"47bd6299-1889-4b65-90a3-15caf9a6cae4","Type":"ContainerStarted","Data":"09cd6e43b2a7713de6909862c1e1236e47d712e645b750eecefa4933e286bf7d"}
Jul 24 17:03:54.976060 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:54.976008    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg79k" podStartSLOduration=2.727504384 podStartE2EDuration="24.975993214s" totalImagesPullingTime="22.24848883s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:03:54.975857193 +0000 UTC m=+25.791831809" watchObservedRunningTime="2026-07-24 17:03:54.975993214 +0000 UTC m=+25.791967828"
Jul 24 17:03:55.758521 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:55.758431    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fpd4"
Jul 24 17:03:55.758707 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:55.758571    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fpd4" podUID="ec08480c-1bcc-4c15-8daa-095f89d01ec1"
Jul 24 17:03:55.965124 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:55.965094    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-npqrh"
Jul 24 17:03:55.965962 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:55.965841    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-npqrh"
Jul 24 17:03:56.758293 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:56.758045    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8m4l"
Jul 24 17:03:56.758293 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:56.758123    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhjb8"
Jul 24 17:03:56.758507 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:56.758322    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8m4l" podUID="e066d7db-af43-4c57-b832-3936cecdb3bc"
Jul 24 17:03:56.758507 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:56.758385    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhjb8" podUID="3cced35a-4cd2-4520-a5c4-9e0f5e0e891b"
Jul 24 17:03:56.963878 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:56.963850    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d6w2m_9f3e23c6-31a7-4e7b-83df-d6eee1335b7a/ovn-acl-logging/0.log"
Jul 24 17:03:56.964212 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:56.964180    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m" event={"ID":"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a","Type":"ContainerStarted","Data":"7aa9949e94f7021b7c7e5e4b8587060c1a09c0fa1e0a12d3833627c59106988f"}
Jul 24 17:03:56.964444 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:56.964420    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:56.964559 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:56.964491    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:56.964638 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:56.964618    2582 scope.go:117] "RemoveContainer" containerID="4f62ea9c48a155e0293133db4085a6469f2eb4edb5ee74342b24c6581793888e"
Jul 24 17:03:56.966142 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:56.966118    2582 generic.go:356] "Generic (PLEG): container finished" podID="071318f4-f26f-4eb9-8bd9-027146a171a4" containerID="7d300a9aec38da872731c58c62a1b8f5eb7360affd19974e699ec499c070b82e" exitCode=0
Jul 24 17:03:56.966925 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:56.966200    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2zx5f" event={"ID":"071318f4-f26f-4eb9-8bd9-027146a171a4","Type":"ContainerDied","Data":"7d300a9aec38da872731c58c62a1b8f5eb7360affd19974e699ec499c070b82e"}
Jul 24 17:03:56.966925 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:56.966448    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-npqrh"
Jul 24 17:03:56.967168 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:56.966980    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-npqrh"
Jul 24 17:03:57.041418 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:57.041395    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:57.758702 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:57.758502    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fpd4"
Jul 24 17:03:57.758919 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:57.758796    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fpd4" podUID="ec08480c-1bcc-4c15-8daa-095f89d01ec1"
Jul 24 17:03:57.971321 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:57.971256    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d6w2m_9f3e23c6-31a7-4e7b-83df-d6eee1335b7a/ovn-acl-logging/0.log"
Jul 24 17:03:57.971692 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:57.971644    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m" event={"ID":"9f3e23c6-31a7-4e7b-83df-d6eee1335b7a","Type":"ContainerStarted","Data":"6bdbfb5f3a4b0b0df90e148c717184a8ffba637e71ff3bb0923eb232c50bbadf"}
Jul 24 17:03:57.971923 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:57.971906    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:57.987504 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:57.987481    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:03:58.092401 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:58.092368    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m" podStartSLOduration=8.618515177999999 podStartE2EDuration="28.092354585s" totalImagesPullingTime="19.473839407s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:03:58.032278075 +0000 UTC m=+28.848252689" watchObservedRunningTime="2026-07-24 17:03:58.092354585 +0000 UTC m=+28.908329197"
Jul 24 17:03:58.757980 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:58.757953    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhjb8"
Jul 24 17:03:58.758129 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:58.757953    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8m4l"
Jul 24 17:03:58.758129 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:58.758058    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhjb8" podUID="3cced35a-4cd2-4520-a5c4-9e0f5e0e891b"
Jul 24 17:03:58.758200 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:58.758123    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8m4l" podUID="e066d7db-af43-4c57-b832-3936cecdb3bc"
Jul 24 17:03:58.976203 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:58.976164    2582 generic.go:356] "Generic (PLEG): container finished" podID="071318f4-f26f-4eb9-8bd9-027146a171a4" containerID="d13467315f8b91cf17676ca639c9cb26fd17448245a82f9ba4485ee177f15c20" exitCode=0
Jul 24 17:03:58.976597 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:58.976250    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2zx5f" event={"ID":"071318f4-f26f-4eb9-8bd9-027146a171a4","Type":"ContainerDied","Data":"d13467315f8b91cf17676ca639c9cb26fd17448245a82f9ba4485ee177f15c20"}
Jul 24 17:03:59.758705 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:03:59.758641    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fpd4"
Jul 24 17:03:59.758922 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:03:59.758757    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fpd4" podUID="ec08480c-1bcc-4c15-8daa-095f89d01ec1"
Jul 24 17:04:00.757851 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:00.757819    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhjb8"
Jul 24 17:04:00.758232 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:04:00.757916    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhjb8" podUID="3cced35a-4cd2-4520-a5c4-9e0f5e0e891b"
Jul 24 17:04:00.758232 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:00.757970    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8m4l"
Jul 24 17:04:00.758232 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:04:00.758042    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8m4l" podUID="e066d7db-af43-4c57-b832-3936cecdb3bc"
Jul 24 17:04:00.983585 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:00.983548    2582 generic.go:356] "Generic (PLEG): container finished" podID="071318f4-f26f-4eb9-8bd9-027146a171a4" containerID="3350ee47194f22e0401815a647daf366acab286fe8b39850caf788275f7a985f" exitCode=0
Jul 24 17:04:00.983757 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:00.983582    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2zx5f" event={"ID":"071318f4-f26f-4eb9-8bd9-027146a171a4","Type":"ContainerDied","Data":"3350ee47194f22e0401815a647daf366acab286fe8b39850caf788275f7a985f"}
Jul 24 17:04:01.758038 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:01.758001    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fpd4"
Jul 24 17:04:01.758429 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:04:01.758149    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fpd4" podUID="ec08480c-1bcc-4c15-8daa-095f89d01ec1"
Jul 24 17:04:02.338905 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:02.338871    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec08480c-1bcc-4c15-8daa-095f89d01ec1-metrics-certs\") pod \"network-metrics-daemon-2fpd4\" (UID: \"ec08480c-1bcc-4c15-8daa-095f89d01ec1\") " pod="openshift-multus/network-metrics-daemon-2fpd4"
Jul 24 17:04:02.339089 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:04:02.339067    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:04:02.339169 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:04:02.339155    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec08480c-1bcc-4c15-8daa-095f89d01ec1-metrics-certs podName:ec08480c-1bcc-4c15-8daa-095f89d01ec1 nodeName:}" failed. No retries permitted until 2026-07-24 17:04:34.33913411 +0000 UTC m=+65.155108727 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec08480c-1bcc-4c15-8daa-095f89d01ec1-metrics-certs") pod "network-metrics-daemon-2fpd4" (UID: "ec08480c-1bcc-4c15-8daa-095f89d01ec1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:04:02.439520 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:02.439477    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3cced35a-4cd2-4520-a5c4-9e0f5e0e891b-original-pull-secret\") pod \"global-pull-secret-syncer-mhjb8\" (UID: \"3cced35a-4cd2-4520-a5c4-9e0f5e0e891b\") " pod="kube-system/global-pull-secret-syncer-mhjb8"
Jul 24 17:04:02.439520 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:02.439520    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzb28\" (UniqueName: \"kubernetes.io/projected/e066d7db-af43-4c57-b832-3936cecdb3bc-kube-api-access-nzb28\") pod \"network-check-target-s8m4l\" (UID: \"e066d7db-af43-4c57-b832-3936cecdb3bc\") " pod="openshift-network-diagnostics/network-check-target-s8m4l"
Jul 24 17:04:02.439816 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:04:02.439642    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:04:02.439816 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:04:02.439642    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:04:02.439816 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:04:02.439744    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cced35a-4cd2-4520-a5c4-9e0f5e0e891b-original-pull-secret podName:3cced35a-4cd2-4520-a5c4-9e0f5e0e891b nodeName:}" failed. No retries permitted until 2026-07-24 17:04:34.439724062 +0000 UTC m=+65.255698656 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3cced35a-4cd2-4520-a5c4-9e0f5e0e891b-original-pull-secret") pod "global-pull-secret-syncer-mhjb8" (UID: "3cced35a-4cd2-4520-a5c4-9e0f5e0e891b") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:04:02.439816 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:04:02.439656    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:04:02.439816 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:04:02.439781    2582 projected.go:196] Error preparing data for projected volume kube-api-access-nzb28 for pod openshift-network-diagnostics/network-check-target-s8m4l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:04:02.439816 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:04:02.439817    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e066d7db-af43-4c57-b832-3936cecdb3bc-kube-api-access-nzb28 podName:e066d7db-af43-4c57-b832-3936cecdb3bc nodeName:}" failed. No retries permitted until 2026-07-24 17:04:34.439807303 +0000 UTC m=+65.255781900 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nzb28" (UniqueName: "kubernetes.io/projected/e066d7db-af43-4c57-b832-3936cecdb3bc-kube-api-access-nzb28") pod "network-check-target-s8m4l" (UID: "e066d7db-af43-4c57-b832-3936cecdb3bc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:04:02.758146 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:02.758073    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhjb8"
Jul 24 17:04:02.758525 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:02.758075    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8m4l"
Jul 24 17:04:02.758525 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:04:02.758195    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhjb8" podUID="3cced35a-4cd2-4520-a5c4-9e0f5e0e891b"
Jul 24 17:04:02.758525 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:04:02.758257    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8m4l" podUID="e066d7db-af43-4c57-b832-3936cecdb3bc"
Jul 24 17:04:03.758638 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:03.758600    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fpd4"
Jul 24 17:04:03.759063 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:04:03.758764    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fpd4" podUID="ec08480c-1bcc-4c15-8daa-095f89d01ec1"
Jul 24 17:04:04.757687 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:04.757623    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8m4l"
Jul 24 17:04:04.757865 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:04.757623    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhjb8"
Jul 24 17:04:04.757865 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:04:04.757793    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8m4l" podUID="e066d7db-af43-4c57-b832-3936cecdb3bc"
Jul 24 17:04:04.757865 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:04:04.757835    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhjb8" podUID="3cced35a-4cd2-4520-a5c4-9e0f5e0e891b"
Jul 24 17:04:05.758331 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:05.758287    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fpd4"
Jul 24 17:04:05.758827 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:04:05.758416    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fpd4" podUID="ec08480c-1bcc-4c15-8daa-095f89d01ec1"
Jul 24 17:04:06.758285 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:06.758252    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhjb8"
Jul 24 17:04:06.758465 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:06.758253    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8m4l"
Jul 24 17:04:06.758465 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:04:06.758358    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhjb8" podUID="3cced35a-4cd2-4520-a5c4-9e0f5e0e891b"
Jul 24 17:04:06.758822 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:04:06.758468    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8m4l" podUID="e066d7db-af43-4c57-b832-3936cecdb3bc"
Jul 24 17:04:07.757787 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:07.757759    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fpd4"
Jul 24 17:04:07.757951 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:04:07.757864    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fpd4" podUID="ec08480c-1bcc-4c15-8daa-095f89d01ec1"
Jul 24 17:04:08.001019 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:08.000973    2582 generic.go:356] "Generic (PLEG): container finished" podID="071318f4-f26f-4eb9-8bd9-027146a171a4" containerID="a1cb9536da773d87a79a9262f1d99e62f5b5e0a8759b9dbafb1dd8200dd13e96" exitCode=0
Jul 24 17:04:08.001450 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:08.001053    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2zx5f" event={"ID":"071318f4-f26f-4eb9-8bd9-027146a171a4","Type":"ContainerDied","Data":"a1cb9536da773d87a79a9262f1d99e62f5b5e0a8759b9dbafb1dd8200dd13e96"}
Jul 24 17:04:08.757810 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:08.757776    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhjb8"
Jul 24 17:04:08.757974 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:08.757822    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8m4l"
Jul 24 17:04:08.757974 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:04:08.757880    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhjb8" podUID="3cced35a-4cd2-4520-a5c4-9e0f5e0e891b"
Jul 24 17:04:08.758111 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:04:08.758010    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8m4l" podUID="e066d7db-af43-4c57-b832-3936cecdb3bc"
Jul 24 17:04:09.005638 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:09.005606    2582 generic.go:356] "Generic (PLEG): container finished" podID="071318f4-f26f-4eb9-8bd9-027146a171a4" containerID="f8ccf8055f53ba92c7a0feca1910a0e7e9f7c4bdcd75185eee303183f3834d97" exitCode=0
Jul 24 17:04:09.005638 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:09.005640    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2zx5f" event={"ID":"071318f4-f26f-4eb9-8bd9-027146a171a4","Type":"ContainerDied","Data":"f8ccf8055f53ba92c7a0feca1910a0e7e9f7c4bdcd75185eee303183f3834d97"}
Jul 24 17:04:09.759000 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:09.758965    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fpd4"
Jul 24 17:04:09.759172 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:04:09.759059    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fpd4" podUID="ec08480c-1bcc-4c15-8daa-095f89d01ec1"
Jul 24 17:04:10.011089 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:10.010993    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2zx5f" event={"ID":"071318f4-f26f-4eb9-8bd9-027146a171a4","Type":"ContainerStarted","Data":"d4e24f92a1a3b9947d9996d424b32465b4e5c2fe1ad0316794031f358a27eda4"}
Jul 24 17:04:10.035340 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:10.035292    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2zx5f" podStartSLOduration=7.9782215149999995 podStartE2EDuration="40.035277084s" totalImagesPullingTime="32.057055569s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:30 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:04:10.034070657 +0000 UTC m=+40.850045272" watchObservedRunningTime="2026-07-24 17:04:10.035277084 +0000 UTC m=+40.851251699"
Jul 24 17:04:10.758198 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:10.758163    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8m4l"
Jul 24 17:04:10.758375 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:10.758163    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhjb8"
Jul 24 17:04:10.758375 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:04:10.758266    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8m4l" podUID="e066d7db-af43-4c57-b832-3936cecdb3bc"
Jul 24 17:04:10.758375 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:04:10.758341    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhjb8" podUID="3cced35a-4cd2-4520-a5c4-9e0f5e0e891b"
Jul 24 17:04:11.758597 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:11.758565    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fpd4"
Jul 24 17:04:11.758973 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:04:11.758722    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fpd4" podUID="ec08480c-1bcc-4c15-8daa-095f89d01ec1"
Jul 24 17:04:12.414531 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:12.414282    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mhjb8"]
Jul 24 17:04:12.414738 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:12.414630    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhjb8"
Jul 24 17:04:12.414792 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:04:12.414767    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhjb8" podUID="3cced35a-4cd2-4520-a5c4-9e0f5e0e891b"
Jul 24 17:04:12.418598 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:12.418548    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s8m4l"]
Jul 24 17:04:12.418748 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:12.418658    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8m4l"
Jul 24 17:04:12.418825 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:04:12.418773    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8m4l" podUID="e066d7db-af43-4c57-b832-3936cecdb3bc"
Jul 24 17:04:12.419307 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:12.419251    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2fpd4"]
Jul 24 17:04:12.419429 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:12.419343    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fpd4"
Jul 24 17:04:12.419493 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:04:12.419441    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fpd4" podUID="ec08480c-1bcc-4c15-8daa-095f89d01ec1"
Jul 24 17:04:13.757860 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:13.757826    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhjb8"
Jul 24 17:04:13.758447 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:04:13.757922    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhjb8" podUID="3cced35a-4cd2-4520-a5c4-9e0f5e0e891b"
Jul 24 17:04:13.758447 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:13.757826    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8m4l"
Jul 24 17:04:13.758447 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:13.757962    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fpd4"
Jul 24 17:04:13.758447 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:04:13.758049    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8m4l" podUID="e066d7db-af43-4c57-b832-3936cecdb3bc"
Jul 24 17:04:13.758447 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:04:13.758162    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fpd4" podUID="ec08480c-1bcc-4c15-8daa-095f89d01ec1"
Jul 24 17:04:15.758477 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:15.758442    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fpd4"
Jul 24 17:04:15.758477 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:15.758461    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8m4l"
Jul 24 17:04:15.758971 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:15.758439    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhjb8"
Jul 24 17:04:15.758971 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:04:15.758555    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2fpd4" podUID="ec08480c-1bcc-4c15-8daa-095f89d01ec1"
Jul 24 17:04:15.758971 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:04:15.758607    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s8m4l" podUID="e066d7db-af43-4c57-b832-3936cecdb3bc"
Jul 24 17:04:15.758971 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:04:15.758665    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhjb8" podUID="3cced35a-4cd2-4520-a5c4-9e0f5e0e891b"
Jul 24 17:04:16.484597 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.484570    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-152.ec2.internal" event="NodeReady"
Jul 24 17:04:16.484811 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.484739    2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 24 17:04:16.522451 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.522417    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-68756f9b9c-qlbf5"]
Jul 24 17:04:16.553865 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.553837    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68756f9b9c-qlbf5"]
Jul 24 17:04:16.554007 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.553875    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gzmft"]
Jul 24 17:04:16.554007 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.553956    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68756f9b9c-qlbf5"
Jul 24 17:04:16.558765 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.557339    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-v9fwg\""
Jul 24 17:04:16.558765 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.558272    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 24 17:04:16.558765 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.558275    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 24 17:04:16.558765 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.558598    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 24 17:04:16.578509 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.578482    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 24 17:04:16.586097 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.586041    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jmnfs"]
Jul 24 17:04:16.586206 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.586159    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gzmft"
Jul 24 17:04:16.588644 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.588625    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gnbfc\""
Jul 24 17:04:16.588777 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.588744    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 24 17:04:16.588777 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.588755    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 24 17:04:16.596072 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.596055    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gzmft"]
Jul 24 17:04:16.596187 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.596084    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jmnfs"]
Jul 24 17:04:16.596187 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.596181    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jmnfs"
Jul 24 17:04:16.598144 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.598127    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 24 17:04:16.598144 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.598143    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bh4kl\""
Jul 24 17:04:16.598339 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.598198    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 24 17:04:16.598339 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.598276    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 24 17:04:16.598339 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.598292    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 24 17:04:16.642417 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.642384    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4s9ql"]
Jul 24 17:04:16.643809 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.643786    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/84117059-507c-48da-80e6-f6822543ca19-registry-tls\") pod \"image-registry-68756f9b9c-qlbf5\" (UID: \"84117059-507c-48da-80e6-f6822543ca19\") " pod="openshift-image-registry/image-registry-68756f9b9c-qlbf5"
Jul 24 17:04:16.643927 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.643827    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/84117059-507c-48da-80e6-f6822543ca19-registry-certificates\") pod \"image-registry-68756f9b9c-qlbf5\" (UID: \"84117059-507c-48da-80e6-f6822543ca19\") " pod="openshift-image-registry/image-registry-68756f9b9c-qlbf5"
Jul 24 17:04:16.643927 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.643845    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgc9n\" (UniqueName: \"kubernetes.io/projected/84117059-507c-48da-80e6-f6822543ca19-kube-api-access-mgc9n\") pod \"image-registry-68756f9b9c-qlbf5\" (UID: \"84117059-507c-48da-80e6-f6822543ca19\") " pod="openshift-image-registry/image-registry-68756f9b9c-qlbf5"
Jul 24 17:04:16.643998 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.643935    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/84117059-507c-48da-80e6-f6822543ca19-bound-sa-token\") pod \"image-registry-68756f9b9c-qlbf5\" (UID: \"84117059-507c-48da-80e6-f6822543ca19\") " pod="openshift-image-registry/image-registry-68756f9b9c-qlbf5"
Jul 24 17:04:16.643998 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.643962    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/84117059-507c-48da-80e6-f6822543ca19-ca-trust-extracted\") pod \"image-registry-68756f9b9c-qlbf5\" (UID: \"84117059-507c-48da-80e6-f6822543ca19\") " pod="openshift-image-registry/image-registry-68756f9b9c-qlbf5"
Jul 24 17:04:16.643998 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.643977    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/84117059-507c-48da-80e6-f6822543ca19-installation-pull-secrets\") pod \"image-registry-68756f9b9c-qlbf5\" (UID: \"84117059-507c-48da-80e6-f6822543ca19\") " pod="openshift-image-registry/image-registry-68756f9b9c-qlbf5"
Jul 24 17:04:16.644089 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.643996    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/84117059-507c-48da-80e6-f6822543ca19-image-registry-private-configuration\") pod \"image-registry-68756f9b9c-qlbf5\" (UID: \"84117059-507c-48da-80e6-f6822543ca19\") " pod="openshift-image-registry/image-registry-68756f9b9c-qlbf5"
Jul 24 17:04:16.644089 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.644042    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/84117059-507c-48da-80e6-f6822543ca19-trusted-ca\") pod \"image-registry-68756f9b9c-qlbf5\" (UID: \"84117059-507c-48da-80e6-f6822543ca19\") " pod="openshift-image-registry/image-registry-68756f9b9c-qlbf5"
Jul 24 17:04:16.656379 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.656349    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4s9ql"]
Jul 24 17:04:16.656522 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.656461    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4s9ql"
Jul 24 17:04:16.660573 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.660552    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 24 17:04:16.660812 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.660798    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 24 17:04:16.660945 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.660930    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 24 17:04:16.661028 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.661010    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ln2rz\""
Jul 24 17:04:16.744797 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.744765    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmg8j\" (UniqueName: \"kubernetes.io/projected/ecca6ab2-75a3-44b2-86b4-cf1b12317f43-kube-api-access-cmg8j\") pod \"dns-default-gzmft\" (UID: \"ecca6ab2-75a3-44b2-86b4-cf1b12317f43\") " pod="openshift-dns/dns-default-gzmft"
Jul 24 17:04:16.744971 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.744814    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/84117059-507c-48da-80e6-f6822543ca19-bound-sa-token\") pod \"image-registry-68756f9b9c-qlbf5\" (UID: \"84117059-507c-48da-80e6-f6822543ca19\") " pod="openshift-image-registry/image-registry-68756f9b9c-qlbf5"
Jul 24 17:04:16.744971 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.744946    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ecca6ab2-75a3-44b2-86b4-cf1b12317f43-config-volume\") pod \"dns-default-gzmft\" (UID: \"ecca6ab2-75a3-44b2-86b4-cf1b12317f43\") " pod="openshift-dns/dns-default-gzmft"
Jul 24 17:04:16.745049 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.744989    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de4d9895-940a-4610-bd34-e1cd1dd3d7e1-cert\") pod \"ingress-canary-4s9ql\" (UID: \"de4d9895-940a-4610-bd34-e1cd1dd3d7e1\") " pod="openshift-ingress-canary/ingress-canary-4s9ql"
Jul 24 17:04:16.745049 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.745031    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/84117059-507c-48da-80e6-f6822543ca19-ca-trust-extracted\") pod \"image-registry-68756f9b9c-qlbf5\" (UID: \"84117059-507c-48da-80e6-f6822543ca19\") " pod="openshift-image-registry/image-registry-68756f9b9c-qlbf5"
Jul 24 17:04:16.745125 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.745110    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/84117059-507c-48da-80e6-f6822543ca19-installation-pull-secrets\") pod \"image-registry-68756f9b9c-qlbf5\" (UID: \"84117059-507c-48da-80e6-f6822543ca19\") " pod="openshift-image-registry/image-registry-68756f9b9c-qlbf5"
Jul 24 17:04:16.745196 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.745178    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ecca6ab2-75a3-44b2-86b4-cf1b12317f43-metrics-tls\") pod \"dns-default-gzmft\" (UID: \"ecca6ab2-75a3-44b2-86b4-cf1b12317f43\") " pod="openshift-dns/dns-default-gzmft"
Jul 24 17:04:16.745233 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.745212    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ecca6ab2-75a3-44b2-86b4-cf1b12317f43-tmp-dir\") pod \"dns-default-gzmft\" (UID: \"ecca6ab2-75a3-44b2-86b4-cf1b12317f43\") " pod="openshift-dns/dns-default-gzmft"
Jul 24 17:04:16.745266 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.745253    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d4ab348a-370a-47c2-91f9-ae50a3a2f332-crio-socket\") pod \"insights-runtime-extractor-jmnfs\" (UID: \"d4ab348a-370a-47c2-91f9-ae50a3a2f332\") " pod="openshift-insights/insights-runtime-extractor-jmnfs"
Jul 24 17:04:16.745297 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.745282    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d4ab348a-370a-47c2-91f9-ae50a3a2f332-data-volume\") pod \"insights-runtime-extractor-jmnfs\" (UID: \"d4ab348a-370a-47c2-91f9-ae50a3a2f332\") " pod="openshift-insights/insights-runtime-extractor-jmnfs"
Jul 24 17:04:16.745330 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.745303    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d4ab348a-370a-47c2-91f9-ae50a3a2f332-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jmnfs\" (UID: \"d4ab348a-370a-47c2-91f9-ae50a3a2f332\") " pod="openshift-insights/insights-runtime-extractor-jmnfs"
Jul 24 17:04:16.745363 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.745349    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/84117059-507c-48da-80e6-f6822543ca19-image-registry-private-configuration\") pod \"image-registry-68756f9b9c-qlbf5\" (UID: \"84117059-507c-48da-80e6-f6822543ca19\") " pod="openshift-image-registry/image-registry-68756f9b9c-qlbf5"
Jul 24 17:04:16.745405 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.745383    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d4ab348a-370a-47c2-91f9-ae50a3a2f332-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jmnfs\" (UID: \"d4ab348a-370a-47c2-91f9-ae50a3a2f332\") " pod="openshift-insights/insights-runtime-extractor-jmnfs"
Jul 24 17:04:16.745440 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.745420    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/84117059-507c-48da-80e6-f6822543ca19-ca-trust-extracted\") pod \"image-registry-68756f9b9c-qlbf5\" (UID: \"84117059-507c-48da-80e6-f6822543ca19\") " pod="openshift-image-registry/image-registry-68756f9b9c-qlbf5"
Jul 24 17:04:16.745555 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.745536    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/84117059-507c-48da-80e6-f6822543ca19-trusted-ca\") pod \"image-registry-68756f9b9c-qlbf5\" (UID: \"84117059-507c-48da-80e6-f6822543ca19\") " pod="openshift-image-registry/image-registry-68756f9b9c-qlbf5"
Jul 24 17:04:16.745731 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.745711    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/84117059-507c-48da-80e6-f6822543ca19-registry-tls\") pod \"image-registry-68756f9b9c-qlbf5\" (UID: \"84117059-507c-48da-80e6-f6822543ca19\") " pod="openshift-image-registry/image-registry-68756f9b9c-qlbf5"
Jul 24 17:04:16.745836 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.745738    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hztth\" (UniqueName: \"kubernetes.io/projected/de4d9895-940a-4610-bd34-e1cd1dd3d7e1-kube-api-access-hztth\") pod \"ingress-canary-4s9ql\" (UID: \"de4d9895-940a-4610-bd34-e1cd1dd3d7e1\") " pod="openshift-ingress-canary/ingress-canary-4s9ql"
Jul 24 17:04:16.745836 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.745772    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcnrs\" (UniqueName: \"kubernetes.io/projected/d4ab348a-370a-47c2-91f9-ae50a3a2f332-kube-api-access-qcnrs\") pod \"insights-runtime-extractor-jmnfs\" (UID: \"d4ab348a-370a-47c2-91f9-ae50a3a2f332\") " pod="openshift-insights/insights-runtime-extractor-jmnfs"
Jul 24 17:04:16.745836 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.745817    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/84117059-507c-48da-80e6-f6822543ca19-registry-certificates\") pod \"image-registry-68756f9b9c-qlbf5\" (UID: \"84117059-507c-48da-80e6-f6822543ca19\") " pod="openshift-image-registry/image-registry-68756f9b9c-qlbf5"
Jul 24 17:04:16.745836 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.745833    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgc9n\" (UniqueName: \"kubernetes.io/projected/84117059-507c-48da-80e6-f6822543ca19-kube-api-access-mgc9n\") pod \"image-registry-68756f9b9c-qlbf5\" (UID: \"84117059-507c-48da-80e6-f6822543ca19\") " pod="openshift-image-registry/image-registry-68756f9b9c-qlbf5"
Jul 24 17:04:16.746463 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.746443    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/84117059-507c-48da-80e6-f6822543ca19-trusted-ca\") pod \"image-registry-68756f9b9c-qlbf5\" (UID: \"84117059-507c-48da-80e6-f6822543ca19\") " pod="openshift-image-registry/image-registry-68756f9b9c-qlbf5"
Jul 24 17:04:16.746556 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.746529    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/84117059-507c-48da-80e6-f6822543ca19-registry-certificates\") pod \"image-registry-68756f9b9c-qlbf5\" (UID: \"84117059-507c-48da-80e6-f6822543ca19\") " pod="openshift-image-registry/image-registry-68756f9b9c-qlbf5"
Jul 24 17:04:16.749331 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.749312    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/84117059-507c-48da-80e6-f6822543ca19-image-registry-private-configuration\") pod \"image-registry-68756f9b9c-qlbf5\" (UID: \"84117059-507c-48da-80e6-f6822543ca19\") " pod="openshift-image-registry/image-registry-68756f9b9c-qlbf5"
Jul 24 17:04:16.749420 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.749393    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/84117059-507c-48da-80e6-f6822543ca19-registry-tls\") pod \"image-registry-68756f9b9c-qlbf5\" (UID: \"84117059-507c-48da-80e6-f6822543ca19\") " pod="openshift-image-registry/image-registry-68756f9b9c-qlbf5"
Jul 24 17:04:16.749478 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.749393    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/84117059-507c-48da-80e6-f6822543ca19-installation-pull-secrets\") pod \"image-registry-68756f9b9c-qlbf5\" (UID: \"84117059-507c-48da-80e6-f6822543ca19\") " pod="openshift-image-registry/image-registry-68756f9b9c-qlbf5"
Jul 24 17:04:16.752139 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.752112    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/84117059-507c-48da-80e6-f6822543ca19-bound-sa-token\") pod \"image-registry-68756f9b9c-qlbf5\" (UID: \"84117059-507c-48da-80e6-f6822543ca19\") " pod="openshift-image-registry/image-registry-68756f9b9c-qlbf5"
Jul 24 17:04:16.752747 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.752730    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgc9n\" (UniqueName: \"kubernetes.io/projected/84117059-507c-48da-80e6-f6822543ca19-kube-api-access-mgc9n\") pod \"image-registry-68756f9b9c-qlbf5\" (UID: \"84117059-507c-48da-80e6-f6822543ca19\") " pod="openshift-image-registry/image-registry-68756f9b9c-qlbf5"
Jul 24 17:04:16.846583 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.846503    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmg8j\" (UniqueName: \"kubernetes.io/projected/ecca6ab2-75a3-44b2-86b4-cf1b12317f43-kube-api-access-cmg8j\") pod \"dns-default-gzmft\" (UID: \"ecca6ab2-75a3-44b2-86b4-cf1b12317f43\") " pod="openshift-dns/dns-default-gzmft"
Jul 24 17:04:16.846583 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.846547    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ecca6ab2-75a3-44b2-86b4-cf1b12317f43-config-volume\") pod \"dns-default-gzmft\" (UID: \"ecca6ab2-75a3-44b2-86b4-cf1b12317f43\") " pod="openshift-dns/dns-default-gzmft"
Jul 24 17:04:16.846583 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.846570    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de4d9895-940a-4610-bd34-e1cd1dd3d7e1-cert\") pod \"ingress-canary-4s9ql\" (UID: \"de4d9895-940a-4610-bd34-e1cd1dd3d7e1\") " pod="openshift-ingress-canary/ingress-canary-4s9ql"
Jul 24 17:04:16.847417 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.846595    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ecca6ab2-75a3-44b2-86b4-cf1b12317f43-metrics-tls\") pod \"dns-default-gzmft\" (UID: \"ecca6ab2-75a3-44b2-86b4-cf1b12317f43\") " pod="openshift-dns/dns-default-gzmft"
Jul 24 17:04:16.847417 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.846615    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ecca6ab2-75a3-44b2-86b4-cf1b12317f43-tmp-dir\") pod \"dns-default-gzmft\" (UID: \"ecca6ab2-75a3-44b2-86b4-cf1b12317f43\") " pod="openshift-dns/dns-default-gzmft"
Jul 24 17:04:16.847417 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.846637    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d4ab348a-370a-47c2-91f9-ae50a3a2f332-crio-socket\") pod \"insights-runtime-extractor-jmnfs\" (UID: \"d4ab348a-370a-47c2-91f9-ae50a3a2f332\") " pod="openshift-insights/insights-runtime-extractor-jmnfs"
Jul 24 17:04:16.847417 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.846658    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d4ab348a-370a-47c2-91f9-ae50a3a2f332-data-volume\") pod \"insights-runtime-extractor-jmnfs\" (UID: \"d4ab348a-370a-47c2-91f9-ae50a3a2f332\") " pod="openshift-insights/insights-runtime-extractor-jmnfs"
Jul 24 17:04:16.847417 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.846703    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d4ab348a-370a-47c2-91f9-ae50a3a2f332-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jmnfs\" (UID: \"d4ab348a-370a-47c2-91f9-ae50a3a2f332\") " pod="openshift-insights/insights-runtime-extractor-jmnfs"
Jul 24 17:04:16.847417 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.846924    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d4ab348a-370a-47c2-91f9-ae50a3a2f332-crio-socket\") pod \"insights-runtime-extractor-jmnfs\" (UID: \"d4ab348a-370a-47c2-91f9-ae50a3a2f332\") " pod="openshift-insights/insights-runtime-extractor-jmnfs"
Jul 24 17:04:16.847417 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.846980    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d4ab348a-370a-47c2-91f9-ae50a3a2f332-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jmnfs\" (UID: \"d4ab348a-370a-47c2-91f9-ae50a3a2f332\") " pod="openshift-insights/insights-runtime-extractor-jmnfs"
Jul 24 17:04:16.847417 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.847030    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ecca6ab2-75a3-44b2-86b4-cf1b12317f43-tmp-dir\") pod \"dns-default-gzmft\" (UID: \"ecca6ab2-75a3-44b2-86b4-cf1b12317f43\") " pod="openshift-dns/dns-default-gzmft"
Jul 24 17:04:16.847417 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.847046    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d4ab348a-370a-47c2-91f9-ae50a3a2f332-data-volume\") pod \"insights-runtime-extractor-jmnfs\" (UID: \"d4ab348a-370a-47c2-91f9-ae50a3a2f332\") " pod="openshift-insights/insights-runtime-extractor-jmnfs"
Jul 24 17:04:16.847417 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.847057    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hztth\" (UniqueName: \"kubernetes.io/projected/de4d9895-940a-4610-bd34-e1cd1dd3d7e1-kube-api-access-hztth\") pod \"ingress-canary-4s9ql\" (UID: \"de4d9895-940a-4610-bd34-e1cd1dd3d7e1\") " pod="openshift-ingress-canary/ingress-canary-4s9ql"
Jul 24 17:04:16.847417 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.847130    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcnrs\" (UniqueName: \"kubernetes.io/projected/d4ab348a-370a-47c2-91f9-ae50a3a2f332-kube-api-access-qcnrs\") pod \"insights-runtime-extractor-jmnfs\" (UID: \"d4ab348a-370a-47c2-91f9-ae50a3a2f332\") " pod="openshift-insights/insights-runtime-extractor-jmnfs"
Jul 24 17:04:16.847417 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.847225    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ecca6ab2-75a3-44b2-86b4-cf1b12317f43-config-volume\") pod \"dns-default-gzmft\" (UID: \"ecca6ab2-75a3-44b2-86b4-cf1b12317f43\") " pod="openshift-dns/dns-default-gzmft"
Jul 24 17:04:16.847877 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.847528    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d4ab348a-370a-47c2-91f9-ae50a3a2f332-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jmnfs\" (UID: \"d4ab348a-370a-47c2-91f9-ae50a3a2f332\") " pod="openshift-insights/insights-runtime-extractor-jmnfs"
Jul 24 17:04:16.849221 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.849195    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ecca6ab2-75a3-44b2-86b4-cf1b12317f43-metrics-tls\") pod \"dns-default-gzmft\" (UID: \"ecca6ab2-75a3-44b2-86b4-cf1b12317f43\") " pod="openshift-dns/dns-default-gzmft"
Jul 24 17:04:16.849495 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.849475    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d4ab348a-370a-47c2-91f9-ae50a3a2f332-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jmnfs\" (UID: \"d4ab348a-370a-47c2-91f9-ae50a3a2f332\") " pod="openshift-insights/insights-runtime-extractor-jmnfs"
Jul 24 17:04:16.849566 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.849549    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de4d9895-940a-4610-bd34-e1cd1dd3d7e1-cert\") pod \"ingress-canary-4s9ql\" (UID: \"de4d9895-940a-4610-bd34-e1cd1dd3d7e1\") " pod="openshift-ingress-canary/ingress-canary-4s9ql"
Jul 24 17:04:16.854316 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.854287    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmg8j\" (UniqueName: \"kubernetes.io/projected/ecca6ab2-75a3-44b2-86b4-cf1b12317f43-kube-api-access-cmg8j\") pod \"dns-default-gzmft\" (UID: \"ecca6ab2-75a3-44b2-86b4-cf1b12317f43\") " pod="openshift-dns/dns-default-gzmft"
Jul 24 17:04:16.854559 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.854534    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hztth\" (UniqueName: \"kubernetes.io/projected/de4d9895-940a-4610-bd34-e1cd1dd3d7e1-kube-api-access-hztth\") pod \"ingress-canary-4s9ql\" (UID: \"de4d9895-940a-4610-bd34-e1cd1dd3d7e1\") " pod="openshift-ingress-canary/ingress-canary-4s9ql"
Jul 24 17:04:16.854833 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.854818    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcnrs\" (UniqueName: \"kubernetes.io/projected/d4ab348a-370a-47c2-91f9-ae50a3a2f332-kube-api-access-qcnrs\") pod \"insights-runtime-extractor-jmnfs\" (UID: \"d4ab348a-370a-47c2-91f9-ae50a3a2f332\") " pod="openshift-insights/insights-runtime-extractor-jmnfs"
Jul 24 17:04:16.868858 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.868837    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68756f9b9c-qlbf5"
Jul 24 17:04:16.894989 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.894967    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gzmft"
Jul 24 17:04:16.903476 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.903447    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jmnfs"
Jul 24 17:04:16.966063 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:16.966035    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4s9ql"
Jul 24 17:04:17.092881 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:17.092604    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gzmft"]
Jul 24 17:04:17.100596 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:04:17.097145    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecca6ab2_75a3_44b2_86b4_cf1b12317f43.slice/crio-add720d9f9952923516abd76530f6b82a0030b40ddaf3eaca1c2ca5ba4db33a7 WatchSource:0}: Error finding container add720d9f9952923516abd76530f6b82a0030b40ddaf3eaca1c2ca5ba4db33a7: Status 404 returned error can't find the container with id add720d9f9952923516abd76530f6b82a0030b40ddaf3eaca1c2ca5ba4db33a7
Jul 24 17:04:17.100596 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:17.099511    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68756f9b9c-qlbf5"]
Jul 24 17:04:17.126456 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:04:17.126428    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84117059_507c_48da_80e6_f6822543ca19.slice/crio-e2505a50041ff46d474fe90bf0ae2ff6eed11a6f63baeb4c21bcec46102899fd WatchSource:0}: Error finding container e2505a50041ff46d474fe90bf0ae2ff6eed11a6f63baeb4c21bcec46102899fd: Status 404 returned error can't find the container with id e2505a50041ff46d474fe90bf0ae2ff6eed11a6f63baeb4c21bcec46102899fd
Jul 24 17:04:17.141151 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:17.141127    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jmnfs"]
Jul 24 17:04:17.144202 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:04:17.144176    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4ab348a_370a_47c2_91f9_ae50a3a2f332.slice/crio-92084e7649839d689688deac11c0182511c44c1c6ef5522dbb19c0eeb60a8fdc WatchSource:0}: Error finding container 92084e7649839d689688deac11c0182511c44c1c6ef5522dbb19c0eeb60a8fdc: Status 404 returned error can't find the container with id 92084e7649839d689688deac11c0182511c44c1c6ef5522dbb19c0eeb60a8fdc
Jul 24 17:04:17.157046 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:17.155000    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4s9ql"]
Jul 24 17:04:17.160838 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:04:17.160816    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde4d9895_940a_4610_bd34_e1cd1dd3d7e1.slice/crio-65fbfab901c6713032db5059afc351453c95102ab7b81fd4e821f618707484f0 WatchSource:0}: Error finding container 65fbfab901c6713032db5059afc351453c95102ab7b81fd4e821f618707484f0: Status 404 returned error can't find the container with id 65fbfab901c6713032db5059afc351453c95102ab7b81fd4e821f618707484f0
Jul 24 17:04:17.764502 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:17.762986    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhjb8"
Jul 24 17:04:17.764502 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:17.763024    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8m4l"
Jul 24 17:04:17.764502 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:17.763354    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fpd4"
Jul 24 17:04:17.766166 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:17.765999    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 17:04:17.767050 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:17.766555    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 17:04:17.767050 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:17.766640    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 17:04:17.767050 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:17.766757    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 17:04:17.767050 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:17.766777    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lpvrb\""
Jul 24 17:04:17.767050 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:17.766899    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f7d7c\""
Jul 24 17:04:18.032269 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:18.032136    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gzmft" event={"ID":"ecca6ab2-75a3-44b2-86b4-cf1b12317f43","Type":"ContainerStarted","Data":"add720d9f9952923516abd76530f6b82a0030b40ddaf3eaca1c2ca5ba4db33a7"}
Jul 24 17:04:18.034410 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:18.034351    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4s9ql" event={"ID":"de4d9895-940a-4610-bd34-e1cd1dd3d7e1","Type":"ContainerStarted","Data":"65fbfab901c6713032db5059afc351453c95102ab7b81fd4e821f618707484f0"}
Jul 24 17:04:18.036005 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:18.035953    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jmnfs" event={"ID":"d4ab348a-370a-47c2-91f9-ae50a3a2f332","Type":"ContainerStarted","Data":"92084e7649839d689688deac11c0182511c44c1c6ef5522dbb19c0eeb60a8fdc"}
Jul 24 17:04:18.037940 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:18.037914    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68756f9b9c-qlbf5" event={"ID":"84117059-507c-48da-80e6-f6822543ca19","Type":"ContainerStarted","Data":"d33693d25fb2e289227ba7bbb59ba1b6a3594e5526e18a98c1422821b44b02f4"}
Jul 24 17:04:18.038032 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:18.037957    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68756f9b9c-qlbf5" event={"ID":"84117059-507c-48da-80e6-f6822543ca19","Type":"ContainerStarted","Data":"e2505a50041ff46d474fe90bf0ae2ff6eed11a6f63baeb4c21bcec46102899fd"}
Jul 24 17:04:18.038756 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:18.038733    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-68756f9b9c-qlbf5"
Jul 24 17:04:18.059401 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:18.059346    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-68756f9b9c-qlbf5" podStartSLOduration=7.059326784 podStartE2EDuration="7.059326784s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:04:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:04:18.058427411 +0000 UTC m=+48.874402027" watchObservedRunningTime="2026-07-24 17:04:18.059326784 +0000 UTC m=+48.875301400"
Jul 24 17:04:24.056941 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:24.056725    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gzmft" event={"ID":"ecca6ab2-75a3-44b2-86b4-cf1b12317f43","Type":"ContainerStarted","Data":"81da19dd9ce9bf236c3009ef49e122e619c400a8c9e9b81e40c06dd2aa46b160"}
Jul 24 17:04:24.057774 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:24.056987    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gzmft"
Jul 24 17:04:24.057774 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:24.057012    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gzmft" event={"ID":"ecca6ab2-75a3-44b2-86b4-cf1b12317f43","Type":"ContainerStarted","Data":"8c19742debb8bacb250b7e83a22a6804f988b75edda03484818dbe4f5592cb25"}
Jul 24 17:04:24.058237 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:24.058216    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4s9ql" event={"ID":"de4d9895-940a-4610-bd34-e1cd1dd3d7e1","Type":"ContainerStarted","Data":"b4926a697116186267accf6c1d3952b8759f40e0aca4b633cffde7e8a9e92c00"}
Jul 24 17:04:24.059581 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:24.059555    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jmnfs" event={"ID":"d4ab348a-370a-47c2-91f9-ae50a3a2f332","Type":"ContainerStarted","Data":"6529668235d6a68e930cd3b37d82623daa0f0a4cc10a979b587eabbc34cf4018"}
Jul 24 17:04:24.074933 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:24.074891    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gzmft" podStartSLOduration=1.76084793 podStartE2EDuration="8.074876934s" totalImagesPullingTime="6.314029004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:04:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:04:24.074210351 +0000 UTC m=+54.890184969" watchObservedRunningTime="2026-07-24 17:04:24.074876934 +0000 UTC m=+54.890851549"
Jul 24 17:04:24.087915 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:24.087864    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4s9ql" podStartSLOduration=1.833843278 podStartE2EDuration="8.087846189s" totalImagesPullingTime="6.254002911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:04:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:04:24.087700304 +0000 UTC m=+54.903674916" watchObservedRunningTime="2026-07-24 17:04:24.087846189 +0000 UTC m=+54.903820805"
Jul 24 17:04:28.075461 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:28.075205    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jmnfs" event={"ID":"d4ab348a-370a-47c2-91f9-ae50a3a2f332","Type":"ContainerStarted","Data":"ee7e2d9549748e058912b8c0e44df30624ef545b099fdcdff9e6b83a9974c74d"}
Jul 24 17:04:30.001110 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:30.001073    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d6w2m"
Jul 24 17:04:31.058487 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:31.058465    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-98r8l"]
Jul 24 17:04:31.060849 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:31.060834    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-98r8l"
Jul 24 17:04:31.062939 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:31.062917    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-tzpph\""
Jul 24 17:04:31.063856 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:31.063838    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 24 17:04:31.063957 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:31.063885    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 24 17:04:31.064013 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:31.063955    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 24 17:04:31.064073 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:31.064059    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 24 17:04:31.064151 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:31.064137    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 24 17:04:31.069423 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:31.069405    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-98r8l"]
Jul 24 17:04:31.089292 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:31.089266    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jmnfs" event={"ID":"d4ab348a-370a-47c2-91f9-ae50a3a2f332","Type":"ContainerStarted","Data":"1ca82341b4eab3ffbf2445c1ebbccbcb1acaab8e689ab619549711ce71ad8b63"}
Jul 24 17:04:31.106190 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:31.106147    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jmnfs" podStartSLOduration=1.410947986 podStartE2EDuration="15.10613206s" totalImagesPullingTime="13.695184074s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:04:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:04:31.104457999 +0000 UTC m=+61.920432613" watchObservedRunningTime="2026-07-24 17:04:31.10613206 +0000 UTC m=+61.922106675"
Jul 24 17:04:31.164327 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:31.164280    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3f8ac37c-9864-4b69-9612-ffba83957c08-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-98r8l\" (UID: \"3f8ac37c-9864-4b69-9612-ffba83957c08\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-98r8l"
Jul 24 17:04:31.164327 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:31.164323    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpdk7\" (UniqueName: \"kubernetes.io/projected/3f8ac37c-9864-4b69-9612-ffba83957c08-kube-api-access-lpdk7\") pod \"prometheus-operator-84d69f794d-98r8l\" (UID: \"3f8ac37c-9864-4b69-9612-ffba83957c08\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-98r8l"
Jul 24 17:04:31.164585 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:31.164416    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f8ac37c-9864-4b69-9612-ffba83957c08-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-98r8l\" (UID: \"3f8ac37c-9864-4b69-9612-ffba83957c08\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-98r8l"
Jul 24 17:04:31.164585 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:31.164449    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f8ac37c-9864-4b69-9612-ffba83957c08-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-98r8l\" (UID: \"3f8ac37c-9864-4b69-9612-ffba83957c08\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-98r8l"
Jul 24 17:04:31.265432 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:31.265397    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpdk7\" (UniqueName: \"kubernetes.io/projected/3f8ac37c-9864-4b69-9612-ffba83957c08-kube-api-access-lpdk7\") pod \"prometheus-operator-84d69f794d-98r8l\" (UID: \"3f8ac37c-9864-4b69-9612-ffba83957c08\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-98r8l"
Jul 24 17:04:31.265604 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:31.265449    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f8ac37c-9864-4b69-9612-ffba83957c08-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-98r8l\" (UID: \"3f8ac37c-9864-4b69-9612-ffba83957c08\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-98r8l"
Jul 24 17:04:31.265604 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:31.265471    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f8ac37c-9864-4b69-9612-ffba83957c08-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-98r8l\" (UID: \"3f8ac37c-9864-4b69-9612-ffba83957c08\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-98r8l"
Jul 24 17:04:31.265604 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:31.265571    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3f8ac37c-9864-4b69-9612-ffba83957c08-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-98r8l\" (UID: \"3f8ac37c-9864-4b69-9612-ffba83957c08\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-98r8l"
Jul 24 17:04:31.266248 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:31.266217    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f8ac37c-9864-4b69-9612-ffba83957c08-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-98r8l\" (UID: \"3f8ac37c-9864-4b69-9612-ffba83957c08\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-98r8l"
Jul 24 17:04:31.269387 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:31.269355    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f8ac37c-9864-4b69-9612-ffba83957c08-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-98r8l\" (UID: \"3f8ac37c-9864-4b69-9612-ffba83957c08\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-98r8l"
Jul 24 17:04:31.269519 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:31.269434    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3f8ac37c-9864-4b69-9612-ffba83957c08-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-98r8l\" (UID: \"3f8ac37c-9864-4b69-9612-ffba83957c08\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-98r8l"
Jul 24 17:04:31.273143 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:31.273126    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpdk7\" (UniqueName: \"kubernetes.io/projected/3f8ac37c-9864-4b69-9612-ffba83957c08-kube-api-access-lpdk7\") pod \"prometheus-operator-84d69f794d-98r8l\" (UID: \"3f8ac37c-9864-4b69-9612-ffba83957c08\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-98r8l"
Jul 24 17:04:31.369745 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:31.369689    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-98r8l"
Jul 24 17:04:31.492435 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:31.492298    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-98r8l"]
Jul 24 17:04:31.494808 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:04:31.494782    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f8ac37c_9864_4b69_9612_ffba83957c08.slice/crio-6ae9a08423b2399609463f7b6a269c3e7856bf70e6be47ae273120bed9703db8 WatchSource:0}: Error finding container 6ae9a08423b2399609463f7b6a269c3e7856bf70e6be47ae273120bed9703db8: Status 404 returned error can't find the container with id 6ae9a08423b2399609463f7b6a269c3e7856bf70e6be47ae273120bed9703db8
Jul 24 17:04:32.092973 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:32.092930    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-98r8l" event={"ID":"3f8ac37c-9864-4b69-9612-ffba83957c08","Type":"ContainerStarted","Data":"6ae9a08423b2399609463f7b6a269c3e7856bf70e6be47ae273120bed9703db8"}
Jul 24 17:04:34.065411 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:34.065381    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gzmft"
Jul 24 17:04:34.100869 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:34.100833    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-98r8l" event={"ID":"3f8ac37c-9864-4b69-9612-ffba83957c08","Type":"ContainerStarted","Data":"52bbf9f97ae08192ce556b5a66800ab2bc74a44cc7a73d24ada490a800d5ea78"}
Jul 24 17:04:34.101027 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:34.100894    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-98r8l" event={"ID":"3f8ac37c-9864-4b69-9612-ffba83957c08","Type":"ContainerStarted","Data":"e61fb8dec256f4993481cac5ab822f6bf0bcea742dc2faca63898a3d2741528d"}
Jul 24 17:04:34.116044 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:34.115989    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-98r8l" podStartSLOduration=1.511967912 podStartE2EDuration="3.115970787s" totalImagesPullingTime="1.604002875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:04:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:04:34.11573644 +0000 UTC m=+64.931711055" watchObservedRunningTime="2026-07-24 17:04:34.115970787 +0000 UTC m=+64.931945403"
Jul 24 17:04:34.391929 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:34.391832    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec08480c-1bcc-4c15-8daa-095f89d01ec1-metrics-certs\") pod \"network-metrics-daemon-2fpd4\" (UID: \"ec08480c-1bcc-4c15-8daa-095f89d01ec1\") " pod="openshift-multus/network-metrics-daemon-2fpd4"
Jul 24 17:04:34.394256 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:34.394238    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 17:04:34.405218 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:34.405194    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec08480c-1bcc-4c15-8daa-095f89d01ec1-metrics-certs\") pod \"network-metrics-daemon-2fpd4\" (UID: \"ec08480c-1bcc-4c15-8daa-095f89d01ec1\") " pod="openshift-multus/network-metrics-daemon-2fpd4"
Jul 24 17:04:34.492513 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:34.492476    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3cced35a-4cd2-4520-a5c4-9e0f5e0e891b-original-pull-secret\") pod \"global-pull-secret-syncer-mhjb8\" (UID: \"3cced35a-4cd2-4520-a5c4-9e0f5e0e891b\") " pod="kube-system/global-pull-secret-syncer-mhjb8"
Jul 24 17:04:34.492712 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:34.492535    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzb28\" (UniqueName: \"kubernetes.io/projected/e066d7db-af43-4c57-b832-3936cecdb3bc-kube-api-access-nzb28\") pod \"network-check-target-s8m4l\" (UID: \"e066d7db-af43-4c57-b832-3936cecdb3bc\") " pod="openshift-network-diagnostics/network-check-target-s8m4l"
Jul 24 17:04:34.495036 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:34.495016    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 17:04:34.495139 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:34.495019    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 17:04:34.505148 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:34.505130    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 17:04:34.505480 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:34.505462    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3cced35a-4cd2-4520-a5c4-9e0f5e0e891b-original-pull-secret\") pod \"global-pull-secret-syncer-mhjb8\" (UID: \"3cced35a-4cd2-4520-a5c4-9e0f5e0e891b\") " pod="kube-system/global-pull-secret-syncer-mhjb8"
Jul 24 17:04:34.515787 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:34.515760    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzb28\" (UniqueName: \"kubernetes.io/projected/e066d7db-af43-4c57-b832-3936cecdb3bc-kube-api-access-nzb28\") pod \"network-check-target-s8m4l\" (UID: \"e066d7db-af43-4c57-b832-3936cecdb3bc\") " pod="openshift-network-diagnostics/network-check-target-s8m4l"
Jul 24 17:04:34.579769 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:34.579725    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhjb8"
Jul 24 17:04:34.591053 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:34.591025    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f7d7c\""
Jul 24 17:04:34.597652 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:34.597633    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lpvrb\""
Jul 24 17:04:34.599248 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:34.599227    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2fpd4"
Jul 24 17:04:34.606512 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:34.606494    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s8m4l"
Jul 24 17:04:34.721701 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:34.721657    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mhjb8"]
Jul 24 17:04:34.724841 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:04:34.724809    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cced35a_4cd2_4520_a5c4_9e0f5e0e891b.slice/crio-b36ddf4702e2def3043fc6dc1f3dc56e8d91e363dfdddfb4b0626bda90c3eb31 WatchSource:0}: Error finding container b36ddf4702e2def3043fc6dc1f3dc56e8d91e363dfdddfb4b0626bda90c3eb31: Status 404 returned error can't find the container with id b36ddf4702e2def3043fc6dc1f3dc56e8d91e363dfdddfb4b0626bda90c3eb31
Jul 24 17:04:34.743744 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:34.743639    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2fpd4"]
Jul 24 17:04:34.745949 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:04:34.745913    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec08480c_1bcc_4c15_8daa_095f89d01ec1.slice/crio-1e847308b6c0adb6994bacffbcfe071688a41d3c8722764945bbc90aea86c3e7 WatchSource:0}: Error finding container 1e847308b6c0adb6994bacffbcfe071688a41d3c8722764945bbc90aea86c3e7: Status 404 returned error can't find the container with id 1e847308b6c0adb6994bacffbcfe071688a41d3c8722764945bbc90aea86c3e7
Jul 24 17:04:34.758961 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:34.758939    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s8m4l"]
Jul 24 17:04:34.761389 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:04:34.761367    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode066d7db_af43_4c57_b832_3936cecdb3bc.slice/crio-768c4174e9d7b58ebcac369b7ae56ebd342b0f7fee0e18362843d7fc25fe9743 WatchSource:0}: Error finding container 768c4174e9d7b58ebcac369b7ae56ebd342b0f7fee0e18362843d7fc25fe9743: Status 404 returned error can't find the container with id 768c4174e9d7b58ebcac369b7ae56ebd342b0f7fee0e18362843d7fc25fe9743
Jul 24 17:04:35.104956 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:35.104911    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s8m4l" event={"ID":"e066d7db-af43-4c57-b832-3936cecdb3bc","Type":"ContainerStarted","Data":"768c4174e9d7b58ebcac369b7ae56ebd342b0f7fee0e18362843d7fc25fe9743"}
Jul 24 17:04:35.106055 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:35.106032    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mhjb8" event={"ID":"3cced35a-4cd2-4520-a5c4-9e0f5e0e891b","Type":"ContainerStarted","Data":"b36ddf4702e2def3043fc6dc1f3dc56e8d91e363dfdddfb4b0626bda90c3eb31"}
Jul 24 17:04:35.107069 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:35.107050    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2fpd4" event={"ID":"ec08480c-1bcc-4c15-8daa-095f89d01ec1","Type":"ContainerStarted","Data":"1e847308b6c0adb6994bacffbcfe071688a41d3c8722764945bbc90aea86c3e7"}
Jul 24 17:04:36.114753 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.114712    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2fpd4" event={"ID":"ec08480c-1bcc-4c15-8daa-095f89d01ec1","Type":"ContainerStarted","Data":"45037e8614e0cd9de48cf86a2f4bdf9fe0fab555c99d60f3a3d54ea284586bac"}
Jul 24 17:04:36.115223 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.114782    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2fpd4" event={"ID":"ec08480c-1bcc-4c15-8daa-095f89d01ec1","Type":"ContainerStarted","Data":"6a5d82454ee52087255f5c12511d5c84b7dc9fea7ccfd06d4a1ea30257936e3d"}
Jul 24 17:04:36.138734 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.138685    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2fpd4" podStartSLOduration=65.204741911 podStartE2EDuration="1m6.138652183s" totalImagesPullingTime="933.910272ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:03:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:04:36.13772192 +0000 UTC m=+66.953696535" watchObservedRunningTime="2026-07-24 17:04:36.138652183 +0000 UTC m=+66.954626802"
Jul 24 17:04:36.424986 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.424832    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9l4xs"]
Jul 24 17:04:36.428930 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.428906    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9l4xs"
Jul 24 17:04:36.431747 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.431454    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 24 17:04:36.431747 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.431467    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-x7dbk\""
Jul 24 17:04:36.431747 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.431478    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 24 17:04:36.432263 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.432076    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 24 17:04:36.436503 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.436477    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-47l2w"]
Jul 24 17:04:36.440687 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.440651    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-47l2w"
Jul 24 17:04:36.442949 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.442932    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 24 17:04:36.443104 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.443081    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-hfj2c\""
Jul 24 17:04:36.443466 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.443450    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 24 17:04:36.443850 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.443826    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 24 17:04:36.457586 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.457559    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-47l2w"]
Jul 24 17:04:36.509636 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.509599    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d2b401ae-454d-481a-b747-18ed02fa1562-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-47l2w\" (UID: \"d2b401ae-454d-481a-b747-18ed02fa1562\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-47l2w"
Jul 24 17:04:36.509829 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.509646    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2b401ae-454d-481a-b747-18ed02fa1562-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-47l2w\" (UID: \"d2b401ae-454d-481a-b747-18ed02fa1562\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-47l2w"
Jul 24 17:04:36.509829 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.509711    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/99b728f8-210e-4921-be29-da27e7c93b83-metrics-client-ca\") pod \"node-exporter-9l4xs\" (UID: \"99b728f8-210e-4921-be29-da27e7c93b83\") " pod="openshift-monitoring/node-exporter-9l4xs"
Jul 24 17:04:36.509829 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.509733    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/99b728f8-210e-4921-be29-da27e7c93b83-node-exporter-tls\") pod \"node-exporter-9l4xs\" (UID: \"99b728f8-210e-4921-be29-da27e7c93b83\") " pod="openshift-monitoring/node-exporter-9l4xs"
Jul 24 17:04:36.509829 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.509766    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99b728f8-210e-4921-be29-da27e7c93b83-sys\") pod \"node-exporter-9l4xs\" (UID: \"99b728f8-210e-4921-be29-da27e7c93b83\") " pod="openshift-monitoring/node-exporter-9l4xs"
Jul 24 17:04:36.509829 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.509802    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/99b728f8-210e-4921-be29-da27e7c93b83-node-exporter-accelerators-collector-config\") pod \"node-exporter-9l4xs\" (UID: \"99b728f8-210e-4921-be29-da27e7c93b83\") " pod="openshift-monitoring/node-exporter-9l4xs"
Jul 24 17:04:36.509829 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.509824    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/99b728f8-210e-4921-be29-da27e7c93b83-node-exporter-textfile\") pod \"node-exporter-9l4xs\" (UID: \"99b728f8-210e-4921-be29-da27e7c93b83\") " pod="openshift-monitoring/node-exporter-9l4xs"
Jul 24 17:04:36.510135 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.509857    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdkdk\" (UniqueName: \"kubernetes.io/projected/99b728f8-210e-4921-be29-da27e7c93b83-kube-api-access-tdkdk\") pod \"node-exporter-9l4xs\" (UID: \"99b728f8-210e-4921-be29-da27e7c93b83\") " pod="openshift-monitoring/node-exporter-9l4xs"
Jul 24 17:04:36.510135 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.509896    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/99b728f8-210e-4921-be29-da27e7c93b83-node-exporter-wtmp\") pod \"node-exporter-9l4xs\" (UID: \"99b728f8-210e-4921-be29-da27e7c93b83\") " pod="openshift-monitoring/node-exporter-9l4xs"
Jul 24 17:04:36.510135 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.509935    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2b401ae-454d-481a-b747-18ed02fa1562-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-47l2w\" (UID: \"d2b401ae-454d-481a-b747-18ed02fa1562\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-47l2w"
Jul 24 17:04:36.510135 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.509989    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/99b728f8-210e-4921-be29-da27e7c93b83-root\") pod \"node-exporter-9l4xs\" (UID: \"99b728f8-210e-4921-be29-da27e7c93b83\") " pod="openshift-monitoring/node-exporter-9l4xs"
Jul 24 17:04:36.510135 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.510018    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d2b401ae-454d-481a-b747-18ed02fa1562-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-47l2w\" (UID: \"d2b401ae-454d-481a-b747-18ed02fa1562\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-47l2w"
Jul 24 17:04:36.510135 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.510061    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2b401ae-454d-481a-b747-18ed02fa1562-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-47l2w\" (UID: \"d2b401ae-454d-481a-b747-18ed02fa1562\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-47l2w"
Jul 24 17:04:36.510135 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.510097    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6qgl\" (UniqueName: \"kubernetes.io/projected/d2b401ae-454d-481a-b747-18ed02fa1562-kube-api-access-s6qgl\") pod \"kube-state-metrics-56d9f944b4-47l2w\" (UID: \"d2b401ae-454d-481a-b747-18ed02fa1562\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-47l2w"
Jul 24 17:04:36.510135 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.510125    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/99b728f8-210e-4921-be29-da27e7c93b83-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9l4xs\" (UID: \"99b728f8-210e-4921-be29-da27e7c93b83\") " pod="openshift-monitoring/node-exporter-9l4xs"
Jul 24 17:04:36.611478 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.611442    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2b401ae-454d-481a-b747-18ed02fa1562-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-47l2w\" (UID: \"d2b401ae-454d-481a-b747-18ed02fa1562\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-47l2w"
Jul 24 17:04:36.611698 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.611496    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/99b728f8-210e-4921-be29-da27e7c93b83-metrics-client-ca\") pod \"node-exporter-9l4xs\" (UID: \"99b728f8-210e-4921-be29-da27e7c93b83\") " pod="openshift-monitoring/node-exporter-9l4xs"
Jul 24 17:04:36.611698 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.611527    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/99b728f8-210e-4921-be29-da27e7c93b83-node-exporter-tls\") pod \"node-exporter-9l4xs\" (UID: \"99b728f8-210e-4921-be29-da27e7c93b83\") " pod="openshift-monitoring/node-exporter-9l4xs"
Jul 24 17:04:36.611698 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.611568    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99b728f8-210e-4921-be29-da27e7c93b83-sys\") pod \"node-exporter-9l4xs\" (UID: \"99b728f8-210e-4921-be29-da27e7c93b83\") " pod="openshift-monitoring/node-exporter-9l4xs"
Jul 24 17:04:36.611698 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.611615    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99b728f8-210e-4921-be29-da27e7c93b83-sys\") pod \"node-exporter-9l4xs\" (UID: \"99b728f8-210e-4921-be29-da27e7c93b83\") " pod="openshift-monitoring/node-exporter-9l4xs"
Jul 24 17:04:36.611698 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.611663    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/99b728f8-210e-4921-be29-da27e7c93b83-node-exporter-accelerators-collector-config\") pod \"node-exporter-9l4xs\" (UID: \"99b728f8-210e-4921-be29-da27e7c93b83\") " pod="openshift-monitoring/node-exporter-9l4xs"
Jul 24 17:04:36.611961 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:04:36.611700    2582 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 24 17:04:36.611961 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.611712    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/99b728f8-210e-4921-be29-da27e7c93b83-node-exporter-textfile\") pod \"node-exporter-9l4xs\" (UID: \"99b728f8-210e-4921-be29-da27e7c93b83\") " pod="openshift-monitoring/node-exporter-9l4xs"
Jul 24 17:04:36.611961 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.611739    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdkdk\" (UniqueName: \"kubernetes.io/projected/99b728f8-210e-4921-be29-da27e7c93b83-kube-api-access-tdkdk\") pod \"node-exporter-9l4xs\" (UID: \"99b728f8-210e-4921-be29-da27e7c93b83\") " pod="openshift-monitoring/node-exporter-9l4xs"
Jul 24 17:04:36.611961 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:04:36.611771    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99b728f8-210e-4921-be29-da27e7c93b83-node-exporter-tls podName:99b728f8-210e-4921-be29-da27e7c93b83 nodeName:}" failed. No retries permitted until 2026-07-24 17:04:37.111749628 +0000 UTC m=+67.927724237 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/99b728f8-210e-4921-be29-da27e7c93b83-node-exporter-tls") pod "node-exporter-9l4xs" (UID: "99b728f8-210e-4921-be29-da27e7c93b83") : secret "node-exporter-tls" not found
Jul 24 17:04:36.611961 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.611805    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/99b728f8-210e-4921-be29-da27e7c93b83-node-exporter-wtmp\") pod \"node-exporter-9l4xs\" (UID: \"99b728f8-210e-4921-be29-da27e7c93b83\") " pod="openshift-monitoring/node-exporter-9l4xs"
Jul 24 17:04:36.611961 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.611831    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2b401ae-454d-481a-b747-18ed02fa1562-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-47l2w\" (UID: \"d2b401ae-454d-481a-b747-18ed02fa1562\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-47l2w"
Jul 24 17:04:36.611961 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.611859    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/99b728f8-210e-4921-be29-da27e7c93b83-root\") pod \"node-exporter-9l4xs\" (UID: \"99b728f8-210e-4921-be29-da27e7c93b83\") " pod="openshift-monitoring/node-exporter-9l4xs"
Jul 24 17:04:36.611961 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.611884    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d2b401ae-454d-481a-b747-18ed02fa1562-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-47l2w\" (UID: \"d2b401ae-454d-481a-b747-18ed02fa1562\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-47l2w"
Jul 24 17:04:36.611961 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.611922    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2b401ae-454d-481a-b747-18ed02fa1562-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-47l2w\" (UID: \"d2b401ae-454d-481a-b747-18ed02fa1562\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-47l2w"
Jul 24 17:04:36.611961 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.611963    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6qgl\" (UniqueName: \"kubernetes.io/projected/d2b401ae-454d-481a-b747-18ed02fa1562-kube-api-access-s6qgl\") pod \"kube-state-metrics-56d9f944b4-47l2w\" (UID: \"d2b401ae-454d-481a-b747-18ed02fa1562\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-47l2w"
Jul 24 17:04:36.612381 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.611992    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/99b728f8-210e-4921-be29-da27e7c93b83-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9l4xs\" (UID: \"99b728f8-210e-4921-be29-da27e7c93b83\") " pod="openshift-monitoring/node-exporter-9l4xs"
Jul 24 17:04:36.612381 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.612022    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d2b401ae-454d-481a-b747-18ed02fa1562-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-47l2w\" (UID: \"d2b401ae-454d-481a-b747-18ed02fa1562\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-47l2w"
Jul 24 17:04:36.612381 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.612040    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/99b728f8-210e-4921-be29-da27e7c93b83-root\") pod \"node-exporter-9l4xs\" (UID: \"99b728f8-210e-4921-be29-da27e7c93b83\") " pod="openshift-monitoring/node-exporter-9l4xs"
Jul 24 17:04:36.612381 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:04:36.612098    2582 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 24 17:04:36.612381 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:04:36.612151    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2b401ae-454d-481a-b747-18ed02fa1562-kube-state-metrics-tls podName:d2b401ae-454d-481a-b747-18ed02fa1562 nodeName:}" failed. No retries permitted until 2026-07-24 17:04:37.112134681 +0000 UTC m=+67.928109318 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/d2b401ae-454d-481a-b747-18ed02fa1562-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-47l2w" (UID: "d2b401ae-454d-481a-b747-18ed02fa1562") : secret "kube-state-metrics-tls" not found
Jul 24 17:04:36.612381 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.612273    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/99b728f8-210e-4921-be29-da27e7c93b83-metrics-client-ca\") pod \"node-exporter-9l4xs\" (UID: \"99b728f8-210e-4921-be29-da27e7c93b83\") " pod="openshift-monitoring/node-exporter-9l4xs"
Jul 24 17:04:36.612381 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.612353    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/99b728f8-210e-4921-be29-da27e7c93b83-node-exporter-wtmp\") pod \"node-exporter-9l4xs\" (UID: \"99b728f8-210e-4921-be29-da27e7c93b83\") " pod="openshift-monitoring/node-exporter-9l4xs"
Jul 24 17:04:36.612381 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.612381    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d2b401ae-454d-481a-b747-18ed02fa1562-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-47l2w\" (UID: \"d2b401ae-454d-481a-b747-18ed02fa1562\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-47l2w"
Jul 24 17:04:36.613347 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.612779    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/99b728f8-210e-4921-be29-da27e7c93b83-node-exporter-textfile\") pod \"node-exporter-9l4xs\" (UID: \"99b728f8-210e-4921-be29-da27e7c93b83\") " pod="openshift-monitoring/node-exporter-9l4xs"
Jul 24 17:04:36.613347 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.612831    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d2b401ae-454d-481a-b747-18ed02fa1562-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-47l2w\" (UID: \"d2b401ae-454d-481a-b747-18ed02fa1562\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-47l2w"
Jul 24 17:04:36.613347 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.613024    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2b401ae-454d-481a-b747-18ed02fa1562-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-47l2w\" (UID: \"d2b401ae-454d-481a-b747-18ed02fa1562\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-47l2w"
Jul 24 17:04:36.613347 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.613309    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/99b728f8-210e-4921-be29-da27e7c93b83-node-exporter-accelerators-collector-config\") pod \"node-exporter-9l4xs\" (UID: \"99b728f8-210e-4921-be29-da27e7c93b83\") " pod="openshift-monitoring/node-exporter-9l4xs"
Jul 24 17:04:36.614808 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.614785    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2b401ae-454d-481a-b747-18ed02fa1562-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-47l2w\" (UID: \"d2b401ae-454d-481a-b747-18ed02fa1562\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-47l2w"
Jul 24 17:04:36.615213 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.615191    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/99b728f8-210e-4921-be29-da27e7c93b83-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9l4xs\" (UID: \"99b728f8-210e-4921-be29-da27e7c93b83\") " pod="openshift-monitoring/node-exporter-9l4xs"
Jul 24 17:04:36.624081 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.624033    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdkdk\" (UniqueName: \"kubernetes.io/projected/99b728f8-210e-4921-be29-da27e7c93b83-kube-api-access-tdkdk\") pod \"node-exporter-9l4xs\" (UID: \"99b728f8-210e-4921-be29-da27e7c93b83\") " pod="openshift-monitoring/node-exporter-9l4xs"
Jul 24 17:04:36.624248 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.624224    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6qgl\" (UniqueName: \"kubernetes.io/projected/d2b401ae-454d-481a-b747-18ed02fa1562-kube-api-access-s6qgl\") pod \"kube-state-metrics-56d9f944b4-47l2w\" (UID: \"d2b401ae-454d-481a-b747-18ed02fa1562\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-47l2w"
Jul 24 17:04:36.875267 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.875143    2582 patch_prober.go:28] interesting pod/image-registry-68756f9b9c-qlbf5 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 24 17:04:36.875441 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:36.875334    2582 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-68756f9b9c-qlbf5" podUID="84117059-507c-48da-80e6-f6822543ca19" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 17:04:37.116131 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.116087    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2b401ae-454d-481a-b747-18ed02fa1562-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-47l2w\" (UID: \"d2b401ae-454d-481a-b747-18ed02fa1562\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-47l2w"
Jul 24 17:04:37.116594 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.116162    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/99b728f8-210e-4921-be29-da27e7c93b83-node-exporter-tls\") pod \"node-exporter-9l4xs\" (UID: \"99b728f8-210e-4921-be29-da27e7c93b83\") " pod="openshift-monitoring/node-exporter-9l4xs"
Jul 24 17:04:37.116594 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:04:37.116221    2582 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 24 17:04:37.116594 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:04:37.116307    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2b401ae-454d-481a-b747-18ed02fa1562-kube-state-metrics-tls podName:d2b401ae-454d-481a-b747-18ed02fa1562 nodeName:}" failed. No retries permitted until 2026-07-24 17:04:38.11628375 +0000 UTC m=+68.932258345 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/d2b401ae-454d-481a-b747-18ed02fa1562-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-47l2w" (UID: "d2b401ae-454d-481a-b747-18ed02fa1562") : secret "kube-state-metrics-tls" not found
Jul 24 17:04:37.120032 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.120000    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/99b728f8-210e-4921-be29-da27e7c93b83-node-exporter-tls\") pod \"node-exporter-9l4xs\" (UID: \"99b728f8-210e-4921-be29-da27e7c93b83\") " pod="openshift-monitoring/node-exporter-9l4xs"
Jul 24 17:04:37.342105 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.342065    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9l4xs"
Jul 24 17:04:37.495722 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.495688    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 17:04:37.506773 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.506743    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:04:37.509536 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.509512    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 24 17:04:37.509536 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.509533    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 24 17:04:37.509763 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.509568    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 24 17:04:37.509849 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.509815    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 24 17:04:37.509929 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.509913    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 24 17:04:37.509929 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.509925    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 24 17:04:37.510039 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.509997    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 24 17:04:37.510264 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.510241    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 24 17:04:37.510389 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.510267    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 24 17:04:37.510389 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.510297    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-q8fns\""
Jul 24 17:04:37.519084 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.519060    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 17:04:37.621945 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.621865    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/405b43e0-f3d1-4c4c-8c71-82a129548098-config-volume\") pod \"alertmanager-main-0\" (UID: \"405b43e0-f3d1-4c4c-8c71-82a129548098\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:04:37.621945 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.621905    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/405b43e0-f3d1-4c4c-8c71-82a129548098-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"405b43e0-f3d1-4c4c-8c71-82a129548098\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:04:37.621945 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.621936    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/405b43e0-f3d1-4c4c-8c71-82a129548098-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"405b43e0-f3d1-4c4c-8c71-82a129548098\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:04:37.622187 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.622051    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/405b43e0-f3d1-4c4c-8c71-82a129548098-tls-assets\") pod \"alertmanager-main-0\" (UID: \"405b43e0-f3d1-4c4c-8c71-82a129548098\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:04:37.622187 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.622098    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/405b43e0-f3d1-4c4c-8c71-82a129548098-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"405b43e0-f3d1-4c4c-8c71-82a129548098\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:04:37.622187 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.622146    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfqvn\" (UniqueName: \"kubernetes.io/projected/405b43e0-f3d1-4c4c-8c71-82a129548098-kube-api-access-qfqvn\") pod \"alertmanager-main-0\" (UID: \"405b43e0-f3d1-4c4c-8c71-82a129548098\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:04:37.622187 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.622175    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/405b43e0-f3d1-4c4c-8c71-82a129548098-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"405b43e0-f3d1-4c4c-8c71-82a129548098\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:04:37.622377 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.622203    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/405b43e0-f3d1-4c4c-8c71-82a129548098-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"405b43e0-f3d1-4c4c-8c71-82a129548098\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:04:37.622377 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.622244    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/405b43e0-f3d1-4c4c-8c71-82a129548098-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"405b43e0-f3d1-4c4c-8c71-82a129548098\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:04:37.622377 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.622272    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/405b43e0-f3d1-4c4c-8c71-82a129548098-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"405b43e0-f3d1-4c4c-8c71-82a129548098\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:04:37.622377 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.622296    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/405b43e0-f3d1-4c4c-8c71-82a129548098-config-out\") pod \"alertmanager-main-0\" (UID: \"405b43e0-f3d1-4c4c-8c71-82a129548098\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:04:37.622565 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.622390    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/405b43e0-f3d1-4c4c-8c71-82a129548098-web-config\") pod \"alertmanager-main-0\" (UID: \"405b43e0-f3d1-4c4c-8c71-82a129548098\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:04:37.622565 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.622426    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/405b43e0-f3d1-4c4c-8c71-82a129548098-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"405b43e0-f3d1-4c4c-8c71-82a129548098\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:04:37.723761 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.723725    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/405b43e0-f3d1-4c4c-8c71-82a129548098-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"405b43e0-f3d1-4c4c-8c71-82a129548098\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:04:37.723952 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.723800    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/405b43e0-f3d1-4c4c-8c71-82a129548098-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"405b43e0-f3d1-4c4c-8c71-82a129548098\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:04:37.723952 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.723828    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/405b43e0-f3d1-4c4c-8c71-82a129548098-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"405b43e0-f3d1-4c4c-8c71-82a129548098\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:04:37.723952 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.723851    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/405b43e0-f3d1-4c4c-8c71-82a129548098-config-out\") pod \"alertmanager-main-0\" (UID: \"405b43e0-f3d1-4c4c-8c71-82a129548098\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:04:37.723952 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.723881    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/405b43e0-f3d1-4c4c-8c71-82a129548098-web-config\") pod \"alertmanager-main-0\" (UID: \"405b43e0-f3d1-4c4c-8c71-82a129548098\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:04:37.723952 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.723910    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/405b43e0-f3d1-4c4c-8c71-82a129548098-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"405b43e0-f3d1-4c4c-8c71-82a129548098\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:04:37.723952 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.723942    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/405b43e0-f3d1-4c4c-8c71-82a129548098-config-volume\") pod \"alertmanager-main-0\" (UID: \"405b43e0-f3d1-4c4c-8c71-82a129548098\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:04:37.724252 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.723970    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/405b43e0-f3d1-4c4c-8c71-82a129548098-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"405b43e0-f3d1-4c4c-8c71-82a129548098\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:04:37.724252 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.724010    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/405b43e0-f3d1-4c4c-8c71-82a129548098-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"405b43e0-f3d1-4c4c-8c71-82a129548098\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:04:37.724252 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.724062    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/405b43e0-f3d1-4c4c-8c71-82a129548098-tls-assets\") pod \"alertmanager-main-0\" (UID: \"405b43e0-f3d1-4c4c-8c71-82a129548098\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:04:37.724252 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.724100    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/405b43e0-f3d1-4c4c-8c71-82a129548098-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"405b43e0-f3d1-4c4c-8c71-82a129548098\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:04:37.724252 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.724126    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfqvn\" (UniqueName: \"kubernetes.io/projected/405b43e0-f3d1-4c4c-8c71-82a129548098-kube-api-access-qfqvn\") pod \"alertmanager-main-0\" (UID: \"405b43e0-f3d1-4c4c-8c71-82a129548098\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:04:37.724252 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.724189    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/405b43e0-f3d1-4c4c-8c71-82a129548098-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"405b43e0-f3d1-4c4c-8c71-82a129548098\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:04:37.725762 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.725732    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/405b43e0-f3d1-4c4c-8c71-82a129548098-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"405b43e0-f3d1-4c4c-8c71-82a129548098\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:04:37.726928 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.726883    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/405b43e0-f3d1-4c4c-8c71-82a129548098-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"405b43e0-f3d1-4c4c-8c71-82a129548098\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:04:37.728361 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.728333    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/405b43e0-f3d1-4c4c-8c71-82a129548098-config-out\") pod \"alertmanager-main-0\" (UID: \"405b43e0-f3d1-4c4c-8c71-82a129548098\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:04:37.728662 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.728641    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/405b43e0-f3d1-4c4c-8c71-82a129548098-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"405b43e0-f3d1-4c4c-8c71-82a129548098\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:04:37.728838 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.728785    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/405b43e0-f3d1-4c4c-8c71-82a129548098-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"405b43e0-f3d1-4c4c-8c71-82a129548098\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:04:37.729347 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.728869    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/405b43e0-f3d1-4c4c-8c71-82a129548098-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"405b43e0-f3d1-4c4c-8c71-82a129548098\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:04:37.729347 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.729265    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/405b43e0-f3d1-4c4c-8c71-82a129548098-config-volume\") pod \"alertmanager-main-0\" (UID: \"405b43e0-f3d1-4c4c-8c71-82a129548098\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:04:37.729347 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.729285    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/405b43e0-f3d1-4c4c-8c71-82a129548098-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"405b43e0-f3d1-4c4c-8c71-82a129548098\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:04:37.729659 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.729609    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/405b43e0-f3d1-4c4c-8c71-82a129548098-tls-assets\") pod \"alertmanager-main-0\" (UID: \"405b43e0-f3d1-4c4c-8c71-82a129548098\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:04:37.730405 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.730373    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/405b43e0-f3d1-4c4c-8c71-82a129548098-web-config\") pod \"alertmanager-main-0\" (UID: \"405b43e0-f3d1-4c4c-8c71-82a129548098\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:04:37.730515 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.730432    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/405b43e0-f3d1-4c4c-8c71-82a129548098-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"405b43e0-f3d1-4c4c-8c71-82a129548098\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:04:37.731050 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.731027    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/405b43e0-f3d1-4c4c-8c71-82a129548098-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"405b43e0-f3d1-4c4c-8c71-82a129548098\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:04:37.735394 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.735364    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfqvn\" (UniqueName: \"kubernetes.io/projected/405b43e0-f3d1-4c4c-8c71-82a129548098-kube-api-access-qfqvn\") pod \"alertmanager-main-0\" (UID: \"405b43e0-f3d1-4c4c-8c71-82a129548098\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:04:37.818588 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:37.818550    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 24 17:04:38.127978 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:38.127946    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2b401ae-454d-481a-b747-18ed02fa1562-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-47l2w\" (UID: \"d2b401ae-454d-481a-b747-18ed02fa1562\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-47l2w"
Jul 24 17:04:38.130616 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:38.130594    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2b401ae-454d-481a-b747-18ed02fa1562-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-47l2w\" (UID: \"d2b401ae-454d-481a-b747-18ed02fa1562\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-47l2w"
Jul 24 17:04:38.251806 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:38.251771    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-47l2w"
Jul 24 17:04:39.682875 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:04:39.682840    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99b728f8_210e_4921_be29_da27e7c93b83.slice/crio-7b6bffea9351591417e43ba94f6328665f2f8f2754e4e035bdb5b0ab5176334a WatchSource:0}: Error finding container 7b6bffea9351591417e43ba94f6328665f2f8f2754e4e035bdb5b0ab5176334a: Status 404 returned error can't find the container with id 7b6bffea9351591417e43ba94f6328665f2f8f2754e4e035bdb5b0ab5176334a
Jul 24 17:04:39.839579 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:39.839553    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-47l2w"]
Jul 24 17:04:39.841297 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:04:39.841267    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2b401ae_454d_481a_b747_18ed02fa1562.slice/crio-171f97cd5a403d4ae20331d446b4cd2a09602d0b64f9f18304dd5bfe2cdc7f06 WatchSource:0}: Error finding container 171f97cd5a403d4ae20331d446b4cd2a09602d0b64f9f18304dd5bfe2cdc7f06: Status 404 returned error can't find the container with id 171f97cd5a403d4ae20331d446b4cd2a09602d0b64f9f18304dd5bfe2cdc7f06
Jul 24 17:04:39.861584 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:39.861556    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 17:04:39.865201 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:04:39.865170    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod405b43e0_f3d1_4c4c_8c71_82a129548098.slice/crio-4e73660fd43fe743fa6bc40746d97e600e027b2a07274619acb5dc542e092e91 WatchSource:0}: Error finding container 4e73660fd43fe743fa6bc40746d97e600e027b2a07274619acb5dc542e092e91: Status 404 returned error can't find the container with id 4e73660fd43fe743fa6bc40746d97e600e027b2a07274619acb5dc542e092e91
Jul 24 17:04:40.048146 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:40.048116    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-68756f9b9c-qlbf5"
Jul 24 17:04:40.132565 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:40.132529    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"405b43e0-f3d1-4c4c-8c71-82a129548098","Type":"ContainerStarted","Data":"4e73660fd43fe743fa6bc40746d97e600e027b2a07274619acb5dc542e092e91"}
Jul 24 17:04:40.133958 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:40.133925    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-47l2w" event={"ID":"d2b401ae-454d-481a-b747-18ed02fa1562","Type":"ContainerStarted","Data":"171f97cd5a403d4ae20331d446b4cd2a09602d0b64f9f18304dd5bfe2cdc7f06"}
Jul 24 17:04:40.135659 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:40.135630    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s8m4l" event={"ID":"e066d7db-af43-4c57-b832-3936cecdb3bc","Type":"ContainerStarted","Data":"bb9f5f39265336c8bc645a9a181e5a057675ef45c28e8e850fc43547dabde0d8"}
Jul 24 17:04:40.135850 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:40.135730    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-s8m4l"
Jul 24 17:04:40.137188 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:40.137160    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mhjb8" event={"ID":"3cced35a-4cd2-4520-a5c4-9e0f5e0e891b","Type":"ContainerStarted","Data":"418bd15e532dd41104f81d9f8405d8a492bc3c76f26095577064f67064d8e183"}
Jul 24 17:04:40.138482 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:40.138457    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9l4xs" event={"ID":"99b728f8-210e-4921-be29-da27e7c93b83","Type":"ContainerStarted","Data":"7b6bffea9351591417e43ba94f6328665f2f8f2754e4e035bdb5b0ab5176334a"}
Jul 24 17:04:40.150875 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:40.150831    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-s8m4l" podStartSLOduration=65.229916141 podStartE2EDuration="1m10.150814307s" totalImagesPullingTime="4.920898166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:03:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:04:40.150569011 +0000 UTC m=+70.966543627" watchObservedRunningTime="2026-07-24 17:04:40.150814307 +0000 UTC m=+70.966788922"
Jul 24 17:04:40.165185 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:40.165148    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mhjb8" podStartSLOduration=65.197842808 podStartE2EDuration="1m10.165136368s" totalImagesPullingTime="4.96729356s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:04:40.163635789 +0000 UTC m=+70.979610407" watchObservedRunningTime="2026-07-24 17:04:40.165136368 +0000 UTC m=+70.981110982"
Jul 24 17:04:41.144096 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:41.144063    2582 generic.go:356] "Generic (PLEG): container finished" podID="99b728f8-210e-4921-be29-da27e7c93b83" containerID="29514bf96cf099e60af1cb2b6a6d212c2f9429b6e488f2ea54794b1c111a145b" exitCode=0
Jul 24 17:04:41.144547 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:41.144160    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9l4xs" event={"ID":"99b728f8-210e-4921-be29-da27e7c93b83","Type":"ContainerDied","Data":"29514bf96cf099e60af1cb2b6a6d212c2f9429b6e488f2ea54794b1c111a145b"}
Jul 24 17:04:42.151635 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:42.151604    2582 generic.go:356] "Generic (PLEG): container finished" podID="405b43e0-f3d1-4c4c-8c71-82a129548098" containerID="14cf754d44d2666720d91b4997ec69701a99f956dcb64d9e0c8a34e9e6a6c68f" exitCode=0
Jul 24 17:04:42.152109 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:42.151705    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"405b43e0-f3d1-4c4c-8c71-82a129548098","Type":"ContainerDied","Data":"14cf754d44d2666720d91b4997ec69701a99f956dcb64d9e0c8a34e9e6a6c68f"}
Jul 24 17:04:42.153922 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:42.153899    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-47l2w" event={"ID":"d2b401ae-454d-481a-b747-18ed02fa1562","Type":"ContainerStarted","Data":"f4f9da79b8b92e8a937e3309ceb724c1ee784fb0f635c9481cf292f4673b574b"}
Jul 24 17:04:42.154009 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:42.153959    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-47l2w" event={"ID":"d2b401ae-454d-481a-b747-18ed02fa1562","Type":"ContainerStarted","Data":"2af842f8d09255e50e72e9057e819704d32590efac71e3ee5cf342efee573e2e"}
Jul 24 17:04:42.154009 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:42.153992    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-47l2w" event={"ID":"d2b401ae-454d-481a-b747-18ed02fa1562","Type":"ContainerStarted","Data":"c0379ba63b7add1e0648610ab94fc5eddd34326a8db6ffef1304848830fc0e91"}
Jul 24 17:04:42.155766 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:42.155742    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9l4xs" event={"ID":"99b728f8-210e-4921-be29-da27e7c93b83","Type":"ContainerStarted","Data":"7c92ad87b9ab539539adedd2a8106afaa792d84b55a190b0c88ec2a6836cdd84"}
Jul 24 17:04:42.155870 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:42.155789    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9l4xs" event={"ID":"99b728f8-210e-4921-be29-da27e7c93b83","Type":"ContainerStarted","Data":"b922943c7005f4f7369af9736f3b28b721a70e54841753d1a33b43d80eb0bccb"}
Jul 24 17:04:42.193810 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:42.193746    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9l4xs" podStartSLOduration=5.34646011 podStartE2EDuration="6.193728728s" totalImagesPullingTime="774.901321ms" totalInitContainerRuntime="72.367297ms" isStatefulPod=true podCreationTimestamp="2026-07-24 17:04:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:04:42.192942313 +0000 UTC m=+73.008916926" watchObservedRunningTime="2026-07-24 17:04:42.193728728 +0000 UTC m=+73.009703342"
Jul 24 17:04:42.210907 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:42.210749    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-47l2w" podStartSLOduration=4.604054457 podStartE2EDuration="6.210729992s" totalImagesPullingTime="1.606675535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:04:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:04:42.210449302 +0000 UTC m=+73.026423918" watchObservedRunningTime="2026-07-24 17:04:42.210729992 +0000 UTC m=+73.026704607"
Jul 24 17:04:44.170856 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:44.170823    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"405b43e0-f3d1-4c4c-8c71-82a129548098","Type":"ContainerStarted","Data":"ca7f26a85812f22f4a92f3538473167ed7588185422e19c7ea12913a50014fca"}
Jul 24 17:04:44.171223 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:44.170889    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"405b43e0-f3d1-4c4c-8c71-82a129548098","Type":"ContainerStarted","Data":"d1f24e2c28ad4027ff002119aeb051ffc2782abac293efe6987e7c9bcb1ff820"}
Jul 24 17:04:44.171223 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:44.170914    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"405b43e0-f3d1-4c4c-8c71-82a129548098","Type":"ContainerStarted","Data":"da9f9d5971fcb5d9b971ab3d271bc4b2c1b84b8a08bdbc7e831de66299bb85d1"}
Jul 24 17:04:44.171223 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:44.170939    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"405b43e0-f3d1-4c4c-8c71-82a129548098","Type":"ContainerStarted","Data":"acfcd8e3898310d4ed62960e7dad76a0877f3cc39ab5c4dc7344d32c7e7bf608"}
Jul 24 17:04:44.171223 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:44.170964    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"405b43e0-f3d1-4c4c-8c71-82a129548098","Type":"ContainerStarted","Data":"7382bcafe8448df98a7793a5c41e8564e22da64c607ff23026d3c5dceb401c17"}
Jul 24 17:04:45.177623 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:45.177586    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"405b43e0-f3d1-4c4c-8c71-82a129548098","Type":"ContainerStarted","Data":"6b24d7f41025f9faabe339b412f83b37e76da9ae94a78dd13cac70f351e2ff95"}
Jul 24 17:04:45.206819 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:04:45.206771    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.424961812 podStartE2EDuration="8.206755685s" totalImagesPullingTime="3.760483773s" totalInitContainerRuntime="21.3101ms" isStatefulPod=false podCreationTimestamp="2026-07-24 17:04:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:04:45.205970039 +0000 UTC m=+76.021944654" watchObservedRunningTime="2026-07-24 17:04:45.206755685 +0000 UTC m=+76.022730301"
Jul 24 17:05:11.147214 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:05:11.147176    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-s8m4l"
Jul 24 17:06:44.199713 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:06:44.199661    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ddjlh"]
Jul 24 17:06:44.202135 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:06:44.202118    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ddjlh"
Jul 24 17:06:44.204594 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:06:44.204566    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 24 17:06:44.204794 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:06:44.204599    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 24 17:06:44.205351 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:06:44.205334    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dxb6j\""
Jul 24 17:06:44.211056 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:06:44.211029    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ddjlh"]
Jul 24 17:06:44.262221 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:06:44.262189    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07ba0e8d-5a55-4583-86c1-f0a9e51abef6-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ddjlh\" (UID: \"07ba0e8d-5a55-4583-86c1-f0a9e51abef6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ddjlh"
Jul 24 17:06:44.262426 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:06:44.262228    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07ba0e8d-5a55-4583-86c1-f0a9e51abef6-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ddjlh\" (UID: \"07ba0e8d-5a55-4583-86c1-f0a9e51abef6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ddjlh"
Jul 24 17:06:44.262426 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:06:44.262266    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8kj6\" (UniqueName: \"kubernetes.io/projected/07ba0e8d-5a55-4583-86c1-f0a9e51abef6-kube-api-access-b8kj6\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ddjlh\" (UID: \"07ba0e8d-5a55-4583-86c1-f0a9e51abef6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ddjlh"
Jul 24 17:06:44.362841 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:06:44.362806    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8kj6\" (UniqueName: \"kubernetes.io/projected/07ba0e8d-5a55-4583-86c1-f0a9e51abef6-kube-api-access-b8kj6\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ddjlh\" (UID: \"07ba0e8d-5a55-4583-86c1-f0a9e51abef6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ddjlh"
Jul 24 17:06:44.363019 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:06:44.362863    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07ba0e8d-5a55-4583-86c1-f0a9e51abef6-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ddjlh\" (UID: \"07ba0e8d-5a55-4583-86c1-f0a9e51abef6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ddjlh"
Jul 24 17:06:44.363019 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:06:44.362887    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07ba0e8d-5a55-4583-86c1-f0a9e51abef6-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ddjlh\" (UID: \"07ba0e8d-5a55-4583-86c1-f0a9e51abef6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ddjlh"
Jul 24 17:06:44.363227 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:06:44.363208    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07ba0e8d-5a55-4583-86c1-f0a9e51abef6-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ddjlh\" (UID: \"07ba0e8d-5a55-4583-86c1-f0a9e51abef6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ddjlh"
Jul 24 17:06:44.363304 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:06:44.363286    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07ba0e8d-5a55-4583-86c1-f0a9e51abef6-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ddjlh\" (UID: \"07ba0e8d-5a55-4583-86c1-f0a9e51abef6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ddjlh"
Jul 24 17:06:44.371704 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:06:44.371655    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8kj6\" (UniqueName: \"kubernetes.io/projected/07ba0e8d-5a55-4583-86c1-f0a9e51abef6-kube-api-access-b8kj6\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ddjlh\" (UID: \"07ba0e8d-5a55-4583-86c1-f0a9e51abef6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ddjlh"
Jul 24 17:06:44.512050 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:06:44.512013    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ddjlh"
Jul 24 17:06:44.638526 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:06:44.638500    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ddjlh"]
Jul 24 17:06:44.641003 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:06:44.640978    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07ba0e8d_5a55_4583_86c1_f0a9e51abef6.slice/crio-e8b5a402b5cba467ab8c972f1c7e4e05d211da39627570b20c6291b9886cf78f WatchSource:0}: Error finding container e8b5a402b5cba467ab8c972f1c7e4e05d211da39627570b20c6291b9886cf78f: Status 404 returned error can't find the container with id e8b5a402b5cba467ab8c972f1c7e4e05d211da39627570b20c6291b9886cf78f
Jul 24 17:06:45.586567 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:06:45.586533    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ddjlh" event={"ID":"07ba0e8d-5a55-4583-86c1-f0a9e51abef6","Type":"ContainerStarted","Data":"e8b5a402b5cba467ab8c972f1c7e4e05d211da39627570b20c6291b9886cf78f"}
Jul 24 17:06:51.612328 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:06:51.612228    2582 generic.go:356] "Generic (PLEG): container finished" podID="07ba0e8d-5a55-4583-86c1-f0a9e51abef6" containerID="cd1c760c588ba9cca9b8c4192c8ebc61151ef6740bc6b89bc7045c53c85e3856" exitCode=0
Jul 24 17:06:51.612328 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:06:51.612276    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ddjlh" event={"ID":"07ba0e8d-5a55-4583-86c1-f0a9e51abef6","Type":"ContainerDied","Data":"cd1c760c588ba9cca9b8c4192c8ebc61151ef6740bc6b89bc7045c53c85e3856"}
Jul 24 17:06:54.624257 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:06:54.624221    2582 generic.go:356] "Generic (PLEG): container finished" podID="07ba0e8d-5a55-4583-86c1-f0a9e51abef6" containerID="0c9d68ac98f2353535270147bed3a667b7d2954cd5f4279ddfe06c1386f4afe2" exitCode=0
Jul 24 17:06:54.624693 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:06:54.624308    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ddjlh" event={"ID":"07ba0e8d-5a55-4583-86c1-f0a9e51abef6","Type":"ContainerDied","Data":"0c9d68ac98f2353535270147bed3a667b7d2954cd5f4279ddfe06c1386f4afe2"}
Jul 24 17:07:03.659449 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:03.659416    2582 generic.go:356] "Generic (PLEG): container finished" podID="07ba0e8d-5a55-4583-86c1-f0a9e51abef6" containerID="f4b532925d9ffd6eac07aab54792960fa8c714e8e2a0ce00df264f29223d31f7" exitCode=0
Jul 24 17:07:03.659871 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:03.659495    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ddjlh" event={"ID":"07ba0e8d-5a55-4583-86c1-f0a9e51abef6","Type":"ContainerDied","Data":"f4b532925d9ffd6eac07aab54792960fa8c714e8e2a0ce00df264f29223d31f7"}
Jul 24 17:07:04.790436 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:04.790408    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ddjlh"
Jul 24 17:07:04.934974 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:04.934881    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07ba0e8d-5a55-4583-86c1-f0a9e51abef6-bundle\") pod \"07ba0e8d-5a55-4583-86c1-f0a9e51abef6\" (UID: \"07ba0e8d-5a55-4583-86c1-f0a9e51abef6\") "
Jul 24 17:07:04.934974 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:04.934924    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07ba0e8d-5a55-4583-86c1-f0a9e51abef6-util\") pod \"07ba0e8d-5a55-4583-86c1-f0a9e51abef6\" (UID: \"07ba0e8d-5a55-4583-86c1-f0a9e51abef6\") "
Jul 24 17:07:04.934974 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:04.934942    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8kj6\" (UniqueName: \"kubernetes.io/projected/07ba0e8d-5a55-4583-86c1-f0a9e51abef6-kube-api-access-b8kj6\") pod \"07ba0e8d-5a55-4583-86c1-f0a9e51abef6\" (UID: \"07ba0e8d-5a55-4583-86c1-f0a9e51abef6\") "
Jul 24 17:07:04.935640 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:04.935614    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07ba0e8d-5a55-4583-86c1-f0a9e51abef6-bundle" (OuterVolumeSpecName: "bundle") pod "07ba0e8d-5a55-4583-86c1-f0a9e51abef6" (UID: "07ba0e8d-5a55-4583-86c1-f0a9e51abef6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:07:04.937126 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:04.937095    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07ba0e8d-5a55-4583-86c1-f0a9e51abef6-kube-api-access-b8kj6" (OuterVolumeSpecName: "kube-api-access-b8kj6") pod "07ba0e8d-5a55-4583-86c1-f0a9e51abef6" (UID: "07ba0e8d-5a55-4583-86c1-f0a9e51abef6"). InnerVolumeSpecName "kube-api-access-b8kj6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:07:04.939200 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:04.939179    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07ba0e8d-5a55-4583-86c1-f0a9e51abef6-util" (OuterVolumeSpecName: "util") pod "07ba0e8d-5a55-4583-86c1-f0a9e51abef6" (UID: "07ba0e8d-5a55-4583-86c1-f0a9e51abef6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:07:05.035478 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:05.035443    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07ba0e8d-5a55-4583-86c1-f0a9e51abef6-bundle\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:07:05.035478 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:05.035471    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07ba0e8d-5a55-4583-86c1-f0a9e51abef6-util\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:07:05.035478 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:05.035481    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8kj6\" (UniqueName: \"kubernetes.io/projected/07ba0e8d-5a55-4583-86c1-f0a9e51abef6-kube-api-access-b8kj6\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:07:05.669080 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:05.669043    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ddjlh" event={"ID":"07ba0e8d-5a55-4583-86c1-f0a9e51abef6","Type":"ContainerDied","Data":"e8b5a402b5cba467ab8c972f1c7e4e05d211da39627570b20c6291b9886cf78f"}
Jul 24 17:07:05.669080 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:05.669082    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ddjlh"
Jul 24 17:07:05.669278 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:05.669120    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e8b5a402b5cba467ab8c972f1c7e4e05d211da39627570b20c6291b9886cf78f"
Jul 24 17:07:12.194729 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:12.194687    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hf6fg"]
Jul 24 17:07:12.195221 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:12.195112    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07ba0e8d-5a55-4583-86c1-f0a9e51abef6" containerName="extract"
Jul 24 17:07:12.195221 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:12.195130    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="07ba0e8d-5a55-4583-86c1-f0a9e51abef6" containerName="extract"
Jul 24 17:07:12.195221 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:12.195145    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07ba0e8d-5a55-4583-86c1-f0a9e51abef6" containerName="util"
Jul 24 17:07:12.195221 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:12.195153    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="07ba0e8d-5a55-4583-86c1-f0a9e51abef6" containerName="util"
Jul 24 17:07:12.195221 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:12.195171    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07ba0e8d-5a55-4583-86c1-f0a9e51abef6" containerName="pull"
Jul 24 17:07:12.195221 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:12.195180    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="07ba0e8d-5a55-4583-86c1-f0a9e51abef6" containerName="pull"
Jul 24 17:07:12.195506 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:12.195266    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="07ba0e8d-5a55-4583-86c1-f0a9e51abef6" containerName="extract"
Jul 24 17:07:12.198764 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:12.198744    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hf6fg"
Jul 24 17:07:12.201036 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:12.201011    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 24 17:07:12.201189 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:12.201082    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-lxtf4\""
Jul 24 17:07:12.201189 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:12.201152    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 24 17:07:12.208930 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:12.208907    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hf6fg"]
Jul 24 17:07:12.293396 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:12.293355    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rltn\" (UniqueName: \"kubernetes.io/projected/13741d73-a35a-414d-9aee-53b1c831c9e5-kube-api-access-4rltn\") pod \"cert-manager-operator-controller-manager-55c444bf86-hf6fg\" (UID: \"13741d73-a35a-414d-9aee-53b1c831c9e5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hf6fg"
Jul 24 17:07:12.293396 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:12.293401    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13741d73-a35a-414d-9aee-53b1c831c9e5-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-hf6fg\" (UID: \"13741d73-a35a-414d-9aee-53b1c831c9e5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hf6fg"
Jul 24 17:07:12.394268 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:12.394239    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rltn\" (UniqueName: \"kubernetes.io/projected/13741d73-a35a-414d-9aee-53b1c831c9e5-kube-api-access-4rltn\") pod \"cert-manager-operator-controller-manager-55c444bf86-hf6fg\" (UID: \"13741d73-a35a-414d-9aee-53b1c831c9e5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hf6fg"
Jul 24 17:07:12.394394 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:12.394276    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13741d73-a35a-414d-9aee-53b1c831c9e5-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-hf6fg\" (UID: \"13741d73-a35a-414d-9aee-53b1c831c9e5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hf6fg"
Jul 24 17:07:12.394699 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:12.394659    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13741d73-a35a-414d-9aee-53b1c831c9e5-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-hf6fg\" (UID: \"13741d73-a35a-414d-9aee-53b1c831c9e5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hf6fg"
Jul 24 17:07:12.402362 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:12.402340    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rltn\" (UniqueName: \"kubernetes.io/projected/13741d73-a35a-414d-9aee-53b1c831c9e5-kube-api-access-4rltn\") pod \"cert-manager-operator-controller-manager-55c444bf86-hf6fg\" (UID: \"13741d73-a35a-414d-9aee-53b1c831c9e5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hf6fg"
Jul 24 17:07:12.507203 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:12.507169    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hf6fg"
Jul 24 17:07:12.637491 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:12.637460    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hf6fg"]
Jul 24 17:07:12.641850 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:07:12.641819    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13741d73_a35a_414d_9aee_53b1c831c9e5.slice/crio-0f65244d98728c2a7d10cd8e52d5d515732ac8891164459dab2c5add22c67be8 WatchSource:0}: Error finding container 0f65244d98728c2a7d10cd8e52d5d515732ac8891164459dab2c5add22c67be8: Status 404 returned error can't find the container with id 0f65244d98728c2a7d10cd8e52d5d515732ac8891164459dab2c5add22c67be8
Jul 24 17:07:12.694935 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:12.694901    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hf6fg" event={"ID":"13741d73-a35a-414d-9aee-53b1c831c9e5","Type":"ContainerStarted","Data":"0f65244d98728c2a7d10cd8e52d5d515732ac8891164459dab2c5add22c67be8"}
Jul 24 17:07:14.704772 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:14.704663    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hf6fg" event={"ID":"13741d73-a35a-414d-9aee-53b1c831c9e5","Type":"ContainerStarted","Data":"06c18995409800f5bcd46af0d9fb668ab71184c25abf9c5a160126e0c44e605d"}
Jul 24 17:07:14.725701 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:14.725637    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hf6fg" podStartSLOduration=1.053033561 podStartE2EDuration="2.725621248s" totalImagesPullingTime="1.672587687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:07:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:07:14.72424527 +0000 UTC m=+225.540219886" watchObservedRunningTime="2026-07-24 17:07:14.725621248 +0000 UTC m=+225.541595862"
Jul 24 17:07:16.073877 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:16.073841    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtspq"]
Jul 24 17:07:16.076253 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:16.076230    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtspq"
Jul 24 17:07:16.078483 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:16.078463    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 24 17:07:16.078574 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:16.078494    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 24 17:07:16.078574 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:16.078471    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dxb6j\""
Jul 24 17:07:16.084679 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:16.084639    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtspq"]
Jul 24 17:07:16.184932 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:16.184894    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-zkrbh"]
Jul 24 17:07:16.186874 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:16.186859    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-zkrbh"
Jul 24 17:07:16.189386 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:16.189366    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-7jj2c\""
Jul 24 17:07:16.189510 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:16.189387    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 24 17:07:16.189510 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:16.189414    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 24 17:07:16.195777 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:16.195755    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-zkrbh"]
Jul 24 17:07:16.228661 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:16.228631    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b18ccf36-f4d3-46ac-9f91-6d57c09cb4df-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtspq\" (UID: \"b18ccf36-f4d3-46ac-9f91-6d57c09cb4df\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtspq"
Jul 24 17:07:16.228833 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:16.228709    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz2wl\" (UniqueName: \"kubernetes.io/projected/b18ccf36-f4d3-46ac-9f91-6d57c09cb4df-kube-api-access-sz2wl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtspq\" (UID: \"b18ccf36-f4d3-46ac-9f91-6d57c09cb4df\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtspq"
Jul 24 17:07:16.228833 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:16.228752    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b18ccf36-f4d3-46ac-9f91-6d57c09cb4df-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtspq\" (UID: \"b18ccf36-f4d3-46ac-9f91-6d57c09cb4df\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtspq"
Jul 24 17:07:16.329629 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:16.329536    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b18ccf36-f4d3-46ac-9f91-6d57c09cb4df-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtspq\" (UID: \"b18ccf36-f4d3-46ac-9f91-6d57c09cb4df\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtspq"
Jul 24 17:07:16.329629 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:16.329578    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0f2b6b72-b0d3-46b7-bee8-ee9885f65fc3-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-zkrbh\" (UID: \"0f2b6b72-b0d3-46b7-bee8-ee9885f65fc3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zkrbh"
Jul 24 17:07:16.329629 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:16.329626    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz2wl\" (UniqueName: \"kubernetes.io/projected/b18ccf36-f4d3-46ac-9f91-6d57c09cb4df-kube-api-access-sz2wl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtspq\" (UID: \"b18ccf36-f4d3-46ac-9f91-6d57c09cb4df\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtspq"
Jul 24 17:07:16.329893 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:16.329693    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kmlg\" (UniqueName: \"kubernetes.io/projected/0f2b6b72-b0d3-46b7-bee8-ee9885f65fc3-kube-api-access-4kmlg\") pod \"cert-manager-webhook-6486ffd997-zkrbh\" (UID: \"0f2b6b72-b0d3-46b7-bee8-ee9885f65fc3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zkrbh"
Jul 24 17:07:16.329893 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:16.329813    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b18ccf36-f4d3-46ac-9f91-6d57c09cb4df-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtspq\" (UID: \"b18ccf36-f4d3-46ac-9f91-6d57c09cb4df\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtspq"
Jul 24 17:07:16.329973 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:16.329924    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b18ccf36-f4d3-46ac-9f91-6d57c09cb4df-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtspq\" (UID: \"b18ccf36-f4d3-46ac-9f91-6d57c09cb4df\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtspq"
Jul 24 17:07:16.330069 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:16.330051    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b18ccf36-f4d3-46ac-9f91-6d57c09cb4df-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtspq\" (UID: \"b18ccf36-f4d3-46ac-9f91-6d57c09cb4df\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtspq"
Jul 24 17:07:16.343492 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:16.343463    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz2wl\" (UniqueName: \"kubernetes.io/projected/b18ccf36-f4d3-46ac-9f91-6d57c09cb4df-kube-api-access-sz2wl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtspq\" (UID: \"b18ccf36-f4d3-46ac-9f91-6d57c09cb4df\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtspq"
Jul 24 17:07:16.385428 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:16.385387    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtspq"
Jul 24 17:07:16.431599 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:16.431566    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kmlg\" (UniqueName: \"kubernetes.io/projected/0f2b6b72-b0d3-46b7-bee8-ee9885f65fc3-kube-api-access-4kmlg\") pod \"cert-manager-webhook-6486ffd997-zkrbh\" (UID: \"0f2b6b72-b0d3-46b7-bee8-ee9885f65fc3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zkrbh"
Jul 24 17:07:16.431783 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:16.431662    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0f2b6b72-b0d3-46b7-bee8-ee9885f65fc3-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-zkrbh\" (UID: \"0f2b6b72-b0d3-46b7-bee8-ee9885f65fc3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zkrbh"
Jul 24 17:07:16.450105 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:16.450034    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0f2b6b72-b0d3-46b7-bee8-ee9885f65fc3-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-zkrbh\" (UID: \"0f2b6b72-b0d3-46b7-bee8-ee9885f65fc3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zkrbh"
Jul 24 17:07:16.451354 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:16.451326    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kmlg\" (UniqueName: \"kubernetes.io/projected/0f2b6b72-b0d3-46b7-bee8-ee9885f65fc3-kube-api-access-4kmlg\") pod \"cert-manager-webhook-6486ffd997-zkrbh\" (UID: \"0f2b6b72-b0d3-46b7-bee8-ee9885f65fc3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zkrbh"
Jul 24 17:07:16.511972 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:16.511949    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtspq"]
Jul 24 17:07:16.514002 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:07:16.513977    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb18ccf36_f4d3_46ac_9f91_6d57c09cb4df.slice/crio-006a8a15555544ee2760f6e54e08cae8aea7c7f3ac73b3a76162b33151ab555a WatchSource:0}: Error finding container 006a8a15555544ee2760f6e54e08cae8aea7c7f3ac73b3a76162b33151ab555a: Status 404 returned error can't find the container with id 006a8a15555544ee2760f6e54e08cae8aea7c7f3ac73b3a76162b33151ab555a
Jul 24 17:07:16.516607 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:16.516588    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-zkrbh"
Jul 24 17:07:16.649857 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:16.649832    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-zkrbh"]
Jul 24 17:07:16.672514 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:07:16.672491    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0f2b6b72_b0d3_46b7_bee8_ee9885f65fc3.slice/crio-68525669c746f96c3e3d51cac4b58661c659cf15188c1915dfe38cffdc95a42e WatchSource:0}: Error finding container 68525669c746f96c3e3d51cac4b58661c659cf15188c1915dfe38cffdc95a42e: Status 404 returned error can't find the container with id 68525669c746f96c3e3d51cac4b58661c659cf15188c1915dfe38cffdc95a42e
Jul 24 17:07:16.713143 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:16.713108    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-zkrbh" event={"ID":"0f2b6b72-b0d3-46b7-bee8-ee9885f65fc3","Type":"ContainerStarted","Data":"68525669c746f96c3e3d51cac4b58661c659cf15188c1915dfe38cffdc95a42e"}
Jul 24 17:07:16.714449 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:16.714424    2582 generic.go:356] "Generic (PLEG): container finished" podID="b18ccf36-f4d3-46ac-9f91-6d57c09cb4df" containerID="f70f759911212b9f4b5a615f0fa5211b6070e69a3b3a9947da1cef91eb4f5466" exitCode=0
Jul 24 17:07:16.714511 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:16.714495    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtspq" event={"ID":"b18ccf36-f4d3-46ac-9f91-6d57c09cb4df","Type":"ContainerDied","Data":"f70f759911212b9f4b5a615f0fa5211b6070e69a3b3a9947da1cef91eb4f5466"}
Jul 24 17:07:16.714559 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:16.714540    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtspq" event={"ID":"b18ccf36-f4d3-46ac-9f91-6d57c09cb4df","Type":"ContainerStarted","Data":"006a8a15555544ee2760f6e54e08cae8aea7c7f3ac73b3a76162b33151ab555a"}
Jul 24 17:07:18.049135 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:18.049090    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-t47w2"]
Jul 24 17:07:18.052875 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:18.052852    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-t47w2"
Jul 24 17:07:18.055156 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:18.055135    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-c8mhs\""
Jul 24 17:07:18.063248 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:18.061656    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-t47w2"]
Jul 24 17:07:18.145593 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:18.145555    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7cx7\" (UniqueName: \"kubernetes.io/projected/899c55b1-3504-42c6-9b30-1d72e0056f9b-kube-api-access-q7cx7\") pod \"cert-manager-cainjector-559cdd8c87-t47w2\" (UID: \"899c55b1-3504-42c6-9b30-1d72e0056f9b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-t47w2"
Jul 24 17:07:18.145786 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:18.145630    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/899c55b1-3504-42c6-9b30-1d72e0056f9b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-t47w2\" (UID: \"899c55b1-3504-42c6-9b30-1d72e0056f9b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-t47w2"
Jul 24 17:07:18.246369 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:18.246325    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/899c55b1-3504-42c6-9b30-1d72e0056f9b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-t47w2\" (UID: \"899c55b1-3504-42c6-9b30-1d72e0056f9b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-t47w2"
Jul 24 17:07:18.246550 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:18.246434    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7cx7\" (UniqueName: \"kubernetes.io/projected/899c55b1-3504-42c6-9b30-1d72e0056f9b-kube-api-access-q7cx7\") pod \"cert-manager-cainjector-559cdd8c87-t47w2\" (UID: \"899c55b1-3504-42c6-9b30-1d72e0056f9b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-t47w2"
Jul 24 17:07:18.255512 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:18.255447    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/899c55b1-3504-42c6-9b30-1d72e0056f9b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-t47w2\" (UID: \"899c55b1-3504-42c6-9b30-1d72e0056f9b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-t47w2"
Jul 24 17:07:18.255685 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:18.255525    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7cx7\" (UniqueName: \"kubernetes.io/projected/899c55b1-3504-42c6-9b30-1d72e0056f9b-kube-api-access-q7cx7\") pod \"cert-manager-cainjector-559cdd8c87-t47w2\" (UID: \"899c55b1-3504-42c6-9b30-1d72e0056f9b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-t47w2"
Jul 24 17:07:18.366663 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:18.366492    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-t47w2"
Jul 24 17:07:19.828736 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:19.828702    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-t47w2"]
Jul 24 17:07:19.830563 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:07:19.830531    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod899c55b1_3504_42c6_9b30_1d72e0056f9b.slice/crio-5fda386b5f120cb7ae69964fb08d605b5dcc7b37f58a3d5e4f639441a2fee943 WatchSource:0}: Error finding container 5fda386b5f120cb7ae69964fb08d605b5dcc7b37f58a3d5e4f639441a2fee943: Status 404 returned error can't find the container with id 5fda386b5f120cb7ae69964fb08d605b5dcc7b37f58a3d5e4f639441a2fee943
Jul 24 17:07:20.734867 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:20.734832    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-zkrbh" event={"ID":"0f2b6b72-b0d3-46b7-bee8-ee9885f65fc3","Type":"ContainerStarted","Data":"b840b0b345f9efa1df8f56c2ecb81364571b311601bf313f19e9423d7c8ec793"}
Jul 24 17:07:20.735048 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:20.734930    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-zkrbh"
Jul 24 17:07:20.736937 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:20.736908    2582 generic.go:356] "Generic (PLEG): container finished" podID="b18ccf36-f4d3-46ac-9f91-6d57c09cb4df" containerID="f7b21a7702d2d51464c279371ed5b131195f24d59da917a14d9b7ac9f157f7d4" exitCode=0
Jul 24 17:07:20.737075 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:20.736995    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtspq" event={"ID":"b18ccf36-f4d3-46ac-9f91-6d57c09cb4df","Type":"ContainerDied","Data":"f7b21a7702d2d51464c279371ed5b131195f24d59da917a14d9b7ac9f157f7d4"}
Jul 24 17:07:20.738631 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:20.738612    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-t47w2" event={"ID":"899c55b1-3504-42c6-9b30-1d72e0056f9b","Type":"ContainerStarted","Data":"3aad80fda8b6ac8e4c2c4603d0533eebf33664d72f0aeed8ad9097f1454cbf27"}
Jul 24 17:07:20.738760 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:20.738639    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-t47w2" event={"ID":"899c55b1-3504-42c6-9b30-1d72e0056f9b","Type":"ContainerStarted","Data":"5fda386b5f120cb7ae69964fb08d605b5dcc7b37f58a3d5e4f639441a2fee943"}
Jul 24 17:07:20.751690 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:20.751596    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-zkrbh" podStartSLOduration=1.72543523 podStartE2EDuration="4.751581616s" totalImagesPullingTime="3.026146386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:07:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:07:20.751017237 +0000 UTC m=+231.566991852" watchObservedRunningTime="2026-07-24 17:07:20.751581616 +0000 UTC m=+231.567556232"
Jul 24 17:07:20.766605 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:20.766562    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-t47w2" podStartSLOduration=2.766549821 podStartE2EDuration="2.766549821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:07:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:07:20.765830743 +0000 UTC m=+231.581805359" watchObservedRunningTime="2026-07-24 17:07:20.766549821 +0000 UTC m=+231.582524436"
Jul 24 17:07:21.745423 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:21.745382    2582 generic.go:356] "Generic (PLEG): container finished" podID="b18ccf36-f4d3-46ac-9f91-6d57c09cb4df" containerID="54c96c3edfe79777e167b8c1ba90007f2d09f2850622130dc7e82442f5834330" exitCode=0
Jul 24 17:07:21.745858 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:21.745477    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtspq" event={"ID":"b18ccf36-f4d3-46ac-9f91-6d57c09cb4df","Type":"ContainerDied","Data":"54c96c3edfe79777e167b8c1ba90007f2d09f2850622130dc7e82442f5834330"}
Jul 24 17:07:22.869586 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:22.869565    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtspq"
Jul 24 17:07:22.985030 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:22.984992    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b18ccf36-f4d3-46ac-9f91-6d57c09cb4df-util\") pod \"b18ccf36-f4d3-46ac-9f91-6d57c09cb4df\" (UID: \"b18ccf36-f4d3-46ac-9f91-6d57c09cb4df\") "
Jul 24 17:07:22.985208 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:22.985044    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sz2wl\" (UniqueName: \"kubernetes.io/projected/b18ccf36-f4d3-46ac-9f91-6d57c09cb4df-kube-api-access-sz2wl\") pod \"b18ccf36-f4d3-46ac-9f91-6d57c09cb4df\" (UID: \"b18ccf36-f4d3-46ac-9f91-6d57c09cb4df\") "
Jul 24 17:07:22.985208 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:22.985107    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b18ccf36-f4d3-46ac-9f91-6d57c09cb4df-bundle\") pod \"b18ccf36-f4d3-46ac-9f91-6d57c09cb4df\" (UID: \"b18ccf36-f4d3-46ac-9f91-6d57c09cb4df\") "
Jul 24 17:07:22.985513 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:22.985481    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b18ccf36-f4d3-46ac-9f91-6d57c09cb4df-bundle" (OuterVolumeSpecName: "bundle") pod "b18ccf36-f4d3-46ac-9f91-6d57c09cb4df" (UID: "b18ccf36-f4d3-46ac-9f91-6d57c09cb4df"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:07:22.987157 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:22.987123    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b18ccf36-f4d3-46ac-9f91-6d57c09cb4df-kube-api-access-sz2wl" (OuterVolumeSpecName: "kube-api-access-sz2wl") pod "b18ccf36-f4d3-46ac-9f91-6d57c09cb4df" (UID: "b18ccf36-f4d3-46ac-9f91-6d57c09cb4df"). InnerVolumeSpecName "kube-api-access-sz2wl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:07:22.989842 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:22.989819    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b18ccf36-f4d3-46ac-9f91-6d57c09cb4df-util" (OuterVolumeSpecName: "util") pod "b18ccf36-f4d3-46ac-9f91-6d57c09cb4df" (UID: "b18ccf36-f4d3-46ac-9f91-6d57c09cb4df"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:07:23.085952 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:23.085879    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b18ccf36-f4d3-46ac-9f91-6d57c09cb4df-util\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:07:23.085952 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:23.085907    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sz2wl\" (UniqueName: \"kubernetes.io/projected/b18ccf36-f4d3-46ac-9f91-6d57c09cb4df-kube-api-access-sz2wl\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:07:23.085952 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:23.085919    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b18ccf36-f4d3-46ac-9f91-6d57c09cb4df-bundle\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:07:23.756883 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:23.756846    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtspq" event={"ID":"b18ccf36-f4d3-46ac-9f91-6d57c09cb4df","Type":"ContainerDied","Data":"006a8a15555544ee2760f6e54e08cae8aea7c7f3ac73b3a76162b33151ab555a"}
Jul 24 17:07:23.756883 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:23.756873    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbtspq"
Jul 24 17:07:23.757081 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:23.756925    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="006a8a15555544ee2760f6e54e08cae8aea7c7f3ac73b3a76162b33151ab555a"
Jul 24 17:07:26.747633 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:26.747607    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-zkrbh"
Jul 24 17:07:41.737749 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:41.737714    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrbhb"]
Jul 24 17:07:41.738214 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:41.737991    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b18ccf36-f4d3-46ac-9f91-6d57c09cb4df" containerName="pull"
Jul 24 17:07:41.738214 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:41.738002    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b18ccf36-f4d3-46ac-9f91-6d57c09cb4df" containerName="pull"
Jul 24 17:07:41.738214 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:41.738012    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b18ccf36-f4d3-46ac-9f91-6d57c09cb4df" containerName="util"
Jul 24 17:07:41.738214 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:41.738018    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b18ccf36-f4d3-46ac-9f91-6d57c09cb4df" containerName="util"
Jul 24 17:07:41.738214 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:41.738035    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b18ccf36-f4d3-46ac-9f91-6d57c09cb4df" containerName="extract"
Jul 24 17:07:41.738214 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:41.738041    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b18ccf36-f4d3-46ac-9f91-6d57c09cb4df" containerName="extract"
Jul 24 17:07:41.738214 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:41.738082    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b18ccf36-f4d3-46ac-9f91-6d57c09cb4df" containerName="extract"
Jul 24 17:07:41.741624 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:41.741603    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrbhb"
Jul 24 17:07:41.744160 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:41.744140    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dxb6j\""
Jul 24 17:07:41.744275 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:41.744163    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 24 17:07:41.744275 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:41.744218    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 24 17:07:41.751017 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:41.750994    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrbhb"]
Jul 24 17:07:41.819337 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:41.819297    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db767968-c5de-421f-94e6-69a8f3f61695-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrbhb\" (UID: \"db767968-c5de-421f-94e6-69a8f3f61695\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrbhb"
Jul 24 17:07:41.819337 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:41.819343    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db767968-c5de-421f-94e6-69a8f3f61695-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrbhb\" (UID: \"db767968-c5de-421f-94e6-69a8f3f61695\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrbhb"
Jul 24 17:07:41.819560 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:41.819363    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76cbx\" (UniqueName: \"kubernetes.io/projected/db767968-c5de-421f-94e6-69a8f3f61695-kube-api-access-76cbx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrbhb\" (UID: \"db767968-c5de-421f-94e6-69a8f3f61695\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrbhb"
Jul 24 17:07:41.920761 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:41.920710    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db767968-c5de-421f-94e6-69a8f3f61695-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrbhb\" (UID: \"db767968-c5de-421f-94e6-69a8f3f61695\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrbhb"
Jul 24 17:07:41.920761 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:41.920770    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db767968-c5de-421f-94e6-69a8f3f61695-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrbhb\" (UID: \"db767968-c5de-421f-94e6-69a8f3f61695\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrbhb"
Jul 24 17:07:41.921002 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:41.920897    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76cbx\" (UniqueName: \"kubernetes.io/projected/db767968-c5de-421f-94e6-69a8f3f61695-kube-api-access-76cbx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrbhb\" (UID: \"db767968-c5de-421f-94e6-69a8f3f61695\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrbhb"
Jul 24 17:07:41.921103 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:41.921088    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db767968-c5de-421f-94e6-69a8f3f61695-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrbhb\" (UID: \"db767968-c5de-421f-94e6-69a8f3f61695\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrbhb"
Jul 24 17:07:41.921152 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:41.921135    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db767968-c5de-421f-94e6-69a8f3f61695-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrbhb\" (UID: \"db767968-c5de-421f-94e6-69a8f3f61695\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrbhb"
Jul 24 17:07:41.929320 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:41.929285    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76cbx\" (UniqueName: \"kubernetes.io/projected/db767968-c5de-421f-94e6-69a8f3f61695-kube-api-access-76cbx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrbhb\" (UID: \"db767968-c5de-421f-94e6-69a8f3f61695\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrbhb"
Jul 24 17:07:42.051471 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:42.051436    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrbhb"
Jul 24 17:07:42.176884 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:42.176740    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrbhb"]
Jul 24 17:07:42.179124 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:07:42.179099    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb767968_c5de_421f_94e6_69a8f3f61695.slice/crio-f3ce2154f6c3e6b5be854aad62df7c25e4ee61bb169594be577ddac11dac6f0e WatchSource:0}: Error finding container f3ce2154f6c3e6b5be854aad62df7c25e4ee61bb169594be577ddac11dac6f0e: Status 404 returned error can't find the container with id f3ce2154f6c3e6b5be854aad62df7c25e4ee61bb169594be577ddac11dac6f0e
Jul 24 17:07:42.832431 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:42.832391    2582 generic.go:356] "Generic (PLEG): container finished" podID="db767968-c5de-421f-94e6-69a8f3f61695" containerID="e9f19dc7d34c33ae2a30183d7b812d2a820dcf083d42045bad55d2d20912c575" exitCode=0
Jul 24 17:07:42.832854 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:42.832475    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrbhb" event={"ID":"db767968-c5de-421f-94e6-69a8f3f61695","Type":"ContainerDied","Data":"e9f19dc7d34c33ae2a30183d7b812d2a820dcf083d42045bad55d2d20912c575"}
Jul 24 17:07:42.832854 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:42.832529    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrbhb" event={"ID":"db767968-c5de-421f-94e6-69a8f3f61695","Type":"ContainerStarted","Data":"f3ce2154f6c3e6b5be854aad62df7c25e4ee61bb169594be577ddac11dac6f0e"}
Jul 24 17:07:43.837764 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:43.837726    2582 generic.go:356] "Generic (PLEG): container finished" podID="db767968-c5de-421f-94e6-69a8f3f61695" containerID="9cb84ea79fc454a2196a0ef3a77e3b580e1d58ad7912c8837b1a258e4156abdf" exitCode=0
Jul 24 17:07:43.838249 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:43.837770    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrbhb" event={"ID":"db767968-c5de-421f-94e6-69a8f3f61695","Type":"ContainerDied","Data":"9cb84ea79fc454a2196a0ef3a77e3b580e1d58ad7912c8837b1a258e4156abdf"}
Jul 24 17:07:44.846340 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:44.846305    2582 generic.go:356] "Generic (PLEG): container finished" podID="db767968-c5de-421f-94e6-69a8f3f61695" containerID="42ae821bf29539f98c7bf6c3c386434df6c6349bc7b1c8b131e72de9a6ff559d" exitCode=0
Jul 24 17:07:44.846816 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:44.846392    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrbhb" event={"ID":"db767968-c5de-421f-94e6-69a8f3f61695","Type":"ContainerDied","Data":"42ae821bf29539f98c7bf6c3c386434df6c6349bc7b1c8b131e72de9a6ff559d"}
Jul 24 17:07:45.977468 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:45.977447    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrbhb"
Jul 24 17:07:46.052330 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:46.052293    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db767968-c5de-421f-94e6-69a8f3f61695-bundle\") pod \"db767968-c5de-421f-94e6-69a8f3f61695\" (UID: \"db767968-c5de-421f-94e6-69a8f3f61695\") "
Jul 24 17:07:46.052330 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:46.052328    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76cbx\" (UniqueName: \"kubernetes.io/projected/db767968-c5de-421f-94e6-69a8f3f61695-kube-api-access-76cbx\") pod \"db767968-c5de-421f-94e6-69a8f3f61695\" (UID: \"db767968-c5de-421f-94e6-69a8f3f61695\") "
Jul 24 17:07:46.052528 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:46.052386    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db767968-c5de-421f-94e6-69a8f3f61695-util\") pod \"db767968-c5de-421f-94e6-69a8f3f61695\" (UID: \"db767968-c5de-421f-94e6-69a8f3f61695\") "
Jul 24 17:07:46.053135 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:46.053107    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db767968-c5de-421f-94e6-69a8f3f61695-bundle" (OuterVolumeSpecName: "bundle") pod "db767968-c5de-421f-94e6-69a8f3f61695" (UID: "db767968-c5de-421f-94e6-69a8f3f61695"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:07:46.054424 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:46.054402    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db767968-c5de-421f-94e6-69a8f3f61695-kube-api-access-76cbx" (OuterVolumeSpecName: "kube-api-access-76cbx") pod "db767968-c5de-421f-94e6-69a8f3f61695" (UID: "db767968-c5de-421f-94e6-69a8f3f61695"). InnerVolumeSpecName "kube-api-access-76cbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:07:46.060977 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:46.060945    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db767968-c5de-421f-94e6-69a8f3f61695-util" (OuterVolumeSpecName: "util") pod "db767968-c5de-421f-94e6-69a8f3f61695" (UID: "db767968-c5de-421f-94e6-69a8f3f61695"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:07:46.153737 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:46.153648    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db767968-c5de-421f-94e6-69a8f3f61695-bundle\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:07:46.153737 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:46.153700    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76cbx\" (UniqueName: \"kubernetes.io/projected/db767968-c5de-421f-94e6-69a8f3f61695-kube-api-access-76cbx\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:07:46.153737 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:46.153709    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db767968-c5de-421f-94e6-69a8f3f61695-util\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:07:46.855983 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:46.855943    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrbhb" event={"ID":"db767968-c5de-421f-94e6-69a8f3f61695","Type":"ContainerDied","Data":"f3ce2154f6c3e6b5be854aad62df7c25e4ee61bb169594be577ddac11dac6f0e"}
Jul 24 17:07:46.855983 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:46.855970    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrbhb"
Jul 24 17:07:46.855983 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:46.855990    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f3ce2154f6c3e6b5be854aad62df7c25e4ee61bb169594be577ddac11dac6f0e"
Jul 24 17:07:51.431856 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:51.431766    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-65bbc66f6-4vvzh"]
Jul 24 17:07:51.432304 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:51.432154    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db767968-c5de-421f-94e6-69a8f3f61695" containerName="extract"
Jul 24 17:07:51.432304 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:51.432172    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="db767968-c5de-421f-94e6-69a8f3f61695" containerName="extract"
Jul 24 17:07:51.432304 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:51.432197    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db767968-c5de-421f-94e6-69a8f3f61695" containerName="util"
Jul 24 17:07:51.432304 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:51.432205    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="db767968-c5de-421f-94e6-69a8f3f61695" containerName="util"
Jul 24 17:07:51.432304 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:51.432216    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db767968-c5de-421f-94e6-69a8f3f61695" containerName="pull"
Jul 24 17:07:51.432304 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:51.432223    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="db767968-c5de-421f-94e6-69a8f3f61695" containerName="pull"
Jul 24 17:07:51.432304 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:51.432288    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="db767968-c5de-421f-94e6-69a8f3f61695" containerName="extract"
Jul 24 17:07:51.434262 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:51.434241    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-65bbc66f6-4vvzh"
Jul 24 17:07:51.436810 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:51.436778    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 24 17:07:51.437484 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:51.437463    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 24 17:07:51.437599 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:51.437460    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 24 17:07:51.437599 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:51.437503    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-5q9x7\""
Jul 24 17:07:51.437599 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:51.437462    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 24 17:07:51.437599 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:51.437580    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 24 17:07:51.448255 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:51.448222    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-65bbc66f6-4vvzh"]
Jul 24 17:07:51.501091 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:51.501062    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wghkj\" (UniqueName: \"kubernetes.io/projected/8f9d7e4e-f561-43a3-a2ba-f540307bd68e-kube-api-access-wghkj\") pod \"lws-controller-manager-65bbc66f6-4vvzh\" (UID: \"8f9d7e4e-f561-43a3-a2ba-f540307bd68e\") " pod="openshift-lws-operator/lws-controller-manager-65bbc66f6-4vvzh"
Jul 24 17:07:51.501226 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:51.501107    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8f9d7e4e-f561-43a3-a2ba-f540307bd68e-manager-config\") pod \"lws-controller-manager-65bbc66f6-4vvzh\" (UID: \"8f9d7e4e-f561-43a3-a2ba-f540307bd68e\") " pod="openshift-lws-operator/lws-controller-manager-65bbc66f6-4vvzh"
Jul 24 17:07:51.501226 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:51.501162    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f9d7e4e-f561-43a3-a2ba-f540307bd68e-cert\") pod \"lws-controller-manager-65bbc66f6-4vvzh\" (UID: \"8f9d7e4e-f561-43a3-a2ba-f540307bd68e\") " pod="openshift-lws-operator/lws-controller-manager-65bbc66f6-4vvzh"
Jul 24 17:07:51.501226 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:51.501185    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8f9d7e4e-f561-43a3-a2ba-f540307bd68e-metrics-cert\") pod \"lws-controller-manager-65bbc66f6-4vvzh\" (UID: \"8f9d7e4e-f561-43a3-a2ba-f540307bd68e\") " pod="openshift-lws-operator/lws-controller-manager-65bbc66f6-4vvzh"
Jul 24 17:07:51.601738 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:51.601691    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f9d7e4e-f561-43a3-a2ba-f540307bd68e-cert\") pod \"lws-controller-manager-65bbc66f6-4vvzh\" (UID: \"8f9d7e4e-f561-43a3-a2ba-f540307bd68e\") " pod="openshift-lws-operator/lws-controller-manager-65bbc66f6-4vvzh"
Jul 24 17:07:51.601930 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:51.601754    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8f9d7e4e-f561-43a3-a2ba-f540307bd68e-metrics-cert\") pod \"lws-controller-manager-65bbc66f6-4vvzh\" (UID: \"8f9d7e4e-f561-43a3-a2ba-f540307bd68e\") " pod="openshift-lws-operator/lws-controller-manager-65bbc66f6-4vvzh"
Jul 24 17:07:51.601930 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:51.601798    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wghkj\" (UniqueName: \"kubernetes.io/projected/8f9d7e4e-f561-43a3-a2ba-f540307bd68e-kube-api-access-wghkj\") pod \"lws-controller-manager-65bbc66f6-4vvzh\" (UID: \"8f9d7e4e-f561-43a3-a2ba-f540307bd68e\") " pod="openshift-lws-operator/lws-controller-manager-65bbc66f6-4vvzh"
Jul 24 17:07:51.601930 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:51.601846    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8f9d7e4e-f561-43a3-a2ba-f540307bd68e-manager-config\") pod \"lws-controller-manager-65bbc66f6-4vvzh\" (UID: \"8f9d7e4e-f561-43a3-a2ba-f540307bd68e\") " pod="openshift-lws-operator/lws-controller-manager-65bbc66f6-4vvzh"
Jul 24 17:07:51.602521 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:51.602498    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8f9d7e4e-f561-43a3-a2ba-f540307bd68e-manager-config\") pod \"lws-controller-manager-65bbc66f6-4vvzh\" (UID: \"8f9d7e4e-f561-43a3-a2ba-f540307bd68e\") " pod="openshift-lws-operator/lws-controller-manager-65bbc66f6-4vvzh"
Jul 24 17:07:51.604115 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:51.604096    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f9d7e4e-f561-43a3-a2ba-f540307bd68e-cert\") pod \"lws-controller-manager-65bbc66f6-4vvzh\" (UID: \"8f9d7e4e-f561-43a3-a2ba-f540307bd68e\") " pod="openshift-lws-operator/lws-controller-manager-65bbc66f6-4vvzh"
Jul 24 17:07:51.604215 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:51.604133    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8f9d7e4e-f561-43a3-a2ba-f540307bd68e-metrics-cert\") pod \"lws-controller-manager-65bbc66f6-4vvzh\" (UID: \"8f9d7e4e-f561-43a3-a2ba-f540307bd68e\") " pod="openshift-lws-operator/lws-controller-manager-65bbc66f6-4vvzh"
Jul 24 17:07:51.610850 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:51.610825    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wghkj\" (UniqueName: \"kubernetes.io/projected/8f9d7e4e-f561-43a3-a2ba-f540307bd68e-kube-api-access-wghkj\") pod \"lws-controller-manager-65bbc66f6-4vvzh\" (UID: \"8f9d7e4e-f561-43a3-a2ba-f540307bd68e\") " pod="openshift-lws-operator/lws-controller-manager-65bbc66f6-4vvzh"
Jul 24 17:07:51.742774 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:51.742745    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-65bbc66f6-4vvzh"
Jul 24 17:07:51.875337 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:51.875312    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-65bbc66f6-4vvzh"]
Jul 24 17:07:51.877986 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:07:51.877962    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f9d7e4e_f561_43a3_a2ba_f540307bd68e.slice/crio-5652ee58dc84f4b59c346e6d46d7fcd5281bb2ecca373f13b95340624d92d940 WatchSource:0}: Error finding container 5652ee58dc84f4b59c346e6d46d7fcd5281bb2ecca373f13b95340624d92d940: Status 404 returned error can't find the container with id 5652ee58dc84f4b59c346e6d46d7fcd5281bb2ecca373f13b95340624d92d940
Jul 24 17:07:52.882635 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:52.882590    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-65bbc66f6-4vvzh" event={"ID":"8f9d7e4e-f561-43a3-a2ba-f540307bd68e","Type":"ContainerStarted","Data":"5652ee58dc84f4b59c346e6d46d7fcd5281bb2ecca373f13b95340624d92d940"}
Jul 24 17:07:53.887655 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:53.887614    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-65bbc66f6-4vvzh" event={"ID":"8f9d7e4e-f561-43a3-a2ba-f540307bd68e","Type":"ContainerStarted","Data":"5ab614b12306cbb96f0be1aefb0ac53b2abab78028ff281e8655f56098fa45f7"}
Jul 24 17:07:53.888025 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:53.887743    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-65bbc66f6-4vvzh"
Jul 24 17:07:53.906857 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:53.906807    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-65bbc66f6-4vvzh" podStartSLOduration=1.483594504 podStartE2EDuration="2.906792797s" totalImagesPullingTime="1.423198293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:07:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:07:53.905628689 +0000 UTC m=+264.721603305" watchObservedRunningTime="2026-07-24 17:07:53.906792797 +0000 UTC m=+264.722767479"
Jul 24 17:07:53.990588 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:53.990550    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-p9dkg"]
Jul 24 17:07:53.992849 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:53.992834    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-p9dkg"
Jul 24 17:07:53.995170 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:53.995146    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 24 17:07:53.995283 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:53.995170    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ltj8k\""
Jul 24 17:07:53.995386 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:53.995370    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 24 17:07:53.995432 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:53.995420    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 24 17:07:53.996022 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:53.996005    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 24 17:07:54.012455 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:54.012431    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-p9dkg"]
Jul 24 17:07:54.037833 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:54.037806    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9ef58556-b59b-4eab-816e-b0dfa48e15fc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bc8c4649b-p9dkg\" (UID: \"9ef58556-b59b-4eab-816e-b0dfa48e15fc\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-p9dkg"
Jul 24 17:07:54.037939 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:54.037839    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ef58556-b59b-4eab-816e-b0dfa48e15fc-tmp\") pod \"opendatahub-operator-controller-manager-6bc8c4649b-p9dkg\" (UID: \"9ef58556-b59b-4eab-816e-b0dfa48e15fc\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-p9dkg"
Jul 24 17:07:54.037939 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:54.037869    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ef58556-b59b-4eab-816e-b0dfa48e15fc-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bc8c4649b-p9dkg\" (UID: \"9ef58556-b59b-4eab-816e-b0dfa48e15fc\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-p9dkg"
Jul 24 17:07:54.037939 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:54.037908    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9ef58556-b59b-4eab-816e-b0dfa48e15fc-manifests\") pod \"opendatahub-operator-controller-manager-6bc8c4649b-p9dkg\" (UID: \"9ef58556-b59b-4eab-816e-b0dfa48e15fc\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-p9dkg"
Jul 24 17:07:54.038042 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:54.037941    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22qj6\" (UniqueName: \"kubernetes.io/projected/9ef58556-b59b-4eab-816e-b0dfa48e15fc-kube-api-access-22qj6\") pod \"opendatahub-operator-controller-manager-6bc8c4649b-p9dkg\" (UID: \"9ef58556-b59b-4eab-816e-b0dfa48e15fc\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-p9dkg"
Jul 24 17:07:54.138371 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:54.138296    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22qj6\" (UniqueName: \"kubernetes.io/projected/9ef58556-b59b-4eab-816e-b0dfa48e15fc-kube-api-access-22qj6\") pod \"opendatahub-operator-controller-manager-6bc8c4649b-p9dkg\" (UID: \"9ef58556-b59b-4eab-816e-b0dfa48e15fc\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-p9dkg"
Jul 24 17:07:54.138371 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:54.138344    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9ef58556-b59b-4eab-816e-b0dfa48e15fc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bc8c4649b-p9dkg\" (UID: \"9ef58556-b59b-4eab-816e-b0dfa48e15fc\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-p9dkg"
Jul 24 17:07:54.138529 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:54.138371    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ef58556-b59b-4eab-816e-b0dfa48e15fc-tmp\") pod \"opendatahub-operator-controller-manager-6bc8c4649b-p9dkg\" (UID: \"9ef58556-b59b-4eab-816e-b0dfa48e15fc\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-p9dkg"
Jul 24 17:07:54.138529 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:54.138413    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ef58556-b59b-4eab-816e-b0dfa48e15fc-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bc8c4649b-p9dkg\" (UID: \"9ef58556-b59b-4eab-816e-b0dfa48e15fc\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-p9dkg"
Jul 24 17:07:54.138529 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:54.138442    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9ef58556-b59b-4eab-816e-b0dfa48e15fc-manifests\") pod \"opendatahub-operator-controller-manager-6bc8c4649b-p9dkg\" (UID: \"9ef58556-b59b-4eab-816e-b0dfa48e15fc\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-p9dkg"
Jul 24 17:07:54.138905 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:54.138882    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9ef58556-b59b-4eab-816e-b0dfa48e15fc-manifests\") pod \"opendatahub-operator-controller-manager-6bc8c4649b-p9dkg\" (UID: \"9ef58556-b59b-4eab-816e-b0dfa48e15fc\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-p9dkg"
Jul 24 17:07:54.140836 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:54.140812    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ef58556-b59b-4eab-816e-b0dfa48e15fc-tmp\") pod \"opendatahub-operator-controller-manager-6bc8c4649b-p9dkg\" (UID: \"9ef58556-b59b-4eab-816e-b0dfa48e15fc\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-p9dkg"
Jul 24 17:07:54.140970 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:54.140953    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9ef58556-b59b-4eab-816e-b0dfa48e15fc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bc8c4649b-p9dkg\" (UID: \"9ef58556-b59b-4eab-816e-b0dfa48e15fc\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-p9dkg"
Jul 24 17:07:54.141128 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:54.141110    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ef58556-b59b-4eab-816e-b0dfa48e15fc-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bc8c4649b-p9dkg\" (UID: \"9ef58556-b59b-4eab-816e-b0dfa48e15fc\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-p9dkg"
Jul 24 17:07:54.145807 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:54.145784    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22qj6\" (UniqueName: \"kubernetes.io/projected/9ef58556-b59b-4eab-816e-b0dfa48e15fc-kube-api-access-22qj6\") pod \"opendatahub-operator-controller-manager-6bc8c4649b-p9dkg\" (UID: \"9ef58556-b59b-4eab-816e-b0dfa48e15fc\") " pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-p9dkg"
Jul 24 17:07:54.302432 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:54.302401    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-p9dkg"
Jul 24 17:07:54.435300 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:54.435235    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-p9dkg"]
Jul 24 17:07:54.440600 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:07:54.440572    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ef58556_b59b_4eab_816e_b0dfa48e15fc.slice/crio-77dea6916d99d943924d264bc73539954ab2005a8c0ec91579335c710c750a37 WatchSource:0}: Error finding container 77dea6916d99d943924d264bc73539954ab2005a8c0ec91579335c710c750a37: Status 404 returned error can't find the container with id 77dea6916d99d943924d264bc73539954ab2005a8c0ec91579335c710c750a37
Jul 24 17:07:54.893221 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:54.893182    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-p9dkg" event={"ID":"9ef58556-b59b-4eab-816e-b0dfa48e15fc","Type":"ContainerStarted","Data":"77dea6916d99d943924d264bc73539954ab2005a8c0ec91579335c710c750a37"}
Jul 24 17:07:57.907826 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:57.907792    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-p9dkg" event={"ID":"9ef58556-b59b-4eab-816e-b0dfa48e15fc","Type":"ContainerStarted","Data":"341db718a6b380e79ac779be32cf6bf670c8aaa2aa67bd0a382c0996c545ca45"}
Jul 24 17:07:58.912873 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:58.912781    2582 generic.go:356] "Generic (PLEG): container finished" podID="9ef58556-b59b-4eab-816e-b0dfa48e15fc" containerID="341db718a6b380e79ac779be32cf6bf670c8aaa2aa67bd0a382c0996c545ca45" exitCode=0
Jul 24 17:07:58.912873 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:58.912853    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-p9dkg" event={"ID":"9ef58556-b59b-4eab-816e-b0dfa48e15fc","Type":"ContainerDied","Data":"341db718a6b380e79ac779be32cf6bf670c8aaa2aa67bd0a382c0996c545ca45"}
Jul 24 17:07:59.919070 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:59.919033    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-p9dkg" event={"ID":"9ef58556-b59b-4eab-816e-b0dfa48e15fc","Type":"ContainerStarted","Data":"762b83a50b0953efb3f503d9dac70ec844cd1ba16c7ff93fcd34814fa0ffc531"}
Jul 24 17:07:59.919441 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:59.919176    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-p9dkg"
Jul 24 17:07:59.944150 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:07:59.944088    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-p9dkg" podStartSLOduration=2.486171638 podStartE2EDuration="6.944068018s" totalImagesPullingTime="3.38541364s" totalInitContainerRuntime="1.07248274s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:07:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:07:59.941828895 +0000 UTC m=+270.757803521" watchObservedRunningTime="2026-07-24 17:07:59.944068018 +0000 UTC m=+270.760042636"
Jul 24 17:08:04.895827 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:04.895793    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-65bbc66f6-4vvzh"
Jul 24 17:08:10.925168 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:10.925138    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6bc8c4649b-p9dkg"
Jul 24 17:08:29.593424 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:29.593393    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d6w2m_9f3e23c6-31a7-4e7b-83df-d6eee1335b7a/ovn-acl-logging/0.log"
Jul 24 17:08:29.601933 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:29.601899    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d6w2m_9f3e23c6-31a7-4e7b-83df-d6eee1335b7a/ovn-acl-logging/0.log"
Jul 24 17:08:29.603290 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:29.603259    2582 kubelet.go:1648] "Image garbage collection succeeded"
Jul 24 17:08:31.167550 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:31.167513    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-9dhs2"]
Jul 24 17:08:31.171080 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:31.171061    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9dhs2"
Jul 24 17:08:31.173335 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:31.173310    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 24 17:08:31.173423 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:31.173337    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 24 17:08:31.173423 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:31.173360    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 24 17:08:31.173423 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:31.173377    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 24 17:08:31.173634 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:31.173621    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 24 17:08:31.173690 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:31.173662    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-98sdk\""
Jul 24 17:08:31.173748 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:31.173733    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 24 17:08:31.184555 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:31.184533    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-9dhs2"]
Jul 24 17:08:31.240387 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:31.240350    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7dab9c37-aefd-499d-af97-188de50db77a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-9dhs2\" (UID: \"7dab9c37-aefd-499d-af97-188de50db77a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9dhs2"
Jul 24 17:08:31.240525 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:31.240399    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7dab9c37-aefd-499d-af97-188de50db77a-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-9dhs2\" (UID: \"7dab9c37-aefd-499d-af97-188de50db77a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9dhs2"
Jul 24 17:08:31.240525 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:31.240423    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdzvz\" (UniqueName: \"kubernetes.io/projected/7dab9c37-aefd-499d-af97-188de50db77a-kube-api-access-tdzvz\") pod \"istiod-openshift-gateway-5677ccb49b-9dhs2\" (UID: \"7dab9c37-aefd-499d-af97-188de50db77a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9dhs2"
Jul 24 17:08:31.240525 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:31.240452    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7dab9c37-aefd-499d-af97-188de50db77a-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-9dhs2\" (UID: \"7dab9c37-aefd-499d-af97-188de50db77a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9dhs2"
Jul 24 17:08:31.240525 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:31.240474    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7dab9c37-aefd-499d-af97-188de50db77a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-9dhs2\" (UID: \"7dab9c37-aefd-499d-af97-188de50db77a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9dhs2"
Jul 24 17:08:31.240753 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:31.240569    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7dab9c37-aefd-499d-af97-188de50db77a-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-9dhs2\" (UID: \"7dab9c37-aefd-499d-af97-188de50db77a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9dhs2"
Jul 24 17:08:31.240753 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:31.240607    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7dab9c37-aefd-499d-af97-188de50db77a-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-9dhs2\" (UID: \"7dab9c37-aefd-499d-af97-188de50db77a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9dhs2"
Jul 24 17:08:31.341852 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:31.341815    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7dab9c37-aefd-499d-af97-188de50db77a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-9dhs2\" (UID: \"7dab9c37-aefd-499d-af97-188de50db77a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9dhs2"
Jul 24 17:08:31.342022 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:31.341861    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7dab9c37-aefd-499d-af97-188de50db77a-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-9dhs2\" (UID: \"7dab9c37-aefd-499d-af97-188de50db77a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9dhs2"
Jul 24 17:08:31.342022 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:31.341975    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdzvz\" (UniqueName: \"kubernetes.io/projected/7dab9c37-aefd-499d-af97-188de50db77a-kube-api-access-tdzvz\") pod \"istiod-openshift-gateway-5677ccb49b-9dhs2\" (UID: \"7dab9c37-aefd-499d-af97-188de50db77a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9dhs2"
Jul 24 17:08:31.342022 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:31.342017    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7dab9c37-aefd-499d-af97-188de50db77a-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-9dhs2\" (UID: \"7dab9c37-aefd-499d-af97-188de50db77a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9dhs2"
Jul 24 17:08:31.342127 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:31.342040    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7dab9c37-aefd-499d-af97-188de50db77a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-9dhs2\" (UID: \"7dab9c37-aefd-499d-af97-188de50db77a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9dhs2"
Jul 24 17:08:31.342127 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:31.342086    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7dab9c37-aefd-499d-af97-188de50db77a-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-9dhs2\" (UID: \"7dab9c37-aefd-499d-af97-188de50db77a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9dhs2"
Jul 24 17:08:31.342127 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:31.342116    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7dab9c37-aefd-499d-af97-188de50db77a-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-9dhs2\" (UID: \"7dab9c37-aefd-499d-af97-188de50db77a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9dhs2"
Jul 24 17:08:31.342733 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:31.342706    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7dab9c37-aefd-499d-af97-188de50db77a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-9dhs2\" (UID: \"7dab9c37-aefd-499d-af97-188de50db77a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9dhs2"
Jul 24 17:08:31.344310 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:31.344276    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7dab9c37-aefd-499d-af97-188de50db77a-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-9dhs2\" (UID: \"7dab9c37-aefd-499d-af97-188de50db77a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9dhs2"
Jul 24 17:08:31.344417 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:31.344344    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7dab9c37-aefd-499d-af97-188de50db77a-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-9dhs2\" (UID: \"7dab9c37-aefd-499d-af97-188de50db77a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9dhs2"
Jul 24 17:08:31.344522 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:31.344502    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7dab9c37-aefd-499d-af97-188de50db77a-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-9dhs2\" (UID: \"7dab9c37-aefd-499d-af97-188de50db77a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9dhs2"
Jul 24 17:08:31.344561 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:31.344515    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7dab9c37-aefd-499d-af97-188de50db77a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-9dhs2\" (UID: \"7dab9c37-aefd-499d-af97-188de50db77a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9dhs2"
Jul 24 17:08:31.351303 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:31.351274    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdzvz\" (UniqueName: \"kubernetes.io/projected/7dab9c37-aefd-499d-af97-188de50db77a-kube-api-access-tdzvz\") pod \"istiod-openshift-gateway-5677ccb49b-9dhs2\" (UID: \"7dab9c37-aefd-499d-af97-188de50db77a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9dhs2"
Jul 24 17:08:31.351516 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:31.351497    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7dab9c37-aefd-499d-af97-188de50db77a-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-9dhs2\" (UID: \"7dab9c37-aefd-499d-af97-188de50db77a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9dhs2"
Jul 24 17:08:31.480183 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:31.480102    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9dhs2"
Jul 24 17:08:31.629066 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:31.629043    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-9dhs2"]
Jul 24 17:08:31.630776 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:08:31.630745    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dab9c37_aefd_499d_af97_188de50db77a.slice/crio-9edad13797158be3ea38e89e70920046ecb22922d2073d72e68a3e949a985b44 WatchSource:0}: Error finding container 9edad13797158be3ea38e89e70920046ecb22922d2073d72e68a3e949a985b44: Status 404 returned error can't find the container with id 9edad13797158be3ea38e89e70920046ecb22922d2073d72e68a3e949a985b44
Jul 24 17:08:31.632764 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:31.632748    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 17:08:32.048983 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:32.048946    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9dhs2" event={"ID":"7dab9c37-aefd-499d-af97-188de50db77a","Type":"ContainerStarted","Data":"9edad13797158be3ea38e89e70920046ecb22922d2073d72e68a3e949a985b44"}
Jul 24 17:08:33.867847 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:33.867807    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:08:33.868137 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:33.867909    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 17:08:34.060832 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:34.060796    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9dhs2" event={"ID":"7dab9c37-aefd-499d-af97-188de50db77a","Type":"ContainerStarted","Data":"5a6940ccb0791d8c4cc2c50879ef5b2d6a7763b900278055389fd63a79da142c"}
Jul 24 17:08:34.061002 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:34.060976    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9dhs2"
Jul 24 17:08:34.062411 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:34.062376    2582 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-9dhs2 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 17:08:34.062540 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:34.062427    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9dhs2" podUID="7dab9c37-aefd-499d-af97-188de50db77a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 17:08:34.103091 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:34.103039    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9dhs2" podStartSLOduration=0.868407298 podStartE2EDuration="3.103020409s" totalImagesPullingTime="2.234613111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:08:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:08:34.100917276 +0000 UTC m=+304.916891873" watchObservedRunningTime="2026-07-24 17:08:34.103020409 +0000 UTC m=+304.918995022"
Jul 24 17:08:34.541840 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:34.541798    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-6qd5f"]
Jul 24 17:08:34.545134 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:34.545116    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6qd5f"
Jul 24 17:08:34.548737 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:34.548719    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-sw2cn\""
Jul 24 17:08:34.549147 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:34.549134    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 24 17:08:34.576758 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:34.576726    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc4s7\" (UniqueName: \"kubernetes.io/projected/8a4bf84f-4c30-490b-983a-883ae343d837-kube-api-access-nc4s7\") pod \"kserve-controller-manager-d6f4b65b8-6qd5f\" (UID: \"8a4bf84f-4c30-490b-983a-883ae343d837\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6qd5f"
Jul 24 17:08:34.576950 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:34.576794    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a4bf84f-4c30-490b-983a-883ae343d837-cert\") pod \"kserve-controller-manager-d6f4b65b8-6qd5f\" (UID: \"8a4bf84f-4c30-490b-983a-883ae343d837\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6qd5f"
Jul 24 17:08:34.640895 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:34.640860    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-6qd5f"]
Jul 24 17:08:34.677975 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:34.677942    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc4s7\" (UniqueName: \"kubernetes.io/projected/8a4bf84f-4c30-490b-983a-883ae343d837-kube-api-access-nc4s7\") pod \"kserve-controller-manager-d6f4b65b8-6qd5f\" (UID: \"8a4bf84f-4c30-490b-983a-883ae343d837\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6qd5f"
Jul 24 17:08:34.678139 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:34.677993    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a4bf84f-4c30-490b-983a-883ae343d837-cert\") pod \"kserve-controller-manager-d6f4b65b8-6qd5f\" (UID: \"8a4bf84f-4c30-490b-983a-883ae343d837\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6qd5f"
Jul 24 17:08:34.678139 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:08:34.678098    2582 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 24 17:08:34.678220 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:08:34.678154    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a4bf84f-4c30-490b-983a-883ae343d837-cert podName:8a4bf84f-4c30-490b-983a-883ae343d837 nodeName:}" failed. No retries permitted until 2026-07-24 17:08:35.17813799 +0000 UTC m=+305.994112582 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8a4bf84f-4c30-490b-983a-883ae343d837-cert") pod "kserve-controller-manager-d6f4b65b8-6qd5f" (UID: "8a4bf84f-4c30-490b-983a-883ae343d837") : secret "kserve-webhook-server-cert" not found
Jul 24 17:08:34.714796 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:34.714762    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc4s7\" (UniqueName: \"kubernetes.io/projected/8a4bf84f-4c30-490b-983a-883ae343d837-kube-api-access-nc4s7\") pod \"kserve-controller-manager-d6f4b65b8-6qd5f\" (UID: \"8a4bf84f-4c30-490b-983a-883ae343d837\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6qd5f"
Jul 24 17:08:35.067301 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:35.067271    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-9dhs2"
Jul 24 17:08:35.183027 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:35.182990    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a4bf84f-4c30-490b-983a-883ae343d837-cert\") pod \"kserve-controller-manager-d6f4b65b8-6qd5f\" (UID: \"8a4bf84f-4c30-490b-983a-883ae343d837\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6qd5f"
Jul 24 17:08:35.183219 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:08:35.183123    2582 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 24 17:08:35.183219 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:08:35.183197    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a4bf84f-4c30-490b-983a-883ae343d837-cert podName:8a4bf84f-4c30-490b-983a-883ae343d837 nodeName:}" failed. No retries permitted until 2026-07-24 17:08:36.183174903 +0000 UTC m=+306.999149506 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8a4bf84f-4c30-490b-983a-883ae343d837-cert") pod "kserve-controller-manager-d6f4b65b8-6qd5f" (UID: "8a4bf84f-4c30-490b-983a-883ae343d837") : secret "kserve-webhook-server-cert" not found
Jul 24 17:08:36.194443 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:36.194401    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a4bf84f-4c30-490b-983a-883ae343d837-cert\") pod \"kserve-controller-manager-d6f4b65b8-6qd5f\" (UID: \"8a4bf84f-4c30-490b-983a-883ae343d837\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6qd5f"
Jul 24 17:08:36.196715 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:36.196692    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a4bf84f-4c30-490b-983a-883ae343d837-cert\") pod \"kserve-controller-manager-d6f4b65b8-6qd5f\" (UID: \"8a4bf84f-4c30-490b-983a-883ae343d837\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6qd5f"
Jul 24 17:08:36.356013 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:36.355976    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6qd5f"
Jul 24 17:08:36.484316 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:36.484293    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-6qd5f"]
Jul 24 17:08:36.486307 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:08:36.486279    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a4bf84f_4c30_490b_983a_883ae343d837.slice/crio-0b151dd49d7c1dc60a4ab36424fa76e5240ac959c3b1d9ba2aeab29955df96a9 WatchSource:0}: Error finding container 0b151dd49d7c1dc60a4ab36424fa76e5240ac959c3b1d9ba2aeab29955df96a9: Status 404 returned error can't find the container with id 0b151dd49d7c1dc60a4ab36424fa76e5240ac959c3b1d9ba2aeab29955df96a9
Jul 24 17:08:37.076270 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:37.076231    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6qd5f" event={"ID":"8a4bf84f-4c30-490b-983a-883ae343d837","Type":"ContainerStarted","Data":"0b151dd49d7c1dc60a4ab36424fa76e5240ac959c3b1d9ba2aeab29955df96a9"}
Jul 24 17:08:39.086466 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:39.086432    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6qd5f" event={"ID":"8a4bf84f-4c30-490b-983a-883ae343d837","Type":"ContainerStarted","Data":"5349619d4904697ec079e2775c30b30892bc264d5b0b40d9bc74e00bcde4078e"}
Jul 24 17:08:39.086899 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:39.086499    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6qd5f"
Jul 24 17:08:39.104055 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:08:39.104009    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6qd5f" podStartSLOduration=2.617337951 podStartE2EDuration="5.103993932s" totalImagesPullingTime="2.486655981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:08:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:08:39.10300492 +0000 UTC m=+309.918979535" watchObservedRunningTime="2026-07-24 17:08:39.103993932 +0000 UTC m=+309.919968547"
Jul 24 17:09:10.095393 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:10.095358    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6qd5f"
Jul 24 17:09:30.082531 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:30.082497    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ccbzq"]
Jul 24 17:09:30.085816 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:30.085799    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ccbzq"
Jul 24 17:09:30.088158 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:30.088134    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 24 17:09:30.088286 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:30.088138    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 24 17:09:30.088687 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:30.088658    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6lscw\""
Jul 24 17:09:30.093785 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:30.093761    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ccbzq"]
Jul 24 17:09:30.153942 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:30.153913    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/464d2872-3e18-44d1-8a8f-62b396be809d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ccbzq\" (UID: \"464d2872-3e18-44d1-8a8f-62b396be809d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ccbzq"
Jul 24 17:09:30.154072 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:30.153961    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/464d2872-3e18-44d1-8a8f-62b396be809d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ccbzq\" (UID: \"464d2872-3e18-44d1-8a8f-62b396be809d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ccbzq"
Jul 24 17:09:30.154072 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:30.154044    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwvb6\" (UniqueName: \"kubernetes.io/projected/464d2872-3e18-44d1-8a8f-62b396be809d-kube-api-access-zwvb6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ccbzq\" (UID: \"464d2872-3e18-44d1-8a8f-62b396be809d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ccbzq"
Jul 24 17:09:30.254905 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:30.254858    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwvb6\" (UniqueName: \"kubernetes.io/projected/464d2872-3e18-44d1-8a8f-62b396be809d-kube-api-access-zwvb6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ccbzq\" (UID: \"464d2872-3e18-44d1-8a8f-62b396be809d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ccbzq"
Jul 24 17:09:30.254905 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:30.254917    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/464d2872-3e18-44d1-8a8f-62b396be809d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ccbzq\" (UID: \"464d2872-3e18-44d1-8a8f-62b396be809d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ccbzq"
Jul 24 17:09:30.255090 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:30.254962    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/464d2872-3e18-44d1-8a8f-62b396be809d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ccbzq\" (UID: \"464d2872-3e18-44d1-8a8f-62b396be809d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ccbzq"
Jul 24 17:09:30.255396 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:30.255376    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/464d2872-3e18-44d1-8a8f-62b396be809d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ccbzq\" (UID: \"464d2872-3e18-44d1-8a8f-62b396be809d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ccbzq"
Jul 24 17:09:30.255433 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:30.255387    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/464d2872-3e18-44d1-8a8f-62b396be809d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ccbzq\" (UID: \"464d2872-3e18-44d1-8a8f-62b396be809d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ccbzq"
Jul 24 17:09:30.263157 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:30.263117    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwvb6\" (UniqueName: \"kubernetes.io/projected/464d2872-3e18-44d1-8a8f-62b396be809d-kube-api-access-zwvb6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ccbzq\" (UID: \"464d2872-3e18-44d1-8a8f-62b396be809d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ccbzq"
Jul 24 17:09:30.396088 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:30.396000    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ccbzq"
Jul 24 17:09:30.518988 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:30.518964    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ccbzq"]
Jul 24 17:09:30.521330 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:09:30.521303    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod464d2872_3e18_44d1_8a8f_62b396be809d.slice/crio-6961d381718a406b2cc6914f4645c3b58cd129b65cbd69e4bd39f10445bd9c82 WatchSource:0}: Error finding container 6961d381718a406b2cc6914f4645c3b58cd129b65cbd69e4bd39f10445bd9c82: Status 404 returned error can't find the container with id 6961d381718a406b2cc6914f4645c3b58cd129b65cbd69e4bd39f10445bd9c82
Jul 24 17:09:30.695976 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:30.695900    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tr5px"]
Jul 24 17:09:30.699163 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:30.699141    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tr5px"
Jul 24 17:09:30.708223 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:30.708201    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tr5px"]
Jul 24 17:09:30.759415 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:30.759383    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp477\" (UniqueName: \"kubernetes.io/projected/86d6d822-1f60-42af-bf60-8fab9ffb0c84-kube-api-access-xp477\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tr5px\" (UID: \"86d6d822-1f60-42af-bf60-8fab9ffb0c84\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tr5px"
Jul 24 17:09:30.759560 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:30.759421    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86d6d822-1f60-42af-bf60-8fab9ffb0c84-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tr5px\" (UID: \"86d6d822-1f60-42af-bf60-8fab9ffb0c84\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tr5px"
Jul 24 17:09:30.759560 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:30.759490    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86d6d822-1f60-42af-bf60-8fab9ffb0c84-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tr5px\" (UID: \"86d6d822-1f60-42af-bf60-8fab9ffb0c84\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tr5px"
Jul 24 17:09:30.860622 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:30.860596    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86d6d822-1f60-42af-bf60-8fab9ffb0c84-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tr5px\" (UID: \"86d6d822-1f60-42af-bf60-8fab9ffb0c84\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tr5px"
Jul 24 17:09:30.860760 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:30.860649    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp477\" (UniqueName: \"kubernetes.io/projected/86d6d822-1f60-42af-bf60-8fab9ffb0c84-kube-api-access-xp477\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tr5px\" (UID: \"86d6d822-1f60-42af-bf60-8fab9ffb0c84\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tr5px"
Jul 24 17:09:30.860760 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:30.860682    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86d6d822-1f60-42af-bf60-8fab9ffb0c84-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tr5px\" (UID: \"86d6d822-1f60-42af-bf60-8fab9ffb0c84\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tr5px"
Jul 24 17:09:30.861047 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:30.861028    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86d6d822-1f60-42af-bf60-8fab9ffb0c84-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tr5px\" (UID: \"86d6d822-1f60-42af-bf60-8fab9ffb0c84\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tr5px"
Jul 24 17:09:30.861087 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:30.861044    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86d6d822-1f60-42af-bf60-8fab9ffb0c84-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tr5px\" (UID: \"86d6d822-1f60-42af-bf60-8fab9ffb0c84\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tr5px"
Jul 24 17:09:30.868522 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:30.868499    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp477\" (UniqueName: \"kubernetes.io/projected/86d6d822-1f60-42af-bf60-8fab9ffb0c84-kube-api-access-xp477\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tr5px\" (UID: \"86d6d822-1f60-42af-bf60-8fab9ffb0c84\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tr5px"
Jul 24 17:09:31.008367 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:31.008340    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tr5px"
Jul 24 17:09:31.131572 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:31.131547    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tr5px"]
Jul 24 17:09:31.133578 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:09:31.133551    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86d6d822_1f60_42af_bf60_8fab9ffb0c84.slice/crio-c892d253b00d62cf3304df075736252196a529417cf1c6982ae989bb21907943 WatchSource:0}: Error finding container c892d253b00d62cf3304df075736252196a529417cf1c6982ae989bb21907943: Status 404 returned error can't find the container with id c892d253b00d62cf3304df075736252196a529417cf1c6982ae989bb21907943
Jul 24 17:09:31.285221 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:31.285187    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hknb4"]
Jul 24 17:09:31.288422 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:31.288407    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hknb4"
Jul 24 17:09:31.297657 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:31.297626    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hknb4"]
Jul 24 17:09:31.316554 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:31.316523    2582 generic.go:356] "Generic (PLEG): container finished" podID="86d6d822-1f60-42af-bf60-8fab9ffb0c84" containerID="63e1c8c1f78d23d5f2e5fe48c29a37c150256a953e0dc21711d8f3f8e49372b8" exitCode=0
Jul 24 17:09:31.316729 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:31.316608    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tr5px" event={"ID":"86d6d822-1f60-42af-bf60-8fab9ffb0c84","Type":"ContainerDied","Data":"63e1c8c1f78d23d5f2e5fe48c29a37c150256a953e0dc21711d8f3f8e49372b8"}
Jul 24 17:09:31.316729 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:31.316657    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tr5px" event={"ID":"86d6d822-1f60-42af-bf60-8fab9ffb0c84","Type":"ContainerStarted","Data":"c892d253b00d62cf3304df075736252196a529417cf1c6982ae989bb21907943"}
Jul 24 17:09:31.318102 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:31.318076    2582 generic.go:356] "Generic (PLEG): container finished" podID="464d2872-3e18-44d1-8a8f-62b396be809d" containerID="f41ee262696c4f3b2d8b9cab9fa57466c0e7a69035e0ba7b839d5b647be52551" exitCode=0
Jul 24 17:09:31.318375 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:31.318163    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ccbzq" event={"ID":"464d2872-3e18-44d1-8a8f-62b396be809d","Type":"ContainerDied","Data":"f41ee262696c4f3b2d8b9cab9fa57466c0e7a69035e0ba7b839d5b647be52551"}
Jul 24 17:09:31.318375 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:31.318211    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ccbzq" event={"ID":"464d2872-3e18-44d1-8a8f-62b396be809d","Type":"ContainerStarted","Data":"6961d381718a406b2cc6914f4645c3b58cd129b65cbd69e4bd39f10445bd9c82"}
Jul 24 17:09:31.364741 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:31.364705    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e318229b-75be-421d-a406-b6e82ce86b65-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hknb4\" (UID: \"e318229b-75be-421d-a406-b6e82ce86b65\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hknb4"
Jul 24 17:09:31.364741 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:31.364740    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76cf5\" (UniqueName: \"kubernetes.io/projected/e318229b-75be-421d-a406-b6e82ce86b65-kube-api-access-76cf5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hknb4\" (UID: \"e318229b-75be-421d-a406-b6e82ce86b65\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hknb4"
Jul 24 17:09:31.364985 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:31.364769    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e318229b-75be-421d-a406-b6e82ce86b65-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hknb4\" (UID: \"e318229b-75be-421d-a406-b6e82ce86b65\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hknb4"
Jul 24 17:09:31.466044 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:31.466001    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e318229b-75be-421d-a406-b6e82ce86b65-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hknb4\" (UID: \"e318229b-75be-421d-a406-b6e82ce86b65\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hknb4"
Jul 24 17:09:31.466044 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:31.466048    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76cf5\" (UniqueName: \"kubernetes.io/projected/e318229b-75be-421d-a406-b6e82ce86b65-kube-api-access-76cf5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hknb4\" (UID: \"e318229b-75be-421d-a406-b6e82ce86b65\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hknb4"
Jul 24 17:09:31.466304 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:31.466086    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e318229b-75be-421d-a406-b6e82ce86b65-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hknb4\" (UID: \"e318229b-75be-421d-a406-b6e82ce86b65\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hknb4"
Jul 24 17:09:31.466422 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:31.466399    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e318229b-75be-421d-a406-b6e82ce86b65-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hknb4\" (UID: \"e318229b-75be-421d-a406-b6e82ce86b65\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hknb4"
Jul 24 17:09:31.466484 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:31.466442    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e318229b-75be-421d-a406-b6e82ce86b65-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hknb4\" (UID: \"e318229b-75be-421d-a406-b6e82ce86b65\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hknb4"
Jul 24 17:09:31.473930 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:31.473905    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76cf5\" (UniqueName: \"kubernetes.io/projected/e318229b-75be-421d-a406-b6e82ce86b65-kube-api-access-76cf5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hknb4\" (UID: \"e318229b-75be-421d-a406-b6e82ce86b65\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hknb4"
Jul 24 17:09:31.604305 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:31.604216    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hknb4"
Jul 24 17:09:31.688858 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:31.688825    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cbdp"]
Jul 24 17:09:31.692355 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:31.692332    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cbdp"
Jul 24 17:09:31.701008 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:31.700934    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cbdp"]
Jul 24 17:09:31.763152 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:09:31.763122    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode318229b_75be_421d_a406_b6e82ce86b65.slice/crio-e7d8e4cb148f38ced2e7828dd338ca4aef881d71a52cbf7866b9f4aa6e861ad9 WatchSource:0}: Error finding container e7d8e4cb148f38ced2e7828dd338ca4aef881d71a52cbf7866b9f4aa6e861ad9: Status 404 returned error can't find the container with id e7d8e4cb148f38ced2e7828dd338ca4aef881d71a52cbf7866b9f4aa6e861ad9
Jul 24 17:09:31.764900 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:31.764873    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hknb4"]
Jul 24 17:09:31.768804 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:31.768711    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/607befef-a5aa-4e9a-8d93-1ef4f87e196f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cbdp\" (UID: \"607befef-a5aa-4e9a-8d93-1ef4f87e196f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cbdp"
Jul 24 17:09:31.768804 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:31.768793    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/607befef-a5aa-4e9a-8d93-1ef4f87e196f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cbdp\" (UID: \"607befef-a5aa-4e9a-8d93-1ef4f87e196f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cbdp"
Jul 24 17:09:31.768939 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:31.768815    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lsln\" (UniqueName: \"kubernetes.io/projected/607befef-a5aa-4e9a-8d93-1ef4f87e196f-kube-api-access-9lsln\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cbdp\" (UID: \"607befef-a5aa-4e9a-8d93-1ef4f87e196f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cbdp"
Jul 24 17:09:31.870154 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:31.870085    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/607befef-a5aa-4e9a-8d93-1ef4f87e196f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cbdp\" (UID: \"607befef-a5aa-4e9a-8d93-1ef4f87e196f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cbdp"
Jul 24 17:09:31.870283 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:31.870187    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/607befef-a5aa-4e9a-8d93-1ef4f87e196f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cbdp\" (UID: \"607befef-a5aa-4e9a-8d93-1ef4f87e196f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cbdp"
Jul 24 17:09:31.870346 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:31.870302    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lsln\" (UniqueName: \"kubernetes.io/projected/607befef-a5aa-4e9a-8d93-1ef4f87e196f-kube-api-access-9lsln\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cbdp\" (UID: \"607befef-a5aa-4e9a-8d93-1ef4f87e196f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cbdp"
Jul 24 17:09:31.870469 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:31.870449    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/607befef-a5aa-4e9a-8d93-1ef4f87e196f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cbdp\" (UID: \"607befef-a5aa-4e9a-8d93-1ef4f87e196f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cbdp"
Jul 24 17:09:31.870578 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:31.870504    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/607befef-a5aa-4e9a-8d93-1ef4f87e196f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cbdp\" (UID: \"607befef-a5aa-4e9a-8d93-1ef4f87e196f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cbdp"
Jul 24 17:09:31.879184 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:31.879161    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lsln\" (UniqueName: \"kubernetes.io/projected/607befef-a5aa-4e9a-8d93-1ef4f87e196f-kube-api-access-9lsln\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cbdp\" (UID: \"607befef-a5aa-4e9a-8d93-1ef4f87e196f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cbdp"
Jul 24 17:09:32.002122 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:32.002101    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cbdp"
Jul 24 17:09:32.136873 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:32.136846    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cbdp"]
Jul 24 17:09:32.178300 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:09:32.178265    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod607befef_a5aa_4e9a_8d93_1ef4f87e196f.slice/crio-539a807a32e5e18c52b71675ded7725e5ee4e78262f3aef5718560c9f73f08e3 WatchSource:0}: Error finding container 539a807a32e5e18c52b71675ded7725e5ee4e78262f3aef5718560c9f73f08e3: Status 404 returned error can't find the container with id 539a807a32e5e18c52b71675ded7725e5ee4e78262f3aef5718560c9f73f08e3
Jul 24 17:09:32.323908 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:32.323881    2582 generic.go:356] "Generic (PLEG): container finished" podID="86d6d822-1f60-42af-bf60-8fab9ffb0c84" containerID="964e0aea2b9c6d07b965316e8ccabe377c7840cb9a1fb0b0605428286164f01b" exitCode=0
Jul 24 17:09:32.324014 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:32.323966    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tr5px" event={"ID":"86d6d822-1f60-42af-bf60-8fab9ffb0c84","Type":"ContainerDied","Data":"964e0aea2b9c6d07b965316e8ccabe377c7840cb9a1fb0b0605428286164f01b"}
Jul 24 17:09:32.325407 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:32.325385    2582 generic.go:356] "Generic (PLEG): container finished" podID="e318229b-75be-421d-a406-b6e82ce86b65" containerID="0e9490cc2231c5def3f1ab4adc95222de491fe53527e447e670f0d596291d931" exitCode=0
Jul 24 17:09:32.325475 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:32.325457    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hknb4" event={"ID":"e318229b-75be-421d-a406-b6e82ce86b65","Type":"ContainerDied","Data":"0e9490cc2231c5def3f1ab4adc95222de491fe53527e447e670f0d596291d931"}
Jul 24 17:09:32.325524 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:32.325497    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hknb4" event={"ID":"e318229b-75be-421d-a406-b6e82ce86b65","Type":"ContainerStarted","Data":"e7d8e4cb148f38ced2e7828dd338ca4aef881d71a52cbf7866b9f4aa6e861ad9"}
Jul 24 17:09:32.326966 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:32.326946    2582 generic.go:356] "Generic (PLEG): container finished" podID="607befef-a5aa-4e9a-8d93-1ef4f87e196f" containerID="d975250cedd0326c3927ea357f86128eaf1e5bc5563b1241a909782994c5617b" exitCode=0
Jul 24 17:09:32.327041 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:32.326979    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cbdp" event={"ID":"607befef-a5aa-4e9a-8d93-1ef4f87e196f","Type":"ContainerDied","Data":"d975250cedd0326c3927ea357f86128eaf1e5bc5563b1241a909782994c5617b"}
Jul 24 17:09:32.327041 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:32.327021    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cbdp" event={"ID":"607befef-a5aa-4e9a-8d93-1ef4f87e196f","Type":"ContainerStarted","Data":"539a807a32e5e18c52b71675ded7725e5ee4e78262f3aef5718560c9f73f08e3"}
Jul 24 17:09:33.333567 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:33.333532    2582 generic.go:356] "Generic (PLEG): container finished" podID="607befef-a5aa-4e9a-8d93-1ef4f87e196f" containerID="e1928175b0b937d0a3445000a4e221b1bc1a5373991917dc8210a02dc39f64ec" exitCode=0
Jul 24 17:09:33.334016 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:33.333624    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cbdp" event={"ID":"607befef-a5aa-4e9a-8d93-1ef4f87e196f","Type":"ContainerDied","Data":"e1928175b0b937d0a3445000a4e221b1bc1a5373991917dc8210a02dc39f64ec"}
Jul 24 17:09:33.335879 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:33.335856    2582 generic.go:356] "Generic (PLEG): container finished" podID="86d6d822-1f60-42af-bf60-8fab9ffb0c84" containerID="4acdbc290395f5f54881ccf30bfdcb705b3d4d7e16b0d77d83ea030147c6fe1b" exitCode=0
Jul 24 17:09:33.335984 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:33.335917    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tr5px" event={"ID":"86d6d822-1f60-42af-bf60-8fab9ffb0c84","Type":"ContainerDied","Data":"4acdbc290395f5f54881ccf30bfdcb705b3d4d7e16b0d77d83ea030147c6fe1b"}
Jul 24 17:09:33.337580 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:33.337560    2582 generic.go:356] "Generic (PLEG): container finished" podID="464d2872-3e18-44d1-8a8f-62b396be809d" containerID="72424c5ecbd65c994c53e0aa38e048e711e95d18fd5e2d5535c9fbe58d843b55" exitCode=0
Jul 24 17:09:33.337695 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:33.337587    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ccbzq" event={"ID":"464d2872-3e18-44d1-8a8f-62b396be809d","Type":"ContainerDied","Data":"72424c5ecbd65c994c53e0aa38e048e711e95d18fd5e2d5535c9fbe58d843b55"}
Jul 24 17:09:33.339522 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:33.339504    2582 generic.go:356] "Generic (PLEG): container finished" podID="e318229b-75be-421d-a406-b6e82ce86b65" containerID="4627593b20268b43bb962014c434f7a4d27e0a904728432445983d4c69482379" exitCode=0
Jul 24 17:09:33.339583 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:33.339555    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hknb4" event={"ID":"e318229b-75be-421d-a406-b6e82ce86b65","Type":"ContainerDied","Data":"4627593b20268b43bb962014c434f7a4d27e0a904728432445983d4c69482379"}
Jul 24 17:09:34.346816 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:34.346772    2582 generic.go:356] "Generic (PLEG): container finished" podID="464d2872-3e18-44d1-8a8f-62b396be809d" containerID="e5bf1dbf3daeea40289b6dbc51fbcc87f06cdb94d22182a5d2ba31adc67d51cf" exitCode=0
Jul 24 17:09:34.347269 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:34.346854    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ccbzq" event={"ID":"464d2872-3e18-44d1-8a8f-62b396be809d","Type":"ContainerDied","Data":"e5bf1dbf3daeea40289b6dbc51fbcc87f06cdb94d22182a5d2ba31adc67d51cf"}
Jul 24 17:09:34.348789 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:34.348765    2582 generic.go:356] "Generic (PLEG): container finished" podID="e318229b-75be-421d-a406-b6e82ce86b65" containerID="d7ea38e9db89ae6b6339825f1461d0e11beda6371af4c1c236be80284a75fea0" exitCode=0
Jul 24 17:09:34.348879 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:34.348854    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hknb4" event={"ID":"e318229b-75be-421d-a406-b6e82ce86b65","Type":"ContainerDied","Data":"d7ea38e9db89ae6b6339825f1461d0e11beda6371af4c1c236be80284a75fea0"}
Jul 24 17:09:34.350824 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:34.350791    2582 generic.go:356] "Generic (PLEG): container finished" podID="607befef-a5aa-4e9a-8d93-1ef4f87e196f" containerID="d875366a2d3f1be549a60adfa31c79b6d0ab264c848dd612c20ff97d2cb7cb03" exitCode=0
Jul 24 17:09:34.350925 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:34.350844    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cbdp" event={"ID":"607befef-a5aa-4e9a-8d93-1ef4f87e196f","Type":"ContainerDied","Data":"d875366a2d3f1be549a60adfa31c79b6d0ab264c848dd612c20ff97d2cb7cb03"}
Jul 24 17:09:34.473978 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:34.473951    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tr5px"
Jul 24 17:09:34.597141 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:34.597058    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86d6d822-1f60-42af-bf60-8fab9ffb0c84-bundle\") pod \"86d6d822-1f60-42af-bf60-8fab9ffb0c84\" (UID: \"86d6d822-1f60-42af-bf60-8fab9ffb0c84\") "
Jul 24 17:09:34.597141 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:34.597131    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86d6d822-1f60-42af-bf60-8fab9ffb0c84-util\") pod \"86d6d822-1f60-42af-bf60-8fab9ffb0c84\" (UID: \"86d6d822-1f60-42af-bf60-8fab9ffb0c84\") "
Jul 24 17:09:34.597329 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:34.597188    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xp477\" (UniqueName: \"kubernetes.io/projected/86d6d822-1f60-42af-bf60-8fab9ffb0c84-kube-api-access-xp477\") pod \"86d6d822-1f60-42af-bf60-8fab9ffb0c84\" (UID: \"86d6d822-1f60-42af-bf60-8fab9ffb0c84\") "
Jul 24 17:09:34.597704 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:34.597661    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86d6d822-1f60-42af-bf60-8fab9ffb0c84-bundle" (OuterVolumeSpecName: "bundle") pod "86d6d822-1f60-42af-bf60-8fab9ffb0c84" (UID: "86d6d822-1f60-42af-bf60-8fab9ffb0c84"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:09:34.599288 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:34.599261    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86d6d822-1f60-42af-bf60-8fab9ffb0c84-kube-api-access-xp477" (OuterVolumeSpecName: "kube-api-access-xp477") pod "86d6d822-1f60-42af-bf60-8fab9ffb0c84" (UID: "86d6d822-1f60-42af-bf60-8fab9ffb0c84"). InnerVolumeSpecName "kube-api-access-xp477". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:09:34.602299 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:34.602267    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86d6d822-1f60-42af-bf60-8fab9ffb0c84-util" (OuterVolumeSpecName: "util") pod "86d6d822-1f60-42af-bf60-8fab9ffb0c84" (UID: "86d6d822-1f60-42af-bf60-8fab9ffb0c84"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:09:34.698264 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:34.698228    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xp477\" (UniqueName: \"kubernetes.io/projected/86d6d822-1f60-42af-bf60-8fab9ffb0c84-kube-api-access-xp477\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:09:34.698264 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:34.698257    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86d6d822-1f60-42af-bf60-8fab9ffb0c84-bundle\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:09:34.698264 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:34.698267    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86d6d822-1f60-42af-bf60-8fab9ffb0c84-util\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:09:35.358133 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:35.358102    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tr5px" event={"ID":"86d6d822-1f60-42af-bf60-8fab9ffb0c84","Type":"ContainerDied","Data":"c892d253b00d62cf3304df075736252196a529417cf1c6982ae989bb21907943"}
Jul 24 17:09:35.358566 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:35.358141    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tr5px"
Jul 24 17:09:35.358566 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:35.358150    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c892d253b00d62cf3304df075736252196a529417cf1c6982ae989bb21907943"
Jul 24 17:09:35.488441 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:35.488417    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cbdp"
Jul 24 17:09:35.543606 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:35.543578    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hknb4"
Jul 24 17:09:35.546332 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:35.546311    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ccbzq"
Jul 24 17:09:35.605255 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:35.605228    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e318229b-75be-421d-a406-b6e82ce86b65-bundle\") pod \"e318229b-75be-421d-a406-b6e82ce86b65\" (UID: \"e318229b-75be-421d-a406-b6e82ce86b65\") "
Jul 24 17:09:35.605459 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:35.605269    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76cf5\" (UniqueName: \"kubernetes.io/projected/e318229b-75be-421d-a406-b6e82ce86b65-kube-api-access-76cf5\") pod \"e318229b-75be-421d-a406-b6e82ce86b65\" (UID: \"e318229b-75be-421d-a406-b6e82ce86b65\") "
Jul 24 17:09:35.605459 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:35.605288    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/607befef-a5aa-4e9a-8d93-1ef4f87e196f-bundle\") pod \"607befef-a5aa-4e9a-8d93-1ef4f87e196f\" (UID: \"607befef-a5aa-4e9a-8d93-1ef4f87e196f\") "
Jul 24 17:09:35.605459 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:35.605314    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/464d2872-3e18-44d1-8a8f-62b396be809d-bundle\") pod \"464d2872-3e18-44d1-8a8f-62b396be809d\" (UID: \"464d2872-3e18-44d1-8a8f-62b396be809d\") "
Jul 24 17:09:35.605459 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:35.605338    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e318229b-75be-421d-a406-b6e82ce86b65-util\") pod \"e318229b-75be-421d-a406-b6e82ce86b65\" (UID: \"e318229b-75be-421d-a406-b6e82ce86b65\") "
Jul 24 17:09:35.605459 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:35.605423    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/464d2872-3e18-44d1-8a8f-62b396be809d-util\") pod \"464d2872-3e18-44d1-8a8f-62b396be809d\" (UID: \"464d2872-3e18-44d1-8a8f-62b396be809d\") "
Jul 24 17:09:35.605744 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:35.605493    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwvb6\" (UniqueName: \"kubernetes.io/projected/464d2872-3e18-44d1-8a8f-62b396be809d-kube-api-access-zwvb6\") pod \"464d2872-3e18-44d1-8a8f-62b396be809d\" (UID: \"464d2872-3e18-44d1-8a8f-62b396be809d\") "
Jul 24 17:09:35.605744 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:35.605518    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/607befef-a5aa-4e9a-8d93-1ef4f87e196f-util\") pod \"607befef-a5aa-4e9a-8d93-1ef4f87e196f\" (UID: \"607befef-a5aa-4e9a-8d93-1ef4f87e196f\") "
Jul 24 17:09:35.606027 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:35.605920    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/464d2872-3e18-44d1-8a8f-62b396be809d-bundle" (OuterVolumeSpecName: "bundle") pod "464d2872-3e18-44d1-8a8f-62b396be809d" (UID: "464d2872-3e18-44d1-8a8f-62b396be809d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:09:35.606027 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:35.605966    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e318229b-75be-421d-a406-b6e82ce86b65-bundle" (OuterVolumeSpecName: "bundle") pod "e318229b-75be-421d-a406-b6e82ce86b65" (UID: "e318229b-75be-421d-a406-b6e82ce86b65"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:09:35.606027 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:35.605970    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/607befef-a5aa-4e9a-8d93-1ef4f87e196f-bundle" (OuterVolumeSpecName: "bundle") pod "607befef-a5aa-4e9a-8d93-1ef4f87e196f" (UID: "607befef-a5aa-4e9a-8d93-1ef4f87e196f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:09:35.606257 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:35.606033    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lsln\" (UniqueName: \"kubernetes.io/projected/607befef-a5aa-4e9a-8d93-1ef4f87e196f-kube-api-access-9lsln\") pod \"607befef-a5aa-4e9a-8d93-1ef4f87e196f\" (UID: \"607befef-a5aa-4e9a-8d93-1ef4f87e196f\") "
Jul 24 17:09:35.606336 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:35.606322    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e318229b-75be-421d-a406-b6e82ce86b65-bundle\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:09:35.606398 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:35.606341    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/607befef-a5aa-4e9a-8d93-1ef4f87e196f-bundle\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:09:35.606398 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:35.606353    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/464d2872-3e18-44d1-8a8f-62b396be809d-bundle\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:09:35.608095 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:35.608066    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/607befef-a5aa-4e9a-8d93-1ef4f87e196f-kube-api-access-9lsln" (OuterVolumeSpecName: "kube-api-access-9lsln") pod "607befef-a5aa-4e9a-8d93-1ef4f87e196f" (UID: "607befef-a5aa-4e9a-8d93-1ef4f87e196f"). InnerVolumeSpecName "kube-api-access-9lsln". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:09:35.608218 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:35.608157    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/464d2872-3e18-44d1-8a8f-62b396be809d-kube-api-access-zwvb6" (OuterVolumeSpecName: "kube-api-access-zwvb6") pod "464d2872-3e18-44d1-8a8f-62b396be809d" (UID: "464d2872-3e18-44d1-8a8f-62b396be809d"). InnerVolumeSpecName "kube-api-access-zwvb6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:09:35.608374 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:35.608358    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e318229b-75be-421d-a406-b6e82ce86b65-kube-api-access-76cf5" (OuterVolumeSpecName: "kube-api-access-76cf5") pod "e318229b-75be-421d-a406-b6e82ce86b65" (UID: "e318229b-75be-421d-a406-b6e82ce86b65"). InnerVolumeSpecName "kube-api-access-76cf5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:09:35.611264 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:35.611242    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e318229b-75be-421d-a406-b6e82ce86b65-util" (OuterVolumeSpecName: "util") pod "e318229b-75be-421d-a406-b6e82ce86b65" (UID: "e318229b-75be-421d-a406-b6e82ce86b65"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:09:35.611779 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:35.611757    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/607befef-a5aa-4e9a-8d93-1ef4f87e196f-util" (OuterVolumeSpecName: "util") pod "607befef-a5aa-4e9a-8d93-1ef4f87e196f" (UID: "607befef-a5aa-4e9a-8d93-1ef4f87e196f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:09:35.612002 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:35.611979    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/464d2872-3e18-44d1-8a8f-62b396be809d-util" (OuterVolumeSpecName: "util") pod "464d2872-3e18-44d1-8a8f-62b396be809d" (UID: "464d2872-3e18-44d1-8a8f-62b396be809d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:09:35.707494 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:35.707453    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76cf5\" (UniqueName: \"kubernetes.io/projected/e318229b-75be-421d-a406-b6e82ce86b65-kube-api-access-76cf5\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:09:35.707494 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:35.707485    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e318229b-75be-421d-a406-b6e82ce86b65-util\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:09:35.707494 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:35.707499    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/464d2872-3e18-44d1-8a8f-62b396be809d-util\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:09:35.707754 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:35.707510    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwvb6\" (UniqueName: \"kubernetes.io/projected/464d2872-3e18-44d1-8a8f-62b396be809d-kube-api-access-zwvb6\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:09:35.707754 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:35.707523    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/607befef-a5aa-4e9a-8d93-1ef4f87e196f-util\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:09:35.707754 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:35.707534    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lsln\" (UniqueName: \"kubernetes.io/projected/607befef-a5aa-4e9a-8d93-1ef4f87e196f-kube-api-access-9lsln\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:09:36.364677 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:36.364637    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cbdp"
Jul 24 17:09:36.364677 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:36.364655    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cbdp" event={"ID":"607befef-a5aa-4e9a-8d93-1ef4f87e196f","Type":"ContainerDied","Data":"539a807a32e5e18c52b71675ded7725e5ee4e78262f3aef5718560c9f73f08e3"}
Jul 24 17:09:36.365150 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:36.364721    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="539a807a32e5e18c52b71675ded7725e5ee4e78262f3aef5718560c9f73f08e3"
Jul 24 17:09:36.366561 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:36.366525    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ccbzq" event={"ID":"464d2872-3e18-44d1-8a8f-62b396be809d","Type":"ContainerDied","Data":"6961d381718a406b2cc6914f4645c3b58cd129b65cbd69e4bd39f10445bd9c82"}
Jul 24 17:09:36.366708 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:36.366568    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6961d381718a406b2cc6914f4645c3b58cd129b65cbd69e4bd39f10445bd9c82"
Jul 24 17:09:36.366708 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:36.366533    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ccbzq"
Jul 24 17:09:36.368624 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:36.368606    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hknb4" event={"ID":"e318229b-75be-421d-a406-b6e82ce86b65","Type":"ContainerDied","Data":"e7d8e4cb148f38ced2e7828dd338ca4aef881d71a52cbf7866b9f4aa6e861ad9"}
Jul 24 17:09:36.368724 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:36.368637    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e7d8e4cb148f38ced2e7828dd338ca4aef881d71a52cbf7866b9f4aa6e861ad9"
Jul 24 17:09:36.368724 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:09:36.368645    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hknb4"
Jul 24 17:10:04.124514 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.124475    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rmslq"]
Jul 24 17:10:04.125029 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.124795    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="464d2872-3e18-44d1-8a8f-62b396be809d" containerName="extract"
Jul 24 17:10:04.125029 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.124807    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="464d2872-3e18-44d1-8a8f-62b396be809d" containerName="extract"
Jul 24 17:10:04.125029 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.124817    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e318229b-75be-421d-a406-b6e82ce86b65" containerName="util"
Jul 24 17:10:04.125029 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.124822    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e318229b-75be-421d-a406-b6e82ce86b65" containerName="util"
Jul 24 17:10:04.125029 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.124838    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86d6d822-1f60-42af-bf60-8fab9ffb0c84" containerName="pull"
Jul 24 17:10:04.125029 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.124844    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="86d6d822-1f60-42af-bf60-8fab9ffb0c84" containerName="pull"
Jul 24 17:10:04.125029 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.124849    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="607befef-a5aa-4e9a-8d93-1ef4f87e196f" containerName="pull"
Jul 24 17:10:04.125029 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.124854    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="607befef-a5aa-4e9a-8d93-1ef4f87e196f" containerName="pull"
Jul 24 17:10:04.125029 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.124863    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="607befef-a5aa-4e9a-8d93-1ef4f87e196f" containerName="util"
Jul 24 17:10:04.125029 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.124868    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="607befef-a5aa-4e9a-8d93-1ef4f87e196f" containerName="util"
Jul 24 17:10:04.125029 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.124876    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e318229b-75be-421d-a406-b6e82ce86b65" containerName="extract"
Jul 24 17:10:04.125029 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.124881    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e318229b-75be-421d-a406-b6e82ce86b65" containerName="extract"
Jul 24 17:10:04.125029 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.124888    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="464d2872-3e18-44d1-8a8f-62b396be809d" containerName="util"
Jul 24 17:10:04.125029 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.124893    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="464d2872-3e18-44d1-8a8f-62b396be809d" containerName="util"
Jul 24 17:10:04.125029 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.124897    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="607befef-a5aa-4e9a-8d93-1ef4f87e196f" containerName="extract"
Jul 24 17:10:04.125029 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.124902    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="607befef-a5aa-4e9a-8d93-1ef4f87e196f" containerName="extract"
Jul 24 17:10:04.125029 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.124907    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="464d2872-3e18-44d1-8a8f-62b396be809d" containerName="pull"
Jul 24 17:10:04.125029 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.124911    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="464d2872-3e18-44d1-8a8f-62b396be809d" containerName="pull"
Jul 24 17:10:04.125029 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.124917    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e318229b-75be-421d-a406-b6e82ce86b65" containerName="pull"
Jul 24 17:10:04.125029 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.124930    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e318229b-75be-421d-a406-b6e82ce86b65" containerName="pull"
Jul 24 17:10:04.125029 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.124937    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86d6d822-1f60-42af-bf60-8fab9ffb0c84" containerName="util"
Jul 24 17:10:04.125029 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.124941    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="86d6d822-1f60-42af-bf60-8fab9ffb0c84" containerName="util"
Jul 24 17:10:04.125029 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.124948    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86d6d822-1f60-42af-bf60-8fab9ffb0c84" containerName="extract"
Jul 24 17:10:04.125029 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.124952    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="86d6d822-1f60-42af-bf60-8fab9ffb0c84" containerName="extract"
Jul 24 17:10:04.125029 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.124994    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e318229b-75be-421d-a406-b6e82ce86b65" containerName="extract"
Jul 24 17:10:04.125029 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.125004    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="86d6d822-1f60-42af-bf60-8fab9ffb0c84" containerName="extract"
Jul 24 17:10:04.125029 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.125009    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="464d2872-3e18-44d1-8a8f-62b396be809d" containerName="extract"
Jul 24 17:10:04.125029 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.125014    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="607befef-a5aa-4e9a-8d93-1ef4f87e196f" containerName="extract"
Jul 24 17:10:04.128189 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.128169    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rmslq"
Jul 24 17:10:04.131123 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.131105    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 24 17:10:04.131235 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.131115    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wjdgd\""
Jul 24 17:10:04.131235 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.131139    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 24 17:10:04.140806 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.140783    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfvg2\" (UniqueName: \"kubernetes.io/projected/edf81122-fa6a-43a7-bfd4-e6c882268851-kube-api-access-hfvg2\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rmslq\" (UID: \"edf81122-fa6a-43a7-bfd4-e6c882268851\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rmslq"
Jul 24 17:10:04.141036 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.141016    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/edf81122-fa6a-43a7-bfd4-e6c882268851-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rmslq\" (UID: \"edf81122-fa6a-43a7-bfd4-e6c882268851\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rmslq"
Jul 24 17:10:04.143271 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.143252    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rmslq"]
Jul 24 17:10:04.237621 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.237590    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rmslq"]
Jul 24 17:10:04.237891 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:10:04.237870    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-hfvg2], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rmslq" podUID="edf81122-fa6a-43a7-bfd4-e6c882268851"
Jul 24 17:10:04.241796 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.241772    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/edf81122-fa6a-43a7-bfd4-e6c882268851-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rmslq\" (UID: \"edf81122-fa6a-43a7-bfd4-e6c882268851\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rmslq"
Jul 24 17:10:04.241871 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.241858    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfvg2\" (UniqueName: \"kubernetes.io/projected/edf81122-fa6a-43a7-bfd4-e6c882268851-kube-api-access-hfvg2\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rmslq\" (UID: \"edf81122-fa6a-43a7-bfd4-e6c882268851\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rmslq"
Jul 24 17:10:04.242222 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.242206    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/edf81122-fa6a-43a7-bfd4-e6c882268851-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rmslq\" (UID: \"edf81122-fa6a-43a7-bfd4-e6c882268851\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rmslq"
Jul 24 17:10:04.255446 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.255418    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfvg2\" (UniqueName: \"kubernetes.io/projected/edf81122-fa6a-43a7-bfd4-e6c882268851-kube-api-access-hfvg2\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rmslq\" (UID: \"edf81122-fa6a-43a7-bfd4-e6c882268851\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rmslq"
Jul 24 17:10:04.495761 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.495730    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rmslq"
Jul 24 17:10:04.502706 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.502682    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rmslq"
Jul 24 17:10:04.542868 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.542843    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfvg2\" (UniqueName: \"kubernetes.io/projected/edf81122-fa6a-43a7-bfd4-e6c882268851-kube-api-access-hfvg2\") pod \"edf81122-fa6a-43a7-bfd4-e6c882268851\" (UID: \"edf81122-fa6a-43a7-bfd4-e6c882268851\") "
Jul 24 17:10:04.543025 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.542890    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/edf81122-fa6a-43a7-bfd4-e6c882268851-extensions-socket-volume\") pod \"edf81122-fa6a-43a7-bfd4-e6c882268851\" (UID: \"edf81122-fa6a-43a7-bfd4-e6c882268851\") "
Jul 24 17:10:04.543174 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.543154    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edf81122-fa6a-43a7-bfd4-e6c882268851-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "edf81122-fa6a-43a7-bfd4-e6c882268851" (UID: "edf81122-fa6a-43a7-bfd4-e6c882268851"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:10:04.544847 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.544823    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edf81122-fa6a-43a7-bfd4-e6c882268851-kube-api-access-hfvg2" (OuterVolumeSpecName: "kube-api-access-hfvg2") pod "edf81122-fa6a-43a7-bfd4-e6c882268851" (UID: "edf81122-fa6a-43a7-bfd4-e6c882268851"). InnerVolumeSpecName "kube-api-access-hfvg2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:10:04.643538 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.643506    2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/edf81122-fa6a-43a7-bfd4-e6c882268851-extensions-socket-volume\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:10:04.643538 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.643533    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfvg2\" (UniqueName: \"kubernetes.io/projected/edf81122-fa6a-43a7-bfd4-e6c882268851-kube-api-access-hfvg2\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:10:04.728956 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.728916    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rmslq"]
Jul 24 17:10:04.741890 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:04.741858    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rmslq"]
Jul 24 17:10:05.503334 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:05.503307    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rmslq"
Jul 24 17:10:05.506225 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:10:05.506199    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-rmslq\" is forbidden: User \"system:node:ip-10-0-134-152.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-152.ec2.internal' and this object" podUID="edf81122-fa6a-43a7-bfd4-e6c882268851" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rmslq"
Jul 24 17:10:05.511532 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:10:05.511503    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-rmslq\" is forbidden: User \"system:node:ip-10-0-134-152.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-152.ec2.internal' and this object" podUID="edf81122-fa6a-43a7-bfd4-e6c882268851" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rmslq"
Jul 24 17:10:05.763078 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:05.762998    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edf81122-fa6a-43a7-bfd4-e6c882268851" path="/var/lib/kubelet/pods/edf81122-fa6a-43a7-bfd4-e6c882268851/volumes"
Jul 24 17:10:56.057948 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:56.057868    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:10:56.061139 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:56.061118    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-ts924"
Jul 24 17:10:56.066987 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:56.066964    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 24 17:10:56.067124 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:56.066966    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6lscw\""
Jul 24 17:10:56.067511 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:56.067237    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 24 17:10:56.067593 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:56.067530    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 24 17:10:56.072250 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:56.072231    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:10:56.112388 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:56.112363    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:10:56.164626 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:56.164595    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zp84\" (UniqueName: \"kubernetes.io/projected/fcb05ced-0e16-406d-8fba-6a682de945e4-kube-api-access-4zp84\") pod \"limitador-limitador-54d6d988d5-ts924\" (UID: \"fcb05ced-0e16-406d-8fba-6a682de945e4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ts924"
Jul 24 17:10:56.164813 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:56.164712    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fcb05ced-0e16-406d-8fba-6a682de945e4-config-file\") pod \"limitador-limitador-54d6d988d5-ts924\" (UID: \"fcb05ced-0e16-406d-8fba-6a682de945e4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ts924"
Jul 24 17:10:56.265565 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:56.265525    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fcb05ced-0e16-406d-8fba-6a682de945e4-config-file\") pod \"limitador-limitador-54d6d988d5-ts924\" (UID: \"fcb05ced-0e16-406d-8fba-6a682de945e4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ts924"
Jul 24 17:10:56.265756 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:56.265582    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zp84\" (UniqueName: \"kubernetes.io/projected/fcb05ced-0e16-406d-8fba-6a682de945e4-kube-api-access-4zp84\") pod \"limitador-limitador-54d6d988d5-ts924\" (UID: \"fcb05ced-0e16-406d-8fba-6a682de945e4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ts924"
Jul 24 17:10:56.266178 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:56.266158    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fcb05ced-0e16-406d-8fba-6a682de945e4-config-file\") pod \"limitador-limitador-54d6d988d5-ts924\" (UID: \"fcb05ced-0e16-406d-8fba-6a682de945e4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ts924"
Jul 24 17:10:56.274072 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:56.274040    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zp84\" (UniqueName: \"kubernetes.io/projected/fcb05ced-0e16-406d-8fba-6a682de945e4-kube-api-access-4zp84\") pod \"limitador-limitador-54d6d988d5-ts924\" (UID: \"fcb05ced-0e16-406d-8fba-6a682de945e4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ts924"
Jul 24 17:10:56.371619 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:56.371549    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-ts924"
Jul 24 17:10:56.501732 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:56.501642    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:10:56.503410 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:10:56.503385    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcb05ced_0e16_406d_8fba_6a682de945e4.slice/crio-ae8d1e3b8ebc9924e11690168db9979b463bb8ff8400859d52c376638ce978de WatchSource:0}: Error finding container ae8d1e3b8ebc9924e11690168db9979b463bb8ff8400859d52c376638ce978de: Status 404 returned error can't find the container with id ae8d1e3b8ebc9924e11690168db9979b463bb8ff8400859d52c376638ce978de
Jul 24 17:10:56.733855 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:56.733772    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-ts924" event={"ID":"fcb05ced-0e16-406d-8fba-6a682de945e4","Type":"ContainerStarted","Data":"ae8d1e3b8ebc9924e11690168db9979b463bb8ff8400859d52c376638ce978de"}
Jul 24 17:10:59.750933 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:59.750883    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-ts924" event={"ID":"fcb05ced-0e16-406d-8fba-6a682de945e4","Type":"ContainerStarted","Data":"e5748e3e8b803ab4a82641fd39d32b235b684002569d76942e69058685093995"}
Jul 24 17:10:59.751347 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:59.751060    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-ts924"
Jul 24 17:10:59.768697 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:10:59.768643    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-ts924" podStartSLOduration=1.434118654 podStartE2EDuration="3.768628775s" totalImagesPullingTime="2.334510121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:10:59.767385357 +0000 UTC m=+450.583359972" watchObservedRunningTime="2026-07-24 17:10:59.768628775 +0000 UTC m=+450.584603390"
Jul 24 17:11:10.757060 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:11:10.757028    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-ts924"
Jul 24 17:12:11.782801 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:12:11.782767    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:12:29.995695 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:12:29.995653    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:12:43.377595 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:12:43.377559    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:12:50.031064 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:12:50.031031    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-twkgz"]
Jul 24 17:12:50.034513 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:12:50.034498    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twkgz"
Jul 24 17:12:50.037412 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:12:50.037395    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-85ddw\""
Jul 24 17:12:50.041361 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:12:50.041345    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 24 17:12:50.042484 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:12:50.042463    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 24 17:12:50.042908 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:12:50.042892    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 24 17:12:50.068004 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:12:50.067986    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-twkgz"]
Jul 24 17:12:50.199344 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:12:50.199315    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45941db4-67a7-4176-b724-2af100aba887-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-twkgz\" (UID: \"45941db4-67a7-4176-b724-2af100aba887\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twkgz"
Jul 24 17:12:50.199500 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:12:50.199357    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45941db4-67a7-4176-b724-2af100aba887-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-twkgz\" (UID: \"45941db4-67a7-4176-b724-2af100aba887\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twkgz"
Jul 24 17:12:50.199500 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:12:50.199382    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45941db4-67a7-4176-b724-2af100aba887-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-twkgz\" (UID: \"45941db4-67a7-4176-b724-2af100aba887\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twkgz"
Jul 24 17:12:50.199500 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:12:50.199405    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqz5l\" (UniqueName: \"kubernetes.io/projected/45941db4-67a7-4176-b724-2af100aba887-kube-api-access-rqz5l\") pod \"e2e-trlp-test-simulated-kserve-598466548d-twkgz\" (UID: \"45941db4-67a7-4176-b724-2af100aba887\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twkgz"
Jul 24 17:12:50.199500 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:12:50.199423    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45941db4-67a7-4176-b724-2af100aba887-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-twkgz\" (UID: \"45941db4-67a7-4176-b724-2af100aba887\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twkgz"
Jul 24 17:12:50.199500 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:12:50.199443    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45941db4-67a7-4176-b724-2af100aba887-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-twkgz\" (UID: \"45941db4-67a7-4176-b724-2af100aba887\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twkgz"
Jul 24 17:12:50.300597 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:12:50.300522    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45941db4-67a7-4176-b724-2af100aba887-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-twkgz\" (UID: \"45941db4-67a7-4176-b724-2af100aba887\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twkgz"
Jul 24 17:12:50.300597 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:12:50.300561    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45941db4-67a7-4176-b724-2af100aba887-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-twkgz\" (UID: \"45941db4-67a7-4176-b724-2af100aba887\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twkgz"
Jul 24 17:12:50.300597 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:12:50.300589    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqz5l\" (UniqueName: \"kubernetes.io/projected/45941db4-67a7-4176-b724-2af100aba887-kube-api-access-rqz5l\") pod \"e2e-trlp-test-simulated-kserve-598466548d-twkgz\" (UID: \"45941db4-67a7-4176-b724-2af100aba887\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twkgz"
Jul 24 17:12:50.300883 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:12:50.300614    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45941db4-67a7-4176-b724-2af100aba887-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-twkgz\" (UID: \"45941db4-67a7-4176-b724-2af100aba887\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twkgz"
Jul 24 17:12:50.300883 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:12:50.300647    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45941db4-67a7-4176-b724-2af100aba887-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-twkgz\" (UID: \"45941db4-67a7-4176-b724-2af100aba887\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twkgz"
Jul 24 17:12:50.300883 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:12:50.300730    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45941db4-67a7-4176-b724-2af100aba887-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-twkgz\" (UID: \"45941db4-67a7-4176-b724-2af100aba887\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twkgz"
Jul 24 17:12:50.301014 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:12:50.300935    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45941db4-67a7-4176-b724-2af100aba887-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-twkgz\" (UID: \"45941db4-67a7-4176-b724-2af100aba887\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twkgz"
Jul 24 17:12:50.301051 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:12:50.301004    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45941db4-67a7-4176-b724-2af100aba887-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-twkgz\" (UID: \"45941db4-67a7-4176-b724-2af100aba887\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twkgz"
Jul 24 17:12:50.301051 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:12:50.301026    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45941db4-67a7-4176-b724-2af100aba887-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-twkgz\" (UID: \"45941db4-67a7-4176-b724-2af100aba887\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twkgz"
Jul 24 17:12:50.302820 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:12:50.302798    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45941db4-67a7-4176-b724-2af100aba887-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-twkgz\" (UID: \"45941db4-67a7-4176-b724-2af100aba887\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twkgz"
Jul 24 17:12:50.303020 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:12:50.303004    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45941db4-67a7-4176-b724-2af100aba887-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-twkgz\" (UID: \"45941db4-67a7-4176-b724-2af100aba887\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twkgz"
Jul 24 17:12:50.313968 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:12:50.313948    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqz5l\" (UniqueName: \"kubernetes.io/projected/45941db4-67a7-4176-b724-2af100aba887-kube-api-access-rqz5l\") pod \"e2e-trlp-test-simulated-kserve-598466548d-twkgz\" (UID: \"45941db4-67a7-4176-b724-2af100aba887\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twkgz"
Jul 24 17:12:50.344709 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:12:50.344687    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twkgz"
Jul 24 17:12:50.477574 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:12:50.477540    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-twkgz"]
Jul 24 17:12:50.481380 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:12:50.481353    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45941db4_67a7_4176_b724_2af100aba887.slice/crio-6ef234874a0450f07049e59f06c876866a62b05afe6e7df9cb48fb3b4f8a505e WatchSource:0}: Error finding container 6ef234874a0450f07049e59f06c876866a62b05afe6e7df9cb48fb3b4f8a505e: Status 404 returned error can't find the container with id 6ef234874a0450f07049e59f06c876866a62b05afe6e7df9cb48fb3b4f8a505e
Jul 24 17:12:51.273373 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:12:51.273336    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twkgz" event={"ID":"45941db4-67a7-4176-b724-2af100aba887","Type":"ContainerStarted","Data":"6ef234874a0450f07049e59f06c876866a62b05afe6e7df9cb48fb3b4f8a505e"}
Jul 24 17:12:51.390414 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:12:51.390382    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:12:52.278963 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:12:52.278925    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twkgz" event={"ID":"45941db4-67a7-4176-b724-2af100aba887","Type":"ContainerStarted","Data":"9bc1284e8b2cdedd6e17e5b4a462c2b2957db4d04c33d8f24b2b4122502ea52a"}
Jul 24 17:12:52.316280 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:12:52.316233    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twkgz" podStartSLOduration=2.126386937 podStartE2EDuration="3.316215162s" totalImagesPullingTime="1.189828225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:12:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:12:52.315149313 +0000 UTC m=+563.131123928" watchObservedRunningTime="2026-07-24 17:12:52.316215162 +0000 UTC m=+563.132189754"
Jul 24 17:13:00.345317 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:13:00.345282    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twkgz"
Jul 24 17:13:00.345736 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:13:00.345355    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twkgz"
Jul 24 17:13:00.357533 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:13:00.357507    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twkgz"
Jul 24 17:13:01.330786 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:13:01.330757    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-twkgz"
Jul 24 17:13:05.925205 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:13:05.925172    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:13:06.907208 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:13:06.907179    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zcl2x"]
Jul 24 17:13:06.910357 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:13:06.910342    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zcl2x"
Jul 24 17:13:06.922239 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:13:06.922208    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 24 17:13:06.930971 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:13:06.930939    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zcl2x"]
Jul 24 17:13:07.044363 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:13:07.044326    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e02ba4f-6552-4cc9-a285-a2da3666b719-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zcl2x\" (UID: \"8e02ba4f-6552-4cc9-a285-a2da3666b719\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zcl2x"
Jul 24 17:13:07.044557 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:13:07.044385    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e02ba4f-6552-4cc9-a285-a2da3666b719-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zcl2x\" (UID: \"8e02ba4f-6552-4cc9-a285-a2da3666b719\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zcl2x"
Jul 24 17:13:07.044557 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:13:07.044459    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e02ba4f-6552-4cc9-a285-a2da3666b719-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zcl2x\" (UID: \"8e02ba4f-6552-4cc9-a285-a2da3666b719\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zcl2x"
Jul 24 17:13:07.044650 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:13:07.044581    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e02ba4f-6552-4cc9-a285-a2da3666b719-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zcl2x\" (UID: \"8e02ba4f-6552-4cc9-a285-a2da3666b719\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zcl2x"
Jul 24 17:13:07.044650 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:13:07.044604    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rqj2\" (UniqueName: \"kubernetes.io/projected/8e02ba4f-6552-4cc9-a285-a2da3666b719-kube-api-access-6rqj2\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zcl2x\" (UID: \"8e02ba4f-6552-4cc9-a285-a2da3666b719\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zcl2x"
Jul 24 17:13:07.044650 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:13:07.044625    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e02ba4f-6552-4cc9-a285-a2da3666b719-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zcl2x\" (UID: \"8e02ba4f-6552-4cc9-a285-a2da3666b719\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zcl2x"
Jul 24 17:13:07.145911 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:13:07.145872    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e02ba4f-6552-4cc9-a285-a2da3666b719-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zcl2x\" (UID: \"8e02ba4f-6552-4cc9-a285-a2da3666b719\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zcl2x"
Jul 24 17:13:07.145911 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:13:07.145909    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rqj2\" (UniqueName: \"kubernetes.io/projected/8e02ba4f-6552-4cc9-a285-a2da3666b719-kube-api-access-6rqj2\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zcl2x\" (UID: \"8e02ba4f-6552-4cc9-a285-a2da3666b719\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zcl2x"
Jul 24 17:13:07.146198 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:13:07.145927    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e02ba4f-6552-4cc9-a285-a2da3666b719-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zcl2x\" (UID: \"8e02ba4f-6552-4cc9-a285-a2da3666b719\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zcl2x"
Jul 24 17:13:07.146198 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:13:07.145951    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e02ba4f-6552-4cc9-a285-a2da3666b719-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zcl2x\" (UID: \"8e02ba4f-6552-4cc9-a285-a2da3666b719\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zcl2x"
Jul 24 17:13:07.146198 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:13:07.145982    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e02ba4f-6552-4cc9-a285-a2da3666b719-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zcl2x\" (UID: \"8e02ba4f-6552-4cc9-a285-a2da3666b719\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zcl2x"
Jul 24 17:13:07.146198 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:13:07.146013    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e02ba4f-6552-4cc9-a285-a2da3666b719-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zcl2x\" (UID: \"8e02ba4f-6552-4cc9-a285-a2da3666b719\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zcl2x"
Jul 24 17:13:07.146397 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:13:07.146299    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e02ba4f-6552-4cc9-a285-a2da3666b719-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zcl2x\" (UID: \"8e02ba4f-6552-4cc9-a285-a2da3666b719\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zcl2x"
Jul 24 17:13:07.146397 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:13:07.146350    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e02ba4f-6552-4cc9-a285-a2da3666b719-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zcl2x\" (UID: \"8e02ba4f-6552-4cc9-a285-a2da3666b719\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zcl2x"
Jul 24 17:13:07.146463 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:13:07.146414    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e02ba4f-6552-4cc9-a285-a2da3666b719-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zcl2x\" (UID: \"8e02ba4f-6552-4cc9-a285-a2da3666b719\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zcl2x"
Jul 24 17:13:07.148197 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:13:07.148178    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e02ba4f-6552-4cc9-a285-a2da3666b719-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zcl2x\" (UID: \"8e02ba4f-6552-4cc9-a285-a2da3666b719\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zcl2x"
Jul 24 17:13:07.148351 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:13:07.148335    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e02ba4f-6552-4cc9-a285-a2da3666b719-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zcl2x\" (UID: \"8e02ba4f-6552-4cc9-a285-a2da3666b719\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zcl2x"
Jul 24 17:13:07.163693 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:13:07.163616    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rqj2\" (UniqueName: \"kubernetes.io/projected/8e02ba4f-6552-4cc9-a285-a2da3666b719-kube-api-access-6rqj2\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zcl2x\" (UID: \"8e02ba4f-6552-4cc9-a285-a2da3666b719\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zcl2x"
Jul 24 17:13:07.221727 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:13:07.221664    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zcl2x"
Jul 24 17:13:07.367630 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:13:07.367554    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zcl2x"]
Jul 24 17:13:07.369780 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:13:07.369752    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e02ba4f_6552_4cc9_a285_a2da3666b719.slice/crio-f20e61e5d264ed19725666258131ce1a4e6174e783854d79d2f4ecd3d93eb31e WatchSource:0}: Error finding container f20e61e5d264ed19725666258131ce1a4e6174e783854d79d2f4ecd3d93eb31e: Status 404 returned error can't find the container with id f20e61e5d264ed19725666258131ce1a4e6174e783854d79d2f4ecd3d93eb31e
Jul 24 17:13:08.352941 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:13:08.352898    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zcl2x" event={"ID":"8e02ba4f-6552-4cc9-a285-a2da3666b719","Type":"ContainerStarted","Data":"c36e56bb237205623593f3f33d753f0bc6e9a13c8c73673b4423476315e6f3b8"}
Jul 24 17:13:08.353336 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:13:08.352953    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zcl2x" event={"ID":"8e02ba4f-6552-4cc9-a285-a2da3666b719","Type":"ContainerStarted","Data":"f20e61e5d264ed19725666258131ce1a4e6174e783854d79d2f4ecd3d93eb31e"}
Jul 24 17:13:08.390990 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:13:08.390935    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zcl2x" podStartSLOduration=1.913405569 podStartE2EDuration="2.390918623s" totalImagesPullingTime="477.513054ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:13:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:13:08.389648424 +0000 UTC m=+579.205623037" watchObservedRunningTime="2026-07-24 17:13:08.390918623 +0000 UTC m=+579.206893236"
Jul 24 17:13:15.809947 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:13:15.809912    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:13:17.222734 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:13:17.222699    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zcl2x"
Jul 24 17:13:17.223121 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:13:17.222768    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zcl2x"
Jul 24 17:13:17.234924 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:13:17.234897    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zcl2x"
Jul 24 17:13:17.408604 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:13:17.408574    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zcl2x"
Jul 24 17:13:29.635461 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:13:29.635433    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d6w2m_9f3e23c6-31a7-4e7b-83df-d6eee1335b7a/ovn-acl-logging/0.log"
Jul 24 17:13:29.637913 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:13:29.637891    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d6w2m_9f3e23c6-31a7-4e7b-83df-d6eee1335b7a/ovn-acl-logging/0.log"
Jul 24 17:14:58.312785 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:14:58.312749    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:15:00.204891 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:15:00.204855    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748555-w7562"]
Jul 24 17:15:00.207929 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:15:00.207913    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748555-w7562"
Jul 24 17:15:00.210367 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:15:00.210349    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tdqg2\""
Jul 24 17:15:00.216940 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:15:00.216924    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748555-w7562"
Jul 24 17:15:00.225617 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:15:00.225594    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748555-w7562"]
Jul 24 17:15:00.351914 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:15:00.351881    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748555-w7562"]
Jul 24 17:15:00.354262 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:15:00.354230    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb86ac69c_9754_4aa9_91c8_56d65b0e3036.slice/crio-6c25c2cf8ce306ce64a1be1cd0f448a44d187416e1ba178e4f426a21043b4b5e WatchSource:0}: Error finding container 6c25c2cf8ce306ce64a1be1cd0f448a44d187416e1ba178e4f426a21043b4b5e: Status 404 returned error can't find the container with id 6c25c2cf8ce306ce64a1be1cd0f448a44d187416e1ba178e4f426a21043b4b5e
Jul 24 17:15:00.356176 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:15:00.356160    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 17:15:00.889995 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:15:00.889954    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748555-w7562" event={"ID":"b86ac69c-9754-4aa9-91c8-56d65b0e3036","Type":"ContainerStarted","Data":"6c25c2cf8ce306ce64a1be1cd0f448a44d187416e1ba178e4f426a21043b4b5e"}
Jul 24 17:15:02.900357 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:15:02.900272    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748555-w7562" event={"ID":"b86ac69c-9754-4aa9-91c8-56d65b0e3036","Type":"ContainerStarted","Data":"9fd7321d28666e86ab0608974f8ddb5e02d3ba65387fa588c3645011fe347b3f"}
Jul 24 17:15:02.922189 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:15:02.922140    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748555-w7562" podStartSLOduration=1.011542034 podStartE2EDuration="2.922124043s" totalImagesPullingTime="1.910582009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:15:02.919534939 +0000 UTC m=+693.735509568" watchObservedRunningTime="2026-07-24 17:15:02.922124043 +0000 UTC m=+693.738098657"
Jul 24 17:15:03.907365 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:15:03.907327    2582 generic.go:356] "Generic (PLEG): container finished" podID="b86ac69c-9754-4aa9-91c8-56d65b0e3036" containerID="9fd7321d28666e86ab0608974f8ddb5e02d3ba65387fa588c3645011fe347b3f" exitCode=0
Jul 24 17:15:03.907783 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:15:03.907414    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748555-w7562" event={"ID":"b86ac69c-9754-4aa9-91c8-56d65b0e3036","Type":"ContainerDied","Data":"9fd7321d28666e86ab0608974f8ddb5e02d3ba65387fa588c3645011fe347b3f"}
Jul 24 17:15:05.040890 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:15:05.040865    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748555-w7562"
Jul 24 17:15:05.918253 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:15:05.918227    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748555-w7562"
Jul 24 17:15:05.918253 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:15:05.918233    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748555-w7562" event={"ID":"b86ac69c-9754-4aa9-91c8-56d65b0e3036","Type":"ContainerDied","Data":"6c25c2cf8ce306ce64a1be1cd0f448a44d187416e1ba178e4f426a21043b4b5e"}
Jul 24 17:15:05.918449 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:15:05.918277    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6c25c2cf8ce306ce64a1be1cd0f448a44d187416e1ba178e4f426a21043b4b5e"
Jul 24 17:15:07.978463 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:15:07.978431    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:15:18.673478 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:15:18.673440    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:17:00.187654 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:17:00.187574    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:17:11.995046 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:17:11.995010    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:17:42.192719 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:17:42.192679    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:17:50.087032 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:17:50.086995    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:18:01.989109 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:18:01.989070    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:18:10.084209 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:18:10.084172    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:18:21.394364 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:18:21.394283    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:18:29.668269 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:18:29.668235    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d6w2m_9f3e23c6-31a7-4e7b-83df-d6eee1335b7a/ovn-acl-logging/0.log"
Jul 24 17:18:29.668967 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:18:29.668945    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d6w2m_9f3e23c6-31a7-4e7b-83df-d6eee1335b7a/ovn-acl-logging/0.log"
Jul 24 17:18:32.488530 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:18:32.488490    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:18:43.374204 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:18:43.374162    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:18:53.086336 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:18:53.086303    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:19:15.472586 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:19:15.472545    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:19:27.275472 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:19:27.275434    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:19:52.073525 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:19:52.073448    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:20:02.893523 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:20:02.893487    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:20:13.572978 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:20:13.572930    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:20:27.581227 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:20:27.581191    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:20:38.387314 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:20:38.387277    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:20:50.379783 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:20:50.379749    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:21:00.000612 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:21:00.000580    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:22:47.377938 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:22:47.377902    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:22:58.889501 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:22:58.889418    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:23:09.477727 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:23:09.477694    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:23:20.180750 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:23:20.180716    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:23:29.704410 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:23:29.704379    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d6w2m_9f3e23c6-31a7-4e7b-83df-d6eee1335b7a/ovn-acl-logging/0.log"
Jul 24 17:23:29.706271 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:23:29.706246    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d6w2m_9f3e23c6-31a7-4e7b-83df-d6eee1335b7a/ovn-acl-logging/0.log"
Jul 24 17:23:31.683889 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:23:31.683854    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:23:42.470985 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:23:42.470944    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:23:50.899734 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:23:50.899697    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:24:02.589577 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:24:02.589537    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:24:13.282632 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:24:13.282600    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:24:21.983101 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:24:21.983021    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:24:32.782656 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:24:32.782625    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:24:54.480559 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:24:54.480520    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:25:03.975840 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:25:03.975798    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:25:15.381247 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:25:15.381215    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:25:32.082439 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:25:32.082398    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:25:59.676143 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:25:59.676064    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:26:12.871855 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:26:12.871821    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:26:19.486320 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:26:19.486283    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:26:35.676864 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:26:35.676827    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:26:45.184613 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:26:45.184574    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:26:54.779712 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:26:54.779662    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:27:02.890113 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:27:02.890077    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:27:13.582625 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:27:13.582583    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:27:24.184579 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:27:24.184508    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:27:36.188724 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:27:36.188664    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:27:50.774247 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:27:50.774213    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:28:00.219838 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:28:00.219802    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:28:09.262601 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:28:09.262557    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:28:21.583098 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:28:21.583057    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:28:29.735016 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:28:29.734989    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d6w2m_9f3e23c6-31a7-4e7b-83df-d6eee1335b7a/ovn-acl-logging/0.log"
Jul 24 17:28:29.737263 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:28:29.737241    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d6w2m_9f3e23c6-31a7-4e7b-83df-d6eee1335b7a/ovn-acl-logging/0.log"
Jul 24 17:28:37.074091 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:28:37.074051    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:28:49.879186 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:28:49.879148    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:29:01.794338 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:29:01.794255    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:29:15.292003 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:29:15.291966    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:29:27.268306 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:29:27.268278    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:29:44.083900 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:29:44.083861    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:30:00.138951 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:00.138918    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-6432af27-29748570-6mf2w"]
Jul 24 17:30:00.141379 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:00.139399    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b86ac69c-9754-4aa9-91c8-56d65b0e3036" containerName="cleanup"
Jul 24 17:30:00.141379 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:00.139416    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b86ac69c-9754-4aa9-91c8-56d65b0e3036" containerName="cleanup"
Jul 24 17:30:00.141379 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:00.139470    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b86ac69c-9754-4aa9-91c8-56d65b0e3036" containerName="cleanup"
Jul 24 17:30:00.142316 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:00.142296    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-6432af27-29748570-6mf2w"
Jul 24 17:30:00.143046 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:00.143026    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748570-dkn8q"]
Jul 24 17:30:00.145193 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:00.145170    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tdqg2\""
Jul 24 17:30:00.145964 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:00.145946    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748570-dkn8q"
Jul 24 17:30:00.159941 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:00.159394    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-6432af27-29748570-6mf2w"]
Jul 24 17:30:00.160182 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:00.160143    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-6432af27-29748570-6mf2w"
Jul 24 17:30:00.163827 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:00.163798    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748570-dkn8q"]
Jul 24 17:30:00.168629 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:00.168609    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748570-dkn8q"
Jul 24 17:30:00.305169 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:00.305136    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-6432af27-29748570-6mf2w"]
Jul 24 17:30:00.307256 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:30:00.307220    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5678ea27_806e_4738_8685_f3bda5fe2547.slice/crio-09e1735413d841fd5e8f205391edb3eb8822bb4a3d7c816a968f48d19fb1f08e WatchSource:0}: Error finding container 09e1735413d841fd5e8f205391edb3eb8822bb4a3d7c816a968f48d19fb1f08e: Status 404 returned error can't find the container with id 09e1735413d841fd5e8f205391edb3eb8822bb4a3d7c816a968f48d19fb1f08e
Jul 24 17:30:00.332018 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:00.331995    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748570-dkn8q"]
Jul 24 17:30:00.351768 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:30:00.351742    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13d4ee84_9d27_4c0e_8c6f_3239cc098b7e.slice/crio-f2a2bfaa3817218e0abf82f7b51ae74ee3e7847b2757fb2db2d8638af036fa4e WatchSource:0}: Error finding container f2a2bfaa3817218e0abf82f7b51ae74ee3e7847b2757fb2db2d8638af036fa4e: Status 404 returned error can't find the container with id f2a2bfaa3817218e0abf82f7b51ae74ee3e7847b2757fb2db2d8638af036fa4e
Jul 24 17:30:01.231329 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:01.231293    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748570-dkn8q" event={"ID":"13d4ee84-9d27-4c0e-8c6f-3239cc098b7e","Type":"ContainerStarted","Data":"6c02c3ec1ebdea4a47ef201f5e86a721bbc90e12528bbc7b5a1156337083797b"}
Jul 24 17:30:01.231817 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:01.231352    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748570-dkn8q" event={"ID":"13d4ee84-9d27-4c0e-8c6f-3239cc098b7e","Type":"ContainerStarted","Data":"f2a2bfaa3817218e0abf82f7b51ae74ee3e7847b2757fb2db2d8638af036fa4e"}
Jul 24 17:30:01.232732 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:01.232707    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-6432af27-29748570-6mf2w" event={"ID":"5678ea27-806e-4738-8685-f3bda5fe2547","Type":"ContainerStarted","Data":"80148e330667e9150b26229bc07ab6fa84f20b3bbc74614f4a81d4fe2d5ad8be"}
Jul 24 17:30:01.232822 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:01.232751    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-6432af27-29748570-6mf2w" event={"ID":"5678ea27-806e-4738-8685-f3bda5fe2547","Type":"ContainerStarted","Data":"09e1735413d841fd5e8f205391edb3eb8822bb4a3d7c816a968f48d19fb1f08e"}
Jul 24 17:30:01.248438 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:01.248394    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748570-dkn8q" podStartSLOduration=1.248379495 podStartE2EDuration="1.248379495s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:30:01.246047853 +0000 UTC m=+1592.062022472" watchObservedRunningTime="2026-07-24 17:30:01.248379495 +0000 UTC m=+1592.064354110"
Jul 24 17:30:01.261210 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:01.261164    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-6432af27-29748570-6mf2w" podStartSLOduration=1.2611483940000001 podStartE2EDuration="1.261148394s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:30:01.259600704 +0000 UTC m=+1592.075575323" watchObservedRunningTime="2026-07-24 17:30:01.261148394 +0000 UTC m=+1592.077123008"
Jul 24 17:30:01.988763 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:01.988724    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6432af27-9gpxr"]
Jul 24 17:30:01.992135 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:01.992119    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6432af27-9gpxr"
Jul 24 17:30:01.994378 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:01.994355    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 17:30:01.998136 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:01.998114    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6432af27-9gpxr"]
Jul 24 17:30:02.088524 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:02.088486    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d2ebaf4-a581-4df7-9700-07ad8f70a8d5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-6432af27-9gpxr\" (UID: \"3d2ebaf4-a581-4df7-9700-07ad8f70a8d5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6432af27-9gpxr"
Jul 24 17:30:02.189546 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:02.189503    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d2ebaf4-a581-4df7-9700-07ad8f70a8d5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-6432af27-9gpxr\" (UID: \"3d2ebaf4-a581-4df7-9700-07ad8f70a8d5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6432af27-9gpxr"
Jul 24 17:30:02.190152 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:02.190134    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d2ebaf4-a581-4df7-9700-07ad8f70a8d5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-6432af27-9gpxr\" (UID: \"3d2ebaf4-a581-4df7-9700-07ad8f70a8d5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6432af27-9gpxr"
Jul 24 17:30:02.239222 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:02.239137    2582 generic.go:356] "Generic (PLEG): container finished" podID="13d4ee84-9d27-4c0e-8c6f-3239cc098b7e" containerID="6c02c3ec1ebdea4a47ef201f5e86a721bbc90e12528bbc7b5a1156337083797b" exitCode=0
Jul 24 17:30:02.239222 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:02.239216    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748570-dkn8q" event={"ID":"13d4ee84-9d27-4c0e-8c6f-3239cc098b7e","Type":"ContainerDied","Data":"6c02c3ec1ebdea4a47ef201f5e86a721bbc90e12528bbc7b5a1156337083797b"}
Jul 24 17:30:02.240707 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:02.240663    2582 generic.go:356] "Generic (PLEG): container finished" podID="5678ea27-806e-4738-8685-f3bda5fe2547" containerID="80148e330667e9150b26229bc07ab6fa84f20b3bbc74614f4a81d4fe2d5ad8be" exitCode=0
Jul 24 17:30:02.240816 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:02.240764    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-6432af27-29748570-6mf2w" event={"ID":"5678ea27-806e-4738-8685-f3bda5fe2547","Type":"ContainerDied","Data":"80148e330667e9150b26229bc07ab6fa84f20b3bbc74614f4a81d4fe2d5ad8be"}
Jul 24 17:30:02.305029 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:02.304991    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6432af27-9gpxr"
Jul 24 17:30:02.437534 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:02.437492    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6432af27-9gpxr"]
Jul 24 17:30:02.439551 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:30:02.439526    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d2ebaf4_a581_4df7_9700_07ad8f70a8d5.slice/crio-aaa002fd1db1de08612890e703521ff6fb013cebfd09e01e262444711587bcd5 WatchSource:0}: Error finding container aaa002fd1db1de08612890e703521ff6fb013cebfd09e01e262444711587bcd5: Status 404 returned error can't find the container with id aaa002fd1db1de08612890e703521ff6fb013cebfd09e01e262444711587bcd5
Jul 24 17:30:03.246846 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:03.246815    2582 generic.go:356] "Generic (PLEG): container finished" podID="3d2ebaf4-a581-4df7-9700-07ad8f70a8d5" containerID="47c2812e9fc372f9427ee0ef040de2bf631b286d11502eec58ea6ee98184b0bb" exitCode=0
Jul 24 17:30:03.247268 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:03.246879    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6432af27-9gpxr" event={"ID":"3d2ebaf4-a581-4df7-9700-07ad8f70a8d5","Type":"ContainerDied","Data":"47c2812e9fc372f9427ee0ef040de2bf631b286d11502eec58ea6ee98184b0bb"}
Jul 24 17:30:03.247268 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:03.246921    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6432af27-9gpxr" event={"ID":"3d2ebaf4-a581-4df7-9700-07ad8f70a8d5","Type":"ContainerStarted","Data":"aaa002fd1db1de08612890e703521ff6fb013cebfd09e01e262444711587bcd5"}
Jul 24 17:30:03.377472 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:03.377443    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748570-dkn8q"
Jul 24 17:30:03.417231 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:03.417202    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-6432af27-29748570-6mf2w"
Jul 24 17:30:04.252826 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:04.252800    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748570-dkn8q"
Jul 24 17:30:04.253274 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:04.252798    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748570-dkn8q" event={"ID":"13d4ee84-9d27-4c0e-8c6f-3239cc098b7e","Type":"ContainerDied","Data":"f2a2bfaa3817218e0abf82f7b51ae74ee3e7847b2757fb2db2d8638af036fa4e"}
Jul 24 17:30:04.253274 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:04.252933    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f2a2bfaa3817218e0abf82f7b51ae74ee3e7847b2757fb2db2d8638af036fa4e"
Jul 24 17:30:04.254030 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:04.254015    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-6432af27-29748570-6mf2w"
Jul 24 17:30:04.254121 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:04.254067    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-6432af27-29748570-6mf2w" event={"ID":"5678ea27-806e-4738-8685-f3bda5fe2547","Type":"ContainerDied","Data":"09e1735413d841fd5e8f205391edb3eb8822bb4a3d7c816a968f48d19fb1f08e"}
Jul 24 17:30:04.254121 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:04.254108    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="09e1735413d841fd5e8f205391edb3eb8822bb4a3d7c816a968f48d19fb1f08e"
Jul 24 17:30:04.383651 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:04.383627    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6432af27-9gpxr"
Jul 24 17:30:04.511254 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:04.511151    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d2ebaf4-a581-4df7-9700-07ad8f70a8d5-maas-api-service-ca\") pod \"3d2ebaf4-a581-4df7-9700-07ad8f70a8d5\" (UID: \"3d2ebaf4-a581-4df7-9700-07ad8f70a8d5\") "
Jul 24 17:30:04.511566 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:04.511539    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d2ebaf4-a581-4df7-9700-07ad8f70a8d5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3d2ebaf4-a581-4df7-9700-07ad8f70a8d5" (UID: "3d2ebaf4-a581-4df7-9700-07ad8f70a8d5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:30:04.612025 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:04.611987    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d2ebaf4-a581-4df7-9700-07ad8f70a8d5-maas-api-service-ca\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:30:05.259895 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:05.259867    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6432af27-9gpxr"
Jul 24 17:30:05.260322 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:05.259866    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6432af27-9gpxr" event={"ID":"3d2ebaf4-a581-4df7-9700-07ad8f70a8d5","Type":"ContainerDied","Data":"aaa002fd1db1de08612890e703521ff6fb013cebfd09e01e262444711587bcd5"}
Jul 24 17:30:05.260322 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:05.260001    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aaa002fd1db1de08612890e703521ff6fb013cebfd09e01e262444711587bcd5"
Jul 24 17:30:12.450726 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:12.450687    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-6432af27-29748570-6mf2w"]
Jul 24 17:30:12.456408 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:12.456380    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-6432af27-29748570-6mf2w"]
Jul 24 17:30:13.763315 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:13.763281    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5678ea27-806e-4738-8685-f3bda5fe2547" path="/var/lib/kubelet/pods/5678ea27-806e-4738-8685-f3bda5fe2547/volumes"
Jul 24 17:30:15.572008 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:15.571974    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:30:17.080809 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:17.080771    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6432af27-9gpxr"]
Jul 24 17:30:17.085293 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:17.085263    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6432af27-9gpxr"]
Jul 24 17:30:17.763616 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:17.763586    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d2ebaf4-a581-4df7-9700-07ad8f70a8d5" path="/var/lib/kubelet/pods/3d2ebaf4-a581-4df7-9700-07ad8f70a8d5/volumes"
Jul 24 17:30:31.695747 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:31.695636    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:30:52.191216 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:52.191173    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1f7abc01-qm47w"]
Jul 24 17:30:52.191814 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:52.191632    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13d4ee84-9d27-4c0e-8c6f-3239cc098b7e" containerName="cleanup"
Jul 24 17:30:52.191814 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:52.191652    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="13d4ee84-9d27-4c0e-8c6f-3239cc098b7e" containerName="cleanup"
Jul 24 17:30:52.191814 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:52.191664    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d2ebaf4-a581-4df7-9700-07ad8f70a8d5" containerName="revoke-keys"
Jul 24 17:30:52.191814 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:52.191689    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d2ebaf4-a581-4df7-9700-07ad8f70a8d5" containerName="revoke-keys"
Jul 24 17:30:52.191814 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:52.191708    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5678ea27-806e-4738-8685-f3bda5fe2547" containerName="cleanup"
Jul 24 17:30:52.191814 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:52.191716    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5678ea27-806e-4738-8685-f3bda5fe2547" containerName="cleanup"
Jul 24 17:30:52.191814 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:52.191798    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5678ea27-806e-4738-8685-f3bda5fe2547" containerName="cleanup"
Jul 24 17:30:52.191814 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:52.191812    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="13d4ee84-9d27-4c0e-8c6f-3239cc098b7e" containerName="cleanup"
Jul 24 17:30:52.191814 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:52.191819    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d2ebaf4-a581-4df7-9700-07ad8f70a8d5" containerName="revoke-keys"
Jul 24 17:30:52.194927 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:52.194906    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1f7abc01-qm47w"
Jul 24 17:30:52.197350 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:52.197329    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tdqg2\""
Jul 24 17:30:52.197448 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:52.197374    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 17:30:52.203342 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:52.203320    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1f7abc01-qm47w"]
Jul 24 17:30:52.338462 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:52.338425    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fe96f24-7090-4e9f-9703-9c6ec4a786ce-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-1f7abc01-qm47w\" (UID: \"2fe96f24-7090-4e9f-9703-9c6ec4a786ce\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1f7abc01-qm47w"
Jul 24 17:30:52.439927 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:52.439890    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fe96f24-7090-4e9f-9703-9c6ec4a786ce-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-1f7abc01-qm47w\" (UID: \"2fe96f24-7090-4e9f-9703-9c6ec4a786ce\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1f7abc01-qm47w"
Jul 24 17:30:52.440516 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:52.440494    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fe96f24-7090-4e9f-9703-9c6ec4a786ce-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-1f7abc01-qm47w\" (UID: \"2fe96f24-7090-4e9f-9703-9c6ec4a786ce\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1f7abc01-qm47w"
Jul 24 17:30:52.506096 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:52.506065    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1f7abc01-qm47w"
Jul 24 17:30:52.644877 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:52.644846    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1f7abc01-qm47w"]
Jul 24 17:30:52.648174 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:30:52.648147    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fe96f24_7090_4e9f_9703_9c6ec4a786ce.slice/crio-efdff27f1d6320e6feddf866d110275e378de0b91d04a1abfc8c2ff2232101c9 WatchSource:0}: Error finding container efdff27f1d6320e6feddf866d110275e378de0b91d04a1abfc8c2ff2232101c9: Status 404 returned error can't find the container with id efdff27f1d6320e6feddf866d110275e378de0b91d04a1abfc8c2ff2232101c9
Jul 24 17:30:53.493205 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:53.493173    2582 generic.go:356] "Generic (PLEG): container finished" podID="2fe96f24-7090-4e9f-9703-9c6ec4a786ce" containerID="bc36685c99d66415441cfb75eff7b371c50816367b8e7d4512d117c2944cfd4c" exitCode=0
Jul 24 17:30:53.493581 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:53.493226    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1f7abc01-qm47w" event={"ID":"2fe96f24-7090-4e9f-9703-9c6ec4a786ce","Type":"ContainerDied","Data":"bc36685c99d66415441cfb75eff7b371c50816367b8e7d4512d117c2944cfd4c"}
Jul 24 17:30:53.493581 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:53.493263    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1f7abc01-qm47w" event={"ID":"2fe96f24-7090-4e9f-9703-9c6ec4a786ce","Type":"ContainerStarted","Data":"efdff27f1d6320e6feddf866d110275e378de0b91d04a1abfc8c2ff2232101c9"}
Jul 24 17:30:54.622373 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:54.622348    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1f7abc01-qm47w"
Jul 24 17:30:54.759303 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:54.759207    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fe96f24-7090-4e9f-9703-9c6ec4a786ce-maas-api-service-ca\") pod \"2fe96f24-7090-4e9f-9703-9c6ec4a786ce\" (UID: \"2fe96f24-7090-4e9f-9703-9c6ec4a786ce\") "
Jul 24 17:30:54.759558 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:54.759538    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fe96f24-7090-4e9f-9703-9c6ec4a786ce-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2fe96f24-7090-4e9f-9703-9c6ec4a786ce" (UID: "2fe96f24-7090-4e9f-9703-9c6ec4a786ce"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:30:54.860293 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:54.860255    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fe96f24-7090-4e9f-9703-9c6ec4a786ce-maas-api-service-ca\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:30:55.504798 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:55.504763    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1f7abc01-qm47w" event={"ID":"2fe96f24-7090-4e9f-9703-9c6ec4a786ce","Type":"ContainerDied","Data":"efdff27f1d6320e6feddf866d110275e378de0b91d04a1abfc8c2ff2232101c9"}
Jul 24 17:30:55.504798 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:55.504791    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1f7abc01-qm47w"
Jul 24 17:30:55.505080 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:30:55.504812    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="efdff27f1d6320e6feddf866d110275e378de0b91d04a1abfc8c2ff2232101c9"
Jul 24 17:31:06.079843 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:06.079806    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:31:07.269894 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:07.269856    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1f7abc01-qm47w"]
Jul 24 17:31:07.272879 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:07.272853    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1f7abc01-qm47w"]
Jul 24 17:31:07.763128 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:07.763094    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fe96f24-7090-4e9f-9703-9c6ec4a786ce" path="/var/lib/kubelet/pods/2fe96f24-7090-4e9f-9703-9c6ec4a786ce/volumes"
Jul 24 17:31:11.191463 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:11.191422    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1f216bac-75894d6c6d-hr7wf"]
Jul 24 17:31:11.191988 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:11.191911    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fe96f24-7090-4e9f-9703-9c6ec4a786ce" containerName="revoke-keys"
Jul 24 17:31:11.191988 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:11.191930    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fe96f24-7090-4e9f-9703-9c6ec4a786ce" containerName="revoke-keys"
Jul 24 17:31:11.192100 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:11.192026    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fe96f24-7090-4e9f-9703-9c6ec4a786ce" containerName="revoke-keys"
Jul 24 17:31:11.195052 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:11.195031    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1f216bac-75894d6c6d-hr7wf"
Jul 24 17:31:11.199022 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:11.198999    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-1f216bac-dockercfg-bq82x\""
Jul 24 17:31:11.199382 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:11.199366    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-1f216bac\""
Jul 24 17:31:11.206839 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:11.206818    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1f216bac-75894d6c6d-hr7wf"]
Jul 24 17:31:11.301357 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:11.301321    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gg6kx\" (UniqueName: \"kubernetes.io/projected/dfe2c778-ac97-4e7f-a0c0-8a341f94b29c-kube-api-access-gg6kx\") pod \"payload-pre-processing-e2e-ait-1f216bac-75894d6c6d-hr7wf\" (UID: \"dfe2c778-ac97-4e7f-a0c0-8a341f94b29c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1f216bac-75894d6c6d-hr7wf"
Jul 24 17:31:11.301540 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:11.301366    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfe2c778-ac97-4e7f-a0c0-8a341f94b29c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-1f216bac-75894d6c6d-hr7wf\" (UID: \"dfe2c778-ac97-4e7f-a0c0-8a341f94b29c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1f216bac-75894d6c6d-hr7wf"
Jul 24 17:31:11.402836 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:11.402805    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfe2c778-ac97-4e7f-a0c0-8a341f94b29c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-1f216bac-75894d6c6d-hr7wf\" (UID: \"dfe2c778-ac97-4e7f-a0c0-8a341f94b29c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1f216bac-75894d6c6d-hr7wf"
Jul 24 17:31:11.403030 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:11.402894    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg6kx\" (UniqueName: \"kubernetes.io/projected/dfe2c778-ac97-4e7f-a0c0-8a341f94b29c-kube-api-access-gg6kx\") pod \"payload-pre-processing-e2e-ait-1f216bac-75894d6c6d-hr7wf\" (UID: \"dfe2c778-ac97-4e7f-a0c0-8a341f94b29c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1f216bac-75894d6c6d-hr7wf"
Jul 24 17:31:11.403541 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:11.403515    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfe2c778-ac97-4e7f-a0c0-8a341f94b29c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-1f216bac-75894d6c6d-hr7wf\" (UID: \"dfe2c778-ac97-4e7f-a0c0-8a341f94b29c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1f216bac-75894d6c6d-hr7wf"
Jul 24 17:31:11.411032 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:11.411002    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg6kx\" (UniqueName: \"kubernetes.io/projected/dfe2c778-ac97-4e7f-a0c0-8a341f94b29c-kube-api-access-gg6kx\") pod \"payload-pre-processing-e2e-ait-1f216bac-75894d6c6d-hr7wf\" (UID: \"dfe2c778-ac97-4e7f-a0c0-8a341f94b29c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1f216bac-75894d6c6d-hr7wf"
Jul 24 17:31:11.506085 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:11.506053    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1f216bac-75894d6c6d-hr7wf"
Jul 24 17:31:11.635555 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:11.635531    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1f216bac-75894d6c6d-hr7wf"]
Jul 24 17:31:11.637165 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:31:11.637132    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe2c778_ac97_4e7f_a0c0_8a341f94b29c.slice/crio-f1b58d3ae12c32ad7f4d635abb3d1f18d520ac1977b8b081447be8ea9b984c47 WatchSource:0}: Error finding container f1b58d3ae12c32ad7f4d635abb3d1f18d520ac1977b8b081447be8ea9b984c47: Status 404 returned error can't find the container with id f1b58d3ae12c32ad7f4d635abb3d1f18d520ac1977b8b081447be8ea9b984c47
Jul 24 17:31:11.639378 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:11.639354    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 17:31:12.594545 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:12.594503    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1f216bac-75894d6c6d-hr7wf" event={"ID":"dfe2c778-ac97-4e7f-a0c0-8a341f94b29c","Type":"ContainerStarted","Data":"f1b58d3ae12c32ad7f4d635abb3d1f18d520ac1977b8b081447be8ea9b984c47"}
Jul 24 17:31:13.601335 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:13.601297    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1f216bac-75894d6c6d-hr7wf" event={"ID":"dfe2c778-ac97-4e7f-a0c0-8a341f94b29c","Type":"ContainerStarted","Data":"c8eb06ddab21894c8066d28d365ae3eabad4656cc76368af7de3a1627e030dac"}
Jul 24 17:31:13.601734 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:13.601392    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-1f216bac-75894d6c6d-hr7wf"
Jul 24 17:31:13.620065 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:13.620008    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-1f216bac-75894d6c6d-hr7wf" podStartSLOduration=1.067050034 podStartE2EDuration="2.619991342s" totalImagesPullingTime="1.552941308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:31:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:31:13.61740279 +0000 UTC m=+1664.433377405" watchObservedRunningTime="2026-07-24 17:31:13.619991342 +0000 UTC m=+1664.435965995"
Jul 24 17:31:17.377912 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:17.377874    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:31:24.609254 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:24.609219    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-1f216bac-75894d6c6d-hr7wf"
Jul 24 17:31:36.288658 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:36.288616    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f216bac-pkclk"]
Jul 24 17:31:36.291867 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:36.291845    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f216bac-pkclk"
Jul 24 17:31:36.298602 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:36.298582    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 17:31:36.298735 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:36.298627    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tdqg2\""
Jul 24 17:31:36.305028 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:36.305003    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f216bac-pkclk"]
Jul 24 17:31:36.426525 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:36.426483    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d83f1172-dcde-410a-ae02-a691f27e983b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-1f216bac-pkclk\" (UID: \"d83f1172-dcde-410a-ae02-a691f27e983b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f216bac-pkclk"
Jul 24 17:31:36.527104 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:36.527066    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d83f1172-dcde-410a-ae02-a691f27e983b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-1f216bac-pkclk\" (UID: \"d83f1172-dcde-410a-ae02-a691f27e983b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f216bac-pkclk"
Jul 24 17:31:36.527714 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:36.527694    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d83f1172-dcde-410a-ae02-a691f27e983b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-1f216bac-pkclk\" (UID: \"d83f1172-dcde-410a-ae02-a691f27e983b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f216bac-pkclk"
Jul 24 17:31:36.602073 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:36.601976    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f216bac-pkclk"
Jul 24 17:31:36.745904 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:36.745878    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f216bac-pkclk"]
Jul 24 17:31:36.747286 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:31:36.747262    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd83f1172_dcde_410a_ae02_a691f27e983b.slice/crio-00321051ec3796e083508f2e92413f88b9678af0f77a75f3b381b2b231f7bdb4 WatchSource:0}: Error finding container 00321051ec3796e083508f2e92413f88b9678af0f77a75f3b381b2b231f7bdb4: Status 404 returned error can't find the container with id 00321051ec3796e083508f2e92413f88b9678af0f77a75f3b381b2b231f7bdb4
Jul 24 17:31:37.723367 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:37.723282    2582 generic.go:356] "Generic (PLEG): container finished" podID="d83f1172-dcde-410a-ae02-a691f27e983b" containerID="7077b584ac8ca4b534a05d974ea6c5b7dffd33d7d0ae1281cc5f21994ff58f23" exitCode=0
Jul 24 17:31:37.723734 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:37.723379    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f216bac-pkclk" event={"ID":"d83f1172-dcde-410a-ae02-a691f27e983b","Type":"ContainerDied","Data":"7077b584ac8ca4b534a05d974ea6c5b7dffd33d7d0ae1281cc5f21994ff58f23"}
Jul 24 17:31:37.723734 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:37.723426    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f216bac-pkclk" event={"ID":"d83f1172-dcde-410a-ae02-a691f27e983b","Type":"ContainerStarted","Data":"00321051ec3796e083508f2e92413f88b9678af0f77a75f3b381b2b231f7bdb4"}
Jul 24 17:31:38.854308 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:38.854282    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f216bac-pkclk"
Jul 24 17:31:38.950268 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:38.950238    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d83f1172-dcde-410a-ae02-a691f27e983b-maas-api-service-ca\") pod \"d83f1172-dcde-410a-ae02-a691f27e983b\" (UID: \"d83f1172-dcde-410a-ae02-a691f27e983b\") "
Jul 24 17:31:38.950600 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:38.950575    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d83f1172-dcde-410a-ae02-a691f27e983b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d83f1172-dcde-410a-ae02-a691f27e983b" (UID: "d83f1172-dcde-410a-ae02-a691f27e983b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:31:39.050988 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:39.050953    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d83f1172-dcde-410a-ae02-a691f27e983b-maas-api-service-ca\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:31:39.734359 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:39.734333    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f216bac-pkclk"
Jul 24 17:31:39.734542 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:39.734321    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f216bac-pkclk" event={"ID":"d83f1172-dcde-410a-ae02-a691f27e983b","Type":"ContainerDied","Data":"00321051ec3796e083508f2e92413f88b9678af0f77a75f3b381b2b231f7bdb4"}
Jul 24 17:31:39.734542 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:39.734489    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="00321051ec3796e083508f2e92413f88b9678af0f77a75f3b381b2b231f7bdb4"
Jul 24 17:31:46.949641 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:46.949604    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1f216bac-75894d6c6d-hr7wf"]
Jul 24 17:31:46.950064 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:46.949889    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-1f216bac-75894d6c6d-hr7wf" podUID="dfe2c778-ac97-4e7f-a0c0-8a341f94b29c" containerName="payload-pre-processing" containerID="cri-o://c8eb06ddab21894c8066d28d365ae3eabad4656cc76368af7de3a1627e030dac" gracePeriod=30
Jul 24 17:31:47.195274 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:47.195247    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1f216bac-75894d6c6d-hr7wf"
Jul 24 17:31:47.327043 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:47.327001    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gg6kx\" (UniqueName: \"kubernetes.io/projected/dfe2c778-ac97-4e7f-a0c0-8a341f94b29c-kube-api-access-gg6kx\") pod \"dfe2c778-ac97-4e7f-a0c0-8a341f94b29c\" (UID: \"dfe2c778-ac97-4e7f-a0c0-8a341f94b29c\") "
Jul 24 17:31:47.327043 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:47.327052    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfe2c778-ac97-4e7f-a0c0-8a341f94b29c-plugins-config-volume\") pod \"dfe2c778-ac97-4e7f-a0c0-8a341f94b29c\" (UID: \"dfe2c778-ac97-4e7f-a0c0-8a341f94b29c\") "
Jul 24 17:31:47.327442 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:47.327414    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfe2c778-ac97-4e7f-a0c0-8a341f94b29c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dfe2c778-ac97-4e7f-a0c0-8a341f94b29c" (UID: "dfe2c778-ac97-4e7f-a0c0-8a341f94b29c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:31:47.329285 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:47.329259    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfe2c778-ac97-4e7f-a0c0-8a341f94b29c-kube-api-access-gg6kx" (OuterVolumeSpecName: "kube-api-access-gg6kx") pod "dfe2c778-ac97-4e7f-a0c0-8a341f94b29c" (UID: "dfe2c778-ac97-4e7f-a0c0-8a341f94b29c"). InnerVolumeSpecName "kube-api-access-gg6kx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:31:47.428042 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:47.428013    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gg6kx\" (UniqueName: \"kubernetes.io/projected/dfe2c778-ac97-4e7f-a0c0-8a341f94b29c-kube-api-access-gg6kx\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:31:47.428042 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:47.428038    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dfe2c778-ac97-4e7f-a0c0-8a341f94b29c-plugins-config-volume\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:31:47.781645 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:47.781608    2582 generic.go:356] "Generic (PLEG): container finished" podID="dfe2c778-ac97-4e7f-a0c0-8a341f94b29c" containerID="c8eb06ddab21894c8066d28d365ae3eabad4656cc76368af7de3a1627e030dac" exitCode=0
Jul 24 17:31:47.781645 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:47.781646    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1f216bac-75894d6c6d-hr7wf"
Jul 24 17:31:47.781875 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:47.781699    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1f216bac-75894d6c6d-hr7wf" event={"ID":"dfe2c778-ac97-4e7f-a0c0-8a341f94b29c","Type":"ContainerDied","Data":"c8eb06ddab21894c8066d28d365ae3eabad4656cc76368af7de3a1627e030dac"}
Jul 24 17:31:47.781875 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:47.781746    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1f216bac-75894d6c6d-hr7wf" event={"ID":"dfe2c778-ac97-4e7f-a0c0-8a341f94b29c","Type":"ContainerDied","Data":"f1b58d3ae12c32ad7f4d635abb3d1f18d520ac1977b8b081447be8ea9b984c47"}
Jul 24 17:31:47.781875 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:47.781780    2582 scope.go:117] "RemoveContainer" containerID="c8eb06ddab21894c8066d28d365ae3eabad4656cc76368af7de3a1627e030dac"
Jul 24 17:31:47.790571 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:47.790552    2582 scope.go:117] "RemoveContainer" containerID="c8eb06ddab21894c8066d28d365ae3eabad4656cc76368af7de3a1627e030dac"
Jul 24 17:31:47.790842 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:31:47.790819    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8eb06ddab21894c8066d28d365ae3eabad4656cc76368af7de3a1627e030dac\": container with ID starting with c8eb06ddab21894c8066d28d365ae3eabad4656cc76368af7de3a1627e030dac not found: ID does not exist" containerID="c8eb06ddab21894c8066d28d365ae3eabad4656cc76368af7de3a1627e030dac"
Jul 24 17:31:47.790920 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:47.790851    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8eb06ddab21894c8066d28d365ae3eabad4656cc76368af7de3a1627e030dac"} err="failed to get container status \"c8eb06ddab21894c8066d28d365ae3eabad4656cc76368af7de3a1627e030dac\": rpc error: code = NotFound desc = could not find container \"c8eb06ddab21894c8066d28d365ae3eabad4656cc76368af7de3a1627e030dac\": container with ID starting with c8eb06ddab21894c8066d28d365ae3eabad4656cc76368af7de3a1627e030dac not found: ID does not exist"
Jul 24 17:31:47.798787 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:47.798762    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1f216bac-75894d6c6d-hr7wf"]
Jul 24 17:31:47.803027 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:47.803006    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1f216bac-75894d6c6d-hr7wf"]
Jul 24 17:31:49.763035 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:49.763006    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfe2c778-ac97-4e7f-a0c0-8a341f94b29c" path="/var/lib/kubelet/pods/dfe2c778-ac97-4e7f-a0c0-8a341f94b29c/volumes"
Jul 24 17:31:49.879392 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:49.879353    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:31:51.347681 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:51.347590    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f216bac-pkclk"]
Jul 24 17:31:51.350876 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:51.350854    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1f216bac-pkclk"]
Jul 24 17:31:51.763926 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:51.763892    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d83f1172-dcde-410a-ae02-a691f27e983b" path="/var/lib/kubelet/pods/d83f1172-dcde-410a-ae02-a691f27e983b/volumes"
Jul 24 17:31:56.454109 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:56.454070    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-deb90cc5-57947d4468-779xw"]
Jul 24 17:31:56.454599 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:56.454409    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfe2c778-ac97-4e7f-a0c0-8a341f94b29c" containerName="payload-pre-processing"
Jul 24 17:31:56.454599 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:56.454420    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfe2c778-ac97-4e7f-a0c0-8a341f94b29c" containerName="payload-pre-processing"
Jul 24 17:31:56.454599 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:56.454439    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d83f1172-dcde-410a-ae02-a691f27e983b" containerName="revoke-keys"
Jul 24 17:31:56.454599 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:56.454444    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d83f1172-dcde-410a-ae02-a691f27e983b" containerName="revoke-keys"
Jul 24 17:31:56.454599 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:56.454495    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d83f1172-dcde-410a-ae02-a691f27e983b" containerName="revoke-keys"
Jul 24 17:31:56.454599 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:56.454504    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfe2c778-ac97-4e7f-a0c0-8a341f94b29c" containerName="payload-pre-processing"
Jul 24 17:31:56.458602 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:56.458584    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-deb90cc5-57947d4468-779xw"
Jul 24 17:31:56.461211 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:56.461189    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-deb90cc5\""
Jul 24 17:31:56.461321 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:56.461189    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-deb90cc5-dockercfg-fprmp\""
Jul 24 17:31:56.468659 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:56.468633    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-deb90cc5-57947d4468-779xw"]
Jul 24 17:31:56.500032 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:56.500003    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-deb90cc5-6f47bd8894-4zmg7"]
Jul 24 17:31:56.501159 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:56.501136    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad79268e-b97a-419c-a2cb-6d862acb02bb-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-deb90cc5-57947d4468-779xw\" (UID: \"ad79268e-b97a-419c-a2cb-6d862acb02bb\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-deb90cc5-57947d4468-779xw"
Jul 24 17:31:56.501226 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:56.501203    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mndbk\" (UniqueName: \"kubernetes.io/projected/ad79268e-b97a-419c-a2cb-6d862acb02bb-kube-api-access-mndbk\") pod \"payload-pre-processing-e2e-derive-deb90cc5-57947d4468-779xw\" (UID: \"ad79268e-b97a-419c-a2cb-6d862acb02bb\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-deb90cc5-57947d4468-779xw"
Jul 24 17:31:56.503380 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:56.503364    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-deb90cc5-6f47bd8894-4zmg7"
Jul 24 17:31:56.515450 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:56.515426    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-deb90cc5-6f47bd8894-4zmg7"]
Jul 24 17:31:56.601995 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:56.601958    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mndbk\" (UniqueName: \"kubernetes.io/projected/ad79268e-b97a-419c-a2cb-6d862acb02bb-kube-api-access-mndbk\") pod \"payload-pre-processing-e2e-derive-deb90cc5-57947d4468-779xw\" (UID: \"ad79268e-b97a-419c-a2cb-6d862acb02bb\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-deb90cc5-57947d4468-779xw"
Jul 24 17:31:56.602162 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:56.602003    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96952\" (UniqueName: \"kubernetes.io/projected/1945a6a2-fbd4-48ea-a1fb-eab578a83eb4-kube-api-access-96952\") pod \"payload-processing-e2e-derive-deb90cc5-6f47bd8894-4zmg7\" (UID: \"1945a6a2-fbd4-48ea-a1fb-eab578a83eb4\") " pod="openshift-ingress/payload-processing-e2e-derive-deb90cc5-6f47bd8894-4zmg7"
Jul 24 17:31:56.602162 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:56.602033    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1945a6a2-fbd4-48ea-a1fb-eab578a83eb4-plugins-config-volume\") pod \"payload-processing-e2e-derive-deb90cc5-6f47bd8894-4zmg7\" (UID: \"1945a6a2-fbd4-48ea-a1fb-eab578a83eb4\") " pod="openshift-ingress/payload-processing-e2e-derive-deb90cc5-6f47bd8894-4zmg7"
Jul 24 17:31:56.602240 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:56.602149    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad79268e-b97a-419c-a2cb-6d862acb02bb-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-deb90cc5-57947d4468-779xw\" (UID: \"ad79268e-b97a-419c-a2cb-6d862acb02bb\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-deb90cc5-57947d4468-779xw"
Jul 24 17:31:56.602859 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:56.602841    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad79268e-b97a-419c-a2cb-6d862acb02bb-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-deb90cc5-57947d4468-779xw\" (UID: \"ad79268e-b97a-419c-a2cb-6d862acb02bb\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-deb90cc5-57947d4468-779xw"
Jul 24 17:31:56.611227 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:56.611196    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mndbk\" (UniqueName: \"kubernetes.io/projected/ad79268e-b97a-419c-a2cb-6d862acb02bb-kube-api-access-mndbk\") pod \"payload-pre-processing-e2e-derive-deb90cc5-57947d4468-779xw\" (UID: \"ad79268e-b97a-419c-a2cb-6d862acb02bb\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-deb90cc5-57947d4468-779xw"
Jul 24 17:31:56.702969 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:56.702934    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96952\" (UniqueName: \"kubernetes.io/projected/1945a6a2-fbd4-48ea-a1fb-eab578a83eb4-kube-api-access-96952\") pod \"payload-processing-e2e-derive-deb90cc5-6f47bd8894-4zmg7\" (UID: \"1945a6a2-fbd4-48ea-a1fb-eab578a83eb4\") " pod="openshift-ingress/payload-processing-e2e-derive-deb90cc5-6f47bd8894-4zmg7"
Jul 24 17:31:56.702969 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:56.702971    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1945a6a2-fbd4-48ea-a1fb-eab578a83eb4-plugins-config-volume\") pod \"payload-processing-e2e-derive-deb90cc5-6f47bd8894-4zmg7\" (UID: \"1945a6a2-fbd4-48ea-a1fb-eab578a83eb4\") " pod="openshift-ingress/payload-processing-e2e-derive-deb90cc5-6f47bd8894-4zmg7"
Jul 24 17:31:56.703734 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:56.703714    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1945a6a2-fbd4-48ea-a1fb-eab578a83eb4-plugins-config-volume\") pod \"payload-processing-e2e-derive-deb90cc5-6f47bd8894-4zmg7\" (UID: \"1945a6a2-fbd4-48ea-a1fb-eab578a83eb4\") " pod="openshift-ingress/payload-processing-e2e-derive-deb90cc5-6f47bd8894-4zmg7"
Jul 24 17:31:56.710630 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:56.710570    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96952\" (UniqueName: \"kubernetes.io/projected/1945a6a2-fbd4-48ea-a1fb-eab578a83eb4-kube-api-access-96952\") pod \"payload-processing-e2e-derive-deb90cc5-6f47bd8894-4zmg7\" (UID: \"1945a6a2-fbd4-48ea-a1fb-eab578a83eb4\") " pod="openshift-ingress/payload-processing-e2e-derive-deb90cc5-6f47bd8894-4zmg7"
Jul 24 17:31:56.770060 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:56.770032    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-deb90cc5-57947d4468-779xw"
Jul 24 17:31:56.813663 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:56.813631    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-deb90cc5-6f47bd8894-4zmg7"
Jul 24 17:31:56.915418 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:56.915377    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-deb90cc5-57947d4468-779xw"]
Jul 24 17:31:56.917960 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:31:56.917912    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad79268e_b97a_419c_a2cb_6d862acb02bb.slice/crio-fdc84b1412f9403b98262ba81d015dd97026e607c0a3f3ceea4920f429ca6a38 WatchSource:0}: Error finding container fdc84b1412f9403b98262ba81d015dd97026e607c0a3f3ceea4920f429ca6a38: Status 404 returned error can't find the container with id fdc84b1412f9403b98262ba81d015dd97026e607c0a3f3ceea4920f429ca6a38
Jul 24 17:31:56.971259 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:56.971233    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-deb90cc5-6f47bd8894-4zmg7"]
Jul 24 17:31:56.974122 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:31:56.974087    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1945a6a2_fbd4_48ea_a1fb_eab578a83eb4.slice/crio-e67f5b48caa11d63bf47692e12bcd26fa5e54a7bb7418e1771363392cf8ca95c WatchSource:0}: Error finding container e67f5b48caa11d63bf47692e12bcd26fa5e54a7bb7418e1771363392cf8ca95c: Status 404 returned error can't find the container with id e67f5b48caa11d63bf47692e12bcd26fa5e54a7bb7418e1771363392cf8ca95c
Jul 24 17:31:57.838809 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:57.838771    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-deb90cc5-6f47bd8894-4zmg7" event={"ID":"1945a6a2-fbd4-48ea-a1fb-eab578a83eb4","Type":"ContainerStarted","Data":"4ce88320ab11c80b2e07134f7ca636c337987da1fbc8770d09d26607e68edc22"}
Jul 24 17:31:57.839216 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:57.838832    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-deb90cc5-6f47bd8894-4zmg7" event={"ID":"1945a6a2-fbd4-48ea-a1fb-eab578a83eb4","Type":"ContainerStarted","Data":"e67f5b48caa11d63bf47692e12bcd26fa5e54a7bb7418e1771363392cf8ca95c"}
Jul 24 17:31:57.839216 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:57.838876    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-deb90cc5-6f47bd8894-4zmg7"
Jul 24 17:31:57.840488 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:57.840461    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-deb90cc5-57947d4468-779xw" event={"ID":"ad79268e-b97a-419c-a2cb-6d862acb02bb","Type":"ContainerStarted","Data":"26ed295359514e24d02463ca3f89c60a52aaf375cad314cf491403444c7d3e2e"}
Jul 24 17:31:57.840606 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:57.840509    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-deb90cc5-57947d4468-779xw" event={"ID":"ad79268e-b97a-419c-a2cb-6d862acb02bb","Type":"ContainerStarted","Data":"fdc84b1412f9403b98262ba81d015dd97026e607c0a3f3ceea4920f429ca6a38"}
Jul 24 17:31:57.840606 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:57.840548    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-deb90cc5-57947d4468-779xw"
Jul 24 17:31:57.857246 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:57.857210    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-deb90cc5-6f47bd8894-4zmg7" podStartSLOduration=1.857195193 podStartE2EDuration="1.857195193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:31:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:31:57.854492153 +0000 UTC m=+1708.670466832" watchObservedRunningTime="2026-07-24 17:31:57.857195193 +0000 UTC m=+1708.673169807"
Jul 24 17:31:57.871978 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:31:57.871930    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-deb90cc5-57947d4468-779xw" podStartSLOduration=1.871912582 podStartE2EDuration="1.871912582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:31:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:31:57.869299956 +0000 UTC m=+1708.685274572" watchObservedRunningTime="2026-07-24 17:31:57.871912582 +0000 UTC m=+1708.687887205"
Jul 24 17:32:01.778157 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:01.778124    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:32:08.847462 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:08.847431    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-deb90cc5-57947d4468-779xw"
Jul 24 17:32:08.847890 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:08.847586    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-deb90cc5-6f47bd8894-4zmg7"
Jul 24 17:32:20.495746 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:20.495710    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-deb90cc5-8wkld"]
Jul 24 17:32:20.499159 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:20.499142    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-deb90cc5-8wkld"
Jul 24 17:32:20.501762 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:20.501738    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tdqg2\""
Jul 24 17:32:20.502039 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:20.502023    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 17:32:20.508616 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:20.508592    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-deb90cc5-8wkld"]
Jul 24 17:32:20.608597 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:20.608560    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/023c2606-357f-4590-bf1d-d628c16d7b84-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-deb90cc5-8wkld\" (UID: \"023c2606-357f-4590-bf1d-d628c16d7b84\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-deb90cc5-8wkld"
Jul 24 17:32:20.709926 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:20.709887    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/023c2606-357f-4590-bf1d-d628c16d7b84-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-deb90cc5-8wkld\" (UID: \"023c2606-357f-4590-bf1d-d628c16d7b84\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-deb90cc5-8wkld"
Jul 24 17:32:20.710524 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:20.710505    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/023c2606-357f-4590-bf1d-d628c16d7b84-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-deb90cc5-8wkld\" (UID: \"023c2606-357f-4590-bf1d-d628c16d7b84\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-deb90cc5-8wkld"
Jul 24 17:32:20.810652 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:20.810568    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-deb90cc5-8wkld"
Jul 24 17:32:20.940450 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:20.940427    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-deb90cc5-8wkld"]
Jul 24 17:32:20.941998 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:32:20.941972    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod023c2606_357f_4590_bf1d_d628c16d7b84.slice/crio-ac1a10f466941e77c23ef90392865fe11d82973dc84093357ea28892bb6b475c WatchSource:0}: Error finding container ac1a10f466941e77c23ef90392865fe11d82973dc84093357ea28892bb6b475c: Status 404 returned error can't find the container with id ac1a10f466941e77c23ef90392865fe11d82973dc84093357ea28892bb6b475c
Jul 24 17:32:20.966847 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:20.966812    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-deb90cc5-8wkld" event={"ID":"023c2606-357f-4590-bf1d-d628c16d7b84","Type":"ContainerStarted","Data":"ac1a10f466941e77c23ef90392865fe11d82973dc84093357ea28892bb6b475c"}
Jul 24 17:32:21.977923 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:21.977832    2582 generic.go:356] "Generic (PLEG): container finished" podID="023c2606-357f-4590-bf1d-d628c16d7b84" containerID="9d4ea8651ffde9b4a240115cb309c3749320cc3ab7b2d41ac238abd70c7541d3" exitCode=0
Jul 24 17:32:21.977923 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:21.977878    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-deb90cc5-8wkld" event={"ID":"023c2606-357f-4590-bf1d-d628c16d7b84","Type":"ContainerDied","Data":"9d4ea8651ffde9b4a240115cb309c3749320cc3ab7b2d41ac238abd70c7541d3"}
Jul 24 17:32:23.116234 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:23.116211    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-deb90cc5-8wkld"
Jul 24 17:32:23.230140 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:23.230096    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/023c2606-357f-4590-bf1d-d628c16d7b84-maas-api-service-ca\") pod \"023c2606-357f-4590-bf1d-d628c16d7b84\" (UID: \"023c2606-357f-4590-bf1d-d628c16d7b84\") "
Jul 24 17:32:23.230473 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:23.230452    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/023c2606-357f-4590-bf1d-d628c16d7b84-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "023c2606-357f-4590-bf1d-d628c16d7b84" (UID: "023c2606-357f-4590-bf1d-d628c16d7b84"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:32:23.331751 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:23.331713    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/023c2606-357f-4590-bf1d-d628c16d7b84-maas-api-service-ca\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:32:23.989716 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:23.989685    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-deb90cc5-8wkld"
Jul 24 17:32:23.989716 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:23.989698    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-deb90cc5-8wkld" event={"ID":"023c2606-357f-4590-bf1d-d628c16d7b84","Type":"ContainerDied","Data":"ac1a10f466941e77c23ef90392865fe11d82973dc84093357ea28892bb6b475c"}
Jul 24 17:32:23.989957 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:23.989742    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ac1a10f466941e77c23ef90392865fe11d82973dc84093357ea28892bb6b475c"
Jul 24 17:32:30.949635 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:30.949598    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-deb90cc5-6f47bd8894-4zmg7"]
Jul 24 17:32:30.950171 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:30.949876    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-deb90cc5-6f47bd8894-4zmg7" podUID="1945a6a2-fbd4-48ea-a1fb-eab578a83eb4" containerName="payload-processing" containerID="cri-o://4ce88320ab11c80b2e07134f7ca636c337987da1fbc8770d09d26607e68edc22" gracePeriod=30
Jul 24 17:32:30.963364 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:30.963051    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-deb90cc5-57947d4468-779xw"]
Jul 24 17:32:30.963364 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:30.963288    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-deb90cc5-57947d4468-779xw" podUID="ad79268e-b97a-419c-a2cb-6d862acb02bb" containerName="payload-pre-processing" containerID="cri-o://26ed295359514e24d02463ca3f89c60a52aaf375cad314cf491403444c7d3e2e" gracePeriod=30
Jul 24 17:32:31.231767 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:31.231733    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-deb90cc5-6f47bd8894-4zmg7"
Jul 24 17:32:31.255497 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:31.255469    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-deb90cc5-57947d4468-779xw"
Jul 24 17:32:31.407491 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:31.407458    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad79268e-b97a-419c-a2cb-6d862acb02bb-plugins-config-volume\") pod \"ad79268e-b97a-419c-a2cb-6d862acb02bb\" (UID: \"ad79268e-b97a-419c-a2cb-6d862acb02bb\") "
Jul 24 17:32:31.407491 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:31.407493    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-96952\" (UniqueName: \"kubernetes.io/projected/1945a6a2-fbd4-48ea-a1fb-eab578a83eb4-kube-api-access-96952\") pod \"1945a6a2-fbd4-48ea-a1fb-eab578a83eb4\" (UID: \"1945a6a2-fbd4-48ea-a1fb-eab578a83eb4\") "
Jul 24 17:32:31.407741 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:31.407529    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1945a6a2-fbd4-48ea-a1fb-eab578a83eb4-plugins-config-volume\") pod \"1945a6a2-fbd4-48ea-a1fb-eab578a83eb4\" (UID: \"1945a6a2-fbd4-48ea-a1fb-eab578a83eb4\") "
Jul 24 17:32:31.407741 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:31.407626    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mndbk\" (UniqueName: \"kubernetes.io/projected/ad79268e-b97a-419c-a2cb-6d862acb02bb-kube-api-access-mndbk\") pod \"ad79268e-b97a-419c-a2cb-6d862acb02bb\" (UID: \"ad79268e-b97a-419c-a2cb-6d862acb02bb\") "
Jul 24 17:32:31.407904 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:31.407878    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad79268e-b97a-419c-a2cb-6d862acb02bb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ad79268e-b97a-419c-a2cb-6d862acb02bb" (UID: "ad79268e-b97a-419c-a2cb-6d862acb02bb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:32:31.407965 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:31.407936    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1945a6a2-fbd4-48ea-a1fb-eab578a83eb4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1945a6a2-fbd4-48ea-a1fb-eab578a83eb4" (UID: "1945a6a2-fbd4-48ea-a1fb-eab578a83eb4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:32:31.409594 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:31.409572    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad79268e-b97a-419c-a2cb-6d862acb02bb-kube-api-access-mndbk" (OuterVolumeSpecName: "kube-api-access-mndbk") pod "ad79268e-b97a-419c-a2cb-6d862acb02bb" (UID: "ad79268e-b97a-419c-a2cb-6d862acb02bb"). InnerVolumeSpecName "kube-api-access-mndbk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:32:31.409688 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:31.409604    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1945a6a2-fbd4-48ea-a1fb-eab578a83eb4-kube-api-access-96952" (OuterVolumeSpecName: "kube-api-access-96952") pod "1945a6a2-fbd4-48ea-a1fb-eab578a83eb4" (UID: "1945a6a2-fbd4-48ea-a1fb-eab578a83eb4"). InnerVolumeSpecName "kube-api-access-96952". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:32:31.508933 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:31.508903    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mndbk\" (UniqueName: \"kubernetes.io/projected/ad79268e-b97a-419c-a2cb-6d862acb02bb-kube-api-access-mndbk\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:32:31.508933 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:31.508930    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad79268e-b97a-419c-a2cb-6d862acb02bb-plugins-config-volume\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:32:31.509125 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:31.508941    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-96952\" (UniqueName: \"kubernetes.io/projected/1945a6a2-fbd4-48ea-a1fb-eab578a83eb4-kube-api-access-96952\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:32:31.509125 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:31.508949    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1945a6a2-fbd4-48ea-a1fb-eab578a83eb4-plugins-config-volume\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:32:32.031905 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:32.031809    2582 generic.go:356] "Generic (PLEG): container finished" podID="1945a6a2-fbd4-48ea-a1fb-eab578a83eb4" containerID="4ce88320ab11c80b2e07134f7ca636c337987da1fbc8770d09d26607e68edc22" exitCode=0
Jul 24 17:32:32.031905 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:32.031863    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-deb90cc5-6f47bd8894-4zmg7"
Jul 24 17:32:32.032417 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:32.031904    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-deb90cc5-6f47bd8894-4zmg7" event={"ID":"1945a6a2-fbd4-48ea-a1fb-eab578a83eb4","Type":"ContainerDied","Data":"4ce88320ab11c80b2e07134f7ca636c337987da1fbc8770d09d26607e68edc22"}
Jul 24 17:32:32.032417 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:32.031965    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-deb90cc5-6f47bd8894-4zmg7" event={"ID":"1945a6a2-fbd4-48ea-a1fb-eab578a83eb4","Type":"ContainerDied","Data":"e67f5b48caa11d63bf47692e12bcd26fa5e54a7bb7418e1771363392cf8ca95c"}
Jul 24 17:32:32.032417 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:32.032000    2582 scope.go:117] "RemoveContainer" containerID="4ce88320ab11c80b2e07134f7ca636c337987da1fbc8770d09d26607e68edc22"
Jul 24 17:32:32.033448 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:32.033424    2582 generic.go:356] "Generic (PLEG): container finished" podID="ad79268e-b97a-419c-a2cb-6d862acb02bb" containerID="26ed295359514e24d02463ca3f89c60a52aaf375cad314cf491403444c7d3e2e" exitCode=0
Jul 24 17:32:32.033580 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:32.033468    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-deb90cc5-57947d4468-779xw"
Jul 24 17:32:32.033580 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:32.033503    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-deb90cc5-57947d4468-779xw" event={"ID":"ad79268e-b97a-419c-a2cb-6d862acb02bb","Type":"ContainerDied","Data":"26ed295359514e24d02463ca3f89c60a52aaf375cad314cf491403444c7d3e2e"}
Jul 24 17:32:32.033580 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:32.033553    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-deb90cc5-57947d4468-779xw" event={"ID":"ad79268e-b97a-419c-a2cb-6d862acb02bb","Type":"ContainerDied","Data":"fdc84b1412f9403b98262ba81d015dd97026e607c0a3f3ceea4920f429ca6a38"}
Jul 24 17:32:32.041450 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:32.041433    2582 scope.go:117] "RemoveContainer" containerID="4ce88320ab11c80b2e07134f7ca636c337987da1fbc8770d09d26607e68edc22"
Jul 24 17:32:32.041756 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:32:32.041737    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ce88320ab11c80b2e07134f7ca636c337987da1fbc8770d09d26607e68edc22\": container with ID starting with 4ce88320ab11c80b2e07134f7ca636c337987da1fbc8770d09d26607e68edc22 not found: ID does not exist" containerID="4ce88320ab11c80b2e07134f7ca636c337987da1fbc8770d09d26607e68edc22"
Jul 24 17:32:32.041819 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:32.041766    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ce88320ab11c80b2e07134f7ca636c337987da1fbc8770d09d26607e68edc22"} err="failed to get container status \"4ce88320ab11c80b2e07134f7ca636c337987da1fbc8770d09d26607e68edc22\": rpc error: code = NotFound desc = could not find container \"4ce88320ab11c80b2e07134f7ca636c337987da1fbc8770d09d26607e68edc22\": container with ID starting with 4ce88320ab11c80b2e07134f7ca636c337987da1fbc8770d09d26607e68edc22 not found: ID does not exist"
Jul 24 17:32:32.041819 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:32.041782    2582 scope.go:117] "RemoveContainer" containerID="26ed295359514e24d02463ca3f89c60a52aaf375cad314cf491403444c7d3e2e"
Jul 24 17:32:32.049616 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:32.049596    2582 scope.go:117] "RemoveContainer" containerID="26ed295359514e24d02463ca3f89c60a52aaf375cad314cf491403444c7d3e2e"
Jul 24 17:32:32.049882 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:32:32.049865    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26ed295359514e24d02463ca3f89c60a52aaf375cad314cf491403444c7d3e2e\": container with ID starting with 26ed295359514e24d02463ca3f89c60a52aaf375cad314cf491403444c7d3e2e not found: ID does not exist" containerID="26ed295359514e24d02463ca3f89c60a52aaf375cad314cf491403444c7d3e2e"
Jul 24 17:32:32.049948 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:32.049887    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26ed295359514e24d02463ca3f89c60a52aaf375cad314cf491403444c7d3e2e"} err="failed to get container status \"26ed295359514e24d02463ca3f89c60a52aaf375cad314cf491403444c7d3e2e\": rpc error: code = NotFound desc = could not find container \"26ed295359514e24d02463ca3f89c60a52aaf375cad314cf491403444c7d3e2e\": container with ID starting with 26ed295359514e24d02463ca3f89c60a52aaf375cad314cf491403444c7d3e2e not found: ID does not exist"
Jul 24 17:32:32.054701 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:32.054679    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-deb90cc5-57947d4468-779xw"]
Jul 24 17:32:32.063019 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:32.062994    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-deb90cc5-57947d4468-779xw"]
Jul 24 17:32:32.079819 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:32.079787    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-deb90cc5-6f47bd8894-4zmg7"]
Jul 24 17:32:32.086408 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:32.086380    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-deb90cc5-6f47bd8894-4zmg7"]
Jul 24 17:32:33.581191 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:33.581150    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:32:33.763968 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:33.763936    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1945a6a2-fbd4-48ea-a1fb-eab578a83eb4" path="/var/lib/kubelet/pods/1945a6a2-fbd4-48ea-a1fb-eab578a83eb4/volumes"
Jul 24 17:32:33.764280 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:33.764268    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad79268e-b97a-419c-a2cb-6d862acb02bb" path="/var/lib/kubelet/pods/ad79268e-b97a-419c-a2cb-6d862acb02bb/volumes"
Jul 24 17:32:35.545153 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:35.545110    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-deb90cc5-8wkld"]
Jul 24 17:32:35.547400 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:35.547377    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-deb90cc5-8wkld"]
Jul 24 17:32:35.764133 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:32:35.764098    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="023c2606-357f-4590-bf1d-d628c16d7b84" path="/var/lib/kubelet/pods/023c2606-357f-4590-bf1d-d628c16d7b84/volumes"
Jul 24 17:33:29.768261 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:33:29.768233    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d6w2m_9f3e23c6-31a7-4e7b-83df-d6eee1335b7a/ovn-acl-logging/0.log"
Jul 24 17:33:29.771570 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:33:29.771548    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d6w2m_9f3e23c6-31a7-4e7b-83df-d6eee1335b7a/ovn-acl-logging/0.log"
Jul 24 17:34:02.093587 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:02.093545    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:34:08.578333 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:08.578299    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:34:19.604252 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:19.604217    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:34:23.915109 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:23.915071    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0bdb575b-5cd5f7b95b-8hbd6"]
Jul 24 17:34:23.915483 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:23.915404    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1945a6a2-fbd4-48ea-a1fb-eab578a83eb4" containerName="payload-processing"
Jul 24 17:34:23.915483 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:23.915417    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1945a6a2-fbd4-48ea-a1fb-eab578a83eb4" containerName="payload-processing"
Jul 24 17:34:23.915483 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:23.915436    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="023c2606-357f-4590-bf1d-d628c16d7b84" containerName="revoke-keys"
Jul 24 17:34:23.915483 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:23.915442    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="023c2606-357f-4590-bf1d-d628c16d7b84" containerName="revoke-keys"
Jul 24 17:34:23.915483 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:23.915452    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad79268e-b97a-419c-a2cb-6d862acb02bb" containerName="payload-pre-processing"
Jul 24 17:34:23.915483 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:23.915458    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad79268e-b97a-419c-a2cb-6d862acb02bb" containerName="payload-pre-processing"
Jul 24 17:34:23.915681 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:23.915511    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="023c2606-357f-4590-bf1d-d628c16d7b84" containerName="revoke-keys"
Jul 24 17:34:23.915681 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:23.915520    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1945a6a2-fbd4-48ea-a1fb-eab578a83eb4" containerName="payload-processing"
Jul 24 17:34:23.915681 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:23.915527    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad79268e-b97a-419c-a2cb-6d862acb02bb" containerName="payload-pre-processing"
Jul 24 17:34:23.918359 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:23.918343    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0bdb575b-5cd5f7b95b-8hbd6"
Jul 24 17:34:23.920861 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:23.920837    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-0bdb575b\""
Jul 24 17:34:23.928055 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:23.928032    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0bdb575b-5cd5f7b95b-8hbd6"]
Jul 24 17:34:23.949514 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:23.949474    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0bdb575b-698b9659c4-ltgkz"]
Jul 24 17:34:23.953344 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:23.953326    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0bdb575b-698b9659c4-ltgkz"
Jul 24 17:34:23.955783 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:23.955765    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-0bdb575b-dockercfg-6gl7g\""
Jul 24 17:34:23.963973 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:23.963945    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0bdb575b-698b9659c4-ltgkz"]
Jul 24 17:34:24.057157 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:24.057122    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf7e5176-c30e-4f88-8e56-b0ef90cba022-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-0bdb575b-5cd5f7b95b-8hbd6\" (UID: \"cf7e5176-c30e-4f88-8e56-b0ef90cba022\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0bdb575b-5cd5f7b95b-8hbd6"
Jul 24 17:34:24.057157 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:24.057170    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vp78\" (UniqueName: \"kubernetes.io/projected/cf7e5176-c30e-4f88-8e56-b0ef90cba022-kube-api-access-5vp78\") pod \"payload-pre-processing-e2e-mt-0bdb575b-5cd5f7b95b-8hbd6\" (UID: \"cf7e5176-c30e-4f88-8e56-b0ef90cba022\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0bdb575b-5cd5f7b95b-8hbd6"
Jul 24 17:34:24.057398 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:24.057200    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btxlw\" (UniqueName: \"kubernetes.io/projected/dd404724-a6d7-4bbe-9105-37de3aa4e5e7-kube-api-access-btxlw\") pod \"payload-processing-e2e-mt-0bdb575b-698b9659c4-ltgkz\" (UID: \"dd404724-a6d7-4bbe-9105-37de3aa4e5e7\") " pod="openshift-ingress/payload-processing-e2e-mt-0bdb575b-698b9659c4-ltgkz"
Jul 24 17:34:24.057398 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:24.057283    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd404724-a6d7-4bbe-9105-37de3aa4e5e7-plugins-config-volume\") pod \"payload-processing-e2e-mt-0bdb575b-698b9659c4-ltgkz\" (UID: \"dd404724-a6d7-4bbe-9105-37de3aa4e5e7\") " pod="openshift-ingress/payload-processing-e2e-mt-0bdb575b-698b9659c4-ltgkz"
Jul 24 17:34:24.158266 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:24.158230    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf7e5176-c30e-4f88-8e56-b0ef90cba022-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-0bdb575b-5cd5f7b95b-8hbd6\" (UID: \"cf7e5176-c30e-4f88-8e56-b0ef90cba022\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0bdb575b-5cd5f7b95b-8hbd6"
Jul 24 17:34:24.158470 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:24.158276    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vp78\" (UniqueName: \"kubernetes.io/projected/cf7e5176-c30e-4f88-8e56-b0ef90cba022-kube-api-access-5vp78\") pod \"payload-pre-processing-e2e-mt-0bdb575b-5cd5f7b95b-8hbd6\" (UID: \"cf7e5176-c30e-4f88-8e56-b0ef90cba022\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0bdb575b-5cd5f7b95b-8hbd6"
Jul 24 17:34:24.158470 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:24.158301    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btxlw\" (UniqueName: \"kubernetes.io/projected/dd404724-a6d7-4bbe-9105-37de3aa4e5e7-kube-api-access-btxlw\") pod \"payload-processing-e2e-mt-0bdb575b-698b9659c4-ltgkz\" (UID: \"dd404724-a6d7-4bbe-9105-37de3aa4e5e7\") " pod="openshift-ingress/payload-processing-e2e-mt-0bdb575b-698b9659c4-ltgkz"
Jul 24 17:34:24.158470 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:24.158334    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd404724-a6d7-4bbe-9105-37de3aa4e5e7-plugins-config-volume\") pod \"payload-processing-e2e-mt-0bdb575b-698b9659c4-ltgkz\" (UID: \"dd404724-a6d7-4bbe-9105-37de3aa4e5e7\") " pod="openshift-ingress/payload-processing-e2e-mt-0bdb575b-698b9659c4-ltgkz"
Jul 24 17:34:24.159070 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:24.159046    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd404724-a6d7-4bbe-9105-37de3aa4e5e7-plugins-config-volume\") pod \"payload-processing-e2e-mt-0bdb575b-698b9659c4-ltgkz\" (UID: \"dd404724-a6d7-4bbe-9105-37de3aa4e5e7\") " pod="openshift-ingress/payload-processing-e2e-mt-0bdb575b-698b9659c4-ltgkz"
Jul 24 17:34:24.159164 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:24.159049    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf7e5176-c30e-4f88-8e56-b0ef90cba022-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-0bdb575b-5cd5f7b95b-8hbd6\" (UID: \"cf7e5176-c30e-4f88-8e56-b0ef90cba022\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0bdb575b-5cd5f7b95b-8hbd6"
Jul 24 17:34:24.166255 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:24.166203    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btxlw\" (UniqueName: \"kubernetes.io/projected/dd404724-a6d7-4bbe-9105-37de3aa4e5e7-kube-api-access-btxlw\") pod \"payload-processing-e2e-mt-0bdb575b-698b9659c4-ltgkz\" (UID: \"dd404724-a6d7-4bbe-9105-37de3aa4e5e7\") " pod="openshift-ingress/payload-processing-e2e-mt-0bdb575b-698b9659c4-ltgkz"
Jul 24 17:34:24.166335 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:24.166322    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vp78\" (UniqueName: \"kubernetes.io/projected/cf7e5176-c30e-4f88-8e56-b0ef90cba022-kube-api-access-5vp78\") pod \"payload-pre-processing-e2e-mt-0bdb575b-5cd5f7b95b-8hbd6\" (UID: \"cf7e5176-c30e-4f88-8e56-b0ef90cba022\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0bdb575b-5cd5f7b95b-8hbd6"
Jul 24 17:34:24.230227 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:24.230187    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0bdb575b-5cd5f7b95b-8hbd6"
Jul 24 17:34:24.264688 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:24.264649    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0bdb575b-698b9659c4-ltgkz"
Jul 24 17:34:24.376441 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:24.376410    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0bdb575b-5cd5f7b95b-8hbd6"]
Jul 24 17:34:24.377203 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:34:24.377162    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf7e5176_c30e_4f88_8e56_b0ef90cba022.slice/crio-54255c19f84038ef0ed4c566092bef54d54982f079d1510ae9804c814d6ccdda WatchSource:0}: Error finding container 54255c19f84038ef0ed4c566092bef54d54982f079d1510ae9804c814d6ccdda: Status 404 returned error can't find the container with id 54255c19f84038ef0ed4c566092bef54d54982f079d1510ae9804c814d6ccdda
Jul 24 17:34:24.410123 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:24.410100    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0bdb575b-698b9659c4-ltgkz"]
Jul 24 17:34:24.412056 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:34:24.412027    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd404724_a6d7_4bbe_9105_37de3aa4e5e7.slice/crio-8a5cd0e46660238cb3c15ae16e23163ab7affb8cb397fe53f53c3d519285816c WatchSource:0}: Error finding container 8a5cd0e46660238cb3c15ae16e23163ab7affb8cb397fe53f53c3d519285816c: Status 404 returned error can't find the container with id 8a5cd0e46660238cb3c15ae16e23163ab7affb8cb397fe53f53c3d519285816c
Jul 24 17:34:24.611316 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:24.611276    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0bdb575b-5cd5f7b95b-8hbd6" event={"ID":"cf7e5176-c30e-4f88-8e56-b0ef90cba022","Type":"ContainerStarted","Data":"46abc2218f6be0392d07d84819f75213240deeed7197a0cc33afe1af6ce62be7"}
Jul 24 17:34:24.611520 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:24.611336    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0bdb575b-5cd5f7b95b-8hbd6" event={"ID":"cf7e5176-c30e-4f88-8e56-b0ef90cba022","Type":"ContainerStarted","Data":"54255c19f84038ef0ed4c566092bef54d54982f079d1510ae9804c814d6ccdda"}
Jul 24 17:34:24.611520 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:24.611365    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-0bdb575b-5cd5f7b95b-8hbd6"
Jul 24 17:34:24.612724 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:24.612696    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0bdb575b-698b9659c4-ltgkz" event={"ID":"dd404724-a6d7-4bbe-9105-37de3aa4e5e7","Type":"ContainerStarted","Data":"7f33ca8c60e24380905a522981efd90ba357826ed199f9396637860e89b3ae54"}
Jul 24 17:34:24.612847 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:24.612739    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0bdb575b-698b9659c4-ltgkz" event={"ID":"dd404724-a6d7-4bbe-9105-37de3aa4e5e7","Type":"ContainerStarted","Data":"8a5cd0e46660238cb3c15ae16e23163ab7affb8cb397fe53f53c3d519285816c"}
Jul 24 17:34:24.612847 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:24.612770    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-0bdb575b-698b9659c4-ltgkz"
Jul 24 17:34:24.627856 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:24.627809    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-0bdb575b-5cd5f7b95b-8hbd6" podStartSLOduration=1.627792423 podStartE2EDuration="1.627792423s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:34:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:34:24.626756467 +0000 UTC m=+1855.442731084" watchObservedRunningTime="2026-07-24 17:34:24.627792423 +0000 UTC m=+1855.443767037"
Jul 24 17:34:24.644571 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:24.644518    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-0bdb575b-698b9659c4-ltgkz" podStartSLOduration=1.644503805 podStartE2EDuration="1.644503805s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:34:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:34:24.642613643 +0000 UTC m=+1855.458588262" watchObservedRunningTime="2026-07-24 17:34:24.644503805 +0000 UTC m=+1855.460478420"
Jul 24 17:34:32.981394 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:32.981357    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:34:34.595357 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:34.595314    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0bdb575b-d2mgj"]
Jul 24 17:34:34.600131 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:34.600099    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0bdb575b-d2mgj"
Jul 24 17:34:34.602389 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:34.602367    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tdqg2\""
Jul 24 17:34:34.602521 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:34.602464    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 17:34:34.606299 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:34.606270    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0bdb575b-d2mgj"]
Jul 24 17:34:34.636915 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:34.636877    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/10fb1714-8f59-44bd-bba1-e2c8081b241c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0bdb575b-d2mgj\" (UID: \"10fb1714-8f59-44bd-bba1-e2c8081b241c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0bdb575b-d2mgj"
Jul 24 17:34:34.738350 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:34.738316    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/10fb1714-8f59-44bd-bba1-e2c8081b241c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0bdb575b-d2mgj\" (UID: \"10fb1714-8f59-44bd-bba1-e2c8081b241c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0bdb575b-d2mgj"
Jul 24 17:34:34.738944 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:34.738925    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/10fb1714-8f59-44bd-bba1-e2c8081b241c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0bdb575b-d2mgj\" (UID: \"10fb1714-8f59-44bd-bba1-e2c8081b241c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0bdb575b-d2mgj"
Jul 24 17:34:34.912579 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:34.912498    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0bdb575b-d2mgj"
Jul 24 17:34:35.047306 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:35.047108    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0bdb575b-d2mgj"]
Jul 24 17:34:35.049468 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:34:35.049443    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10fb1714_8f59_44bd_bba1_e2c8081b241c.slice/crio-7a50e33e9330cbf93adae549798620a3dda14fff2e1baeb260c7508af3466e46 WatchSource:0}: Error finding container 7a50e33e9330cbf93adae549798620a3dda14fff2e1baeb260c7508af3466e46: Status 404 returned error can't find the container with id 7a50e33e9330cbf93adae549798620a3dda14fff2e1baeb260c7508af3466e46
Jul 24 17:34:35.619838 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:35.619747    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-0bdb575b-698b9659c4-ltgkz"
Jul 24 17:34:35.620222 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:35.619844    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-0bdb575b-5cd5f7b95b-8hbd6"
Jul 24 17:34:35.673800 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:35.673758    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0bdb575b-d2mgj" event={"ID":"10fb1714-8f59-44bd-bba1-e2c8081b241c","Type":"ContainerStarted","Data":"ca48161df30dea7a07410391e95692f969a1f6e5191aabe08a286e9fa423c866"}
Jul 24 17:34:35.673959 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:35.673822    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0bdb575b-d2mgj" event={"ID":"10fb1714-8f59-44bd-bba1-e2c8081b241c","Type":"ContainerStarted","Data":"7a50e33e9330cbf93adae549798620a3dda14fff2e1baeb260c7508af3466e46"}
Jul 24 17:34:35.697879 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:35.697829    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0bdb575b-d2mgj" podStartSLOduration=1.6978139620000001 podStartE2EDuration="1.697813962s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:34:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:34:35.696074311 +0000 UTC m=+1866.512048926" watchObservedRunningTime="2026-07-24 17:34:35.697813962 +0000 UTC m=+1866.513788578"
Jul 24 17:34:36.680634 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:36.680601    2582 generic.go:356] "Generic (PLEG): container finished" podID="10fb1714-8f59-44bd-bba1-e2c8081b241c" containerID="ca48161df30dea7a07410391e95692f969a1f6e5191aabe08a286e9fa423c866" exitCode=0
Jul 24 17:34:36.681058 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:36.680648    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0bdb575b-d2mgj" event={"ID":"10fb1714-8f59-44bd-bba1-e2c8081b241c","Type":"ContainerDied","Data":"ca48161df30dea7a07410391e95692f969a1f6e5191aabe08a286e9fa423c866"}
Jul 24 17:34:37.814229 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:37.814201    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0bdb575b-d2mgj"
Jul 24 17:34:37.861129 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:37.861094    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/10fb1714-8f59-44bd-bba1-e2c8081b241c-maas-api-service-ca\") pod \"10fb1714-8f59-44bd-bba1-e2c8081b241c\" (UID: \"10fb1714-8f59-44bd-bba1-e2c8081b241c\") "
Jul 24 17:34:37.861431 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:37.861409    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10fb1714-8f59-44bd-bba1-e2c8081b241c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "10fb1714-8f59-44bd-bba1-e2c8081b241c" (UID: "10fb1714-8f59-44bd-bba1-e2c8081b241c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:34:37.962091 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:37.961998    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/10fb1714-8f59-44bd-bba1-e2c8081b241c-maas-api-service-ca\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:34:38.692584 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:38.692555    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0bdb575b-d2mgj"
Jul 24 17:34:38.692584 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:38.692580    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0bdb575b-d2mgj" event={"ID":"10fb1714-8f59-44bd-bba1-e2c8081b241c","Type":"ContainerDied","Data":"7a50e33e9330cbf93adae549798620a3dda14fff2e1baeb260c7508af3466e46"}
Jul 24 17:34:38.692880 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:38.692626    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7a50e33e9330cbf93adae549798620a3dda14fff2e1baeb260c7508af3466e46"
Jul 24 17:34:45.367175 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:45.367144    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0bdb575b-698b9659c4-ltgkz"]
Jul 24 17:34:45.367687 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:45.367326    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-0bdb575b-698b9659c4-ltgkz" podUID="dd404724-a6d7-4bbe-9105-37de3aa4e5e7" containerName="payload-processing" containerID="cri-o://7f33ca8c60e24380905a522981efd90ba357826ed199f9396637860e89b3ae54" gracePeriod=30
Jul 24 17:34:45.382083 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:45.382054    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0bdb575b-5cd5f7b95b-8hbd6"]
Jul 24 17:34:45.382310 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:45.382285    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-0bdb575b-5cd5f7b95b-8hbd6" podUID="cf7e5176-c30e-4f88-8e56-b0ef90cba022" containerName="payload-pre-processing" containerID="cri-o://46abc2218f6be0392d07d84819f75213240deeed7197a0cc33afe1af6ce62be7" gracePeriod=30
Jul 24 17:34:45.653899 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:45.653866    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0bdb575b-698b9659c4-ltgkz"
Jul 24 17:34:45.657165 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:45.657145    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0bdb575b-5cd5f7b95b-8hbd6"
Jul 24 17:34:45.724734 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:45.724691    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vp78\" (UniqueName: \"kubernetes.io/projected/cf7e5176-c30e-4f88-8e56-b0ef90cba022-kube-api-access-5vp78\") pod \"cf7e5176-c30e-4f88-8e56-b0ef90cba022\" (UID: \"cf7e5176-c30e-4f88-8e56-b0ef90cba022\") "
Jul 24 17:34:45.724923 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:45.724744    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-btxlw\" (UniqueName: \"kubernetes.io/projected/dd404724-a6d7-4bbe-9105-37de3aa4e5e7-kube-api-access-btxlw\") pod \"dd404724-a6d7-4bbe-9105-37de3aa4e5e7\" (UID: \"dd404724-a6d7-4bbe-9105-37de3aa4e5e7\") "
Jul 24 17:34:45.724923 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:45.724870    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf7e5176-c30e-4f88-8e56-b0ef90cba022-plugins-config-volume\") pod \"cf7e5176-c30e-4f88-8e56-b0ef90cba022\" (UID: \"cf7e5176-c30e-4f88-8e56-b0ef90cba022\") "
Jul 24 17:34:45.724923 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:45.724889    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd404724-a6d7-4bbe-9105-37de3aa4e5e7-plugins-config-volume\") pod \"dd404724-a6d7-4bbe-9105-37de3aa4e5e7\" (UID: \"dd404724-a6d7-4bbe-9105-37de3aa4e5e7\") "
Jul 24 17:34:45.725272 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:45.725242    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf7e5176-c30e-4f88-8e56-b0ef90cba022-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cf7e5176-c30e-4f88-8e56-b0ef90cba022" (UID: "cf7e5176-c30e-4f88-8e56-b0ef90cba022"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:34:45.725392 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:45.725352    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd404724-a6d7-4bbe-9105-37de3aa4e5e7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dd404724-a6d7-4bbe-9105-37de3aa4e5e7" (UID: "dd404724-a6d7-4bbe-9105-37de3aa4e5e7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:34:45.726938 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:45.726912    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf7e5176-c30e-4f88-8e56-b0ef90cba022-kube-api-access-5vp78" (OuterVolumeSpecName: "kube-api-access-5vp78") pod "cf7e5176-c30e-4f88-8e56-b0ef90cba022" (UID: "cf7e5176-c30e-4f88-8e56-b0ef90cba022"). InnerVolumeSpecName "kube-api-access-5vp78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:34:45.727023 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:45.726946    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd404724-a6d7-4bbe-9105-37de3aa4e5e7-kube-api-access-btxlw" (OuterVolumeSpecName: "kube-api-access-btxlw") pod "dd404724-a6d7-4bbe-9105-37de3aa4e5e7" (UID: "dd404724-a6d7-4bbe-9105-37de3aa4e5e7"). InnerVolumeSpecName "kube-api-access-btxlw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:34:45.730507 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:45.730482    2582 generic.go:356] "Generic (PLEG): container finished" podID="cf7e5176-c30e-4f88-8e56-b0ef90cba022" containerID="46abc2218f6be0392d07d84819f75213240deeed7197a0cc33afe1af6ce62be7" exitCode=0
Jul 24 17:34:45.730594 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:45.730522    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0bdb575b-5cd5f7b95b-8hbd6"
Jul 24 17:34:45.730594 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:45.730557    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0bdb575b-5cd5f7b95b-8hbd6" event={"ID":"cf7e5176-c30e-4f88-8e56-b0ef90cba022","Type":"ContainerDied","Data":"46abc2218f6be0392d07d84819f75213240deeed7197a0cc33afe1af6ce62be7"}
Jul 24 17:34:45.730726 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:45.730625    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0bdb575b-5cd5f7b95b-8hbd6" event={"ID":"cf7e5176-c30e-4f88-8e56-b0ef90cba022","Type":"ContainerDied","Data":"54255c19f84038ef0ed4c566092bef54d54982f079d1510ae9804c814d6ccdda"}
Jul 24 17:34:45.730726 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:45.730647    2582 scope.go:117] "RemoveContainer" containerID="46abc2218f6be0392d07d84819f75213240deeed7197a0cc33afe1af6ce62be7"
Jul 24 17:34:45.731802 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:45.731766    2582 generic.go:356] "Generic (PLEG): container finished" podID="dd404724-a6d7-4bbe-9105-37de3aa4e5e7" containerID="7f33ca8c60e24380905a522981efd90ba357826ed199f9396637860e89b3ae54" exitCode=0
Jul 24 17:34:45.731869 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:45.731795    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0bdb575b-698b9659c4-ltgkz" event={"ID":"dd404724-a6d7-4bbe-9105-37de3aa4e5e7","Type":"ContainerDied","Data":"7f33ca8c60e24380905a522981efd90ba357826ed199f9396637860e89b3ae54"}
Jul 24 17:34:45.731869 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:45.731824    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0bdb575b-698b9659c4-ltgkz"
Jul 24 17:34:45.731869 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:45.731839    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0bdb575b-698b9659c4-ltgkz" event={"ID":"dd404724-a6d7-4bbe-9105-37de3aa4e5e7","Type":"ContainerDied","Data":"8a5cd0e46660238cb3c15ae16e23163ab7affb8cb397fe53f53c3d519285816c"}
Jul 24 17:34:45.740501 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:45.740429    2582 scope.go:117] "RemoveContainer" containerID="46abc2218f6be0392d07d84819f75213240deeed7197a0cc33afe1af6ce62be7"
Jul 24 17:34:45.741040 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:34:45.741016    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46abc2218f6be0392d07d84819f75213240deeed7197a0cc33afe1af6ce62be7\": container with ID starting with 46abc2218f6be0392d07d84819f75213240deeed7197a0cc33afe1af6ce62be7 not found: ID does not exist" containerID="46abc2218f6be0392d07d84819f75213240deeed7197a0cc33afe1af6ce62be7"
Jul 24 17:34:45.741123 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:45.741045    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46abc2218f6be0392d07d84819f75213240deeed7197a0cc33afe1af6ce62be7"} err="failed to get container status \"46abc2218f6be0392d07d84819f75213240deeed7197a0cc33afe1af6ce62be7\": rpc error: code = NotFound desc = could not find container \"46abc2218f6be0392d07d84819f75213240deeed7197a0cc33afe1af6ce62be7\": container with ID starting with 46abc2218f6be0392d07d84819f75213240deeed7197a0cc33afe1af6ce62be7 not found: ID does not exist"
Jul 24 17:34:45.741123 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:45.741062    2582 scope.go:117] "RemoveContainer" containerID="7f33ca8c60e24380905a522981efd90ba357826ed199f9396637860e89b3ae54"
Jul 24 17:34:45.749147 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:45.749128    2582 scope.go:117] "RemoveContainer" containerID="7f33ca8c60e24380905a522981efd90ba357826ed199f9396637860e89b3ae54"
Jul 24 17:34:45.749403 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:34:45.749384    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f33ca8c60e24380905a522981efd90ba357826ed199f9396637860e89b3ae54\": container with ID starting with 7f33ca8c60e24380905a522981efd90ba357826ed199f9396637860e89b3ae54 not found: ID does not exist" containerID="7f33ca8c60e24380905a522981efd90ba357826ed199f9396637860e89b3ae54"
Jul 24 17:34:45.749450 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:45.749409    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f33ca8c60e24380905a522981efd90ba357826ed199f9396637860e89b3ae54"} err="failed to get container status \"7f33ca8c60e24380905a522981efd90ba357826ed199f9396637860e89b3ae54\": rpc error: code = NotFound desc = could not find container \"7f33ca8c60e24380905a522981efd90ba357826ed199f9396637860e89b3ae54\": container with ID starting with 7f33ca8c60e24380905a522981efd90ba357826ed199f9396637860e89b3ae54 not found: ID does not exist"
Jul 24 17:34:45.755742 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:45.755721    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0bdb575b-5cd5f7b95b-8hbd6"]
Jul 24 17:34:45.763992 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:45.763971    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0bdb575b-5cd5f7b95b-8hbd6"]
Jul 24 17:34:45.774570 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:45.774544    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0bdb575b-698b9659c4-ltgkz"]
Jul 24 17:34:45.780711 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:45.780688    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0bdb575b-698b9659c4-ltgkz"]
Jul 24 17:34:45.826024 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:45.825991    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf7e5176-c30e-4f88-8e56-b0ef90cba022-plugins-config-volume\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:34:45.826024 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:45.826018    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd404724-a6d7-4bbe-9105-37de3aa4e5e7-plugins-config-volume\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:34:45.826024 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:45.826030    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vp78\" (UniqueName: \"kubernetes.io/projected/cf7e5176-c30e-4f88-8e56-b0ef90cba022-kube-api-access-5vp78\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:34:45.826229 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:45.826039    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btxlw\" (UniqueName: \"kubernetes.io/projected/dd404724-a6d7-4bbe-9105-37de3aa4e5e7-kube-api-access-btxlw\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:34:46.619459 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:46.619412    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-mt-0bdb575b-698b9659c4-ltgkz" podUID="dd404724-a6d7-4bbe-9105-37de3aa4e5e7" containerName="payload-processing" probeResult="failure" output="dial tcp 10.133.0.42:9004: i/o timeout"
Jul 24 17:34:46.619946 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:46.619416    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-mt-0bdb575b-5cd5f7b95b-8hbd6" podUID="cf7e5176-c30e-4f88-8e56-b0ef90cba022" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.41:9004: i/o timeout"
Jul 24 17:34:47.763151 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:47.763109    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf7e5176-c30e-4f88-8e56-b0ef90cba022" path="/var/lib/kubelet/pods/cf7e5176-c30e-4f88-8e56-b0ef90cba022/volumes"
Jul 24 17:34:47.763659 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:47.763594    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd404724-a6d7-4bbe-9105-37de3aa4e5e7" path="/var/lib/kubelet/pods/dd404724-a6d7-4bbe-9105-37de3aa4e5e7/volumes"
Jul 24 17:34:48.301235 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:48.301196    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:34:49.677738 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:49.674733    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0bdb575b-d2mgj"]
Jul 24 17:34:49.680481 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:49.680454    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0bdb575b-d2mgj"]
Jul 24 17:34:49.763201 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:34:49.763164    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10fb1714-8f59-44bd-bba1-e2c8081b241c" path="/var/lib/kubelet/pods/10fb1714-8f59-44bd-bba1-e2c8081b241c/volumes"
Jul 24 17:35:20.927516 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:20.927485    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-4fe99dd6-667b8bd88-pbdtg"]
Jul 24 17:35:20.929766 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:20.927832    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd404724-a6d7-4bbe-9105-37de3aa4e5e7" containerName="payload-processing"
Jul 24 17:35:20.929766 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:20.927845    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd404724-a6d7-4bbe-9105-37de3aa4e5e7" containerName="payload-processing"
Jul 24 17:35:20.929766 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:20.927863    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf7e5176-c30e-4f88-8e56-b0ef90cba022" containerName="payload-pre-processing"
Jul 24 17:35:20.929766 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:20.927869    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf7e5176-c30e-4f88-8e56-b0ef90cba022" containerName="payload-pre-processing"
Jul 24 17:35:20.929766 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:20.927881    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10fb1714-8f59-44bd-bba1-e2c8081b241c" containerName="revoke-keys"
Jul 24 17:35:20.929766 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:20.927887    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="10fb1714-8f59-44bd-bba1-e2c8081b241c" containerName="revoke-keys"
Jul 24 17:35:20.929766 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:20.927935    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf7e5176-c30e-4f88-8e56-b0ef90cba022" containerName="payload-pre-processing"
Jul 24 17:35:20.929766 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:20.927945    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd404724-a6d7-4bbe-9105-37de3aa4e5e7" containerName="payload-processing"
Jul 24 17:35:20.929766 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:20.927953    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="10fb1714-8f59-44bd-bba1-e2c8081b241c" containerName="revoke-keys"
Jul 24 17:35:20.930727 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:20.930711    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-4fe99dd6-667b8bd88-pbdtg"
Jul 24 17:35:20.934837 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:20.934815    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-4fe99dd6-dockercfg-2vwcm\""
Jul 24 17:35:20.935004 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:20.934989    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-4fe99dd6\""
Jul 24 17:35:20.943265 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:20.943234    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-4fe99dd6-667b8bd88-pbdtg"]
Jul 24 17:35:20.943607 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:20.943578    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10faccf9-87c0-48fe-9cc2-4a5bff1b5214-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-4fe99dd6-667b8bd88-pbdtg\" (UID: \"10faccf9-87c0-48fe-9cc2-4a5bff1b5214\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-4fe99dd6-667b8bd88-pbdtg"
Jul 24 17:35:20.943750 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:20.943643    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkstx\" (UniqueName: \"kubernetes.io/projected/10faccf9-87c0-48fe-9cc2-4a5bff1b5214-kube-api-access-lkstx\") pod \"payload-pre-processing-e2e-mt-4fe99dd6-667b8bd88-pbdtg\" (UID: \"10faccf9-87c0-48fe-9cc2-4a5bff1b5214\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-4fe99dd6-667b8bd88-pbdtg"
Jul 24 17:35:20.945482 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:20.945460    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-4fe99dd6-78b7d4c7d-j7qmm"]
Jul 24 17:35:20.954001 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:20.953978    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-4fe99dd6-78b7d4c7d-j7qmm"
Jul 24 17:35:20.963162 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:20.963139    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-4fe99dd6-78b7d4c7d-j7qmm"]
Jul 24 17:35:21.044324 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:21.044285    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkstx\" (UniqueName: \"kubernetes.io/projected/10faccf9-87c0-48fe-9cc2-4a5bff1b5214-kube-api-access-lkstx\") pod \"payload-pre-processing-e2e-mt-4fe99dd6-667b8bd88-pbdtg\" (UID: \"10faccf9-87c0-48fe-9cc2-4a5bff1b5214\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-4fe99dd6-667b8bd88-pbdtg"
Jul 24 17:35:21.044503 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:21.044363    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p9r6\" (UniqueName: \"kubernetes.io/projected/7b13ead0-7547-41e7-96cd-f5dcaca22b15-kube-api-access-8p9r6\") pod \"payload-processing-e2e-mt-4fe99dd6-78b7d4c7d-j7qmm\" (UID: \"7b13ead0-7547-41e7-96cd-f5dcaca22b15\") " pod="openshift-ingress/payload-processing-e2e-mt-4fe99dd6-78b7d4c7d-j7qmm"
Jul 24 17:35:21.044503 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:21.044384    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10faccf9-87c0-48fe-9cc2-4a5bff1b5214-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-4fe99dd6-667b8bd88-pbdtg\" (UID: \"10faccf9-87c0-48fe-9cc2-4a5bff1b5214\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-4fe99dd6-667b8bd88-pbdtg"
Jul 24 17:35:21.044503 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:21.044431    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b13ead0-7547-41e7-96cd-f5dcaca22b15-plugins-config-volume\") pod \"payload-processing-e2e-mt-4fe99dd6-78b7d4c7d-j7qmm\" (UID: \"7b13ead0-7547-41e7-96cd-f5dcaca22b15\") " pod="openshift-ingress/payload-processing-e2e-mt-4fe99dd6-78b7d4c7d-j7qmm"
Jul 24 17:35:21.045100 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:21.045081    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10faccf9-87c0-48fe-9cc2-4a5bff1b5214-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-4fe99dd6-667b8bd88-pbdtg\" (UID: \"10faccf9-87c0-48fe-9cc2-4a5bff1b5214\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-4fe99dd6-667b8bd88-pbdtg"
Jul 24 17:35:21.052863 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:21.052837    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkstx\" (UniqueName: \"kubernetes.io/projected/10faccf9-87c0-48fe-9cc2-4a5bff1b5214-kube-api-access-lkstx\") pod \"payload-pre-processing-e2e-mt-4fe99dd6-667b8bd88-pbdtg\" (UID: \"10faccf9-87c0-48fe-9cc2-4a5bff1b5214\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-4fe99dd6-667b8bd88-pbdtg"
Jul 24 17:35:21.144901 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:21.144862    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p9r6\" (UniqueName: \"kubernetes.io/projected/7b13ead0-7547-41e7-96cd-f5dcaca22b15-kube-api-access-8p9r6\") pod \"payload-processing-e2e-mt-4fe99dd6-78b7d4c7d-j7qmm\" (UID: \"7b13ead0-7547-41e7-96cd-f5dcaca22b15\") " pod="openshift-ingress/payload-processing-e2e-mt-4fe99dd6-78b7d4c7d-j7qmm"
Jul 24 17:35:21.145090 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:21.144916    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b13ead0-7547-41e7-96cd-f5dcaca22b15-plugins-config-volume\") pod \"payload-processing-e2e-mt-4fe99dd6-78b7d4c7d-j7qmm\" (UID: \"7b13ead0-7547-41e7-96cd-f5dcaca22b15\") " pod="openshift-ingress/payload-processing-e2e-mt-4fe99dd6-78b7d4c7d-j7qmm"
Jul 24 17:35:21.145597 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:21.145578    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b13ead0-7547-41e7-96cd-f5dcaca22b15-plugins-config-volume\") pod \"payload-processing-e2e-mt-4fe99dd6-78b7d4c7d-j7qmm\" (UID: \"7b13ead0-7547-41e7-96cd-f5dcaca22b15\") " pod="openshift-ingress/payload-processing-e2e-mt-4fe99dd6-78b7d4c7d-j7qmm"
Jul 24 17:35:21.152617 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:21.152591    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p9r6\" (UniqueName: \"kubernetes.io/projected/7b13ead0-7547-41e7-96cd-f5dcaca22b15-kube-api-access-8p9r6\") pod \"payload-processing-e2e-mt-4fe99dd6-78b7d4c7d-j7qmm\" (UID: \"7b13ead0-7547-41e7-96cd-f5dcaca22b15\") " pod="openshift-ingress/payload-processing-e2e-mt-4fe99dd6-78b7d4c7d-j7qmm"
Jul 24 17:35:21.242203 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:21.242176    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-4fe99dd6-667b8bd88-pbdtg"
Jul 24 17:35:21.266174 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:21.266142    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-4fe99dd6-78b7d4c7d-j7qmm"
Jul 24 17:35:21.395875 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:21.395845    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-4fe99dd6-667b8bd88-pbdtg"]
Jul 24 17:35:21.398030 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:35:21.398002    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10faccf9_87c0_48fe_9cc2_4a5bff1b5214.slice/crio-1ccbb938ca7b36848ec86fb85b37d3d69d6de32a6fdaa216816be66d368198c6 WatchSource:0}: Error finding container 1ccbb938ca7b36848ec86fb85b37d3d69d6de32a6fdaa216816be66d368198c6: Status 404 returned error can't find the container with id 1ccbb938ca7b36848ec86fb85b37d3d69d6de32a6fdaa216816be66d368198c6
Jul 24 17:35:21.428835 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:21.428807    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-4fe99dd6-78b7d4c7d-j7qmm"]
Jul 24 17:35:21.432752 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:35:21.432727    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b13ead0_7547_41e7_96cd_f5dcaca22b15.slice/crio-0d6867d73b3a0cccedfcac89b2b3a0c93b051bcc699f3b70b9a320789b14551c WatchSource:0}: Error finding container 0d6867d73b3a0cccedfcac89b2b3a0c93b051bcc699f3b70b9a320789b14551c: Status 404 returned error can't find the container with id 0d6867d73b3a0cccedfcac89b2b3a0c93b051bcc699f3b70b9a320789b14551c
Jul 24 17:35:21.922146 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:21.922106    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-4fe99dd6-78b7d4c7d-j7qmm" event={"ID":"7b13ead0-7547-41e7-96cd-f5dcaca22b15","Type":"ContainerStarted","Data":"1fb1800467fbbb3add2d79cb05a11be4dda7d695688374b1d3d4a61f111f9514"}
Jul 24 17:35:21.922341 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:21.922168    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-4fe99dd6-78b7d4c7d-j7qmm" event={"ID":"7b13ead0-7547-41e7-96cd-f5dcaca22b15","Type":"ContainerStarted","Data":"0d6867d73b3a0cccedfcac89b2b3a0c93b051bcc699f3b70b9a320789b14551c"}
Jul 24 17:35:21.922341 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:21.922225    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-4fe99dd6-78b7d4c7d-j7qmm"
Jul 24 17:35:21.923624 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:21.923598    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-4fe99dd6-667b8bd88-pbdtg" event={"ID":"10faccf9-87c0-48fe-9cc2-4a5bff1b5214","Type":"ContainerStarted","Data":"da050a95f299046e6d15f59c49aa2405374604318792e8b80a022d811b09d616"}
Jul 24 17:35:21.923755 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:21.923645    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-4fe99dd6-667b8bd88-pbdtg" event={"ID":"10faccf9-87c0-48fe-9cc2-4a5bff1b5214","Type":"ContainerStarted","Data":"1ccbb938ca7b36848ec86fb85b37d3d69d6de32a6fdaa216816be66d368198c6"}
Jul 24 17:35:21.923755 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:21.923687    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-4fe99dd6-667b8bd88-pbdtg"
Jul 24 17:35:21.943267 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:21.943207    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-4fe99dd6-78b7d4c7d-j7qmm" podStartSLOduration=1.9431844310000002 podStartE2EDuration="1.943184431s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:35:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:35:21.940703076 +0000 UTC m=+1912.756677691" watchObservedRunningTime="2026-07-24 17:35:21.943184431 +0000 UTC m=+1912.759159050"
Jul 24 17:35:21.959459 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:21.959401    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-4fe99dd6-667b8bd88-pbdtg" podStartSLOduration=1.9593820119999998 podStartE2EDuration="1.959382012s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:35:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:35:21.958983855 +0000 UTC m=+1912.774958470" watchObservedRunningTime="2026-07-24 17:35:21.959382012 +0000 UTC m=+1912.775356629"
Jul 24 17:35:26.381440 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:26.381405    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:35:32.935252 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:32.935221    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-4fe99dd6-667b8bd88-pbdtg"
Jul 24 17:35:32.935635 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:32.935376    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-4fe99dd6-78b7d4c7d-j7qmm"
Jul 24 17:35:51.980555 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:35:51.980514    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:36:09.856277 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:09.856243    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:36:14.379702 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:14.379649    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fe99dd6-khww2"]
Jul 24 17:36:14.383189 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:14.383172    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fe99dd6-khww2"
Jul 24 17:36:14.386434 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:14.386414    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 17:36:14.386523 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:14.386455    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tdqg2\""
Jul 24 17:36:14.391750 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:14.391724    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fe99dd6-khww2"]
Jul 24 17:36:14.401970 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:14.401945    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8fc5e6d-563e-4467-9efa-afb0dc607a24-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-4fe99dd6-khww2\" (UID: \"c8fc5e6d-563e-4467-9efa-afb0dc607a24\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fe99dd6-khww2"
Jul 24 17:36:14.503077 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:14.503038    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8fc5e6d-563e-4467-9efa-afb0dc607a24-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-4fe99dd6-khww2\" (UID: \"c8fc5e6d-563e-4467-9efa-afb0dc607a24\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fe99dd6-khww2"
Jul 24 17:36:14.503757 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:14.503736    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8fc5e6d-563e-4467-9efa-afb0dc607a24-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-4fe99dd6-khww2\" (UID: \"c8fc5e6d-563e-4467-9efa-afb0dc607a24\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fe99dd6-khww2"
Jul 24 17:36:14.694699 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:14.694577    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fe99dd6-khww2"
Jul 24 17:36:14.826867 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:14.826842    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fe99dd6-khww2"]
Jul 24 17:36:14.829606 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:36:14.829578    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8fc5e6d_563e_4467_9efa_afb0dc607a24.slice/crio-aa37f8ffdd4608fae469bfd64f970826cefa011af474ef14dd0e587497b0b279 WatchSource:0}: Error finding container aa37f8ffdd4608fae469bfd64f970826cefa011af474ef14dd0e587497b0b279: Status 404 returned error can't find the container with id aa37f8ffdd4608fae469bfd64f970826cefa011af474ef14dd0e587497b0b279
Jul 24 17:36:15.212184 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:15.212150    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fe99dd6-khww2" event={"ID":"c8fc5e6d-563e-4467-9efa-afb0dc607a24","Type":"ContainerStarted","Data":"ea044b6824bf8f4f0c354effb7dd390829a533090bfa0c1351f3d65edcaa6302"}
Jul 24 17:36:15.212428 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:15.212210    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fe99dd6-khww2" event={"ID":"c8fc5e6d-563e-4467-9efa-afb0dc607a24","Type":"ContainerStarted","Data":"aa37f8ffdd4608fae469bfd64f970826cefa011af474ef14dd0e587497b0b279"}
Jul 24 17:36:15.227733 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:15.227663    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fe99dd6-khww2" podStartSLOduration=1.22764657 podStartE2EDuration="1.22764657s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:36:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:36:15.225928246 +0000 UTC m=+1966.041902860" watchObservedRunningTime="2026-07-24 17:36:15.22764657 +0000 UTC m=+1966.043621184"
Jul 24 17:36:16.219218 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:16.219183    2582 generic.go:356] "Generic (PLEG): container finished" podID="c8fc5e6d-563e-4467-9efa-afb0dc607a24" containerID="ea044b6824bf8f4f0c354effb7dd390829a533090bfa0c1351f3d65edcaa6302" exitCode=0
Jul 24 17:36:16.219218 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:16.219221    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fe99dd6-khww2" event={"ID":"c8fc5e6d-563e-4467-9efa-afb0dc607a24","Type":"ContainerDied","Data":"ea044b6824bf8f4f0c354effb7dd390829a533090bfa0c1351f3d65edcaa6302"}
Jul 24 17:36:17.358179 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:17.358154    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fe99dd6-khww2"
Jul 24 17:36:17.430354 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:17.430321    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8fc5e6d-563e-4467-9efa-afb0dc607a24-maas-api-service-ca\") pod \"c8fc5e6d-563e-4467-9efa-afb0dc607a24\" (UID: \"c8fc5e6d-563e-4467-9efa-afb0dc607a24\") "
Jul 24 17:36:17.430738 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:17.430713    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8fc5e6d-563e-4467-9efa-afb0dc607a24-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c8fc5e6d-563e-4467-9efa-afb0dc607a24" (UID: "c8fc5e6d-563e-4467-9efa-afb0dc607a24"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:36:17.531592 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:17.531555    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8fc5e6d-563e-4467-9efa-afb0dc607a24-maas-api-service-ca\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:36:18.230878 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:18.230851    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fe99dd6-khww2"
Jul 24 17:36:18.231025 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:18.230843    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fe99dd6-khww2" event={"ID":"c8fc5e6d-563e-4467-9efa-afb0dc607a24","Type":"ContainerDied","Data":"aa37f8ffdd4608fae469bfd64f970826cefa011af474ef14dd0e587497b0b279"}
Jul 24 17:36:18.231025 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:18.230985    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa37f8ffdd4608fae469bfd64f970826cefa011af474ef14dd0e587497b0b279"
Jul 24 17:36:28.686957 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:28.686876    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:36:29.827892 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:29.827825    2582 scope.go:117] "RemoveContainer" containerID="47c2812e9fc372f9427ee0ef040de2bf631b286d11502eec58ea6ee98184b0bb"
Jul 24 17:36:29.839018 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:29.839002    2582 scope.go:117] "RemoveContainer" containerID="80148e330667e9150b26229bc07ab6fa84f20b3bbc74614f4a81d4fe2d5ad8be"
Jul 24 17:36:30.030179 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:30.030145    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-4fe99dd6-78b7d4c7d-j7qmm"]
Jul 24 17:36:30.030407 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:30.030384    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-4fe99dd6-78b7d4c7d-j7qmm" podUID="7b13ead0-7547-41e7-96cd-f5dcaca22b15" containerName="payload-processing" containerID="cri-o://1fb1800467fbbb3add2d79cb05a11be4dda7d695688374b1d3d4a61f111f9514" gracePeriod=30
Jul 24 17:36:30.032305 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:30.032280    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-4fe99dd6-667b8bd88-pbdtg"]
Jul 24 17:36:30.032507 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:30.032471    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-4fe99dd6-667b8bd88-pbdtg" podUID="10faccf9-87c0-48fe-9cc2-4a5bff1b5214" containerName="payload-pre-processing" containerID="cri-o://da050a95f299046e6d15f59c49aa2405374604318792e8b80a022d811b09d616" gracePeriod=30
Jul 24 17:36:30.293911 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:30.293876    2582 generic.go:356] "Generic (PLEG): container finished" podID="7b13ead0-7547-41e7-96cd-f5dcaca22b15" containerID="1fb1800467fbbb3add2d79cb05a11be4dda7d695688374b1d3d4a61f111f9514" exitCode=0
Jul 24 17:36:30.294095 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:30.293956    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-4fe99dd6-78b7d4c7d-j7qmm" event={"ID":"7b13ead0-7547-41e7-96cd-f5dcaca22b15","Type":"ContainerDied","Data":"1fb1800467fbbb3add2d79cb05a11be4dda7d695688374b1d3d4a61f111f9514"}
Jul 24 17:36:30.295731 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:30.295706    2582 generic.go:356] "Generic (PLEG): container finished" podID="10faccf9-87c0-48fe-9cc2-4a5bff1b5214" containerID="da050a95f299046e6d15f59c49aa2405374604318792e8b80a022d811b09d616" exitCode=0
Jul 24 17:36:30.295847 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:30.295776    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-4fe99dd6-667b8bd88-pbdtg" event={"ID":"10faccf9-87c0-48fe-9cc2-4a5bff1b5214","Type":"ContainerDied","Data":"da050a95f299046e6d15f59c49aa2405374604318792e8b80a022d811b09d616"}
Jul 24 17:36:30.324223 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:30.324197    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-4fe99dd6-78b7d4c7d-j7qmm"
Jul 24 17:36:30.326989 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:30.326968    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-4fe99dd6-667b8bd88-pbdtg"
Jul 24 17:36:30.449224 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:30.449145    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8p9r6\" (UniqueName: \"kubernetes.io/projected/7b13ead0-7547-41e7-96cd-f5dcaca22b15-kube-api-access-8p9r6\") pod \"7b13ead0-7547-41e7-96cd-f5dcaca22b15\" (UID: \"7b13ead0-7547-41e7-96cd-f5dcaca22b15\") "
Jul 24 17:36:30.449224 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:30.449196    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b13ead0-7547-41e7-96cd-f5dcaca22b15-plugins-config-volume\") pod \"7b13ead0-7547-41e7-96cd-f5dcaca22b15\" (UID: \"7b13ead0-7547-41e7-96cd-f5dcaca22b15\") "
Jul 24 17:36:30.449403 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:30.449370    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10faccf9-87c0-48fe-9cc2-4a5bff1b5214-plugins-config-volume\") pod \"10faccf9-87c0-48fe-9cc2-4a5bff1b5214\" (UID: \"10faccf9-87c0-48fe-9cc2-4a5bff1b5214\") "
Jul 24 17:36:30.449474 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:30.449457    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkstx\" (UniqueName: \"kubernetes.io/projected/10faccf9-87c0-48fe-9cc2-4a5bff1b5214-kube-api-access-lkstx\") pod \"10faccf9-87c0-48fe-9cc2-4a5bff1b5214\" (UID: \"10faccf9-87c0-48fe-9cc2-4a5bff1b5214\") "
Jul 24 17:36:30.449542 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:30.449524    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b13ead0-7547-41e7-96cd-f5dcaca22b15-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7b13ead0-7547-41e7-96cd-f5dcaca22b15" (UID: "7b13ead0-7547-41e7-96cd-f5dcaca22b15"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:36:30.449754 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:30.449740    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b13ead0-7547-41e7-96cd-f5dcaca22b15-plugins-config-volume\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:36:30.449821 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:30.449755    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10faccf9-87c0-48fe-9cc2-4a5bff1b5214-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "10faccf9-87c0-48fe-9cc2-4a5bff1b5214" (UID: "10faccf9-87c0-48fe-9cc2-4a5bff1b5214"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:36:30.451188 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:30.451169    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b13ead0-7547-41e7-96cd-f5dcaca22b15-kube-api-access-8p9r6" (OuterVolumeSpecName: "kube-api-access-8p9r6") pod "7b13ead0-7547-41e7-96cd-f5dcaca22b15" (UID: "7b13ead0-7547-41e7-96cd-f5dcaca22b15"). InnerVolumeSpecName "kube-api-access-8p9r6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:36:30.451316 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:30.451297    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10faccf9-87c0-48fe-9cc2-4a5bff1b5214-kube-api-access-lkstx" (OuterVolumeSpecName: "kube-api-access-lkstx") pod "10faccf9-87c0-48fe-9cc2-4a5bff1b5214" (UID: "10faccf9-87c0-48fe-9cc2-4a5bff1b5214"). InnerVolumeSpecName "kube-api-access-lkstx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:36:30.550646 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:30.550618    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8p9r6\" (UniqueName: \"kubernetes.io/projected/7b13ead0-7547-41e7-96cd-f5dcaca22b15-kube-api-access-8p9r6\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:36:30.550646 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:30.550641    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10faccf9-87c0-48fe-9cc2-4a5bff1b5214-plugins-config-volume\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:36:30.550646 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:30.550650    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkstx\" (UniqueName: \"kubernetes.io/projected/10faccf9-87c0-48fe-9cc2-4a5bff1b5214-kube-api-access-lkstx\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:36:31.302634 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:31.302541    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-4fe99dd6-667b8bd88-pbdtg"
Jul 24 17:36:31.302634 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:31.302594    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-4fe99dd6-667b8bd88-pbdtg" event={"ID":"10faccf9-87c0-48fe-9cc2-4a5bff1b5214","Type":"ContainerDied","Data":"1ccbb938ca7b36848ec86fb85b37d3d69d6de32a6fdaa216816be66d368198c6"}
Jul 24 17:36:31.303148 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:31.302651    2582 scope.go:117] "RemoveContainer" containerID="da050a95f299046e6d15f59c49aa2405374604318792e8b80a022d811b09d616"
Jul 24 17:36:31.304170 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:31.304149    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-4fe99dd6-78b7d4c7d-j7qmm" event={"ID":"7b13ead0-7547-41e7-96cd-f5dcaca22b15","Type":"ContainerDied","Data":"0d6867d73b3a0cccedfcac89b2b3a0c93b051bcc699f3b70b9a320789b14551c"}
Jul 24 17:36:31.304252 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:31.304178    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-4fe99dd6-78b7d4c7d-j7qmm"
Jul 24 17:36:31.312605 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:31.312582    2582 scope.go:117] "RemoveContainer" containerID="1fb1800467fbbb3add2d79cb05a11be4dda7d695688374b1d3d4a61f111f9514"
Jul 24 17:36:31.326449 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:31.326430    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-4fe99dd6-667b8bd88-pbdtg"]
Jul 24 17:36:31.330404 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:31.330384    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-4fe99dd6-667b8bd88-pbdtg"]
Jul 24 17:36:31.344931 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:31.344910    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-4fe99dd6-78b7d4c7d-j7qmm"]
Jul 24 17:36:31.352206 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:31.352187    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-4fe99dd6-78b7d4c7d-j7qmm"]
Jul 24 17:36:31.762963 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:31.762932    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10faccf9-87c0-48fe-9cc2-4a5bff1b5214" path="/var/lib/kubelet/pods/10faccf9-87c0-48fe-9cc2-4a5bff1b5214/volumes"
Jul 24 17:36:31.763263 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:31.763251    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b13ead0-7547-41e7-96cd-f5dcaca22b15" path="/var/lib/kubelet/pods/7b13ead0-7547-41e7-96cd-f5dcaca22b15/volumes"
Jul 24 17:36:34.452349 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:34.452315    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fe99dd6-khww2"]
Jul 24 17:36:34.454887 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:34.454865    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fe99dd6-khww2"]
Jul 24 17:36:35.763447 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:35.763410    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8fc5e6d-563e-4467-9efa-afb0dc607a24" path="/var/lib/kubelet/pods/c8fc5e6d-563e-4467-9efa-afb0dc607a24/volumes"
Jul 24 17:36:37.375892 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:36:37.375861    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:37:29.681806 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:37:29.681775    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:37:29.860741 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:37:29.860652    2582 scope.go:117] "RemoveContainer" containerID="bc36685c99d66415441cfb75eff7b371c50816367b8e7d4512d117c2944cfd4c"
Jul 24 17:37:42.289919 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:37:42.289887    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:38:26.799416 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:26.799381    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-0d8e36-dd89f757b-4pbwm"]
Jul 24 17:38:26.799901 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:26.799707    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8fc5e6d-563e-4467-9efa-afb0dc607a24" containerName="revoke-keys"
Jul 24 17:38:26.799901 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:26.799719    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8fc5e6d-563e-4467-9efa-afb0dc607a24" containerName="revoke-keys"
Jul 24 17:38:26.799901 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:26.799729    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10faccf9-87c0-48fe-9cc2-4a5bff1b5214" containerName="payload-pre-processing"
Jul 24 17:38:26.799901 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:26.799735    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="10faccf9-87c0-48fe-9cc2-4a5bff1b5214" containerName="payload-pre-processing"
Jul 24 17:38:26.799901 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:26.799745    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b13ead0-7547-41e7-96cd-f5dcaca22b15" containerName="payload-processing"
Jul 24 17:38:26.799901 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:26.799750    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b13ead0-7547-41e7-96cd-f5dcaca22b15" containerName="payload-processing"
Jul 24 17:38:26.799901 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:26.799807    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8fc5e6d-563e-4467-9efa-afb0dc607a24" containerName="revoke-keys"
Jul 24 17:38:26.799901 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:26.799817    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="10faccf9-87c0-48fe-9cc2-4a5bff1b5214" containerName="payload-pre-processing"
Jul 24 17:38:26.799901 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:26.799825    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b13ead0-7547-41e7-96cd-f5dcaca22b15" containerName="payload-processing"
Jul 24 17:38:26.802702 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:26.802685    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d8e36-dd89f757b-4pbwm"
Jul 24 17:38:26.805197 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:26.805175    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-0d8e36\""
Jul 24 17:38:26.805359 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:26.805341    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-0d8e36-dockercfg-f749r\""
Jul 24 17:38:26.812020 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:26.811997    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-0d8e36-dd89f757b-4pbwm"]
Jul 24 17:38:26.861811 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:26.861786    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbr6g\" (UniqueName: \"kubernetes.io/projected/ca8539f5-fa17-41c8-8dff-fff2ec9a82fb-kube-api-access-sbr6g\") pod \"payload-pre-processing-e2e-inf-a-0d8e36-dd89f757b-4pbwm\" (UID: \"ca8539f5-fa17-41c8-8dff-fff2ec9a82fb\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d8e36-dd89f757b-4pbwm"
Jul 24 17:38:26.861928 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:26.861882    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca8539f5-fa17-41c8-8dff-fff2ec9a82fb-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-0d8e36-dd89f757b-4pbwm\" (UID: \"ca8539f5-fa17-41c8-8dff-fff2ec9a82fb\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d8e36-dd89f757b-4pbwm"
Jul 24 17:38:26.962237 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:26.962203    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbr6g\" (UniqueName: \"kubernetes.io/projected/ca8539f5-fa17-41c8-8dff-fff2ec9a82fb-kube-api-access-sbr6g\") pod \"payload-pre-processing-e2e-inf-a-0d8e36-dd89f757b-4pbwm\" (UID: \"ca8539f5-fa17-41c8-8dff-fff2ec9a82fb\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d8e36-dd89f757b-4pbwm"
Jul 24 17:38:26.962389 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:26.962287    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca8539f5-fa17-41c8-8dff-fff2ec9a82fb-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-0d8e36-dd89f757b-4pbwm\" (UID: \"ca8539f5-fa17-41c8-8dff-fff2ec9a82fb\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d8e36-dd89f757b-4pbwm"
Jul 24 17:38:26.962911 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:26.962894    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca8539f5-fa17-41c8-8dff-fff2ec9a82fb-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-0d8e36-dd89f757b-4pbwm\" (UID: \"ca8539f5-fa17-41c8-8dff-fff2ec9a82fb\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d8e36-dd89f757b-4pbwm"
Jul 24 17:38:26.970497 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:26.970467    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbr6g\" (UniqueName: \"kubernetes.io/projected/ca8539f5-fa17-41c8-8dff-fff2ec9a82fb-kube-api-access-sbr6g\") pod \"payload-pre-processing-e2e-inf-a-0d8e36-dd89f757b-4pbwm\" (UID: \"ca8539f5-fa17-41c8-8dff-fff2ec9a82fb\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d8e36-dd89f757b-4pbwm"
Jul 24 17:38:27.113903 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:27.113822    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d8e36-dd89f757b-4pbwm"
Jul 24 17:38:27.245207 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:27.245183    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-0d8e36-dd89f757b-4pbwm"]
Jul 24 17:38:27.247321 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:38:27.247295    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca8539f5_fa17_41c8_8dff_fff2ec9a82fb.slice/crio-78feb50333048a1e6a801d191b763e9b1c70382092a578c26a5008735709aba0 WatchSource:0}: Error finding container 78feb50333048a1e6a801d191b763e9b1c70382092a578c26a5008735709aba0: Status 404 returned error can't find the container with id 78feb50333048a1e6a801d191b763e9b1c70382092a578c26a5008735709aba0
Jul 24 17:38:27.897053 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:27.897014    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d8e36-dd89f757b-4pbwm" event={"ID":"ca8539f5-fa17-41c8-8dff-fff2ec9a82fb","Type":"ContainerStarted","Data":"9013074126df4305d6dcdf6986c64d1ab78a6dad6b4e23c64dcfc95cdf8de17c"}
Jul 24 17:38:27.897439 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:27.897069    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d8e36-dd89f757b-4pbwm" event={"ID":"ca8539f5-fa17-41c8-8dff-fff2ec9a82fb","Type":"ContainerStarted","Data":"78feb50333048a1e6a801d191b763e9b1c70382092a578c26a5008735709aba0"}
Jul 24 17:38:27.897439 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:27.897119    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d8e36-dd89f757b-4pbwm"
Jul 24 17:38:27.919595 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:27.919553    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d8e36-dd89f757b-4pbwm" podStartSLOduration=1.919541598 podStartE2EDuration="1.919541598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:38:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:38:27.91769497 +0000 UTC m=+2098.733669712" watchObservedRunningTime="2026-07-24 17:38:27.919541598 +0000 UTC m=+2098.735516213"
Jul 24 17:38:29.802789 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:29.802704    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d6w2m_9f3e23c6-31a7-4e7b-83df-d6eee1335b7a/ovn-acl-logging/0.log"
Jul 24 17:38:29.807701 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:29.807682    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d6w2m_9f3e23c6-31a7-4e7b-83df-d6eee1335b7a/ovn-acl-logging/0.log"
Jul 24 17:38:29.886345 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:29.886321    2582 scope.go:117] "RemoveContainer" containerID="7077b584ac8ca4b534a05d974ea6c5b7dffd33d7d0ae1281cc5f21994ff58f23"
Jul 24 17:38:29.894541 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:29.894516    2582 scope.go:117] "RemoveContainer" containerID="9d4ea8651ffde9b4a240115cb309c3749320cc3ab7b2d41ac238abd70c7541d3"
Jul 24 17:38:34.404399 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:34.404365    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:38:34.823654 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:34.823616    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-746c88-756d5747bd-tlg82"]
Jul 24 17:38:34.827119 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:34.827099    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-746c88-756d5747bd-tlg82"
Jul 24 17:38:34.830174 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:34.830154    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-746c88\""
Jul 24 17:38:34.846303 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:34.846281    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-746c88-756d5747bd-tlg82"]
Jul 24 17:38:34.917117 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:34.917085    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3139b35e-9fc7-4103-bcd1-76a99a1460e8-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-746c88-756d5747bd-tlg82\" (UID: \"3139b35e-9fc7-4103-bcd1-76a99a1460e8\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-746c88-756d5747bd-tlg82"
Jul 24 17:38:34.917294 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:34.917156    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dkgp\" (UniqueName: \"kubernetes.io/projected/3139b35e-9fc7-4103-bcd1-76a99a1460e8-kube-api-access-2dkgp\") pod \"payload-pre-processing-e2e-inf-b-746c88-756d5747bd-tlg82\" (UID: \"3139b35e-9fc7-4103-bcd1-76a99a1460e8\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-746c88-756d5747bd-tlg82"
Jul 24 17:38:35.017608 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:35.017575    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dkgp\" (UniqueName: \"kubernetes.io/projected/3139b35e-9fc7-4103-bcd1-76a99a1460e8-kube-api-access-2dkgp\") pod \"payload-pre-processing-e2e-inf-b-746c88-756d5747bd-tlg82\" (UID: \"3139b35e-9fc7-4103-bcd1-76a99a1460e8\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-746c88-756d5747bd-tlg82"
Jul 24 17:38:35.017815 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:35.017644    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3139b35e-9fc7-4103-bcd1-76a99a1460e8-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-746c88-756d5747bd-tlg82\" (UID: \"3139b35e-9fc7-4103-bcd1-76a99a1460e8\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-746c88-756d5747bd-tlg82"
Jul 24 17:38:35.018357 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:35.018336    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3139b35e-9fc7-4103-bcd1-76a99a1460e8-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-746c88-756d5747bd-tlg82\" (UID: \"3139b35e-9fc7-4103-bcd1-76a99a1460e8\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-746c88-756d5747bd-tlg82"
Jul 24 17:38:35.029644 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:35.029616    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dkgp\" (UniqueName: \"kubernetes.io/projected/3139b35e-9fc7-4103-bcd1-76a99a1460e8-kube-api-access-2dkgp\") pod \"payload-pre-processing-e2e-inf-b-746c88-756d5747bd-tlg82\" (UID: \"3139b35e-9fc7-4103-bcd1-76a99a1460e8\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-746c88-756d5747bd-tlg82"
Jul 24 17:38:35.137783 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:35.137663    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-746c88-756d5747bd-tlg82"
Jul 24 17:38:35.279694 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:35.279651    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-746c88-756d5747bd-tlg82"]
Jul 24 17:38:35.281119 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:38:35.281087    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3139b35e_9fc7_4103_bcd1_76a99a1460e8.slice/crio-3745f55772b028330dd3be921369f4c3c075ea7b7a9d6d50765ed895fdbce00a WatchSource:0}: Error finding container 3745f55772b028330dd3be921369f4c3c075ea7b7a9d6d50765ed895fdbce00a: Status 404 returned error can't find the container with id 3745f55772b028330dd3be921369f4c3c075ea7b7a9d6d50765ed895fdbce00a
Jul 24 17:38:35.939213 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:35.939181    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-746c88-756d5747bd-tlg82" event={"ID":"3139b35e-9fc7-4103-bcd1-76a99a1460e8","Type":"ContainerStarted","Data":"f3971ec75ebbf14d16f08ba80e4de66bd71f105bb0e590588de98526d319584c"}
Jul 24 17:38:35.939626 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:35.939229    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-746c88-756d5747bd-tlg82" event={"ID":"3139b35e-9fc7-4103-bcd1-76a99a1460e8","Type":"ContainerStarted","Data":"3745f55772b028330dd3be921369f4c3c075ea7b7a9d6d50765ed895fdbce00a"}
Jul 24 17:38:35.939626 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:35.939301    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-746c88-756d5747bd-tlg82"
Jul 24 17:38:35.960717 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:35.960653    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-746c88-756d5747bd-tlg82" podStartSLOduration=1.9606368299999999 podStartE2EDuration="1.96063683s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:38:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:38:35.958501678 +0000 UTC m=+2106.774476293" watchObservedRunningTime="2026-07-24 17:38:35.96063683 +0000 UTC m=+2106.776611445"
Jul 24 17:38:38.904869 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:38.904837    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d8e36-dd89f757b-4pbwm"
Jul 24 17:38:46.886246 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:46.884335    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:38:46.947583 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:38:46.947554    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-746c88-756d5747bd-tlg82"
Jul 24 17:39:03.081646 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:03.081610    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:39:06.970291 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:06.970255    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-746c88/test-model-746c88-kserve-ddb845ffc-9bc7q"]
Jul 24 17:39:06.974002 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:06.973979    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-746c88/test-model-746c88-kserve-ddb845ffc-9bc7q"
Jul 24 17:39:06.977207 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:06.977185    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-746c88\"/\"kube-root-ca.crt\""
Jul 24 17:39:06.977437 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:06.977200    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-746c88\"/\"openshift-service-ca.crt\""
Jul 24 17:39:06.977536 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:06.977222    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-746c88\"/\"default-dockercfg-f6lk4\""
Jul 24 17:39:06.977536 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:06.977243    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-746c88\"/\"test-model-746c88-kserve-self-signed-certs\""
Jul 24 17:39:06.983458 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:06.983439    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-746c88/test-model-746c88-kserve-ddb845ffc-9bc7q"]
Jul 24 17:39:07.098862 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:07.098829    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a0bc3d1-5dff-492f-9d5f-cae94baad3e6-home\") pod \"test-model-746c88-kserve-ddb845ffc-9bc7q\" (UID: \"8a0bc3d1-5dff-492f-9d5f-cae94baad3e6\") " pod="ai-tenant-e2e-inf-b-746c88/test-model-746c88-kserve-ddb845ffc-9bc7q"
Jul 24 17:39:07.099051 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:07.098886    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a0bc3d1-5dff-492f-9d5f-cae94baad3e6-tls-certs\") pod \"test-model-746c88-kserve-ddb845ffc-9bc7q\" (UID: \"8a0bc3d1-5dff-492f-9d5f-cae94baad3e6\") " pod="ai-tenant-e2e-inf-b-746c88/test-model-746c88-kserve-ddb845ffc-9bc7q"
Jul 24 17:39:07.099051 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:07.098925    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a0bc3d1-5dff-492f-9d5f-cae94baad3e6-model-cache\") pod \"test-model-746c88-kserve-ddb845ffc-9bc7q\" (UID: \"8a0bc3d1-5dff-492f-9d5f-cae94baad3e6\") " pod="ai-tenant-e2e-inf-b-746c88/test-model-746c88-kserve-ddb845ffc-9bc7q"
Jul 24 17:39:07.099051 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:07.098961    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmm95\" (UniqueName: \"kubernetes.io/projected/8a0bc3d1-5dff-492f-9d5f-cae94baad3e6-kube-api-access-cmm95\") pod \"test-model-746c88-kserve-ddb845ffc-9bc7q\" (UID: \"8a0bc3d1-5dff-492f-9d5f-cae94baad3e6\") " pod="ai-tenant-e2e-inf-b-746c88/test-model-746c88-kserve-ddb845ffc-9bc7q"
Jul 24 17:39:07.099051 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:07.099011    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a0bc3d1-5dff-492f-9d5f-cae94baad3e6-dshm\") pod \"test-model-746c88-kserve-ddb845ffc-9bc7q\" (UID: \"8a0bc3d1-5dff-492f-9d5f-cae94baad3e6\") " pod="ai-tenant-e2e-inf-b-746c88/test-model-746c88-kserve-ddb845ffc-9bc7q"
Jul 24 17:39:07.099051 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:07.099037    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a0bc3d1-5dff-492f-9d5f-cae94baad3e6-tmp-dir\") pod \"test-model-746c88-kserve-ddb845ffc-9bc7q\" (UID: \"8a0bc3d1-5dff-492f-9d5f-cae94baad3e6\") " pod="ai-tenant-e2e-inf-b-746c88/test-model-746c88-kserve-ddb845ffc-9bc7q"
Jul 24 17:39:07.199856 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:07.199802    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a0bc3d1-5dff-492f-9d5f-cae94baad3e6-tls-certs\") pod \"test-model-746c88-kserve-ddb845ffc-9bc7q\" (UID: \"8a0bc3d1-5dff-492f-9d5f-cae94baad3e6\") " pod="ai-tenant-e2e-inf-b-746c88/test-model-746c88-kserve-ddb845ffc-9bc7q"
Jul 24 17:39:07.199856 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:07.199860    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a0bc3d1-5dff-492f-9d5f-cae94baad3e6-model-cache\") pod \"test-model-746c88-kserve-ddb845ffc-9bc7q\" (UID: \"8a0bc3d1-5dff-492f-9d5f-cae94baad3e6\") " pod="ai-tenant-e2e-inf-b-746c88/test-model-746c88-kserve-ddb845ffc-9bc7q"
Jul 24 17:39:07.200172 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:07.199896    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmm95\" (UniqueName: \"kubernetes.io/projected/8a0bc3d1-5dff-492f-9d5f-cae94baad3e6-kube-api-access-cmm95\") pod \"test-model-746c88-kserve-ddb845ffc-9bc7q\" (UID: \"8a0bc3d1-5dff-492f-9d5f-cae94baad3e6\") " pod="ai-tenant-e2e-inf-b-746c88/test-model-746c88-kserve-ddb845ffc-9bc7q"
Jul 24 17:39:07.200172 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:07.200070    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a0bc3d1-5dff-492f-9d5f-cae94baad3e6-dshm\") pod \"test-model-746c88-kserve-ddb845ffc-9bc7q\" (UID: \"8a0bc3d1-5dff-492f-9d5f-cae94baad3e6\") " pod="ai-tenant-e2e-inf-b-746c88/test-model-746c88-kserve-ddb845ffc-9bc7q"
Jul 24 17:39:07.200172 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:07.200125    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a0bc3d1-5dff-492f-9d5f-cae94baad3e6-tmp-dir\") pod \"test-model-746c88-kserve-ddb845ffc-9bc7q\" (UID: \"8a0bc3d1-5dff-492f-9d5f-cae94baad3e6\") " pod="ai-tenant-e2e-inf-b-746c88/test-model-746c88-kserve-ddb845ffc-9bc7q"
Jul 24 17:39:07.200313 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:07.200180    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a0bc3d1-5dff-492f-9d5f-cae94baad3e6-home\") pod \"test-model-746c88-kserve-ddb845ffc-9bc7q\" (UID: \"8a0bc3d1-5dff-492f-9d5f-cae94baad3e6\") " pod="ai-tenant-e2e-inf-b-746c88/test-model-746c88-kserve-ddb845ffc-9bc7q"
Jul 24 17:39:07.200359 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:07.200307    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a0bc3d1-5dff-492f-9d5f-cae94baad3e6-model-cache\") pod \"test-model-746c88-kserve-ddb845ffc-9bc7q\" (UID: \"8a0bc3d1-5dff-492f-9d5f-cae94baad3e6\") " pod="ai-tenant-e2e-inf-b-746c88/test-model-746c88-kserve-ddb845ffc-9bc7q"
Jul 24 17:39:07.200460 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:07.200442    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a0bc3d1-5dff-492f-9d5f-cae94baad3e6-tmp-dir\") pod \"test-model-746c88-kserve-ddb845ffc-9bc7q\" (UID: \"8a0bc3d1-5dff-492f-9d5f-cae94baad3e6\") " pod="ai-tenant-e2e-inf-b-746c88/test-model-746c88-kserve-ddb845ffc-9bc7q"
Jul 24 17:39:07.200518 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:07.200504    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a0bc3d1-5dff-492f-9d5f-cae94baad3e6-home\") pod \"test-model-746c88-kserve-ddb845ffc-9bc7q\" (UID: \"8a0bc3d1-5dff-492f-9d5f-cae94baad3e6\") " pod="ai-tenant-e2e-inf-b-746c88/test-model-746c88-kserve-ddb845ffc-9bc7q"
Jul 24 17:39:07.202412 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:07.202389    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a0bc3d1-5dff-492f-9d5f-cae94baad3e6-tls-certs\") pod \"test-model-746c88-kserve-ddb845ffc-9bc7q\" (UID: \"8a0bc3d1-5dff-492f-9d5f-cae94baad3e6\") " pod="ai-tenant-e2e-inf-b-746c88/test-model-746c88-kserve-ddb845ffc-9bc7q"
Jul 24 17:39:07.202520 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:07.202418    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a0bc3d1-5dff-492f-9d5f-cae94baad3e6-dshm\") pod \"test-model-746c88-kserve-ddb845ffc-9bc7q\" (UID: \"8a0bc3d1-5dff-492f-9d5f-cae94baad3e6\") " pod="ai-tenant-e2e-inf-b-746c88/test-model-746c88-kserve-ddb845ffc-9bc7q"
Jul 24 17:39:07.208156 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:07.208136    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmm95\" (UniqueName: \"kubernetes.io/projected/8a0bc3d1-5dff-492f-9d5f-cae94baad3e6-kube-api-access-cmm95\") pod \"test-model-746c88-kserve-ddb845ffc-9bc7q\" (UID: \"8a0bc3d1-5dff-492f-9d5f-cae94baad3e6\") " pod="ai-tenant-e2e-inf-b-746c88/test-model-746c88-kserve-ddb845ffc-9bc7q"
Jul 24 17:39:07.286083 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:07.286043    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-746c88/test-model-746c88-kserve-ddb845ffc-9bc7q"
Jul 24 17:39:07.424093 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:07.424015    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-746c88/test-model-746c88-kserve-ddb845ffc-9bc7q"]
Jul 24 17:39:07.426730 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:39:07.426702    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a0bc3d1_5dff_492f_9d5f_cae94baad3e6.slice/crio-36ebfc056d7b025b6b91057f9d65a94b1a5526d4b6d52600a075b448b231ebd8 WatchSource:0}: Error finding container 36ebfc056d7b025b6b91057f9d65a94b1a5526d4b6d52600a075b448b231ebd8: Status 404 returned error can't find the container with id 36ebfc056d7b025b6b91057f9d65a94b1a5526d4b6d52600a075b448b231ebd8
Jul 24 17:39:08.101684 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:08.101637    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-746c88/test-model-746c88-kserve-ddb845ffc-9bc7q" event={"ID":"8a0bc3d1-5dff-492f-9d5f-cae94baad3e6","Type":"ContainerStarted","Data":"3d110c952f3139085a4745f6cef95f5ae68de9f0de657ea0f380b3666ad5f48a"}
Jul 24 17:39:08.102150 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:08.101712    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-746c88/test-model-746c88-kserve-ddb845ffc-9bc7q" event={"ID":"8a0bc3d1-5dff-492f-9d5f-cae94baad3e6","Type":"ContainerStarted","Data":"36ebfc056d7b025b6b91057f9d65a94b1a5526d4b6d52600a075b448b231ebd8"}
Jul 24 17:39:08.122974 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:08.122923    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-746c88/test-model-746c88-kserve-ddb845ffc-9bc7q" podStartSLOduration=2.12290912 podStartE2EDuration="2.12290912s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:39:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:39:08.120768815 +0000 UTC m=+2138.936743431" watchObservedRunningTime="2026-07-24 17:39:08.12290912 +0000 UTC m=+2138.938883732"
Jul 24 17:39:14.177097 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:14.177063    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:39:17.286162 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:17.286125    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-746c88/test-model-746c88-kserve-ddb845ffc-9bc7q"
Jul 24 17:39:17.286162 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:17.286172    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-746c88/test-model-746c88-kserve-ddb845ffc-9bc7q"
Jul 24 17:39:17.298140 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:17.298110    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-746c88/test-model-746c88-kserve-ddb845ffc-9bc7q"
Jul 24 17:39:18.165655 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:18.165631    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-746c88/test-model-746c88-kserve-ddb845ffc-9bc7q"
Jul 24 17:39:59.104845 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:59.104811    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-746c88/test-model-746c88-kserve-ddb845ffc-9bc7q"]
Jul 24 17:39:59.238293 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:59.238255    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0d8e36-thqlj"]
Jul 24 17:39:59.241753 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:59.241737    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0d8e36-thqlj"
Jul 24 17:39:59.243878 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:59.243853    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 17:39:59.244210 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:59.244195    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tdqg2\""
Jul 24 17:39:59.250345 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:59.250321    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0d8e36-thqlj"]
Jul 24 17:39:59.353077 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:59.353043    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8c88ee5-977b-4216-a777-321e99accc62-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-0d8e36-thqlj\" (UID: \"c8c88ee5-977b-4216-a777-321e99accc62\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0d8e36-thqlj"
Jul 24 17:39:59.454286 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:59.454203    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8c88ee5-977b-4216-a777-321e99accc62-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-0d8e36-thqlj\" (UID: \"c8c88ee5-977b-4216-a777-321e99accc62\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0d8e36-thqlj"
Jul 24 17:39:59.454873 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:59.454853    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8c88ee5-977b-4216-a777-321e99accc62-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-0d8e36-thqlj\" (UID: \"c8c88ee5-977b-4216-a777-321e99accc62\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0d8e36-thqlj"
Jul 24 17:39:59.553502 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:59.553471    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0d8e36-thqlj"
Jul 24 17:39:59.678203 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:39:59.678177    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0d8e36-thqlj"]
Jul 24 17:39:59.680016 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:39:59.679988    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8c88ee5_977b_4216_a777_321e99accc62.slice/crio-780266277abd8c5dee74621c6314ad2712a45658d5e210ab53b6c9675dbf8793 WatchSource:0}: Error finding container 780266277abd8c5dee74621c6314ad2712a45658d5e210ab53b6c9675dbf8793: Status 404 returned error can't find the container with id 780266277abd8c5dee74621c6314ad2712a45658d5e210ab53b6c9675dbf8793
Jul 24 17:40:00.363556 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:00.363529    2582 generic.go:356] "Generic (PLEG): container finished" podID="c8c88ee5-977b-4216-a777-321e99accc62" containerID="a5717e22ca028109105da06506f594d72007a27be21edcbbeede19014af809bb" exitCode=0
Jul 24 17:40:00.363907 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:00.363595    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0d8e36-thqlj" event={"ID":"c8c88ee5-977b-4216-a777-321e99accc62","Type":"ContainerDied","Data":"a5717e22ca028109105da06506f594d72007a27be21edcbbeede19014af809bb"}
Jul 24 17:40:00.363907 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:00.363647    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0d8e36-thqlj" event={"ID":"c8c88ee5-977b-4216-a777-321e99accc62","Type":"ContainerStarted","Data":"780266277abd8c5dee74621c6314ad2712a45658d5e210ab53b6c9675dbf8793"}
Jul 24 17:40:01.497110 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:01.497086    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0d8e36-thqlj"
Jul 24 17:40:01.672767 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:01.672647    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8c88ee5-977b-4216-a777-321e99accc62-maas-api-service-ca\") pod \"c8c88ee5-977b-4216-a777-321e99accc62\" (UID: \"c8c88ee5-977b-4216-a777-321e99accc62\") "
Jul 24 17:40:01.673016 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:01.672986    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8c88ee5-977b-4216-a777-321e99accc62-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c8c88ee5-977b-4216-a777-321e99accc62" (UID: "c8c88ee5-977b-4216-a777-321e99accc62"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:40:01.773814 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:01.773785    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8c88ee5-977b-4216-a777-321e99accc62-maas-api-service-ca\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:40:02.374144 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:02.374110    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0d8e36-thqlj" event={"ID":"c8c88ee5-977b-4216-a777-321e99accc62","Type":"ContainerDied","Data":"780266277abd8c5dee74621c6314ad2712a45658d5e210ab53b6c9675dbf8793"}
Jul 24 17:40:02.374144 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:02.374138    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0d8e36-thqlj"
Jul 24 17:40:02.374352 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:02.374158    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="780266277abd8c5dee74621c6314ad2712a45658d5e210ab53b6c9675dbf8793"
Jul 24 17:40:02.787038 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:02.787005    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:40:09.890166 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:09.890120    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-0d8e36-dd89f757b-4pbwm"]
Jul 24 17:40:09.890646 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:09.890413    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d8e36-dd89f757b-4pbwm" podUID="ca8539f5-fa17-41c8-8dff-fff2ec9a82fb" containerName="payload-pre-processing" containerID="cri-o://9013074126df4305d6dcdf6986c64d1ab78a6dad6b4e23c64dcfc95cdf8de17c" gracePeriod=30
Jul 24 17:40:10.134784 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:10.134761    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d8e36-dd89f757b-4pbwm"
Jul 24 17:40:10.243194 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:10.243167    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca8539f5-fa17-41c8-8dff-fff2ec9a82fb-plugins-config-volume\") pod \"ca8539f5-fa17-41c8-8dff-fff2ec9a82fb\" (UID: \"ca8539f5-fa17-41c8-8dff-fff2ec9a82fb\") "
Jul 24 17:40:10.243386 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:10.243205    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbr6g\" (UniqueName: \"kubernetes.io/projected/ca8539f5-fa17-41c8-8dff-fff2ec9a82fb-kube-api-access-sbr6g\") pod \"ca8539f5-fa17-41c8-8dff-fff2ec9a82fb\" (UID: \"ca8539f5-fa17-41c8-8dff-fff2ec9a82fb\") "
Jul 24 17:40:10.243623 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:10.243598    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca8539f5-fa17-41c8-8dff-fff2ec9a82fb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ca8539f5-fa17-41c8-8dff-fff2ec9a82fb" (UID: "ca8539f5-fa17-41c8-8dff-fff2ec9a82fb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:40:10.245583 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:10.245552    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca8539f5-fa17-41c8-8dff-fff2ec9a82fb-kube-api-access-sbr6g" (OuterVolumeSpecName: "kube-api-access-sbr6g") pod "ca8539f5-fa17-41c8-8dff-fff2ec9a82fb" (UID: "ca8539f5-fa17-41c8-8dff-fff2ec9a82fb"). InnerVolumeSpecName "kube-api-access-sbr6g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:40:10.344170 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:10.344131    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca8539f5-fa17-41c8-8dff-fff2ec9a82fb-plugins-config-volume\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:40:10.344170 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:10.344163    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbr6g\" (UniqueName: \"kubernetes.io/projected/ca8539f5-fa17-41c8-8dff-fff2ec9a82fb-kube-api-access-sbr6g\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:40:10.417014 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:10.416970    2582 generic.go:356] "Generic (PLEG): container finished" podID="ca8539f5-fa17-41c8-8dff-fff2ec9a82fb" containerID="9013074126df4305d6dcdf6986c64d1ab78a6dad6b4e23c64dcfc95cdf8de17c" exitCode=0
Jul 24 17:40:10.417200 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:10.417024    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d8e36-dd89f757b-4pbwm"
Jul 24 17:40:10.417200 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:10.417063    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d8e36-dd89f757b-4pbwm" event={"ID":"ca8539f5-fa17-41c8-8dff-fff2ec9a82fb","Type":"ContainerDied","Data":"9013074126df4305d6dcdf6986c64d1ab78a6dad6b4e23c64dcfc95cdf8de17c"}
Jul 24 17:40:10.417200 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:10.417118    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-0d8e36-dd89f757b-4pbwm" event={"ID":"ca8539f5-fa17-41c8-8dff-fff2ec9a82fb","Type":"ContainerDied","Data":"78feb50333048a1e6a801d191b763e9b1c70382092a578c26a5008735709aba0"}
Jul 24 17:40:10.417200 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:10.417146    2582 scope.go:117] "RemoveContainer" containerID="9013074126df4305d6dcdf6986c64d1ab78a6dad6b4e23c64dcfc95cdf8de17c"
Jul 24 17:40:10.426026 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:10.426007    2582 scope.go:117] "RemoveContainer" containerID="9013074126df4305d6dcdf6986c64d1ab78a6dad6b4e23c64dcfc95cdf8de17c"
Jul 24 17:40:10.426292 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:40:10.426274    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9013074126df4305d6dcdf6986c64d1ab78a6dad6b4e23c64dcfc95cdf8de17c\": container with ID starting with 9013074126df4305d6dcdf6986c64d1ab78a6dad6b4e23c64dcfc95cdf8de17c not found: ID does not exist" containerID="9013074126df4305d6dcdf6986c64d1ab78a6dad6b4e23c64dcfc95cdf8de17c"
Jul 24 17:40:10.426342 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:10.426303    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9013074126df4305d6dcdf6986c64d1ab78a6dad6b4e23c64dcfc95cdf8de17c"} err="failed to get container status \"9013074126df4305d6dcdf6986c64d1ab78a6dad6b4e23c64dcfc95cdf8de17c\": rpc error: code = NotFound desc = could not find container \"9013074126df4305d6dcdf6986c64d1ab78a6dad6b4e23c64dcfc95cdf8de17c\": container with ID starting with 9013074126df4305d6dcdf6986c64d1ab78a6dad6b4e23c64dcfc95cdf8de17c not found: ID does not exist"
Jul 24 17:40:10.437091 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:10.437067    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-0d8e36-dd89f757b-4pbwm"]
Jul 24 17:40:10.440807 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:10.440788    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-0d8e36-dd89f757b-4pbwm"]
Jul 24 17:40:11.763641 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:11.763610    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca8539f5-fa17-41c8-8dff-fff2ec9a82fb" path="/var/lib/kubelet/pods/ca8539f5-fa17-41c8-8dff-fff2ec9a82fb/volumes"
Jul 24 17:40:14.122774 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:14.122729    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-746c88/test-model-746c88-kserve-ddb845ffc-9bc7q" podUID="8a0bc3d1-5dff-492f-9d5f-cae94baad3e6" containerName="main" containerID="cri-o://3d110c952f3139085a4745f6cef95f5ae68de9f0de657ea0f380b3666ad5f48a" gracePeriod=45
Jul 24 17:40:14.317185 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:14.317152    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0d8e36-thqlj"]
Jul 24 17:40:14.319173 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:14.319152    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0d8e36-thqlj"]
Jul 24 17:40:14.362037 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:14.362009    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-746c88/test-model-746c88-kserve-ddb845ffc-9bc7q"
Jul 24 17:40:14.437777 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:14.437696    2582 generic.go:356] "Generic (PLEG): container finished" podID="8a0bc3d1-5dff-492f-9d5f-cae94baad3e6" containerID="3d110c952f3139085a4745f6cef95f5ae68de9f0de657ea0f380b3666ad5f48a" exitCode=0
Jul 24 17:40:14.437777 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:14.437731    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-746c88/test-model-746c88-kserve-ddb845ffc-9bc7q" event={"ID":"8a0bc3d1-5dff-492f-9d5f-cae94baad3e6","Type":"ContainerDied","Data":"3d110c952f3139085a4745f6cef95f5ae68de9f0de657ea0f380b3666ad5f48a"}
Jul 24 17:40:14.437777 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:14.437766    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-746c88/test-model-746c88-kserve-ddb845ffc-9bc7q" event={"ID":"8a0bc3d1-5dff-492f-9d5f-cae94baad3e6","Type":"ContainerDied","Data":"36ebfc056d7b025b6b91057f9d65a94b1a5526d4b6d52600a075b448b231ebd8"}
Jul 24 17:40:14.438041 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:14.437788    2582 scope.go:117] "RemoveContainer" containerID="3d110c952f3139085a4745f6cef95f5ae68de9f0de657ea0f380b3666ad5f48a"
Jul 24 17:40:14.438041 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:14.437793    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-746c88/test-model-746c88-kserve-ddb845ffc-9bc7q"
Jul 24 17:40:14.446252 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:14.446231    2582 scope.go:117] "RemoveContainer" containerID="3d110c952f3139085a4745f6cef95f5ae68de9f0de657ea0f380b3666ad5f48a"
Jul 24 17:40:14.446486 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:40:14.446467    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d110c952f3139085a4745f6cef95f5ae68de9f0de657ea0f380b3666ad5f48a\": container with ID starting with 3d110c952f3139085a4745f6cef95f5ae68de9f0de657ea0f380b3666ad5f48a not found: ID does not exist" containerID="3d110c952f3139085a4745f6cef95f5ae68de9f0de657ea0f380b3666ad5f48a"
Jul 24 17:40:14.446552 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:14.446499    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d110c952f3139085a4745f6cef95f5ae68de9f0de657ea0f380b3666ad5f48a"} err="failed to get container status \"3d110c952f3139085a4745f6cef95f5ae68de9f0de657ea0f380b3666ad5f48a\": rpc error: code = NotFound desc = could not find container \"3d110c952f3139085a4745f6cef95f5ae68de9f0de657ea0f380b3666ad5f48a\": container with ID starting with 3d110c952f3139085a4745f6cef95f5ae68de9f0de657ea0f380b3666ad5f48a not found: ID does not exist"
Jul 24 17:40:14.476069 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:14.476045    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a0bc3d1-5dff-492f-9d5f-cae94baad3e6-tls-certs\") pod \"8a0bc3d1-5dff-492f-9d5f-cae94baad3e6\" (UID: \"8a0bc3d1-5dff-492f-9d5f-cae94baad3e6\") "
Jul 24 17:40:14.476164 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:14.476086    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a0bc3d1-5dff-492f-9d5f-cae94baad3e6-model-cache\") pod \"8a0bc3d1-5dff-492f-9d5f-cae94baad3e6\" (UID: \"8a0bc3d1-5dff-492f-9d5f-cae94baad3e6\") "
Jul 24 17:40:14.476164 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:14.476110    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a0bc3d1-5dff-492f-9d5f-cae94baad3e6-dshm\") pod \"8a0bc3d1-5dff-492f-9d5f-cae94baad3e6\" (UID: \"8a0bc3d1-5dff-492f-9d5f-cae94baad3e6\") "
Jul 24 17:40:14.476164 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:14.476156    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a0bc3d1-5dff-492f-9d5f-cae94baad3e6-home\") pod \"8a0bc3d1-5dff-492f-9d5f-cae94baad3e6\" (UID: \"8a0bc3d1-5dff-492f-9d5f-cae94baad3e6\") "
Jul 24 17:40:14.476305 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:14.476196    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a0bc3d1-5dff-492f-9d5f-cae94baad3e6-tmp-dir\") pod \"8a0bc3d1-5dff-492f-9d5f-cae94baad3e6\" (UID: \"8a0bc3d1-5dff-492f-9d5f-cae94baad3e6\") "
Jul 24 17:40:14.476305 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:14.476224    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmm95\" (UniqueName: \"kubernetes.io/projected/8a0bc3d1-5dff-492f-9d5f-cae94baad3e6-kube-api-access-cmm95\") pod \"8a0bc3d1-5dff-492f-9d5f-cae94baad3e6\" (UID: \"8a0bc3d1-5dff-492f-9d5f-cae94baad3e6\") "
Jul 24 17:40:14.476405 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:14.476302    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a0bc3d1-5dff-492f-9d5f-cae94baad3e6-model-cache" (OuterVolumeSpecName: "model-cache") pod "8a0bc3d1-5dff-492f-9d5f-cae94baad3e6" (UID: "8a0bc3d1-5dff-492f-9d5f-cae94baad3e6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:40:14.476453 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:14.476422    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a0bc3d1-5dff-492f-9d5f-cae94baad3e6-home" (OuterVolumeSpecName: "home") pod "8a0bc3d1-5dff-492f-9d5f-cae94baad3e6" (UID: "8a0bc3d1-5dff-492f-9d5f-cae94baad3e6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:40:14.476453 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:14.476437    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a0bc3d1-5dff-492f-9d5f-cae94baad3e6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8a0bc3d1-5dff-492f-9d5f-cae94baad3e6" (UID: "8a0bc3d1-5dff-492f-9d5f-cae94baad3e6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:40:14.476532 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:14.476474    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a0bc3d1-5dff-492f-9d5f-cae94baad3e6-model-cache\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:40:14.478284 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:14.478263    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a0bc3d1-5dff-492f-9d5f-cae94baad3e6-dshm" (OuterVolumeSpecName: "dshm") pod "8a0bc3d1-5dff-492f-9d5f-cae94baad3e6" (UID: "8a0bc3d1-5dff-492f-9d5f-cae94baad3e6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:40:14.478352 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:14.478278    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a0bc3d1-5dff-492f-9d5f-cae94baad3e6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8a0bc3d1-5dff-492f-9d5f-cae94baad3e6" (UID: "8a0bc3d1-5dff-492f-9d5f-cae94baad3e6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:40:14.478352 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:14.478261    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a0bc3d1-5dff-492f-9d5f-cae94baad3e6-kube-api-access-cmm95" (OuterVolumeSpecName: "kube-api-access-cmm95") pod "8a0bc3d1-5dff-492f-9d5f-cae94baad3e6" (UID: "8a0bc3d1-5dff-492f-9d5f-cae94baad3e6"). InnerVolumeSpecName "kube-api-access-cmm95". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:40:14.577235 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:14.577197    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a0bc3d1-5dff-492f-9d5f-cae94baad3e6-home\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:40:14.577403 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:14.577248    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a0bc3d1-5dff-492f-9d5f-cae94baad3e6-tmp-dir\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:40:14.577403 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:14.577259    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmm95\" (UniqueName: \"kubernetes.io/projected/8a0bc3d1-5dff-492f-9d5f-cae94baad3e6-kube-api-access-cmm95\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:40:14.577403 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:14.577268    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a0bc3d1-5dff-492f-9d5f-cae94baad3e6-tls-certs\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:40:14.577403 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:14.577276    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a0bc3d1-5dff-492f-9d5f-cae94baad3e6-dshm\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:40:14.760296 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:14.760260    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-746c88/test-model-746c88-kserve-ddb845ffc-9bc7q"]
Jul 24 17:40:14.763778 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:14.763747    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-746c88/test-model-746c88-kserve-ddb845ffc-9bc7q"]
Jul 24 17:40:15.763614 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:15.763579    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a0bc3d1-5dff-492f-9d5f-cae94baad3e6" path="/var/lib/kubelet/pods/8a0bc3d1-5dff-492f-9d5f-cae94baad3e6/volumes"
Jul 24 17:40:15.764012 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:15.763914    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8c88ee5-977b-4216-a777-321e99accc62" path="/var/lib/kubelet/pods/c8c88ee5-977b-4216-a777-321e99accc62/volumes"
Jul 24 17:40:16.178705 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:16.178609    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:40:21.725275 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:21.725240    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-746c88-7fkl6"]
Jul 24 17:40:21.727575 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:21.725562    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca8539f5-fa17-41c8-8dff-fff2ec9a82fb" containerName="payload-pre-processing"
Jul 24 17:40:21.727575 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:21.725573    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca8539f5-fa17-41c8-8dff-fff2ec9a82fb" containerName="payload-pre-processing"
Jul 24 17:40:21.727575 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:21.725580    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a0bc3d1-5dff-492f-9d5f-cae94baad3e6" containerName="main"
Jul 24 17:40:21.727575 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:21.725585    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a0bc3d1-5dff-492f-9d5f-cae94baad3e6" containerName="main"
Jul 24 17:40:21.727575 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:21.725596    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8c88ee5-977b-4216-a777-321e99accc62" containerName="revoke-keys"
Jul 24 17:40:21.727575 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:21.725605    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8c88ee5-977b-4216-a777-321e99accc62" containerName="revoke-keys"
Jul 24 17:40:21.727575 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:21.725656    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca8539f5-fa17-41c8-8dff-fff2ec9a82fb" containerName="payload-pre-processing"
Jul 24 17:40:21.727575 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:21.725665    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a0bc3d1-5dff-492f-9d5f-cae94baad3e6" containerName="main"
Jul 24 17:40:21.727575 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:21.725695    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8c88ee5-977b-4216-a777-321e99accc62" containerName="revoke-keys"
Jul 24 17:40:21.728458 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:21.728443    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-746c88-7fkl6"
Jul 24 17:40:21.730842 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:21.730821    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 17:40:21.730842 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:21.730829    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tdqg2\""
Jul 24 17:40:21.737805 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:21.737784    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-746c88-7fkl6"]
Jul 24 17:40:21.841020 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:21.840977    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cd8b0d1-cfd4-4c38-9d89-633eb871ee81-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-746c88-7fkl6\" (UID: \"9cd8b0d1-cfd4-4c38-9d89-633eb871ee81\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-746c88-7fkl6"
Jul 24 17:40:21.941719 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:21.941659    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cd8b0d1-cfd4-4c38-9d89-633eb871ee81-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-746c88-7fkl6\" (UID: \"9cd8b0d1-cfd4-4c38-9d89-633eb871ee81\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-746c88-7fkl6"
Jul 24 17:40:21.942271 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:21.942251    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cd8b0d1-cfd4-4c38-9d89-633eb871ee81-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-746c88-7fkl6\" (UID: \"9cd8b0d1-cfd4-4c38-9d89-633eb871ee81\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-746c88-7fkl6"
Jul 24 17:40:22.042908 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:22.042875    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-746c88-7fkl6"
Jul 24 17:40:22.177985 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:22.177684    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-746c88-7fkl6"]
Jul 24 17:40:22.181099 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:40:22.181065    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cd8b0d1_cfd4_4c38_9d89_633eb871ee81.slice/crio-daf5f9e59b580b797342e574423f3e8841c455d160f9baffe94df4b031b3f914 WatchSource:0}: Error finding container daf5f9e59b580b797342e574423f3e8841c455d160f9baffe94df4b031b3f914: Status 404 returned error can't find the container with id daf5f9e59b580b797342e574423f3e8841c455d160f9baffe94df4b031b3f914
Jul 24 17:40:22.480607 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:22.480569    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-746c88-7fkl6" event={"ID":"9cd8b0d1-cfd4-4c38-9d89-633eb871ee81","Type":"ContainerStarted","Data":"5bb8fbe2d41ae3dfa0ab814fcb366aa400adb3a4aa2a1aebc389295fbf79a0fc"}
Jul 24 17:40:22.480789 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:22.480617    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-746c88-7fkl6" event={"ID":"9cd8b0d1-cfd4-4c38-9d89-633eb871ee81","Type":"ContainerStarted","Data":"daf5f9e59b580b797342e574423f3e8841c455d160f9baffe94df4b031b3f914"}
Jul 24 17:40:22.507028 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:22.506978    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-746c88-7fkl6" podStartSLOduration=1.506961523 podStartE2EDuration="1.506961523s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:40:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:40:22.505527218 +0000 UTC m=+2213.321501832" watchObservedRunningTime="2026-07-24 17:40:22.506961523 +0000 UTC m=+2213.322936137"
Jul 24 17:40:23.487574 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:23.487539    2582 generic.go:356] "Generic (PLEG): container finished" podID="9cd8b0d1-cfd4-4c38-9d89-633eb871ee81" containerID="5bb8fbe2d41ae3dfa0ab814fcb366aa400adb3a4aa2a1aebc389295fbf79a0fc" exitCode=0
Jul 24 17:40:23.487967 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:23.487620    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-746c88-7fkl6" event={"ID":"9cd8b0d1-cfd4-4c38-9d89-633eb871ee81","Type":"ContainerDied","Data":"5bb8fbe2d41ae3dfa0ab814fcb366aa400adb3a4aa2a1aebc389295fbf79a0fc"}
Jul 24 17:40:24.617996 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:24.617971    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-746c88-7fkl6"
Jul 24 17:40:24.669943 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:24.669913    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cd8b0d1-cfd4-4c38-9d89-633eb871ee81-maas-api-service-ca\") pod \"9cd8b0d1-cfd4-4c38-9d89-633eb871ee81\" (UID: \"9cd8b0d1-cfd4-4c38-9d89-633eb871ee81\") "
Jul 24 17:40:24.670243 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:24.670221    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cd8b0d1-cfd4-4c38-9d89-633eb871ee81-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9cd8b0d1-cfd4-4c38-9d89-633eb871ee81" (UID: "9cd8b0d1-cfd4-4c38-9d89-633eb871ee81"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:40:24.770836 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:24.770759    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cd8b0d1-cfd4-4c38-9d89-633eb871ee81-maas-api-service-ca\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:40:25.499165 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:25.499130    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-746c88-7fkl6" event={"ID":"9cd8b0d1-cfd4-4c38-9d89-633eb871ee81","Type":"ContainerDied","Data":"daf5f9e59b580b797342e574423f3e8841c455d160f9baffe94df4b031b3f914"}
Jul 24 17:40:25.499340 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:25.499213    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="daf5f9e59b580b797342e574423f3e8841c455d160f9baffe94df4b031b3f914"
Jul 24 17:40:25.499340 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:25.499150    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-746c88-7fkl6"
Jul 24 17:40:32.390804 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:32.390751    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-746c88-756d5747bd-tlg82"]
Jul 24 17:40:32.391280 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:32.391000    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-746c88-756d5747bd-tlg82" podUID="3139b35e-9fc7-4103-bcd1-76a99a1460e8" containerName="payload-pre-processing" containerID="cri-o://f3971ec75ebbf14d16f08ba80e4de66bd71f105bb0e590588de98526d319584c" gracePeriod=30
Jul 24 17:40:32.536611 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:32.536575    2582 generic.go:356] "Generic (PLEG): container finished" podID="3139b35e-9fc7-4103-bcd1-76a99a1460e8" containerID="f3971ec75ebbf14d16f08ba80e4de66bd71f105bb0e590588de98526d319584c" exitCode=0
Jul 24 17:40:32.536776 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:32.536640    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-746c88-756d5747bd-tlg82" event={"ID":"3139b35e-9fc7-4103-bcd1-76a99a1460e8","Type":"ContainerDied","Data":"f3971ec75ebbf14d16f08ba80e4de66bd71f105bb0e590588de98526d319584c"}
Jul 24 17:40:32.646974 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:32.646915    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-746c88-756d5747bd-tlg82"
Jul 24 17:40:32.734733 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:32.734704    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3139b35e-9fc7-4103-bcd1-76a99a1460e8-plugins-config-volume\") pod \"3139b35e-9fc7-4103-bcd1-76a99a1460e8\" (UID: \"3139b35e-9fc7-4103-bcd1-76a99a1460e8\") "
Jul 24 17:40:32.734880 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:32.734811    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2dkgp\" (UniqueName: \"kubernetes.io/projected/3139b35e-9fc7-4103-bcd1-76a99a1460e8-kube-api-access-2dkgp\") pod \"3139b35e-9fc7-4103-bcd1-76a99a1460e8\" (UID: \"3139b35e-9fc7-4103-bcd1-76a99a1460e8\") "
Jul 24 17:40:32.735113 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:32.735095    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3139b35e-9fc7-4103-bcd1-76a99a1460e8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3139b35e-9fc7-4103-bcd1-76a99a1460e8" (UID: "3139b35e-9fc7-4103-bcd1-76a99a1460e8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:40:32.736827 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:32.736804    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3139b35e-9fc7-4103-bcd1-76a99a1460e8-kube-api-access-2dkgp" (OuterVolumeSpecName: "kube-api-access-2dkgp") pod "3139b35e-9fc7-4103-bcd1-76a99a1460e8" (UID: "3139b35e-9fc7-4103-bcd1-76a99a1460e8"). InnerVolumeSpecName "kube-api-access-2dkgp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:40:32.835652 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:32.835606    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dkgp\" (UniqueName: \"kubernetes.io/projected/3139b35e-9fc7-4103-bcd1-76a99a1460e8-kube-api-access-2dkgp\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:40:32.835652 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:32.835644    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3139b35e-9fc7-4103-bcd1-76a99a1460e8-plugins-config-volume\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:40:33.543684 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:33.543640    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-746c88-756d5747bd-tlg82" event={"ID":"3139b35e-9fc7-4103-bcd1-76a99a1460e8","Type":"ContainerDied","Data":"3745f55772b028330dd3be921369f4c3c075ea7b7a9d6d50765ed895fdbce00a"}
Jul 24 17:40:33.543684 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:33.543663    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-746c88-756d5747bd-tlg82"
Jul 24 17:40:33.544138 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:33.543719    2582 scope.go:117] "RemoveContainer" containerID="f3971ec75ebbf14d16f08ba80e4de66bd71f105bb0e590588de98526d319584c"
Jul 24 17:40:33.582554 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:33.582527    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-746c88-756d5747bd-tlg82"]
Jul 24 17:40:33.597196 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:33.597172    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-746c88-756d5747bd-tlg82"]
Jul 24 17:40:33.762744 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:33.762716    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3139b35e-9fc7-4103-bcd1-76a99a1460e8" path="/var/lib/kubelet/pods/3139b35e-9fc7-4103-bcd1-76a99a1460e8/volumes"
Jul 24 17:40:35.482678 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:35.482632    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:40:36.801415 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:36.801378    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-746c88-7fkl6"]
Jul 24 17:40:36.803931 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:36.803905    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-746c88-7fkl6"]
Jul 24 17:40:37.764120 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:37.764082    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cd8b0d1-cfd4-4c38-9d89-633eb871ee81" path="/var/lib/kubelet/pods/9cd8b0d1-cfd4-4c38-9d89-633eb871ee81/volumes"
Jul 24 17:40:48.520317 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:48.520284    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bb341a-566d7dc99b-z5cv6"]
Jul 24 17:40:48.520753 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:48.520615    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cd8b0d1-cfd4-4c38-9d89-633eb871ee81" containerName="revoke-keys"
Jul 24 17:40:48.520753 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:48.520628    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cd8b0d1-cfd4-4c38-9d89-633eb871ee81" containerName="revoke-keys"
Jul 24 17:40:48.520753 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:48.520643    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3139b35e-9fc7-4103-bcd1-76a99a1460e8" containerName="payload-pre-processing"
Jul 24 17:40:48.520753 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:48.520649    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3139b35e-9fc7-4103-bcd1-76a99a1460e8" containerName="payload-pre-processing"
Jul 24 17:40:48.520753 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:48.520736    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cd8b0d1-cfd4-4c38-9d89-633eb871ee81" containerName="revoke-keys"
Jul 24 17:40:48.520753 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:48.520748    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3139b35e-9fc7-4103-bcd1-76a99a1460e8" containerName="payload-pre-processing"
Jul 24 17:40:48.523705 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:48.523687    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bb341a-566d7dc99b-z5cv6"
Jul 24 17:40:48.526140 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:48.526114    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-bb341a-dockercfg-jcnsf\""
Jul 24 17:40:48.526363 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:48.526340    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-bb341a\""
Jul 24 17:40:48.534120 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:48.534095    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bb341a-566d7dc99b-z5cv6"]
Jul 24 17:40:48.667542 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:48.667500    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45c26818-25ff-4828-9bd0-d2147082eef3-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-bb341a-566d7dc99b-z5cv6\" (UID: \"45c26818-25ff-4828-9bd0-d2147082eef3\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bb341a-566d7dc99b-z5cv6"
Jul 24 17:40:48.667753 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:48.667566    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bptxw\" (UniqueName: \"kubernetes.io/projected/45c26818-25ff-4828-9bd0-d2147082eef3-kube-api-access-bptxw\") pod \"payload-pre-processing-e2e-api-a-bb341a-566d7dc99b-z5cv6\" (UID: \"45c26818-25ff-4828-9bd0-d2147082eef3\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bb341a-566d7dc99b-z5cv6"
Jul 24 17:40:48.768333 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:48.768294    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45c26818-25ff-4828-9bd0-d2147082eef3-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-bb341a-566d7dc99b-z5cv6\" (UID: \"45c26818-25ff-4828-9bd0-d2147082eef3\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bb341a-566d7dc99b-z5cv6"
Jul 24 17:40:48.768504 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:48.768367    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bptxw\" (UniqueName: \"kubernetes.io/projected/45c26818-25ff-4828-9bd0-d2147082eef3-kube-api-access-bptxw\") pod \"payload-pre-processing-e2e-api-a-bb341a-566d7dc99b-z5cv6\" (UID: \"45c26818-25ff-4828-9bd0-d2147082eef3\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bb341a-566d7dc99b-z5cv6"
Jul 24 17:40:48.769005 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:48.768981    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45c26818-25ff-4828-9bd0-d2147082eef3-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-bb341a-566d7dc99b-z5cv6\" (UID: \"45c26818-25ff-4828-9bd0-d2147082eef3\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bb341a-566d7dc99b-z5cv6"
Jul 24 17:40:48.777083 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:48.777020    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bptxw\" (UniqueName: \"kubernetes.io/projected/45c26818-25ff-4828-9bd0-d2147082eef3-kube-api-access-bptxw\") pod \"payload-pre-processing-e2e-api-a-bb341a-566d7dc99b-z5cv6\" (UID: \"45c26818-25ff-4828-9bd0-d2147082eef3\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bb341a-566d7dc99b-z5cv6"
Jul 24 17:40:48.834576 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:48.834543    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bb341a-566d7dc99b-z5cv6"
Jul 24 17:40:48.966193 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:48.966165    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bb341a-566d7dc99b-z5cv6"]
Jul 24 17:40:48.968123 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:40:48.968092    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45c26818_25ff_4828_9bd0_d2147082eef3.slice/crio-eecc89a96e6bc2f9655cd4a8dc3d5ccb9f4e9d81714a4ff0c19bb4055b276d4c WatchSource:0}: Error finding container eecc89a96e6bc2f9655cd4a8dc3d5ccb9f4e9d81714a4ff0c19bb4055b276d4c: Status 404 returned error can't find the container with id eecc89a96e6bc2f9655cd4a8dc3d5ccb9f4e9d81714a4ff0c19bb4055b276d4c
Jul 24 17:40:49.624461 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:49.624420    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bb341a-566d7dc99b-z5cv6" event={"ID":"45c26818-25ff-4828-9bd0-d2147082eef3","Type":"ContainerStarted","Data":"8dcd2758aad278d2f7dd4c96aec3c4ba33e160bf13602b6492c7bc528b04c632"}
Jul 24 17:40:49.624882 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:49.624474    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bb341a-566d7dc99b-z5cv6"
Jul 24 17:40:49.624882 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:49.624489    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bb341a-566d7dc99b-z5cv6" event={"ID":"45c26818-25ff-4828-9bd0-d2147082eef3","Type":"ContainerStarted","Data":"eecc89a96e6bc2f9655cd4a8dc3d5ccb9f4e9d81714a4ff0c19bb4055b276d4c"}
Jul 24 17:40:49.645717 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:49.645652    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bb341a-566d7dc99b-z5cv6" podStartSLOduration=1.645636052 podStartE2EDuration="1.645636052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:40:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:40:49.644083269 +0000 UTC m=+2240.460057905" watchObservedRunningTime="2026-07-24 17:40:49.645636052 +0000 UTC m=+2240.461610669"
Jul 24 17:40:50.573655 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:40:50.573619    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:41:00.634341 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:00.634267    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bb341a-566d7dc99b-z5cv6"
Jul 24 17:41:02.880979 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:02.880940    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:41:08.236073 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:08.236037    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bb341a-jmxz4"]
Jul 24 17:41:08.239459 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:08.239439    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bb341a-jmxz4"
Jul 24 17:41:08.241898 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:08.241876    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 17:41:08.241994 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:08.241973    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tdqg2\""
Jul 24 17:41:08.247770 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:08.247743    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bb341a-jmxz4"]
Jul 24 17:41:08.336897 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:08.336864    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e03b9681-163f-4a43-a53a-e04e3451bfd8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-bb341a-jmxz4\" (UID: \"e03b9681-163f-4a43-a53a-e04e3451bfd8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bb341a-jmxz4"
Jul 24 17:41:08.438301 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:08.438262    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e03b9681-163f-4a43-a53a-e04e3451bfd8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-bb341a-jmxz4\" (UID: \"e03b9681-163f-4a43-a53a-e04e3451bfd8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bb341a-jmxz4"
Jul 24 17:41:08.438963 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:08.438943    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e03b9681-163f-4a43-a53a-e04e3451bfd8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-bb341a-jmxz4\" (UID: \"e03b9681-163f-4a43-a53a-e04e3451bfd8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bb341a-jmxz4"
Jul 24 17:41:08.550150 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:08.550116    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bb341a-jmxz4"
Jul 24 17:41:08.681657 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:08.681625    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bb341a-jmxz4"]
Jul 24 17:41:08.684790 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:41:08.684760    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode03b9681_163f_4a43_a53a_e04e3451bfd8.slice/crio-c35b8d2ec9d543366b3b9d7f69f50c21a7ab64e0be251c5ffccf1994bd36940a WatchSource:0}: Error finding container c35b8d2ec9d543366b3b9d7f69f50c21a7ab64e0be251c5ffccf1994bd36940a: Status 404 returned error can't find the container with id c35b8d2ec9d543366b3b9d7f69f50c21a7ab64e0be251c5ffccf1994bd36940a
Jul 24 17:41:08.723085 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:08.723056    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bb341a-jmxz4" event={"ID":"e03b9681-163f-4a43-a53a-e04e3451bfd8","Type":"ContainerStarted","Data":"c35b8d2ec9d543366b3b9d7f69f50c21a7ab64e0be251c5ffccf1994bd36940a"}
Jul 24 17:41:09.729350 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:09.729260    2582 generic.go:356] "Generic (PLEG): container finished" podID="e03b9681-163f-4a43-a53a-e04e3451bfd8" containerID="a1e1d690a4167230b17a0e212631ef5297861ec2540c44f6a476e4d155d09840" exitCode=0
Jul 24 17:41:09.729350 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:09.729338    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bb341a-jmxz4" event={"ID":"e03b9681-163f-4a43-a53a-e04e3451bfd8","Type":"ContainerDied","Data":"a1e1d690a4167230b17a0e212631ef5297861ec2540c44f6a476e4d155d09840"}
Jul 24 17:41:10.857874 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:10.857848    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bb341a-jmxz4"
Jul 24 17:41:10.960238 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:10.960194    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e03b9681-163f-4a43-a53a-e04e3451bfd8-maas-api-service-ca\") pod \"e03b9681-163f-4a43-a53a-e04e3451bfd8\" (UID: \"e03b9681-163f-4a43-a53a-e04e3451bfd8\") "
Jul 24 17:41:10.960559 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:10.960537    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e03b9681-163f-4a43-a53a-e04e3451bfd8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e03b9681-163f-4a43-a53a-e04e3451bfd8" (UID: "e03b9681-163f-4a43-a53a-e04e3451bfd8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:41:11.060827 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:11.060796    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e03b9681-163f-4a43-a53a-e04e3451bfd8-maas-api-service-ca\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:41:11.741043 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:11.741002    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bb341a-jmxz4" event={"ID":"e03b9681-163f-4a43-a53a-e04e3451bfd8","Type":"ContainerDied","Data":"c35b8d2ec9d543366b3b9d7f69f50c21a7ab64e0be251c5ffccf1994bd36940a"}
Jul 24 17:41:11.741221 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:11.741064    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c35b8d2ec9d543366b3b9d7f69f50c21a7ab64e0be251c5ffccf1994bd36940a"
Jul 24 17:41:11.741221 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:11.741015    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bb341a-jmxz4"
Jul 24 17:41:23.963283 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:23.963244    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bb341a-566d7dc99b-z5cv6"]
Jul 24 17:41:23.963818 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:23.963510    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bb341a-566d7dc99b-z5cv6" podUID="45c26818-25ff-4828-9bd0-d2147082eef3" containerName="payload-pre-processing" containerID="cri-o://8dcd2758aad278d2f7dd4c96aec3c4ba33e160bf13602b6492c7bc528b04c632" gracePeriod=30
Jul 24 17:41:24.212401 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:24.212377    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bb341a-566d7dc99b-z5cv6"
Jul 24 17:41:24.281549 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:24.281516    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bptxw\" (UniqueName: \"kubernetes.io/projected/45c26818-25ff-4828-9bd0-d2147082eef3-kube-api-access-bptxw\") pod \"45c26818-25ff-4828-9bd0-d2147082eef3\" (UID: \"45c26818-25ff-4828-9bd0-d2147082eef3\") "
Jul 24 17:41:24.281742 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:24.281558    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45c26818-25ff-4828-9bd0-d2147082eef3-plugins-config-volume\") pod \"45c26818-25ff-4828-9bd0-d2147082eef3\" (UID: \"45c26818-25ff-4828-9bd0-d2147082eef3\") "
Jul 24 17:41:24.282024 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:24.282001    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45c26818-25ff-4828-9bd0-d2147082eef3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "45c26818-25ff-4828-9bd0-d2147082eef3" (UID: "45c26818-25ff-4828-9bd0-d2147082eef3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:41:24.283604 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:24.283573    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45c26818-25ff-4828-9bd0-d2147082eef3-kube-api-access-bptxw" (OuterVolumeSpecName: "kube-api-access-bptxw") pod "45c26818-25ff-4828-9bd0-d2147082eef3" (UID: "45c26818-25ff-4828-9bd0-d2147082eef3"). InnerVolumeSpecName "kube-api-access-bptxw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:41:24.383042 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:24.382993    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bptxw\" (UniqueName: \"kubernetes.io/projected/45c26818-25ff-4828-9bd0-d2147082eef3-kube-api-access-bptxw\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:41:24.383042 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:24.383034    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45c26818-25ff-4828-9bd0-d2147082eef3-plugins-config-volume\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:41:24.808261 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:24.808225    2582 generic.go:356] "Generic (PLEG): container finished" podID="45c26818-25ff-4828-9bd0-d2147082eef3" containerID="8dcd2758aad278d2f7dd4c96aec3c4ba33e160bf13602b6492c7bc528b04c632" exitCode=0
Jul 24 17:41:24.808446 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:24.808266    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bb341a-566d7dc99b-z5cv6"
Jul 24 17:41:24.808446 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:24.808310    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bb341a-566d7dc99b-z5cv6" event={"ID":"45c26818-25ff-4828-9bd0-d2147082eef3","Type":"ContainerDied","Data":"8dcd2758aad278d2f7dd4c96aec3c4ba33e160bf13602b6492c7bc528b04c632"}
Jul 24 17:41:24.808446 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:24.808356    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bb341a-566d7dc99b-z5cv6" event={"ID":"45c26818-25ff-4828-9bd0-d2147082eef3","Type":"ContainerDied","Data":"eecc89a96e6bc2f9655cd4a8dc3d5ccb9f4e9d81714a4ff0c19bb4055b276d4c"}
Jul 24 17:41:24.808446 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:24.808377    2582 scope.go:117] "RemoveContainer" containerID="8dcd2758aad278d2f7dd4c96aec3c4ba33e160bf13602b6492c7bc528b04c632"
Jul 24 17:41:24.817681 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:24.817655    2582 scope.go:117] "RemoveContainer" containerID="8dcd2758aad278d2f7dd4c96aec3c4ba33e160bf13602b6492c7bc528b04c632"
Jul 24 17:41:24.817955 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:41:24.817935    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8dcd2758aad278d2f7dd4c96aec3c4ba33e160bf13602b6492c7bc528b04c632\": container with ID starting with 8dcd2758aad278d2f7dd4c96aec3c4ba33e160bf13602b6492c7bc528b04c632 not found: ID does not exist" containerID="8dcd2758aad278d2f7dd4c96aec3c4ba33e160bf13602b6492c7bc528b04c632"
Jul 24 17:41:24.818023 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:24.817962    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8dcd2758aad278d2f7dd4c96aec3c4ba33e160bf13602b6492c7bc528b04c632"} err="failed to get container status \"8dcd2758aad278d2f7dd4c96aec3c4ba33e160bf13602b6492c7bc528b04c632\": rpc error: code = NotFound desc = could not find container \"8dcd2758aad278d2f7dd4c96aec3c4ba33e160bf13602b6492c7bc528b04c632\": container with ID starting with 8dcd2758aad278d2f7dd4c96aec3c4ba33e160bf13602b6492c7bc528b04c632 not found: ID does not exist"
Jul 24 17:41:24.828937 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:24.828913    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bb341a-566d7dc99b-z5cv6"]
Jul 24 17:41:24.832384 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:24.832364    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bb341a-566d7dc99b-z5cv6"]
Jul 24 17:41:25.762817 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:25.762781    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45c26818-25ff-4828-9bd0-d2147082eef3" path="/var/lib/kubelet/pods/45c26818-25ff-4828-9bd0-d2147082eef3/volumes"
Jul 24 17:41:26.575923 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:26.575888    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:41:28.320120 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:28.320086    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bb341a-jmxz4"]
Jul 24 17:41:28.321875 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:28.321850    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bb341a-jmxz4"]
Jul 24 17:41:29.765322 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:29.765292    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e03b9681-163f-4a43-a53a-e04e3451bfd8" path="/var/lib/kubelet/pods/e03b9681-163f-4a43-a53a-e04e3451bfd8/volumes"
Jul 24 17:41:29.939340 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:29.939273    2582 scope.go:117] "RemoveContainer" containerID="ca48161df30dea7a07410391e95692f969a1f6e5191aabe08a286e9fa423c866"
Jul 24 17:41:35.372616 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:35.372579    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bcb261-b4gwk"]
Jul 24 17:41:35.373194 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:35.372937    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e03b9681-163f-4a43-a53a-e04e3451bfd8" containerName="revoke-keys"
Jul 24 17:41:35.373194 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:35.372952    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e03b9681-163f-4a43-a53a-e04e3451bfd8" containerName="revoke-keys"
Jul 24 17:41:35.373194 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:35.372973    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45c26818-25ff-4828-9bd0-d2147082eef3" containerName="payload-pre-processing"
Jul 24 17:41:35.373194 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:35.372978    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="45c26818-25ff-4828-9bd0-d2147082eef3" containerName="payload-pre-processing"
Jul 24 17:41:35.373194 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:35.373038    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e03b9681-163f-4a43-a53a-e04e3451bfd8" containerName="revoke-keys"
Jul 24 17:41:35.373194 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:35.373048    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="45c26818-25ff-4828-9bd0-d2147082eef3" containerName="payload-pre-processing"
Jul 24 17:41:35.375936 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:35.375921    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bcb261-b4gwk"
Jul 24 17:41:35.378229 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:35.378210    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tdqg2\""
Jul 24 17:41:35.378346 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:35.378269    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 17:41:35.383907 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:35.383883    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bcb261-b4gwk"]
Jul 24 17:41:35.483041 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:35.483001    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca66f01c-da98-4c83-aa52-d3ba793b097e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-bcb261-b4gwk\" (UID: \"ca66f01c-da98-4c83-aa52-d3ba793b097e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bcb261-b4gwk"
Jul 24 17:41:35.583471 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:35.583434    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca66f01c-da98-4c83-aa52-d3ba793b097e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-bcb261-b4gwk\" (UID: \"ca66f01c-da98-4c83-aa52-d3ba793b097e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bcb261-b4gwk"
Jul 24 17:41:35.584067 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:35.584048    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca66f01c-da98-4c83-aa52-d3ba793b097e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-bcb261-b4gwk\" (UID: \"ca66f01c-da98-4c83-aa52-d3ba793b097e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bcb261-b4gwk"
Jul 24 17:41:35.686781 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:35.686655    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bcb261-b4gwk"
Jul 24 17:41:35.813551 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:35.813516    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bcb261-b4gwk"]
Jul 24 17:41:35.815085 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:41:35.815059    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca66f01c_da98_4c83_aa52_d3ba793b097e.slice/crio-ed8cf7aec22952fa2ad0342638118d27eb4d10d0add2f820d702e441b0b8588b WatchSource:0}: Error finding container ed8cf7aec22952fa2ad0342638118d27eb4d10d0add2f820d702e441b0b8588b: Status 404 returned error can't find the container with id ed8cf7aec22952fa2ad0342638118d27eb4d10d0add2f820d702e441b0b8588b
Jul 24 17:41:35.862758 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:35.862729    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bcb261-b4gwk" event={"ID":"ca66f01c-da98-4c83-aa52-d3ba793b097e","Type":"ContainerStarted","Data":"ed8cf7aec22952fa2ad0342638118d27eb4d10d0add2f820d702e441b0b8588b"}
Jul 24 17:41:36.870276 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:36.870172    2582 generic.go:356] "Generic (PLEG): container finished" podID="ca66f01c-da98-4c83-aa52-d3ba793b097e" containerID="b4d9060f965a45d0ee27eee0c482915117532b071b287a60bb6e1d236ca5ad44" exitCode=0
Jul 24 17:41:36.870276 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:36.870264    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bcb261-b4gwk" event={"ID":"ca66f01c-da98-4c83-aa52-d3ba793b097e","Type":"ContainerDied","Data":"b4d9060f965a45d0ee27eee0c482915117532b071b287a60bb6e1d236ca5ad44"}
Jul 24 17:41:37.998223 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:37.998201    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bcb261-b4gwk"
Jul 24 17:41:38.107158 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:38.107105    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca66f01c-da98-4c83-aa52-d3ba793b097e-maas-api-service-ca\") pod \"ca66f01c-da98-4c83-aa52-d3ba793b097e\" (UID: \"ca66f01c-da98-4c83-aa52-d3ba793b097e\") "
Jul 24 17:41:38.107523 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:38.107489    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca66f01c-da98-4c83-aa52-d3ba793b097e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ca66f01c-da98-4c83-aa52-d3ba793b097e" (UID: "ca66f01c-da98-4c83-aa52-d3ba793b097e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:41:38.208640 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:38.208543    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca66f01c-da98-4c83-aa52-d3ba793b097e-maas-api-service-ca\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:41:38.881564 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:38.881532    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bcb261-b4gwk"
Jul 24 17:41:38.881758 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:38.881566    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bcb261-b4gwk" event={"ID":"ca66f01c-da98-4c83-aa52-d3ba793b097e","Type":"ContainerDied","Data":"ed8cf7aec22952fa2ad0342638118d27eb4d10d0add2f820d702e441b0b8588b"}
Jul 24 17:41:38.881758 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:38.881610    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ed8cf7aec22952fa2ad0342638118d27eb4d10d0add2f820d702e441b0b8588b"
Jul 24 17:41:55.458610 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:55.458577    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bcb261-b4gwk"]
Jul 24 17:41:55.464757 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:55.464730    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bcb261-b4gwk"]
Jul 24 17:41:55.763506 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:55.763472    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca66f01c-da98-4c83-aa52-d3ba793b097e" path="/var/lib/kubelet/pods/ca66f01c-da98-4c83-aa52-d3ba793b097e/volumes"
Jul 24 17:41:56.277333 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:41:56.277297    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:42:07.070070 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:42:07.070036    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-028d4b-786956f876-wkttw"]
Jul 24 17:42:07.071234 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:42:07.071210    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca66f01c-da98-4c83-aa52-d3ba793b097e" containerName="revoke-keys"
Jul 24 17:42:07.071374 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:42:07.071363    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca66f01c-da98-4c83-aa52-d3ba793b097e" containerName="revoke-keys"
Jul 24 17:42:07.071524 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:42:07.071514    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca66f01c-da98-4c83-aa52-d3ba793b097e" containerName="revoke-keys"
Jul 24 17:42:07.074724 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:42:07.074693    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-028d4b-786956f876-wkttw"
Jul 24 17:42:07.078902 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:42:07.078876    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-028d4b\""
Jul 24 17:42:07.079271 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:42:07.079256    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-028d4b-dockercfg-lttnd\""
Jul 24 17:42:07.102197 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:42:07.102172    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-028d4b-786956f876-wkttw"]
Jul 24 17:42:07.161110 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:42:07.161077    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp2jn\" (UniqueName: \"kubernetes.io/projected/c9fc141f-8210-4571-a0ac-241964ddef24-kube-api-access-mp2jn\") pod \"payload-pre-processing-e2e-shared-a-028d4b-786956f876-wkttw\" (UID: \"c9fc141f-8210-4571-a0ac-241964ddef24\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-028d4b-786956f876-wkttw"
Jul 24 17:42:07.161293 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:42:07.161134    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9fc141f-8210-4571-a0ac-241964ddef24-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-028d4b-786956f876-wkttw\" (UID: \"c9fc141f-8210-4571-a0ac-241964ddef24\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-028d4b-786956f876-wkttw"
Jul 24 17:42:07.261817 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:42:07.261774    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp2jn\" (UniqueName: \"kubernetes.io/projected/c9fc141f-8210-4571-a0ac-241964ddef24-kube-api-access-mp2jn\") pod \"payload-pre-processing-e2e-shared-a-028d4b-786956f876-wkttw\" (UID: \"c9fc141f-8210-4571-a0ac-241964ddef24\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-028d4b-786956f876-wkttw"
Jul 24 17:42:07.262020 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:42:07.261831    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9fc141f-8210-4571-a0ac-241964ddef24-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-028d4b-786956f876-wkttw\" (UID: \"c9fc141f-8210-4571-a0ac-241964ddef24\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-028d4b-786956f876-wkttw"
Jul 24 17:42:07.262515 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:42:07.262490    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9fc141f-8210-4571-a0ac-241964ddef24-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-028d4b-786956f876-wkttw\" (UID: \"c9fc141f-8210-4571-a0ac-241964ddef24\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-028d4b-786956f876-wkttw"
Jul 24 17:42:07.269935 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:42:07.269909    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp2jn\" (UniqueName: \"kubernetes.io/projected/c9fc141f-8210-4571-a0ac-241964ddef24-kube-api-access-mp2jn\") pod \"payload-pre-processing-e2e-shared-a-028d4b-786956f876-wkttw\" (UID: \"c9fc141f-8210-4571-a0ac-241964ddef24\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-028d4b-786956f876-wkttw"
Jul 24 17:42:07.385181 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:42:07.385085    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-028d4b-786956f876-wkttw"
Jul 24 17:42:07.519818 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:42:07.519794    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-028d4b-786956f876-wkttw"]
Jul 24 17:42:07.521949 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:42:07.521919    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9fc141f_8210_4571_a0ac_241964ddef24.slice/crio-11b84a5ae88d6d2b93cd47ff50d804af2b2ec3ba2cc19b70b655fab18959cbb8 WatchSource:0}: Error finding container 11b84a5ae88d6d2b93cd47ff50d804af2b2ec3ba2cc19b70b655fab18959cbb8: Status 404 returned error can't find the container with id 11b84a5ae88d6d2b93cd47ff50d804af2b2ec3ba2cc19b70b655fab18959cbb8
Jul 24 17:42:08.026266 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:42:08.026232    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-028d4b-786956f876-wkttw" event={"ID":"c9fc141f-8210-4571-a0ac-241964ddef24","Type":"ContainerStarted","Data":"ac61aa4ce14d437082295ac053c4ce6876665b54ca9c1c2d0dcd14a6c624dda7"}
Jul 24 17:42:08.026486 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:42:08.026284    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-028d4b-786956f876-wkttw" event={"ID":"c9fc141f-8210-4571-a0ac-241964ddef24","Type":"ContainerStarted","Data":"11b84a5ae88d6d2b93cd47ff50d804af2b2ec3ba2cc19b70b655fab18959cbb8"}
Jul 24 17:42:08.026486 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:42:08.026325    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-028d4b-786956f876-wkttw"
Jul 24 17:42:08.048730 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:42:08.048661    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-028d4b-786956f876-wkttw" podStartSLOduration=1.048645714 podStartE2EDuration="1.048645714s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:42:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:42:08.046605489 +0000 UTC m=+2318.862580104" watchObservedRunningTime="2026-07-24 17:42:08.048645714 +0000 UTC m=+2318.864620361"
Jul 24 17:42:13.676685 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:42:13.676636    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:42:15.064731 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:42:15.064699    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-a11aa7-5b6bf9d4b8-9jqbl"]
Jul 24 17:42:15.071743 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:42:15.070183    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a11aa7-5b6bf9d4b8-9jqbl"
Jul 24 17:42:15.074000 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:42:15.073933    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-a11aa7-dockercfg-jz5w9\""
Jul 24 17:42:15.074199 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:42:15.073379    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-a11aa7\""
Jul 24 17:42:15.081052 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:42:15.081029    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-a11aa7-5b6bf9d4b8-9jqbl"]
Jul 24 17:42:15.229588 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:42:15.229556    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4fcc7b9-5c2a-429b-9b7b-9facbde67c2a-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-a11aa7-5b6bf9d4b8-9jqbl\" (UID: \"c4fcc7b9-5c2a-429b-9b7b-9facbde67c2a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a11aa7-5b6bf9d4b8-9jqbl"
Jul 24 17:42:15.229588 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:42:15.229590    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6fhc\" (UniqueName: \"kubernetes.io/projected/c4fcc7b9-5c2a-429b-9b7b-9facbde67c2a-kube-api-access-w6fhc\") pod \"payload-pre-processing-e2e-shared-b-a11aa7-5b6bf9d4b8-9jqbl\" (UID: \"c4fcc7b9-5c2a-429b-9b7b-9facbde67c2a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a11aa7-5b6bf9d4b8-9jqbl"
Jul 24 17:42:15.330316 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:42:15.330240    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4fcc7b9-5c2a-429b-9b7b-9facbde67c2a-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-a11aa7-5b6bf9d4b8-9jqbl\" (UID: \"c4fcc7b9-5c2a-429b-9b7b-9facbde67c2a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a11aa7-5b6bf9d4b8-9jqbl"
Jul 24 17:42:15.330316 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:42:15.330275    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6fhc\" (UniqueName: \"kubernetes.io/projected/c4fcc7b9-5c2a-429b-9b7b-9facbde67c2a-kube-api-access-w6fhc\") pod \"payload-pre-processing-e2e-shared-b-a11aa7-5b6bf9d4b8-9jqbl\" (UID: \"c4fcc7b9-5c2a-429b-9b7b-9facbde67c2a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a11aa7-5b6bf9d4b8-9jqbl"
Jul 24 17:42:15.331018 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:42:15.330998    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4fcc7b9-5c2a-429b-9b7b-9facbde67c2a-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-a11aa7-5b6bf9d4b8-9jqbl\" (UID: \"c4fcc7b9-5c2a-429b-9b7b-9facbde67c2a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a11aa7-5b6bf9d4b8-9jqbl"
Jul 24 17:42:15.339136 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:42:15.339111    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6fhc\" (UniqueName: \"kubernetes.io/projected/c4fcc7b9-5c2a-429b-9b7b-9facbde67c2a-kube-api-access-w6fhc\") pod \"payload-pre-processing-e2e-shared-b-a11aa7-5b6bf9d4b8-9jqbl\" (UID: \"c4fcc7b9-5c2a-429b-9b7b-9facbde67c2a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a11aa7-5b6bf9d4b8-9jqbl"
Jul 24 17:42:15.388116 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:42:15.388084    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a11aa7-5b6bf9d4b8-9jqbl"
Jul 24 17:42:15.518521 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:42:15.518489    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-a11aa7-5b6bf9d4b8-9jqbl"]
Jul 24 17:42:15.519706 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:42:15.519659    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4fcc7b9_5c2a_429b_9b7b_9facbde67c2a.slice/crio-8bd1c8c060ecffcb7ddf31525f393003d71a10a49536ec6c1ab07d5ed77474a0 WatchSource:0}: Error finding container 8bd1c8c060ecffcb7ddf31525f393003d71a10a49536ec6c1ab07d5ed77474a0: Status 404 returned error can't find the container with id 8bd1c8c060ecffcb7ddf31525f393003d71a10a49536ec6c1ab07d5ed77474a0
Jul 24 17:42:16.071931 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:42:16.071891    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a11aa7-5b6bf9d4b8-9jqbl" event={"ID":"c4fcc7b9-5c2a-429b-9b7b-9facbde67c2a","Type":"ContainerStarted","Data":"efda88f3a04e2ddb82ea60de15b12d4cc98ccf2089a903f99e0a3eb36832d8d1"}
Jul 24 17:42:16.072342 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:42:16.071942    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a11aa7-5b6bf9d4b8-9jqbl" event={"ID":"c4fcc7b9-5c2a-429b-9b7b-9facbde67c2a","Type":"ContainerStarted","Data":"8bd1c8c060ecffcb7ddf31525f393003d71a10a49536ec6c1ab07d5ed77474a0"}
Jul 24 17:42:16.072342 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:42:16.072017    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a11aa7-5b6bf9d4b8-9jqbl"
Jul 24 17:42:16.092681 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:42:16.092618    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a11aa7-5b6bf9d4b8-9jqbl" podStartSLOduration=1.092603292 podStartE2EDuration="1.092603292s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:42:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:42:16.090739938 +0000 UTC m=+2326.906714552" watchObservedRunningTime="2026-07-24 17:42:16.092603292 +0000 UTC m=+2326.908577906"
Jul 24 17:42:19.035868 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:42:19.035836    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-028d4b-786956f876-wkttw"
Jul 24 17:42:26.085976 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:42:26.085889    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:42:27.079851 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:42:27.079815    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a11aa7-5b6bf9d4b8-9jqbl"
Jul 24 17:42:29.965817 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:42:29.965735    2582 scope.go:117] "RemoveContainer" containerID="ea044b6824bf8f4f0c354effb7dd390829a533090bfa0c1351f3d65edcaa6302"
Jul 24 17:42:42.429435 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:42:42.429399    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:43:04.689132 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:43:04.689098    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-a11aa7/auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp"]
Jul 24 17:43:04.692657 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:43:04.692641    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a11aa7/auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp"
Jul 24 17:43:04.695909 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:43:04.695879    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a11aa7\"/\"auth-test-model-a11aa7-kserve-self-signed-certs\""
Jul 24 17:43:04.695909 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:43:04.695895    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a11aa7\"/\"kube-root-ca.crt\""
Jul 24 17:43:04.696128 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:43:04.695891    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a11aa7\"/\"default-dockercfg-48vlk\""
Jul 24 17:43:04.696128 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:43:04.695926    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a11aa7\"/\"openshift-service-ca.crt\""
Jul 24 17:43:04.700588 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:43:04.700567    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a11aa7/auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp"]
Jul 24 17:43:04.867201 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:43:04.867161    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40de2b92-8bab-42b6-a7e0-8a9af77b0b49-tls-certs\") pod \"auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp\" (UID: \"40de2b92-8bab-42b6-a7e0-8a9af77b0b49\") " pod="ai-tenant-e2e-shared-b-a11aa7/auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp"
Jul 24 17:43:04.867404 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:43:04.867212    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40de2b92-8bab-42b6-a7e0-8a9af77b0b49-tmp-dir\") pod \"auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp\" (UID: \"40de2b92-8bab-42b6-a7e0-8a9af77b0b49\") " pod="ai-tenant-e2e-shared-b-a11aa7/auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp"
Jul 24 17:43:04.867404 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:43:04.867237    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb5pf\" (UniqueName: \"kubernetes.io/projected/40de2b92-8bab-42b6-a7e0-8a9af77b0b49-kube-api-access-jb5pf\") pod \"auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp\" (UID: \"40de2b92-8bab-42b6-a7e0-8a9af77b0b49\") " pod="ai-tenant-e2e-shared-b-a11aa7/auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp"
Jul 24 17:43:04.867404 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:43:04.867277    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40de2b92-8bab-42b6-a7e0-8a9af77b0b49-dshm\") pod \"auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp\" (UID: \"40de2b92-8bab-42b6-a7e0-8a9af77b0b49\") " pod="ai-tenant-e2e-shared-b-a11aa7/auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp"
Jul 24 17:43:04.867404 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:43:04.867302    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40de2b92-8bab-42b6-a7e0-8a9af77b0b49-home\") pod \"auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp\" (UID: \"40de2b92-8bab-42b6-a7e0-8a9af77b0b49\") " pod="ai-tenant-e2e-shared-b-a11aa7/auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp"
Jul 24 17:43:04.867568 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:43:04.867401    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40de2b92-8bab-42b6-a7e0-8a9af77b0b49-model-cache\") pod \"auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp\" (UID: \"40de2b92-8bab-42b6-a7e0-8a9af77b0b49\") " pod="ai-tenant-e2e-shared-b-a11aa7/auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp"
Jul 24 17:43:04.968432 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:43:04.968342    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40de2b92-8bab-42b6-a7e0-8a9af77b0b49-model-cache\") pod \"auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp\" (UID: \"40de2b92-8bab-42b6-a7e0-8a9af77b0b49\") " pod="ai-tenant-e2e-shared-b-a11aa7/auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp"
Jul 24 17:43:04.968432 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:43:04.968391    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40de2b92-8bab-42b6-a7e0-8a9af77b0b49-tls-certs\") pod \"auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp\" (UID: \"40de2b92-8bab-42b6-a7e0-8a9af77b0b49\") " pod="ai-tenant-e2e-shared-b-a11aa7/auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp"
Jul 24 17:43:04.968701 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:43:04.968554    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40de2b92-8bab-42b6-a7e0-8a9af77b0b49-tmp-dir\") pod \"auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp\" (UID: \"40de2b92-8bab-42b6-a7e0-8a9af77b0b49\") " pod="ai-tenant-e2e-shared-b-a11aa7/auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp"
Jul 24 17:43:04.968701 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:43:04.968582    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb5pf\" (UniqueName: \"kubernetes.io/projected/40de2b92-8bab-42b6-a7e0-8a9af77b0b49-kube-api-access-jb5pf\") pod \"auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp\" (UID: \"40de2b92-8bab-42b6-a7e0-8a9af77b0b49\") " pod="ai-tenant-e2e-shared-b-a11aa7/auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp"
Jul 24 17:43:04.968823 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:43:04.968708    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40de2b92-8bab-42b6-a7e0-8a9af77b0b49-dshm\") pod \"auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp\" (UID: \"40de2b92-8bab-42b6-a7e0-8a9af77b0b49\") " pod="ai-tenant-e2e-shared-b-a11aa7/auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp"
Jul 24 17:43:04.968823 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:43:04.968760    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40de2b92-8bab-42b6-a7e0-8a9af77b0b49-home\") pod \"auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp\" (UID: \"40de2b92-8bab-42b6-a7e0-8a9af77b0b49\") " pod="ai-tenant-e2e-shared-b-a11aa7/auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp"
Jul 24 17:43:04.968913 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:43:04.968828    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40de2b92-8bab-42b6-a7e0-8a9af77b0b49-model-cache\") pod \"auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp\" (UID: \"40de2b92-8bab-42b6-a7e0-8a9af77b0b49\") " pod="ai-tenant-e2e-shared-b-a11aa7/auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp"
Jul 24 17:43:04.968913 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:43:04.968878    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40de2b92-8bab-42b6-a7e0-8a9af77b0b49-tmp-dir\") pod \"auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp\" (UID: \"40de2b92-8bab-42b6-a7e0-8a9af77b0b49\") " pod="ai-tenant-e2e-shared-b-a11aa7/auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp"
Jul 24 17:43:04.969087 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:43:04.969068    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40de2b92-8bab-42b6-a7e0-8a9af77b0b49-home\") pod \"auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp\" (UID: \"40de2b92-8bab-42b6-a7e0-8a9af77b0b49\") " pod="ai-tenant-e2e-shared-b-a11aa7/auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp"
Jul 24 17:43:04.970728 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:43:04.970705    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40de2b92-8bab-42b6-a7e0-8a9af77b0b49-dshm\") pod \"auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp\" (UID: \"40de2b92-8bab-42b6-a7e0-8a9af77b0b49\") " pod="ai-tenant-e2e-shared-b-a11aa7/auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp"
Jul 24 17:43:04.971043 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:43:04.971026    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40de2b92-8bab-42b6-a7e0-8a9af77b0b49-tls-certs\") pod \"auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp\" (UID: \"40de2b92-8bab-42b6-a7e0-8a9af77b0b49\") " pod="ai-tenant-e2e-shared-b-a11aa7/auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp"
Jul 24 17:43:04.976371 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:43:04.976347    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb5pf\" (UniqueName: \"kubernetes.io/projected/40de2b92-8bab-42b6-a7e0-8a9af77b0b49-kube-api-access-jb5pf\") pod \"auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp\" (UID: \"40de2b92-8bab-42b6-a7e0-8a9af77b0b49\") " pod="ai-tenant-e2e-shared-b-a11aa7/auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp"
Jul 24 17:43:05.002430 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:43:05.002401    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a11aa7/auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp"
Jul 24 17:43:05.132541 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:43:05.132519    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a11aa7/auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp"]
Jul 24 17:43:05.134041 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:43:05.134009    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod40de2b92_8bab_42b6_a7e0_8a9af77b0b49.slice/crio-9ace0dc5f4476fb4d8ebf74c51f02339b2b8f006157cba5abb1104f95cd1b24e WatchSource:0}: Error finding container 9ace0dc5f4476fb4d8ebf74c51f02339b2b8f006157cba5abb1104f95cd1b24e: Status 404 returned error can't find the container with id 9ace0dc5f4476fb4d8ebf74c51f02339b2b8f006157cba5abb1104f95cd1b24e
Jul 24 17:43:05.323631 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:43:05.321117    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a11aa7/auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp" event={"ID":"40de2b92-8bab-42b6-a7e0-8a9af77b0b49","Type":"ContainerStarted","Data":"c80a3873c34992848a3d22f1b9f48d1c8939dd6c07e7c6f7a23ec496f4b85bc2"}
Jul 24 17:43:05.323631 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:43:05.321185    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a11aa7/auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp" event={"ID":"40de2b92-8bab-42b6-a7e0-8a9af77b0b49","Type":"ContainerStarted","Data":"9ace0dc5f4476fb4d8ebf74c51f02339b2b8f006157cba5abb1104f95cd1b24e"}
Jul 24 17:43:05.340220 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:43:05.340174    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-a11aa7/auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp" podStartSLOduration=1.340159023 podStartE2EDuration="1.340159023s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:43:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:43:05.338266814 +0000 UTC m=+2376.154241446" watchObservedRunningTime="2026-07-24 17:43:05.340159023 +0000 UTC m=+2376.156133636"
Jul 24 17:43:08.780684 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:43:08.780626    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:43:15.003122 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:43:15.003082    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-a11aa7/auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp"
Jul 24 17:43:15.003745 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:43:15.003135    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-a11aa7/auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp"
Jul 24 17:43:15.015646 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:43:15.015616    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-a11aa7/auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp"
Jul 24 17:43:15.383319 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:43:15.383236    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-a11aa7/auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp"
Jul 24 17:43:27.277447 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:43:27.277413    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:43:29.834789 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:43:29.834707    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d6w2m_9f3e23c6-31a7-4e7b-83df-d6eee1335b7a/ovn-acl-logging/0.log"
Jul 24 17:43:29.841174 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:43:29.841156    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d6w2m_9f3e23c6-31a7-4e7b-83df-d6eee1335b7a/ovn-acl-logging/0.log"
Jul 24 17:43:41.380600 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:43:41.380567    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:43:59.483138 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:43:59.483061    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:44:17.676698 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:44:17.676650    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:44:35.083089 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:44:35.083048    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:44:52.987845 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:44:52.987806    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:45:00.142753 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:00.142720    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a11aa7-29748585-l4fwl"]
Jul 24 17:45:00.146257 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:00.146235    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a11aa7-29748585-l4fwl"
Jul 24 17:45:00.148115 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:00.148088    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-028d4b-29748585-vg6fc"]
Jul 24 17:45:00.148412 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:00.148393    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tdqg2\""
Jul 24 17:45:00.151426 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:00.151406    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748585-phbb7"]
Jul 24 17:45:00.151552 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:00.151521    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-028d4b-29748585-vg6fc"
Jul 24 17:45:00.154927 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:00.154908    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748585-phbb7"
Jul 24 17:45:00.157488 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:00.157474    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a11aa7-29748585-l4fwl"
Jul 24 17:45:00.164844 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:00.164829    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-028d4b-29748585-vg6fc"
Jul 24 17:45:00.170330 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:00.170297    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-028d4b-29748585-vg6fc"]
Jul 24 17:45:00.174155 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:00.174065    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a11aa7-29748585-l4fwl"]
Jul 24 17:45:00.176984 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:00.176960    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748585-phbb7"]
Jul 24 17:45:00.200160 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:00.200133    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748585-phbb7"
Jul 24 17:45:00.318978 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:00.318903    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a11aa7-29748585-l4fwl"]
Jul 24 17:45:00.321390 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:45:00.321353    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5793042_ec6b_45b6_b875_63dc4303c274.slice/crio-d0cab9fd621e5f0bf6c8e45856ecae1f060d32694dab52de5496f54a9fc6196c WatchSource:0}: Error finding container d0cab9fd621e5f0bf6c8e45856ecae1f060d32694dab52de5496f54a9fc6196c: Status 404 returned error can't find the container with id d0cab9fd621e5f0bf6c8e45856ecae1f060d32694dab52de5496f54a9fc6196c
Jul 24 17:45:00.380621 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:00.380597    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748585-phbb7"]
Jul 24 17:45:00.383711 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:45:00.383643    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c824b25_de6c_43b3_8254_9c6e936c9a6d.slice/crio-53733c9ba726b6d433c7be1aaca97abbdda8314a5cb4bcc2a6f9e5045cf2c3f5 WatchSource:0}: Error finding container 53733c9ba726b6d433c7be1aaca97abbdda8314a5cb4bcc2a6f9e5045cf2c3f5: Status 404 returned error can't find the container with id 53733c9ba726b6d433c7be1aaca97abbdda8314a5cb4bcc2a6f9e5045cf2c3f5
Jul 24 17:45:00.548324 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:00.548296    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-028d4b-29748585-vg6fc"]
Jul 24 17:45:00.552735 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:45:00.552703    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36838d7c_57f4_448a_9d91_fe95830a5611.slice/crio-dd984aeab5e4965fa6e399a350bfd1c8c8fa81327566196a1d1d217ba544e8b6 WatchSource:0}: Error finding container dd984aeab5e4965fa6e399a350bfd1c8c8fa81327566196a1d1d217ba544e8b6: Status 404 returned error can't find the container with id dd984aeab5e4965fa6e399a350bfd1c8c8fa81327566196a1d1d217ba544e8b6
Jul 24 17:45:00.895469 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:00.895433    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748585-phbb7" event={"ID":"4c824b25-de6c-43b3-8254-9c6e936c9a6d","Type":"ContainerStarted","Data":"399ed7a9cd86fad66dc201ec4d9bcc8aeadcbe3a5ee8d2aac2b26be699147403"}
Jul 24 17:45:00.895730 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:00.895495    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748585-phbb7" event={"ID":"4c824b25-de6c-43b3-8254-9c6e936c9a6d","Type":"ContainerStarted","Data":"53733c9ba726b6d433c7be1aaca97abbdda8314a5cb4bcc2a6f9e5045cf2c3f5"}
Jul 24 17:45:00.896912 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:00.896884    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-028d4b-29748585-vg6fc" event={"ID":"36838d7c-57f4-448a-9d91-fe95830a5611","Type":"ContainerStarted","Data":"8a629a7798352cd21faa0b2cbe1c42289305d58dce1a6d7a2ddbffae88d94126"}
Jul 24 17:45:00.897008 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:00.896939    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-028d4b-29748585-vg6fc" event={"ID":"36838d7c-57f4-448a-9d91-fe95830a5611","Type":"ContainerStarted","Data":"dd984aeab5e4965fa6e399a350bfd1c8c8fa81327566196a1d1d217ba544e8b6"}
Jul 24 17:45:00.898208 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:00.898182    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a11aa7-29748585-l4fwl" event={"ID":"a5793042-ec6b-45b6-b875-63dc4303c274","Type":"ContainerStarted","Data":"68e3b32cbbd868118dff41dc000b323766f27d0694a9d6482deb13a218dc4adb"}
Jul 24 17:45:00.898342 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:00.898223    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a11aa7-29748585-l4fwl" event={"ID":"a5793042-ec6b-45b6-b875-63dc4303c274","Type":"ContainerStarted","Data":"d0cab9fd621e5f0bf6c8e45856ecae1f060d32694dab52de5496f54a9fc6196c"}
Jul 24 17:45:00.909948 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:00.909806    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748585-phbb7" podStartSLOduration=0.909789592 podStartE2EDuration="909.789592ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:45:00.909432554 +0000 UTC m=+2491.725407180" watchObservedRunningTime="2026-07-24 17:45:00.909789592 +0000 UTC m=+2491.725764208"
Jul 24 17:45:00.923170 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:00.923124    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a11aa7-29748585-l4fwl" podStartSLOduration=0.923109838 podStartE2EDuration="923.109838ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:45:00.92211562 +0000 UTC m=+2491.738090240" watchObservedRunningTime="2026-07-24 17:45:00.923109838 +0000 UTC m=+2491.739084450"
Jul 24 17:45:01.904241 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:01.904208    2582 generic.go:356] "Generic (PLEG): container finished" podID="4c824b25-de6c-43b3-8254-9c6e936c9a6d" containerID="399ed7a9cd86fad66dc201ec4d9bcc8aeadcbe3a5ee8d2aac2b26be699147403" exitCode=0
Jul 24 17:45:01.904735 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:01.904256    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748585-phbb7" event={"ID":"4c824b25-de6c-43b3-8254-9c6e936c9a6d","Type":"ContainerDied","Data":"399ed7a9cd86fad66dc201ec4d9bcc8aeadcbe3a5ee8d2aac2b26be699147403"}
Jul 24 17:45:01.905809 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:01.905781    2582 generic.go:356] "Generic (PLEG): container finished" podID="36838d7c-57f4-448a-9d91-fe95830a5611" containerID="8a629a7798352cd21faa0b2cbe1c42289305d58dce1a6d7a2ddbffae88d94126" exitCode=0
Jul 24 17:45:01.905925 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:01.905856    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-028d4b-29748585-vg6fc" event={"ID":"36838d7c-57f4-448a-9d91-fe95830a5611","Type":"ContainerDied","Data":"8a629a7798352cd21faa0b2cbe1c42289305d58dce1a6d7a2ddbffae88d94126"}
Jul 24 17:45:01.907157 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:01.907139    2582 generic.go:356] "Generic (PLEG): container finished" podID="a5793042-ec6b-45b6-b875-63dc4303c274" containerID="68e3b32cbbd868118dff41dc000b323766f27d0694a9d6482deb13a218dc4adb" exitCode=0
Jul 24 17:45:01.907225 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:01.907210    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a11aa7-29748585-l4fwl" event={"ID":"a5793042-ec6b-45b6-b875-63dc4303c274","Type":"ContainerDied","Data":"68e3b32cbbd868118dff41dc000b323766f27d0694a9d6482deb13a218dc4adb"}
Jul 24 17:45:01.921611 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:01.921569    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-028d4b-29748585-vg6fc" podStartSLOduration=1.9215539640000001 podStartE2EDuration="1.921553964s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:45:00.936796566 +0000 UTC m=+2491.752771199" watchObservedRunningTime="2026-07-24 17:45:01.921553964 +0000 UTC m=+2492.737528582"
Jul 24 17:45:03.055293 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:03.055263    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a11aa7-29748585-l4fwl"
Jul 24 17:45:03.090446 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:03.090423    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748585-phbb7"
Jul 24 17:45:03.093322 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:03.093303    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-028d4b-29748585-vg6fc"
Jul 24 17:45:03.919435 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:03.919400    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-028d4b-29748585-vg6fc" event={"ID":"36838d7c-57f4-448a-9d91-fe95830a5611","Type":"ContainerDied","Data":"dd984aeab5e4965fa6e399a350bfd1c8c8fa81327566196a1d1d217ba544e8b6"}
Jul 24 17:45:03.919632 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:03.919452    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd984aeab5e4965fa6e399a350bfd1c8c8fa81327566196a1d1d217ba544e8b6"
Jul 24 17:45:03.919632 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:03.919413    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-028d4b-29748585-vg6fc"
Jul 24 17:45:03.920803 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:03.920783    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a11aa7-29748585-l4fwl"
Jul 24 17:45:03.920910 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:03.920828    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a11aa7-29748585-l4fwl" event={"ID":"a5793042-ec6b-45b6-b875-63dc4303c274","Type":"ContainerDied","Data":"d0cab9fd621e5f0bf6c8e45856ecae1f060d32694dab52de5496f54a9fc6196c"}
Jul 24 17:45:03.920910 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:03.920865    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d0cab9fd621e5f0bf6c8e45856ecae1f060d32694dab52de5496f54a9fc6196c"
Jul 24 17:45:03.922235 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:03.922219    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748585-phbb7"
Jul 24 17:45:03.922325 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:03.922219    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748585-phbb7" event={"ID":"4c824b25-de6c-43b3-8254-9c6e936c9a6d","Type":"ContainerDied","Data":"53733c9ba726b6d433c7be1aaca97abbdda8314a5cb4bcc2a6f9e5045cf2c3f5"}
Jul 24 17:45:03.922366 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:03.922351    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="53733c9ba726b6d433c7be1aaca97abbdda8314a5cb4bcc2a6f9e5045cf2c3f5"
Jul 24 17:45:09.569882 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:09.569847    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a11aa7/auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp"]
Jul 24 17:45:12.683191 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:12.683151    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:45:24.587744 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:24.587703    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-a11aa7/auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp" podUID="40de2b92-8bab-42b6-a7e0-8a9af77b0b49" containerName="main" containerID="cri-o://c80a3873c34992848a3d22f1b9f48d1c8939dd6c07e7c6f7a23ec496f4b85bc2" gracePeriod=45
Jul 24 17:45:24.833222 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:24.833198    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a11aa7/auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp"
Jul 24 17:45:24.983889 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:24.983820    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40de2b92-8bab-42b6-a7e0-8a9af77b0b49-home\") pod \"40de2b92-8bab-42b6-a7e0-8a9af77b0b49\" (UID: \"40de2b92-8bab-42b6-a7e0-8a9af77b0b49\") "
Jul 24 17:45:24.984033 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:24.983898    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40de2b92-8bab-42b6-a7e0-8a9af77b0b49-tmp-dir\") pod \"40de2b92-8bab-42b6-a7e0-8a9af77b0b49\" (UID: \"40de2b92-8bab-42b6-a7e0-8a9af77b0b49\") "
Jul 24 17:45:24.984033 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:24.983918    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40de2b92-8bab-42b6-a7e0-8a9af77b0b49-tls-certs\") pod \"40de2b92-8bab-42b6-a7e0-8a9af77b0b49\" (UID: \"40de2b92-8bab-42b6-a7e0-8a9af77b0b49\") "
Jul 24 17:45:24.984033 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:24.983940    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40de2b92-8bab-42b6-a7e0-8a9af77b0b49-model-cache\") pod \"40de2b92-8bab-42b6-a7e0-8a9af77b0b49\" (UID: \"40de2b92-8bab-42b6-a7e0-8a9af77b0b49\") "
Jul 24 17:45:24.984033 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:24.983959    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40de2b92-8bab-42b6-a7e0-8a9af77b0b49-dshm\") pod \"40de2b92-8bab-42b6-a7e0-8a9af77b0b49\" (UID: \"40de2b92-8bab-42b6-a7e0-8a9af77b0b49\") "
Jul 24 17:45:24.984033 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:24.984006    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jb5pf\" (UniqueName: \"kubernetes.io/projected/40de2b92-8bab-42b6-a7e0-8a9af77b0b49-kube-api-access-jb5pf\") pod \"40de2b92-8bab-42b6-a7e0-8a9af77b0b49\" (UID: \"40de2b92-8bab-42b6-a7e0-8a9af77b0b49\") "
Jul 24 17:45:24.984282 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:24.984120    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40de2b92-8bab-42b6-a7e0-8a9af77b0b49-home" (OuterVolumeSpecName: "home") pod "40de2b92-8bab-42b6-a7e0-8a9af77b0b49" (UID: "40de2b92-8bab-42b6-a7e0-8a9af77b0b49"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:45:24.984282 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:24.984166    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40de2b92-8bab-42b6-a7e0-8a9af77b0b49-model-cache" (OuterVolumeSpecName: "model-cache") pod "40de2b92-8bab-42b6-a7e0-8a9af77b0b49" (UID: "40de2b92-8bab-42b6-a7e0-8a9af77b0b49"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:45:24.984282 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:24.984190    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40de2b92-8bab-42b6-a7e0-8a9af77b0b49-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "40de2b92-8bab-42b6-a7e0-8a9af77b0b49" (UID: "40de2b92-8bab-42b6-a7e0-8a9af77b0b49"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:45:24.984282 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:24.984246    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40de2b92-8bab-42b6-a7e0-8a9af77b0b49-home\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:45:24.984282 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:24.984261    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40de2b92-8bab-42b6-a7e0-8a9af77b0b49-tmp-dir\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:45:24.984282 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:24.984270    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40de2b92-8bab-42b6-a7e0-8a9af77b0b49-model-cache\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:45:24.986226 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:24.986203    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40de2b92-8bab-42b6-a7e0-8a9af77b0b49-kube-api-access-jb5pf" (OuterVolumeSpecName: "kube-api-access-jb5pf") pod "40de2b92-8bab-42b6-a7e0-8a9af77b0b49" (UID: "40de2b92-8bab-42b6-a7e0-8a9af77b0b49"). InnerVolumeSpecName "kube-api-access-jb5pf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:45:24.986323 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:24.986248    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40de2b92-8bab-42b6-a7e0-8a9af77b0b49-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "40de2b92-8bab-42b6-a7e0-8a9af77b0b49" (UID: "40de2b92-8bab-42b6-a7e0-8a9af77b0b49"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:45:24.986323 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:24.986274    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40de2b92-8bab-42b6-a7e0-8a9af77b0b49-dshm" (OuterVolumeSpecName: "dshm") pod "40de2b92-8bab-42b6-a7e0-8a9af77b0b49" (UID: "40de2b92-8bab-42b6-a7e0-8a9af77b0b49"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:45:25.039601 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:25.039570    2582 generic.go:356] "Generic (PLEG): container finished" podID="40de2b92-8bab-42b6-a7e0-8a9af77b0b49" containerID="c80a3873c34992848a3d22f1b9f48d1c8939dd6c07e7c6f7a23ec496f4b85bc2" exitCode=0
Jul 24 17:45:25.039736 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:25.039616    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a11aa7/auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp"
Jul 24 17:45:25.039736 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:25.039649    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a11aa7/auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp" event={"ID":"40de2b92-8bab-42b6-a7e0-8a9af77b0b49","Type":"ContainerDied","Data":"c80a3873c34992848a3d22f1b9f48d1c8939dd6c07e7c6f7a23ec496f4b85bc2"}
Jul 24 17:45:25.039736 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:25.039708    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a11aa7/auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp" event={"ID":"40de2b92-8bab-42b6-a7e0-8a9af77b0b49","Type":"ContainerDied","Data":"9ace0dc5f4476fb4d8ebf74c51f02339b2b8f006157cba5abb1104f95cd1b24e"}
Jul 24 17:45:25.039736 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:25.039725    2582 scope.go:117] "RemoveContainer" containerID="c80a3873c34992848a3d22f1b9f48d1c8939dd6c07e7c6f7a23ec496f4b85bc2"
Jul 24 17:45:25.048739 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:25.048724    2582 scope.go:117] "RemoveContainer" containerID="c80a3873c34992848a3d22f1b9f48d1c8939dd6c07e7c6f7a23ec496f4b85bc2"
Jul 24 17:45:25.048991 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:45:25.048973    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c80a3873c34992848a3d22f1b9f48d1c8939dd6c07e7c6f7a23ec496f4b85bc2\": container with ID starting with c80a3873c34992848a3d22f1b9f48d1c8939dd6c07e7c6f7a23ec496f4b85bc2 not found: ID does not exist" containerID="c80a3873c34992848a3d22f1b9f48d1c8939dd6c07e7c6f7a23ec496f4b85bc2"
Jul 24 17:45:25.049060 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:25.048997    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c80a3873c34992848a3d22f1b9f48d1c8939dd6c07e7c6f7a23ec496f4b85bc2"} err="failed to get container status \"c80a3873c34992848a3d22f1b9f48d1c8939dd6c07e7c6f7a23ec496f4b85bc2\": rpc error: code = NotFound desc = could not find container \"c80a3873c34992848a3d22f1b9f48d1c8939dd6c07e7c6f7a23ec496f4b85bc2\": container with ID starting with c80a3873c34992848a3d22f1b9f48d1c8939dd6c07e7c6f7a23ec496f4b85bc2 not found: ID does not exist"
Jul 24 17:45:25.062753 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:25.062733    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a11aa7/auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp"]
Jul 24 17:45:25.066239 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:25.066220    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-a11aa7/auth-test-model-a11aa7-kserve-77c7455c7f-hpqmp"]
Jul 24 17:45:25.084976 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:25.084957    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40de2b92-8bab-42b6-a7e0-8a9af77b0b49-dshm\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:45:25.085058 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:25.084976    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jb5pf\" (UniqueName: \"kubernetes.io/projected/40de2b92-8bab-42b6-a7e0-8a9af77b0b49-kube-api-access-jb5pf\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:45:25.085058 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:25.084986    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40de2b92-8bab-42b6-a7e0-8a9af77b0b49-tls-certs\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:45:25.764406 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:25.764377    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40de2b92-8bab-42b6-a7e0-8a9af77b0b49" path="/var/lib/kubelet/pods/40de2b92-8bab-42b6-a7e0-8a9af77b0b49/volumes"
Jul 24 17:45:25.773202 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:25.773173    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:45:58.676653 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:58.676620    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-a11aa7/sub-test-model-a11aa7-kserve-86867c968c-lf94q"]
Jul 24 17:45:58.677204 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:58.677136    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36838d7c-57f4-448a-9d91-fe95830a5611" containerName="cleanup"
Jul 24 17:45:58.677204 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:58.677158    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="36838d7c-57f4-448a-9d91-fe95830a5611" containerName="cleanup"
Jul 24 17:45:58.677204 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:58.677185    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c824b25-de6c-43b3-8254-9c6e936c9a6d" containerName="cleanup"
Jul 24 17:45:58.677204 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:58.677193    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c824b25-de6c-43b3-8254-9c6e936c9a6d" containerName="cleanup"
Jul 24 17:45:58.677420 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:58.677214    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40de2b92-8bab-42b6-a7e0-8a9af77b0b49" containerName="main"
Jul 24 17:45:58.677420 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:58.677222    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="40de2b92-8bab-42b6-a7e0-8a9af77b0b49" containerName="main"
Jul 24 17:45:58.677420 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:58.677232    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5793042-ec6b-45b6-b875-63dc4303c274" containerName="cleanup"
Jul 24 17:45:58.677420 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:58.677240    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5793042-ec6b-45b6-b875-63dc4303c274" containerName="cleanup"
Jul 24 17:45:58.677420 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:58.677321    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c824b25-de6c-43b3-8254-9c6e936c9a6d" containerName="cleanup"
Jul 24 17:45:58.677420 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:58.677332    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5793042-ec6b-45b6-b875-63dc4303c274" containerName="cleanup"
Jul 24 17:45:58.677420 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:58.677344    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="36838d7c-57f4-448a-9d91-fe95830a5611" containerName="cleanup"
Jul 24 17:45:58.677420 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:58.677356    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="40de2b92-8bab-42b6-a7e0-8a9af77b0b49" containerName="main"
Jul 24 17:45:58.680658 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:58.680637    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a11aa7/sub-test-model-a11aa7-kserve-86867c968c-lf94q"
Jul 24 17:45:58.683152 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:58.683129    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a11aa7\"/\"default-dockercfg-48vlk\""
Jul 24 17:45:58.683274 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:58.683167    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a11aa7\"/\"openshift-service-ca.crt\""
Jul 24 17:45:58.684023 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:58.684006    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a11aa7\"/\"sub-test-model-a11aa7-kserve-self-signed-certs\""
Jul 24 17:45:58.684076 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:58.684006    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a11aa7\"/\"kube-root-ca.crt\""
Jul 24 17:45:58.689993 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:58.689966    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a11aa7/sub-test-model-a11aa7-kserve-86867c968c-lf94q"]
Jul 24 17:45:58.764104 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:58.764068    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d22e4035-f4f0-4b41-99c0-d651b1947832-dshm\") pod \"sub-test-model-a11aa7-kserve-86867c968c-lf94q\" (UID: \"d22e4035-f4f0-4b41-99c0-d651b1947832\") " pod="ai-tenant-e2e-shared-b-a11aa7/sub-test-model-a11aa7-kserve-86867c968c-lf94q"
Jul 24 17:45:58.764104 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:58.764107    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d22e4035-f4f0-4b41-99c0-d651b1947832-tmp-dir\") pod \"sub-test-model-a11aa7-kserve-86867c968c-lf94q\" (UID: \"d22e4035-f4f0-4b41-99c0-d651b1947832\") " pod="ai-tenant-e2e-shared-b-a11aa7/sub-test-model-a11aa7-kserve-86867c968c-lf94q"
Jul 24 17:45:58.764350 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:58.764213    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d22e4035-f4f0-4b41-99c0-d651b1947832-model-cache\") pod \"sub-test-model-a11aa7-kserve-86867c968c-lf94q\" (UID: \"d22e4035-f4f0-4b41-99c0-d651b1947832\") " pod="ai-tenant-e2e-shared-b-a11aa7/sub-test-model-a11aa7-kserve-86867c968c-lf94q"
Jul 24 17:45:58.764350 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:58.764262    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d22e4035-f4f0-4b41-99c0-d651b1947832-tls-certs\") pod \"sub-test-model-a11aa7-kserve-86867c968c-lf94q\" (UID: \"d22e4035-f4f0-4b41-99c0-d651b1947832\") " pod="ai-tenant-e2e-shared-b-a11aa7/sub-test-model-a11aa7-kserve-86867c968c-lf94q"
Jul 24 17:45:58.764350 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:58.764296    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlt8s\" (UniqueName: \"kubernetes.io/projected/d22e4035-f4f0-4b41-99c0-d651b1947832-kube-api-access-vlt8s\") pod \"sub-test-model-a11aa7-kserve-86867c968c-lf94q\" (UID: \"d22e4035-f4f0-4b41-99c0-d651b1947832\") " pod="ai-tenant-e2e-shared-b-a11aa7/sub-test-model-a11aa7-kserve-86867c968c-lf94q"
Jul 24 17:45:58.764350 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:58.764336    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d22e4035-f4f0-4b41-99c0-d651b1947832-home\") pod \"sub-test-model-a11aa7-kserve-86867c968c-lf94q\" (UID: \"d22e4035-f4f0-4b41-99c0-d651b1947832\") " pod="ai-tenant-e2e-shared-b-a11aa7/sub-test-model-a11aa7-kserve-86867c968c-lf94q"
Jul 24 17:45:58.865259 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:58.865216    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d22e4035-f4f0-4b41-99c0-d651b1947832-home\") pod \"sub-test-model-a11aa7-kserve-86867c968c-lf94q\" (UID: \"d22e4035-f4f0-4b41-99c0-d651b1947832\") " pod="ai-tenant-e2e-shared-b-a11aa7/sub-test-model-a11aa7-kserve-86867c968c-lf94q"
Jul 24 17:45:58.865462 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:58.865283    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d22e4035-f4f0-4b41-99c0-d651b1947832-dshm\") pod \"sub-test-model-a11aa7-kserve-86867c968c-lf94q\" (UID: \"d22e4035-f4f0-4b41-99c0-d651b1947832\") " pod="ai-tenant-e2e-shared-b-a11aa7/sub-test-model-a11aa7-kserve-86867c968c-lf94q"
Jul 24 17:45:58.865462 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:58.865312    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d22e4035-f4f0-4b41-99c0-d651b1947832-tmp-dir\") pod \"sub-test-model-a11aa7-kserve-86867c968c-lf94q\" (UID: \"d22e4035-f4f0-4b41-99c0-d651b1947832\") " pod="ai-tenant-e2e-shared-b-a11aa7/sub-test-model-a11aa7-kserve-86867c968c-lf94q"
Jul 24 17:45:58.865462 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:58.865388    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d22e4035-f4f0-4b41-99c0-d651b1947832-model-cache\") pod \"sub-test-model-a11aa7-kserve-86867c968c-lf94q\" (UID: \"d22e4035-f4f0-4b41-99c0-d651b1947832\") " pod="ai-tenant-e2e-shared-b-a11aa7/sub-test-model-a11aa7-kserve-86867c968c-lf94q"
Jul 24 17:45:58.865462 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:58.865442    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d22e4035-f4f0-4b41-99c0-d651b1947832-tls-certs\") pod \"sub-test-model-a11aa7-kserve-86867c968c-lf94q\" (UID: \"d22e4035-f4f0-4b41-99c0-d651b1947832\") " pod="ai-tenant-e2e-shared-b-a11aa7/sub-test-model-a11aa7-kserve-86867c968c-lf94q"
Jul 24 17:45:58.865619 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:58.865490    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlt8s\" (UniqueName: \"kubernetes.io/projected/d22e4035-f4f0-4b41-99c0-d651b1947832-kube-api-access-vlt8s\") pod \"sub-test-model-a11aa7-kserve-86867c968c-lf94q\" (UID: \"d22e4035-f4f0-4b41-99c0-d651b1947832\") " pod="ai-tenant-e2e-shared-b-a11aa7/sub-test-model-a11aa7-kserve-86867c968c-lf94q"
Jul 24 17:45:58.866077 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:58.865894    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d22e4035-f4f0-4b41-99c0-d651b1947832-model-cache\") pod \"sub-test-model-a11aa7-kserve-86867c968c-lf94q\" (UID: \"d22e4035-f4f0-4b41-99c0-d651b1947832\") " pod="ai-tenant-e2e-shared-b-a11aa7/sub-test-model-a11aa7-kserve-86867c968c-lf94q"
Jul 24 17:45:58.866077 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:58.865968    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d22e4035-f4f0-4b41-99c0-d651b1947832-tmp-dir\") pod \"sub-test-model-a11aa7-kserve-86867c968c-lf94q\" (UID: \"d22e4035-f4f0-4b41-99c0-d651b1947832\") " pod="ai-tenant-e2e-shared-b-a11aa7/sub-test-model-a11aa7-kserve-86867c968c-lf94q"
Jul 24 17:45:58.866418 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:58.866182    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d22e4035-f4f0-4b41-99c0-d651b1947832-home\") pod \"sub-test-model-a11aa7-kserve-86867c968c-lf94q\" (UID: \"d22e4035-f4f0-4b41-99c0-d651b1947832\") " pod="ai-tenant-e2e-shared-b-a11aa7/sub-test-model-a11aa7-kserve-86867c968c-lf94q"
Jul 24 17:45:58.868028 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:58.868002    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d22e4035-f4f0-4b41-99c0-d651b1947832-dshm\") pod \"sub-test-model-a11aa7-kserve-86867c968c-lf94q\" (UID: \"d22e4035-f4f0-4b41-99c0-d651b1947832\") " pod="ai-tenant-e2e-shared-b-a11aa7/sub-test-model-a11aa7-kserve-86867c968c-lf94q"
Jul 24 17:45:58.868338 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:58.868319    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d22e4035-f4f0-4b41-99c0-d651b1947832-tls-certs\") pod \"sub-test-model-a11aa7-kserve-86867c968c-lf94q\" (UID: \"d22e4035-f4f0-4b41-99c0-d651b1947832\") " pod="ai-tenant-e2e-shared-b-a11aa7/sub-test-model-a11aa7-kserve-86867c968c-lf94q"
Jul 24 17:45:58.874235 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:58.874216    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlt8s\" (UniqueName: \"kubernetes.io/projected/d22e4035-f4f0-4b41-99c0-d651b1947832-kube-api-access-vlt8s\") pod \"sub-test-model-a11aa7-kserve-86867c968c-lf94q\" (UID: \"d22e4035-f4f0-4b41-99c0-d651b1947832\") " pod="ai-tenant-e2e-shared-b-a11aa7/sub-test-model-a11aa7-kserve-86867c968c-lf94q"
Jul 24 17:45:58.990605 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:58.990518    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a11aa7/sub-test-model-a11aa7-kserve-86867c968c-lf94q"
Jul 24 17:45:59.124867 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:59.124843    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a11aa7/sub-test-model-a11aa7-kserve-86867c968c-lf94q"]
Jul 24 17:45:59.126023 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:45:59.125990    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd22e4035_f4f0_4b41_99c0_d651b1947832.slice/crio-4a28d4f3bb47ec34e8f74fec83eade4a83a7f9f3d12992f5a92a9a7b1147927e WatchSource:0}: Error finding container 4a28d4f3bb47ec34e8f74fec83eade4a83a7f9f3d12992f5a92a9a7b1147927e: Status 404 returned error can't find the container with id 4a28d4f3bb47ec34e8f74fec83eade4a83a7f9f3d12992f5a92a9a7b1147927e
Jul 24 17:45:59.214780 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:59.214738    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a11aa7/sub-test-model-a11aa7-kserve-86867c968c-lf94q" event={"ID":"d22e4035-f4f0-4b41-99c0-d651b1947832","Type":"ContainerStarted","Data":"e5298988f71ea8d04637f44ead4010fb402f21cc299e0b51e21047c880acfade"}
Jul 24 17:45:59.214949 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:59.214786    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a11aa7/sub-test-model-a11aa7-kserve-86867c968c-lf94q" event={"ID":"d22e4035-f4f0-4b41-99c0-d651b1947832","Type":"ContainerStarted","Data":"4a28d4f3bb47ec34e8f74fec83eade4a83a7f9f3d12992f5a92a9a7b1147927e"}
Jul 24 17:45:59.233562 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:45:59.233512    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-a11aa7/sub-test-model-a11aa7-kserve-86867c968c-lf94q" podStartSLOduration=1.233494912 podStartE2EDuration="1.233494912s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:45:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:45:59.230947177 +0000 UTC m=+2550.046921795" watchObservedRunningTime="2026-07-24 17:45:59.233494912 +0000 UTC m=+2550.049469524"
Jul 24 17:46:02.581295 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:46:02.581259    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:46:08.991147 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:46:08.991107    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-a11aa7/sub-test-model-a11aa7-kserve-86867c968c-lf94q"
Jul 24 17:46:08.991563 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:46:08.991163    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-a11aa7/sub-test-model-a11aa7-kserve-86867c968c-lf94q"
Jul 24 17:46:09.003572 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:46:09.003540    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-a11aa7/sub-test-model-a11aa7-kserve-86867c968c-lf94q"
Jul 24 17:46:09.282552 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:46:09.282470    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-a11aa7/sub-test-model-a11aa7-kserve-86867c968c-lf94q"
Jul 24 17:46:17.094755 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:46:17.094711    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:46:30.013194 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:46:30.013163    2582 scope.go:117] "RemoveContainer" containerID="5bb8fbe2d41ae3dfa0ab814fcb366aa400adb3a4aa2a1aebc389295fbf79a0fc"
Jul 24 17:46:30.021703 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:46:30.021663    2582 scope.go:117] "RemoveContainer" containerID="a5717e22ca028109105da06506f594d72007a27be21edcbbeede19014af809bb"
Jul 24 17:46:31.284908 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:46:31.284871    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:46:38.616340 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:46:38.616302    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a11aa7/sub-test-model-a11aa7-kserve-86867c968c-lf94q"]
Jul 24 17:46:49.476741 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:46:49.476704    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:46:53.634329 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:46:53.634233    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-a11aa7/sub-test-model-a11aa7-kserve-86867c968c-lf94q" podUID="d22e4035-f4f0-4b41-99c0-d651b1947832" containerName="main" containerID="cri-o://e5298988f71ea8d04637f44ead4010fb402f21cc299e0b51e21047c880acfade" gracePeriod=45
Jul 24 17:46:53.879730 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:46:53.879700    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a11aa7/sub-test-model-a11aa7-kserve-86867c968c-lf94q"
Jul 24 17:46:53.935900 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:46:53.935824    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlt8s\" (UniqueName: \"kubernetes.io/projected/d22e4035-f4f0-4b41-99c0-d651b1947832-kube-api-access-vlt8s\") pod \"d22e4035-f4f0-4b41-99c0-d651b1947832\" (UID: \"d22e4035-f4f0-4b41-99c0-d651b1947832\") "
Jul 24 17:46:53.935900 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:46:53.935864    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d22e4035-f4f0-4b41-99c0-d651b1947832-model-cache\") pod \"d22e4035-f4f0-4b41-99c0-d651b1947832\" (UID: \"d22e4035-f4f0-4b41-99c0-d651b1947832\") "
Jul 24 17:46:53.935900 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:46:53.935887    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d22e4035-f4f0-4b41-99c0-d651b1947832-home\") pod \"d22e4035-f4f0-4b41-99c0-d651b1947832\" (UID: \"d22e4035-f4f0-4b41-99c0-d651b1947832\") "
Jul 24 17:46:53.936155 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:46:53.935933    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d22e4035-f4f0-4b41-99c0-d651b1947832-tmp-dir\") pod \"d22e4035-f4f0-4b41-99c0-d651b1947832\" (UID: \"d22e4035-f4f0-4b41-99c0-d651b1947832\") "
Jul 24 17:46:53.936155 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:46:53.935977    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d22e4035-f4f0-4b41-99c0-d651b1947832-dshm\") pod \"d22e4035-f4f0-4b41-99c0-d651b1947832\" (UID: \"d22e4035-f4f0-4b41-99c0-d651b1947832\") "
Jul 24 17:46:53.936155 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:46:53.935994    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d22e4035-f4f0-4b41-99c0-d651b1947832-tls-certs\") pod \"d22e4035-f4f0-4b41-99c0-d651b1947832\" (UID: \"d22e4035-f4f0-4b41-99c0-d651b1947832\") "
Jul 24 17:46:53.936155 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:46:53.936126    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d22e4035-f4f0-4b41-99c0-d651b1947832-model-cache" (OuterVolumeSpecName: "model-cache") pod "d22e4035-f4f0-4b41-99c0-d651b1947832" (UID: "d22e4035-f4f0-4b41-99c0-d651b1947832"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:46:53.936357 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:46:53.936239    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d22e4035-f4f0-4b41-99c0-d651b1947832-model-cache\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:46:53.936357 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:46:53.936261    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d22e4035-f4f0-4b41-99c0-d651b1947832-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d22e4035-f4f0-4b41-99c0-d651b1947832" (UID: "d22e4035-f4f0-4b41-99c0-d651b1947832"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:46:53.936357 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:46:53.936318    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d22e4035-f4f0-4b41-99c0-d651b1947832-home" (OuterVolumeSpecName: "home") pod "d22e4035-f4f0-4b41-99c0-d651b1947832" (UID: "d22e4035-f4f0-4b41-99c0-d651b1947832"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:46:53.938099 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:46:53.938073    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d22e4035-f4f0-4b41-99c0-d651b1947832-dshm" (OuterVolumeSpecName: "dshm") pod "d22e4035-f4f0-4b41-99c0-d651b1947832" (UID: "d22e4035-f4f0-4b41-99c0-d651b1947832"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:46:53.938197 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:46:53.938091    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d22e4035-f4f0-4b41-99c0-d651b1947832-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d22e4035-f4f0-4b41-99c0-d651b1947832" (UID: "d22e4035-f4f0-4b41-99c0-d651b1947832"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:46:53.938197 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:46:53.938167    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d22e4035-f4f0-4b41-99c0-d651b1947832-kube-api-access-vlt8s" (OuterVolumeSpecName: "kube-api-access-vlt8s") pod "d22e4035-f4f0-4b41-99c0-d651b1947832" (UID: "d22e4035-f4f0-4b41-99c0-d651b1947832"). InnerVolumeSpecName "kube-api-access-vlt8s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:46:54.036822 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:46:54.036785    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d22e4035-f4f0-4b41-99c0-d651b1947832-dshm\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:46:54.036822 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:46:54.036814    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d22e4035-f4f0-4b41-99c0-d651b1947832-tls-certs\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:46:54.036822 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:46:54.036829    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlt8s\" (UniqueName: \"kubernetes.io/projected/d22e4035-f4f0-4b41-99c0-d651b1947832-kube-api-access-vlt8s\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:46:54.037071 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:46:54.036841    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d22e4035-f4f0-4b41-99c0-d651b1947832-home\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:46:54.037071 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:46:54.036853    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d22e4035-f4f0-4b41-99c0-d651b1947832-tmp-dir\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:46:54.508227 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:46:54.508192    2582 generic.go:356] "Generic (PLEG): container finished" podID="d22e4035-f4f0-4b41-99c0-d651b1947832" containerID="e5298988f71ea8d04637f44ead4010fb402f21cc299e0b51e21047c880acfade" exitCode=0
Jul 24 17:46:54.508427 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:46:54.508234    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a11aa7/sub-test-model-a11aa7-kserve-86867c968c-lf94q"
Jul 24 17:46:54.508427 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:46:54.508272    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a11aa7/sub-test-model-a11aa7-kserve-86867c968c-lf94q" event={"ID":"d22e4035-f4f0-4b41-99c0-d651b1947832","Type":"ContainerDied","Data":"e5298988f71ea8d04637f44ead4010fb402f21cc299e0b51e21047c880acfade"}
Jul 24 17:46:54.508427 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:46:54.508312    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a11aa7/sub-test-model-a11aa7-kserve-86867c968c-lf94q" event={"ID":"d22e4035-f4f0-4b41-99c0-d651b1947832","Type":"ContainerDied","Data":"4a28d4f3bb47ec34e8f74fec83eade4a83a7f9f3d12992f5a92a9a7b1147927e"}
Jul 24 17:46:54.508427 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:46:54.508328    2582 scope.go:117] "RemoveContainer" containerID="e5298988f71ea8d04637f44ead4010fb402f21cc299e0b51e21047c880acfade"
Jul 24 17:46:54.517315 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:46:54.517296    2582 scope.go:117] "RemoveContainer" containerID="e5298988f71ea8d04637f44ead4010fb402f21cc299e0b51e21047c880acfade"
Jul 24 17:46:54.517544 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:46:54.517527    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5298988f71ea8d04637f44ead4010fb402f21cc299e0b51e21047c880acfade\": container with ID starting with e5298988f71ea8d04637f44ead4010fb402f21cc299e0b51e21047c880acfade not found: ID does not exist" containerID="e5298988f71ea8d04637f44ead4010fb402f21cc299e0b51e21047c880acfade"
Jul 24 17:46:54.517595 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:46:54.517551    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5298988f71ea8d04637f44ead4010fb402f21cc299e0b51e21047c880acfade"} err="failed to get container status \"e5298988f71ea8d04637f44ead4010fb402f21cc299e0b51e21047c880acfade\": rpc error: code = NotFound desc = could not find container \"e5298988f71ea8d04637f44ead4010fb402f21cc299e0b51e21047c880acfade\": container with ID starting with e5298988f71ea8d04637f44ead4010fb402f21cc299e0b51e21047c880acfade not found: ID does not exist"
Jul 24 17:46:54.530042 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:46:54.530016    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a11aa7/sub-test-model-a11aa7-kserve-86867c968c-lf94q"]
Jul 24 17:46:54.535824 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:46:54.535798    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-a11aa7/sub-test-model-a11aa7-kserve-86867c968c-lf94q"]
Jul 24 17:46:55.764120 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:46:55.764081    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d22e4035-f4f0-4b41-99c0-d651b1947832" path="/var/lib/kubelet/pods/d22e4035-f4f0-4b41-99c0-d651b1947832/volumes"
Jul 24 17:47:06.060055 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:47:06.060020    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-a11aa7/rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw"]
Jul 24 17:47:06.060716 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:47:06.060544    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d22e4035-f4f0-4b41-99c0-d651b1947832" containerName="main"
Jul 24 17:47:06.060716 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:47:06.060566    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d22e4035-f4f0-4b41-99c0-d651b1947832" containerName="main"
Jul 24 17:47:06.060716 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:47:06.060654    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d22e4035-f4f0-4b41-99c0-d651b1947832" containerName="main"
Jul 24 17:47:06.064847 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:47:06.064832    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a11aa7/rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw"
Jul 24 17:47:06.067388 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:47:06.067368    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a11aa7\"/\"openshift-service-ca.crt\""
Jul 24 17:47:06.068274 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:47:06.068253    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a11aa7\"/\"default-dockercfg-48vlk\""
Jul 24 17:47:06.068388 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:47:06.068348    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a11aa7\"/\"rate-test-model-a11aa7-kserve-self-signed-certs\""
Jul 24 17:47:06.068470 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:47:06.068451    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a11aa7\"/\"kube-root-ca.crt\""
Jul 24 17:47:06.073208 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:47:06.073188    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a11aa7/rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw"]
Jul 24 17:47:06.142227 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:47:06.142196    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ef369b4-0922-4ecb-aaec-2df005af1d5e-model-cache\") pod \"rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw\" (UID: \"5ef369b4-0922-4ecb-aaec-2df005af1d5e\") " pod="ai-tenant-e2e-shared-b-a11aa7/rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw"
Jul 24 17:47:06.142398 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:47:06.142251    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ef369b4-0922-4ecb-aaec-2df005af1d5e-home\") pod \"rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw\" (UID: \"5ef369b4-0922-4ecb-aaec-2df005af1d5e\") " pod="ai-tenant-e2e-shared-b-a11aa7/rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw"
Jul 24 17:47:06.142398 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:47:06.142322    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ef369b4-0922-4ecb-aaec-2df005af1d5e-dshm\") pod \"rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw\" (UID: \"5ef369b4-0922-4ecb-aaec-2df005af1d5e\") " pod="ai-tenant-e2e-shared-b-a11aa7/rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw"
Jul 24 17:47:06.142398 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:47:06.142384    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ef369b4-0922-4ecb-aaec-2df005af1d5e-tmp-dir\") pod \"rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw\" (UID: \"5ef369b4-0922-4ecb-aaec-2df005af1d5e\") " pod="ai-tenant-e2e-shared-b-a11aa7/rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw"
Jul 24 17:47:06.142500 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:47:06.142408    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xbwb\" (UniqueName: \"kubernetes.io/projected/5ef369b4-0922-4ecb-aaec-2df005af1d5e-kube-api-access-9xbwb\") pod \"rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw\" (UID: \"5ef369b4-0922-4ecb-aaec-2df005af1d5e\") " pod="ai-tenant-e2e-shared-b-a11aa7/rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw"
Jul 24 17:47:06.142500 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:47:06.142438    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ef369b4-0922-4ecb-aaec-2df005af1d5e-tls-certs\") pod \"rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw\" (UID: \"5ef369b4-0922-4ecb-aaec-2df005af1d5e\") " pod="ai-tenant-e2e-shared-b-a11aa7/rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw"
Jul 24 17:47:06.243136 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:47:06.243102    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ef369b4-0922-4ecb-aaec-2df005af1d5e-home\") pod \"rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw\" (UID: \"5ef369b4-0922-4ecb-aaec-2df005af1d5e\") " pod="ai-tenant-e2e-shared-b-a11aa7/rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw"
Jul 24 17:47:06.243334 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:47:06.243146    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ef369b4-0922-4ecb-aaec-2df005af1d5e-dshm\") pod \"rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw\" (UID: \"5ef369b4-0922-4ecb-aaec-2df005af1d5e\") " pod="ai-tenant-e2e-shared-b-a11aa7/rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw"
Jul 24 17:47:06.243334 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:47:06.243182    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ef369b4-0922-4ecb-aaec-2df005af1d5e-tmp-dir\") pod \"rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw\" (UID: \"5ef369b4-0922-4ecb-aaec-2df005af1d5e\") " pod="ai-tenant-e2e-shared-b-a11aa7/rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw"
Jul 24 17:47:06.243334 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:47:06.243208    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xbwb\" (UniqueName: \"kubernetes.io/projected/5ef369b4-0922-4ecb-aaec-2df005af1d5e-kube-api-access-9xbwb\") pod \"rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw\" (UID: \"5ef369b4-0922-4ecb-aaec-2df005af1d5e\") " pod="ai-tenant-e2e-shared-b-a11aa7/rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw"
Jul 24 17:47:06.243334 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:47:06.243237    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ef369b4-0922-4ecb-aaec-2df005af1d5e-tls-certs\") pod \"rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw\" (UID: \"5ef369b4-0922-4ecb-aaec-2df005af1d5e\") " pod="ai-tenant-e2e-shared-b-a11aa7/rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw"
Jul 24 17:47:06.243334 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:47:06.243259    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ef369b4-0922-4ecb-aaec-2df005af1d5e-model-cache\") pod \"rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw\" (UID: \"5ef369b4-0922-4ecb-aaec-2df005af1d5e\") " pod="ai-tenant-e2e-shared-b-a11aa7/rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw"
Jul 24 17:47:06.243592 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:47:06.243572    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ef369b4-0922-4ecb-aaec-2df005af1d5e-home\") pod \"rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw\" (UID: \"5ef369b4-0922-4ecb-aaec-2df005af1d5e\") " pod="ai-tenant-e2e-shared-b-a11aa7/rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw"
Jul 24 17:47:06.243633 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:47:06.243601    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ef369b4-0922-4ecb-aaec-2df005af1d5e-tmp-dir\") pod \"rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw\" (UID: \"5ef369b4-0922-4ecb-aaec-2df005af1d5e\") " pod="ai-tenant-e2e-shared-b-a11aa7/rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw"
Jul 24 17:47:06.243633 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:47:06.243628    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ef369b4-0922-4ecb-aaec-2df005af1d5e-model-cache\") pod \"rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw\" (UID: \"5ef369b4-0922-4ecb-aaec-2df005af1d5e\") " pod="ai-tenant-e2e-shared-b-a11aa7/rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw"
Jul 24 17:47:06.245499 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:47:06.245479    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ef369b4-0922-4ecb-aaec-2df005af1d5e-dshm\") pod \"rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw\" (UID: \"5ef369b4-0922-4ecb-aaec-2df005af1d5e\") " pod="ai-tenant-e2e-shared-b-a11aa7/rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw"
Jul 24 17:47:06.245682 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:47:06.245649    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ef369b4-0922-4ecb-aaec-2df005af1d5e-tls-certs\") pod \"rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw\" (UID: \"5ef369b4-0922-4ecb-aaec-2df005af1d5e\") " pod="ai-tenant-e2e-shared-b-a11aa7/rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw"
Jul 24 17:47:06.251582 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:47:06.251560    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xbwb\" (UniqueName: \"kubernetes.io/projected/5ef369b4-0922-4ecb-aaec-2df005af1d5e-kube-api-access-9xbwb\") pod \"rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw\" (UID: \"5ef369b4-0922-4ecb-aaec-2df005af1d5e\") " pod="ai-tenant-e2e-shared-b-a11aa7/rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw"
Jul 24 17:47:06.375688 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:47:06.375594    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a11aa7/rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw"
Jul 24 17:47:06.509350 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:47:06.509323    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a11aa7/rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw"]
Jul 24 17:47:06.510966 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:47:06.510936    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ef369b4_0922_4ecb_aaec_2df005af1d5e.slice/crio-0e7412d19407c2c3200651cea057773a1354b3ebe29c59fd00ffa917fae93311 WatchSource:0}: Error finding container 0e7412d19407c2c3200651cea057773a1354b3ebe29c59fd00ffa917fae93311: Status 404 returned error can't find the container with id 0e7412d19407c2c3200651cea057773a1354b3ebe29c59fd00ffa917fae93311
Jul 24 17:47:06.570919 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:47:06.570846    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a11aa7/rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw" event={"ID":"5ef369b4-0922-4ecb-aaec-2df005af1d5e","Type":"ContainerStarted","Data":"0e7412d19407c2c3200651cea057773a1354b3ebe29c59fd00ffa917fae93311"}
Jul 24 17:47:07.578480 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:47:07.578444    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a11aa7/rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw" event={"ID":"5ef369b4-0922-4ecb-aaec-2df005af1d5e","Type":"ContainerStarted","Data":"c9993f7d5ffb6aec6994cc4abc1a325a071ebf74950e46e4c422608e2a9697f4"}
Jul 24 17:47:07.596779 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:47:07.596728    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-a11aa7/rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw" podStartSLOduration=1.596712883 podStartE2EDuration="1.596712883s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:47:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:47:07.595789356 +0000 UTC m=+2618.411763970" watchObservedRunningTime="2026-07-24 17:47:07.596712883 +0000 UTC m=+2618.412687505"
Jul 24 17:47:09.886429 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:47:09.886393    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:47:16.376245 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:47:16.376202    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-a11aa7/rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw"
Jul 24 17:47:16.377081 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:47:16.376263    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-a11aa7/rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw"
Jul 24 17:47:16.388418 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:47:16.388391    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-a11aa7/rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw"
Jul 24 17:47:16.634706 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:47:16.634612    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-a11aa7/rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw"
Jul 24 17:47:30.044490 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:47:30.044455    2582 scope.go:117] "RemoveContainer" containerID="a1e1d690a4167230b17a0e212631ef5297861ec2540c44f6a476e4d155d09840"
Jul 24 17:47:35.186034 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:47:35.186001    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:47:57.983534 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:47:57.983486    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:48:03.070909 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:03.070879    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a11aa7/rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw"]
Jul 24 17:48:14.677686 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:14.677645    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:48:18.089269 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:18.089204    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-a11aa7/rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw" podUID="5ef369b4-0922-4ecb-aaec-2df005af1d5e" containerName="main" containerID="cri-o://c9993f7d5ffb6aec6994cc4abc1a325a071ebf74950e46e4c422608e2a9697f4" gracePeriod=45
Jul 24 17:48:18.328561 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:18.328535    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a11aa7/rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw"
Jul 24 17:48:18.367706 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:18.367608    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ef369b4-0922-4ecb-aaec-2df005af1d5e-tmp-dir\") pod \"5ef369b4-0922-4ecb-aaec-2df005af1d5e\" (UID: \"5ef369b4-0922-4ecb-aaec-2df005af1d5e\") "
Jul 24 17:48:18.367706 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:18.367644    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ef369b4-0922-4ecb-aaec-2df005af1d5e-home\") pod \"5ef369b4-0922-4ecb-aaec-2df005af1d5e\" (UID: \"5ef369b4-0922-4ecb-aaec-2df005af1d5e\") "
Jul 24 17:48:18.367706 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:18.367684    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ef369b4-0922-4ecb-aaec-2df005af1d5e-model-cache\") pod \"5ef369b4-0922-4ecb-aaec-2df005af1d5e\" (UID: \"5ef369b4-0922-4ecb-aaec-2df005af1d5e\") "
Jul 24 17:48:18.367706 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:18.367699    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ef369b4-0922-4ecb-aaec-2df005af1d5e-dshm\") pod \"5ef369b4-0922-4ecb-aaec-2df005af1d5e\" (UID: \"5ef369b4-0922-4ecb-aaec-2df005af1d5e\") "
Jul 24 17:48:18.368034 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:18.367738    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ef369b4-0922-4ecb-aaec-2df005af1d5e-tls-certs\") pod \"5ef369b4-0922-4ecb-aaec-2df005af1d5e\" (UID: \"5ef369b4-0922-4ecb-aaec-2df005af1d5e\") "
Jul 24 17:48:18.368034 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:18.367775    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xbwb\" (UniqueName: \"kubernetes.io/projected/5ef369b4-0922-4ecb-aaec-2df005af1d5e-kube-api-access-9xbwb\") pod \"5ef369b4-0922-4ecb-aaec-2df005af1d5e\" (UID: \"5ef369b4-0922-4ecb-aaec-2df005af1d5e\") "
Jul 24 17:48:18.368034 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:18.367942    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ef369b4-0922-4ecb-aaec-2df005af1d5e-home" (OuterVolumeSpecName: "home") pod "5ef369b4-0922-4ecb-aaec-2df005af1d5e" (UID: "5ef369b4-0922-4ecb-aaec-2df005af1d5e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:48:18.368034 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:18.367953    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ef369b4-0922-4ecb-aaec-2df005af1d5e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5ef369b4-0922-4ecb-aaec-2df005af1d5e" (UID: "5ef369b4-0922-4ecb-aaec-2df005af1d5e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:48:18.368034 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:18.367968    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ef369b4-0922-4ecb-aaec-2df005af1d5e-model-cache" (OuterVolumeSpecName: "model-cache") pod "5ef369b4-0922-4ecb-aaec-2df005af1d5e" (UID: "5ef369b4-0922-4ecb-aaec-2df005af1d5e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:48:18.368247 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:18.368045    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ef369b4-0922-4ecb-aaec-2df005af1d5e-tmp-dir\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:48:18.368247 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:18.368062    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ef369b4-0922-4ecb-aaec-2df005af1d5e-home\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:48:18.368247 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:18.368073    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ef369b4-0922-4ecb-aaec-2df005af1d5e-model-cache\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:48:18.369819 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:18.369783    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ef369b4-0922-4ecb-aaec-2df005af1d5e-dshm" (OuterVolumeSpecName: "dshm") pod "5ef369b4-0922-4ecb-aaec-2df005af1d5e" (UID: "5ef369b4-0922-4ecb-aaec-2df005af1d5e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:48:18.369935 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:18.369849    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ef369b4-0922-4ecb-aaec-2df005af1d5e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5ef369b4-0922-4ecb-aaec-2df005af1d5e" (UID: "5ef369b4-0922-4ecb-aaec-2df005af1d5e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:48:18.369979 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:18.369950    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ef369b4-0922-4ecb-aaec-2df005af1d5e-kube-api-access-9xbwb" (OuterVolumeSpecName: "kube-api-access-9xbwb") pod "5ef369b4-0922-4ecb-aaec-2df005af1d5e" (UID: "5ef369b4-0922-4ecb-aaec-2df005af1d5e"). InnerVolumeSpecName "kube-api-access-9xbwb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:48:18.469059 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:18.469015    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ef369b4-0922-4ecb-aaec-2df005af1d5e-dshm\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:48:18.469059 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:18.469054    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ef369b4-0922-4ecb-aaec-2df005af1d5e-tls-certs\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:48:18.469059 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:18.469069    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xbwb\" (UniqueName: \"kubernetes.io/projected/5ef369b4-0922-4ecb-aaec-2df005af1d5e-kube-api-access-9xbwb\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:48:18.942703 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:18.942651    2582 generic.go:356] "Generic (PLEG): container finished" podID="5ef369b4-0922-4ecb-aaec-2df005af1d5e" containerID="c9993f7d5ffb6aec6994cc4abc1a325a071ebf74950e46e4c422608e2a9697f4" exitCode=0
Jul 24 17:48:18.942703 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:18.942696    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a11aa7/rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw" event={"ID":"5ef369b4-0922-4ecb-aaec-2df005af1d5e","Type":"ContainerDied","Data":"c9993f7d5ffb6aec6994cc4abc1a325a071ebf74950e46e4c422608e2a9697f4"}
Jul 24 17:48:18.942948 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:18.942738    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a11aa7/rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw" event={"ID":"5ef369b4-0922-4ecb-aaec-2df005af1d5e","Type":"ContainerDied","Data":"0e7412d19407c2c3200651cea057773a1354b3ebe29c59fd00ffa917fae93311"}
Jul 24 17:48:18.942948 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:18.942755    2582 scope.go:117] "RemoveContainer" containerID="c9993f7d5ffb6aec6994cc4abc1a325a071ebf74950e46e4c422608e2a9697f4"
Jul 24 17:48:18.942948 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:18.942706    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a11aa7/rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw"
Jul 24 17:48:18.952019 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:18.952003    2582 scope.go:117] "RemoveContainer" containerID="c9993f7d5ffb6aec6994cc4abc1a325a071ebf74950e46e4c422608e2a9697f4"
Jul 24 17:48:18.952275 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:48:18.952255    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9993f7d5ffb6aec6994cc4abc1a325a071ebf74950e46e4c422608e2a9697f4\": container with ID starting with c9993f7d5ffb6aec6994cc4abc1a325a071ebf74950e46e4c422608e2a9697f4 not found: ID does not exist" containerID="c9993f7d5ffb6aec6994cc4abc1a325a071ebf74950e46e4c422608e2a9697f4"
Jul 24 17:48:18.952323 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:18.952284    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9993f7d5ffb6aec6994cc4abc1a325a071ebf74950e46e4c422608e2a9697f4"} err="failed to get container status \"c9993f7d5ffb6aec6994cc4abc1a325a071ebf74950e46e4c422608e2a9697f4\": rpc error: code = NotFound desc = could not find container \"c9993f7d5ffb6aec6994cc4abc1a325a071ebf74950e46e4c422608e2a9697f4\": container with ID starting with c9993f7d5ffb6aec6994cc4abc1a325a071ebf74950e46e4c422608e2a9697f4 not found: ID does not exist"
Jul 24 17:48:18.964151 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:18.964125    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a11aa7/rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw"]
Jul 24 17:48:18.968148 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:18.968127    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-a11aa7/rate-test-model-a11aa7-kserve-6bbcb557c9-ff7zw"]
Jul 24 17:48:19.763361 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:19.763328    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ef369b4-0922-4ecb-aaec-2df005af1d5e" path="/var/lib/kubelet/pods/5ef369b4-0922-4ecb-aaec-2df005af1d5e/volumes"
Jul 24 17:48:26.815663 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:26.815580    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-052d9d-59474c7df6-w974w"]
Jul 24 17:48:26.816148 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:26.815963    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ef369b4-0922-4ecb-aaec-2df005af1d5e" containerName="main"
Jul 24 17:48:26.816148 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:26.815976    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ef369b4-0922-4ecb-aaec-2df005af1d5e" containerName="main"
Jul 24 17:48:26.816148 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:26.816030    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ef369b4-0922-4ecb-aaec-2df005af1d5e" containerName="main"
Jul 24 17:48:26.820344 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:26.820326    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-052d9d-59474c7df6-w974w"
Jul 24 17:48:26.822674 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:26.822651    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-052d9d-dockercfg-29sqn\""
Jul 24 17:48:26.822809 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:26.822651    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-052d9d\""
Jul 24 17:48:26.829907 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:26.829880    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-052d9d-59474c7df6-w974w"]
Jul 24 17:48:26.841290 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:26.841259    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb5xw\" (UniqueName: \"kubernetes.io/projected/39761f36-756d-43dc-b0d7-d86f4530dad4-kube-api-access-nb5xw\") pod \"payload-pre-processing-e2e-ipp-a-052d9d-59474c7df6-w974w\" (UID: \"39761f36-756d-43dc-b0d7-d86f4530dad4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-052d9d-59474c7df6-w974w"
Jul 24 17:48:26.841474 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:26.841303    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39761f36-756d-43dc-b0d7-d86f4530dad4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-052d9d-59474c7df6-w974w\" (UID: \"39761f36-756d-43dc-b0d7-d86f4530dad4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-052d9d-59474c7df6-w974w"
Jul 24 17:48:26.862784 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:26.862753    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-052d9d-f96595bbb-l89w7"]
Jul 24 17:48:26.866096 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:26.866080    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-052d9d-f96595bbb-l89w7"
Jul 24 17:48:26.879522 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:26.879489    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-052d9d-f96595bbb-l89w7"]
Jul 24 17:48:26.942653 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:26.942625    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb5xw\" (UniqueName: \"kubernetes.io/projected/39761f36-756d-43dc-b0d7-d86f4530dad4-kube-api-access-nb5xw\") pod \"payload-pre-processing-e2e-ipp-a-052d9d-59474c7df6-w974w\" (UID: \"39761f36-756d-43dc-b0d7-d86f4530dad4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-052d9d-59474c7df6-w974w"
Jul 24 17:48:26.942823 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:26.942660    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39761f36-756d-43dc-b0d7-d86f4530dad4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-052d9d-59474c7df6-w974w\" (UID: \"39761f36-756d-43dc-b0d7-d86f4530dad4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-052d9d-59474c7df6-w974w"
Jul 24 17:48:26.942823 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:26.942789    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwh9t\" (UniqueName: \"kubernetes.io/projected/0bd0b76e-7019-4b9f-b120-7bc8ac4c27c8-kube-api-access-kwh9t\") pod \"payload-processing-e2e-ipp-a-052d9d-f96595bbb-l89w7\" (UID: \"0bd0b76e-7019-4b9f-b120-7bc8ac4c27c8\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-052d9d-f96595bbb-l89w7"
Jul 24 17:48:26.942910 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:26.942838    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0bd0b76e-7019-4b9f-b120-7bc8ac4c27c8-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-052d9d-f96595bbb-l89w7\" (UID: \"0bd0b76e-7019-4b9f-b120-7bc8ac4c27c8\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-052d9d-f96595bbb-l89w7"
Jul 24 17:48:26.943313 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:26.943295    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39761f36-756d-43dc-b0d7-d86f4530dad4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-052d9d-59474c7df6-w974w\" (UID: \"39761f36-756d-43dc-b0d7-d86f4530dad4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-052d9d-59474c7df6-w974w"
Jul 24 17:48:26.951088 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:26.951065    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb5xw\" (UniqueName: \"kubernetes.io/projected/39761f36-756d-43dc-b0d7-d86f4530dad4-kube-api-access-nb5xw\") pod \"payload-pre-processing-e2e-ipp-a-052d9d-59474c7df6-w974w\" (UID: \"39761f36-756d-43dc-b0d7-d86f4530dad4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-052d9d-59474c7df6-w974w"
Jul 24 17:48:27.043566 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:27.043536    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0bd0b76e-7019-4b9f-b120-7bc8ac4c27c8-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-052d9d-f96595bbb-l89w7\" (UID: \"0bd0b76e-7019-4b9f-b120-7bc8ac4c27c8\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-052d9d-f96595bbb-l89w7"
Jul 24 17:48:27.043736 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:27.043653    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwh9t\" (UniqueName: \"kubernetes.io/projected/0bd0b76e-7019-4b9f-b120-7bc8ac4c27c8-kube-api-access-kwh9t\") pod \"payload-processing-e2e-ipp-a-052d9d-f96595bbb-l89w7\" (UID: \"0bd0b76e-7019-4b9f-b120-7bc8ac4c27c8\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-052d9d-f96595bbb-l89w7"
Jul 24 17:48:27.044313 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:27.044294    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0bd0b76e-7019-4b9f-b120-7bc8ac4c27c8-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-052d9d-f96595bbb-l89w7\" (UID: \"0bd0b76e-7019-4b9f-b120-7bc8ac4c27c8\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-052d9d-f96595bbb-l89w7"
Jul 24 17:48:27.052093 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:27.052068    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwh9t\" (UniqueName: \"kubernetes.io/projected/0bd0b76e-7019-4b9f-b120-7bc8ac4c27c8-kube-api-access-kwh9t\") pod \"payload-processing-e2e-ipp-a-052d9d-f96595bbb-l89w7\" (UID: \"0bd0b76e-7019-4b9f-b120-7bc8ac4c27c8\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-052d9d-f96595bbb-l89w7"
Jul 24 17:48:27.130620 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:27.130530    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-052d9d-59474c7df6-w974w"
Jul 24 17:48:27.176057 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:27.176021    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-052d9d-f96595bbb-l89w7"
Jul 24 17:48:27.269899 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:27.269832    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-052d9d-59474c7df6-w974w"]
Jul 24 17:48:27.271864 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:48:27.271826    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39761f36_756d_43dc_b0d7_d86f4530dad4.slice/crio-e8ac7ba71dee90e24431431647ec0103af7208d19e8f4b258d41e22b338b7ce6 WatchSource:0}: Error finding container e8ac7ba71dee90e24431431647ec0103af7208d19e8f4b258d41e22b338b7ce6: Status 404 returned error can't find the container with id e8ac7ba71dee90e24431431647ec0103af7208d19e8f4b258d41e22b338b7ce6
Jul 24 17:48:27.322807 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:27.322776    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-052d9d-f96595bbb-l89w7"]
Jul 24 17:48:27.324370 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:48:27.324344    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bd0b76e_7019_4b9f_b120_7bc8ac4c27c8.slice/crio-54bb7a21404cc6f99a4da2d293a33d01c11e0d0dbc11a0e29c308a82016b1c51 WatchSource:0}: Error finding container 54bb7a21404cc6f99a4da2d293a33d01c11e0d0dbc11a0e29c308a82016b1c51: Status 404 returned error can't find the container with id 54bb7a21404cc6f99a4da2d293a33d01c11e0d0dbc11a0e29c308a82016b1c51
Jul 24 17:48:27.993799 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:27.993765    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-052d9d-59474c7df6-w974w" event={"ID":"39761f36-756d-43dc-b0d7-d86f4530dad4","Type":"ContainerStarted","Data":"8b4eab48020db9cb56268f36e0cd30a433d6c94e78bb50a7eb542941d2a400bd"}
Jul 24 17:48:27.994233 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:27.993823    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-052d9d-59474c7df6-w974w" event={"ID":"39761f36-756d-43dc-b0d7-d86f4530dad4","Type":"ContainerStarted","Data":"e8ac7ba71dee90e24431431647ec0103af7208d19e8f4b258d41e22b338b7ce6"}
Jul 24 17:48:27.994233 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:27.993867    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-052d9d-59474c7df6-w974w"
Jul 24 17:48:27.995149 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:27.995127    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-052d9d-f96595bbb-l89w7" event={"ID":"0bd0b76e-7019-4b9f-b120-7bc8ac4c27c8","Type":"ContainerStarted","Data":"53a8bc2f03419820305821ea342076399077c2fcb64b52e29373f6c51b76f8ad"}
Jul 24 17:48:27.995254 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:27.995165    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-052d9d-f96595bbb-l89w7" event={"ID":"0bd0b76e-7019-4b9f-b120-7bc8ac4c27c8","Type":"ContainerStarted","Data":"54bb7a21404cc6f99a4da2d293a33d01c11e0d0dbc11a0e29c308a82016b1c51"}
Jul 24 17:48:27.995254 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:27.995209    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-052d9d-f96595bbb-l89w7"
Jul 24 17:48:28.011080 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:28.011038    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-052d9d-59474c7df6-w974w" podStartSLOduration=2.011025662 podStartE2EDuration="2.011025662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:48:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:48:28.009719933 +0000 UTC m=+2698.825694547" watchObservedRunningTime="2026-07-24 17:48:28.011025662 +0000 UTC m=+2698.827000273"
Jul 24 17:48:28.030787 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:28.030474    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-052d9d-f96595bbb-l89w7" podStartSLOduration=2.030454129 podStartE2EDuration="2.030454129s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:48:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:48:28.027401994 +0000 UTC m=+2698.843376621" watchObservedRunningTime="2026-07-24 17:48:28.030454129 +0000 UTC m=+2698.846428741"
Jul 24 17:48:29.869838 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:29.869810    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d6w2m_9f3e23c6-31a7-4e7b-83df-d6eee1335b7a/ovn-acl-logging/0.log"
Jul 24 17:48:29.879817 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:29.879794    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d6w2m_9f3e23c6-31a7-4e7b-83df-d6eee1335b7a/ovn-acl-logging/0.log"
Jul 24 17:48:30.070525 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:30.070496    2582 scope.go:117] "RemoveContainer" containerID="b4d9060f965a45d0ee27eee0c482915117532b071b287a60bb6e1d236ca5ad44"
Jul 24 17:48:34.181909 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:34.181873    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:48:39.002781 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:39.002745    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-052d9d-59474c7df6-w974w"
Jul 24 17:48:39.003273 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:39.002819    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-052d9d-f96595bbb-l89w7"
Jul 24 17:48:45.179333 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:45.179294    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77c4b-696dc4df8-ldxrv"]
Jul 24 17:48:45.182400 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:45.182378    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77c4b-696dc4df8-ldxrv"
Jul 24 17:48:45.191839 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:45.191817    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 24 17:48:45.192055 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:45.192038    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-fxv6v\""
Jul 24 17:48:45.192499 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:45.192484    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 17:48:45.192541 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:45.192528    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert-e2e-ipp-b-b77c4b\""
Jul 24 17:48:45.198993 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:45.198967    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77c4b-696dc4df8-ldxrv"]
Jul 24 17:48:45.313159 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:45.313120    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls8zg\" (UniqueName: \"kubernetes.io/projected/d4c8c00c-4f2f-4700-b353-93e13acdb8f8-kube-api-access-ls8zg\") pod \"maas-api-e2e-ipp-b-b77c4b-696dc4df8-ldxrv\" (UID: \"d4c8c00c-4f2f-4700-b353-93e13acdb8f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77c4b-696dc4df8-ldxrv"
Jul 24 17:48:45.313330 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:45.313190    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4c8c00c-4f2f-4700-b353-93e13acdb8f8-maas-api-tls\") pod \"maas-api-e2e-ipp-b-b77c4b-696dc4df8-ldxrv\" (UID: \"d4c8c00c-4f2f-4700-b353-93e13acdb8f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77c4b-696dc4df8-ldxrv"
Jul 24 17:48:45.313330 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:45.313209    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4c8c00c-4f2f-4700-b353-93e13acdb8f8-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-b77c4b-696dc4df8-ldxrv\" (UID: \"d4c8c00c-4f2f-4700-b353-93e13acdb8f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77c4b-696dc4df8-ldxrv"
Jul 24 17:48:45.414660 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:45.414614    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4c8c00c-4f2f-4700-b353-93e13acdb8f8-maas-api-tls\") pod \"maas-api-e2e-ipp-b-b77c4b-696dc4df8-ldxrv\" (UID: \"d4c8c00c-4f2f-4700-b353-93e13acdb8f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77c4b-696dc4df8-ldxrv"
Jul 24 17:48:45.414660 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:45.414658    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4c8c00c-4f2f-4700-b353-93e13acdb8f8-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-b77c4b-696dc4df8-ldxrv\" (UID: \"d4c8c00c-4f2f-4700-b353-93e13acdb8f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77c4b-696dc4df8-ldxrv"
Jul 24 17:48:45.414940 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:45.414747    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls8zg\" (UniqueName: \"kubernetes.io/projected/d4c8c00c-4f2f-4700-b353-93e13acdb8f8-kube-api-access-ls8zg\") pod \"maas-api-e2e-ipp-b-b77c4b-696dc4df8-ldxrv\" (UID: \"d4c8c00c-4f2f-4700-b353-93e13acdb8f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77c4b-696dc4df8-ldxrv"
Jul 24 17:48:45.415392 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:45.415363    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4c8c00c-4f2f-4700-b353-93e13acdb8f8-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-b77c4b-696dc4df8-ldxrv\" (UID: \"d4c8c00c-4f2f-4700-b353-93e13acdb8f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77c4b-696dc4df8-ldxrv"
Jul 24 17:48:45.417145 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:45.417123    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4c8c00c-4f2f-4700-b353-93e13acdb8f8-maas-api-tls\") pod \"maas-api-e2e-ipp-b-b77c4b-696dc4df8-ldxrv\" (UID: \"d4c8c00c-4f2f-4700-b353-93e13acdb8f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77c4b-696dc4df8-ldxrv"
Jul 24 17:48:45.422773 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:45.422752    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls8zg\" (UniqueName: \"kubernetes.io/projected/d4c8c00c-4f2f-4700-b353-93e13acdb8f8-kube-api-access-ls8zg\") pod \"maas-api-e2e-ipp-b-b77c4b-696dc4df8-ldxrv\" (UID: \"d4c8c00c-4f2f-4700-b353-93e13acdb8f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77c4b-696dc4df8-ldxrv"
Jul 24 17:48:45.492651 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:45.492623    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77c4b-696dc4df8-ldxrv"
Jul 24 17:48:45.647719 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:45.646999    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77c4b-696dc4df8-ldxrv"]
Jul 24 17:48:45.654066 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:45.654007    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 17:48:46.089243 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:46.089211    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77c4b-696dc4df8-ldxrv" event={"ID":"d4c8c00c-4f2f-4700-b353-93e13acdb8f8","Type":"ContainerStarted","Data":"802163dbf96a4afafb9002b148447674e6eaba0c0d1bd4bb334ad5f9c80ff3ff"}
Jul 24 17:48:46.135203 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:46.135170    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-b77c4b-5db8fdd6bb-96tjm"]
Jul 24 17:48:46.139057 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:46.139035    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-b77c4b-5db8fdd6bb-96tjm"
Jul 24 17:48:46.142226 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:46.142201    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-b77c4b\""
Jul 24 17:48:46.142536 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:46.142516    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-b77c4b-dockercfg-pwmh9\""
Jul 24 17:48:46.154571 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:46.154548    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-b77c4b-5db8fdd6bb-96tjm"]
Jul 24 17:48:46.189093 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:46.189053    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-b77c4b-7bc6547b6d-7s4rt"]
Jul 24 17:48:46.192882 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:46.192854    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b77c4b-7bc6547b6d-7s4rt"
Jul 24 17:48:46.207650 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:46.206854    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-b77c4b-7bc6547b6d-7s4rt"]
Jul 24 17:48:46.221718 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:46.221510    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzm95\" (UniqueName: \"kubernetes.io/projected/b20208e8-ac4d-475b-b951-f7d89f3cf6d4-kube-api-access-lzm95\") pod \"payload-processing-e2e-ipp-b-b77c4b-5db8fdd6bb-96tjm\" (UID: \"b20208e8-ac4d-475b-b951-f7d89f3cf6d4\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-b77c4b-5db8fdd6bb-96tjm"
Jul 24 17:48:46.221718 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:46.221633    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b20208e8-ac4d-475b-b951-f7d89f3cf6d4-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-b77c4b-5db8fdd6bb-96tjm\" (UID: \"b20208e8-ac4d-475b-b951-f7d89f3cf6d4\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-b77c4b-5db8fdd6bb-96tjm"
Jul 24 17:48:46.322997 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:46.322947    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42b38ad6-77b6-4380-a30c-b2ea3df13232-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-b77c4b-7bc6547b6d-7s4rt\" (UID: \"42b38ad6-77b6-4380-a30c-b2ea3df13232\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b77c4b-7bc6547b6d-7s4rt"
Jul 24 17:48:46.323193 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:46.323018    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzm95\" (UniqueName: \"kubernetes.io/projected/b20208e8-ac4d-475b-b951-f7d89f3cf6d4-kube-api-access-lzm95\") pod \"payload-processing-e2e-ipp-b-b77c4b-5db8fdd6bb-96tjm\" (UID: \"b20208e8-ac4d-475b-b951-f7d89f3cf6d4\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-b77c4b-5db8fdd6bb-96tjm"
Jul 24 17:48:46.323193 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:46.323061    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlgds\" (UniqueName: \"kubernetes.io/projected/42b38ad6-77b6-4380-a30c-b2ea3df13232-kube-api-access-hlgds\") pod \"payload-pre-processing-e2e-ipp-b-b77c4b-7bc6547b6d-7s4rt\" (UID: \"42b38ad6-77b6-4380-a30c-b2ea3df13232\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b77c4b-7bc6547b6d-7s4rt"
Jul 24 17:48:46.323193 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:46.323128    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b20208e8-ac4d-475b-b951-f7d89f3cf6d4-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-b77c4b-5db8fdd6bb-96tjm\" (UID: \"b20208e8-ac4d-475b-b951-f7d89f3cf6d4\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-b77c4b-5db8fdd6bb-96tjm"
Jul 24 17:48:46.323911 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:46.323891    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b20208e8-ac4d-475b-b951-f7d89f3cf6d4-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-b77c4b-5db8fdd6bb-96tjm\" (UID: \"b20208e8-ac4d-475b-b951-f7d89f3cf6d4\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-b77c4b-5db8fdd6bb-96tjm"
Jul 24 17:48:46.331919 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:46.331896    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzm95\" (UniqueName: \"kubernetes.io/projected/b20208e8-ac4d-475b-b951-f7d89f3cf6d4-kube-api-access-lzm95\") pod \"payload-processing-e2e-ipp-b-b77c4b-5db8fdd6bb-96tjm\" (UID: \"b20208e8-ac4d-475b-b951-f7d89f3cf6d4\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-b77c4b-5db8fdd6bb-96tjm"
Jul 24 17:48:46.424078 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:46.423616    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlgds\" (UniqueName: \"kubernetes.io/projected/42b38ad6-77b6-4380-a30c-b2ea3df13232-kube-api-access-hlgds\") pod \"payload-pre-processing-e2e-ipp-b-b77c4b-7bc6547b6d-7s4rt\" (UID: \"42b38ad6-77b6-4380-a30c-b2ea3df13232\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b77c4b-7bc6547b6d-7s4rt"
Jul 24 17:48:46.424078 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:46.423778    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42b38ad6-77b6-4380-a30c-b2ea3df13232-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-b77c4b-7bc6547b6d-7s4rt\" (UID: \"42b38ad6-77b6-4380-a30c-b2ea3df13232\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b77c4b-7bc6547b6d-7s4rt"
Jul 24 17:48:46.424651 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:46.424620    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42b38ad6-77b6-4380-a30c-b2ea3df13232-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-b77c4b-7bc6547b6d-7s4rt\" (UID: \"42b38ad6-77b6-4380-a30c-b2ea3df13232\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b77c4b-7bc6547b6d-7s4rt"
Jul 24 17:48:46.433351 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:46.433321    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlgds\" (UniqueName: \"kubernetes.io/projected/42b38ad6-77b6-4380-a30c-b2ea3df13232-kube-api-access-hlgds\") pod \"payload-pre-processing-e2e-ipp-b-b77c4b-7bc6547b6d-7s4rt\" (UID: \"42b38ad6-77b6-4380-a30c-b2ea3df13232\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b77c4b-7bc6547b6d-7s4rt"
Jul 24 17:48:46.454921 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:46.454896    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-b77c4b-5db8fdd6bb-96tjm"
Jul 24 17:48:46.508414 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:46.508377    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b77c4b-7bc6547b6d-7s4rt"
Jul 24 17:48:46.626564 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:46.626534    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-b77c4b-5db8fdd6bb-96tjm"]
Jul 24 17:48:46.627765 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:48:46.627733    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb20208e8_ac4d_475b_b951_f7d89f3cf6d4.slice/crio-a5ec61ec42a7cb4261c2019b0425f5978adb11f2142e5fd8b69842033985614b WatchSource:0}: Error finding container a5ec61ec42a7cb4261c2019b0425f5978adb11f2142e5fd8b69842033985614b: Status 404 returned error can't find the container with id a5ec61ec42a7cb4261c2019b0425f5978adb11f2142e5fd8b69842033985614b
Jul 24 17:48:46.705094 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:46.704945    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-b77c4b-7bc6547b6d-7s4rt"]
Jul 24 17:48:46.707491 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:48:46.707462    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42b38ad6_77b6_4380_a30c_b2ea3df13232.slice/crio-148632706c069838afaad5eef6e54b77fd481f08f414c66d7e18e5fbc581ac8d WatchSource:0}: Error finding container 148632706c069838afaad5eef6e54b77fd481f08f414c66d7e18e5fbc581ac8d: Status 404 returned error can't find the container with id 148632706c069838afaad5eef6e54b77fd481f08f414c66d7e18e5fbc581ac8d
Jul 24 17:48:47.096785 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:47.096747    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b77c4b-7bc6547b6d-7s4rt" event={"ID":"42b38ad6-77b6-4380-a30c-b2ea3df13232","Type":"ContainerStarted","Data":"9adbe6a57eabaab5f01cdcf78d28005cfc821f0b7ca2c9246a15d5b6ab66369b"}
Jul 24 17:48:47.096989 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:47.096928    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b77c4b-7bc6547b6d-7s4rt"
Jul 24 17:48:47.096989 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:47.096966    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b77c4b-7bc6547b6d-7s4rt" event={"ID":"42b38ad6-77b6-4380-a30c-b2ea3df13232","Type":"ContainerStarted","Data":"148632706c069838afaad5eef6e54b77fd481f08f414c66d7e18e5fbc581ac8d"}
Jul 24 17:48:47.098601 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:47.098567    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-b77c4b-5db8fdd6bb-96tjm" event={"ID":"b20208e8-ac4d-475b-b951-f7d89f3cf6d4","Type":"ContainerStarted","Data":"7e6a2f81b38f610cd0f42d919c225b538b67b1a2e3a4d3e3bf0db253c469224a"}
Jul 24 17:48:47.098766 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:47.098606    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-b77c4b-5db8fdd6bb-96tjm" event={"ID":"b20208e8-ac4d-475b-b951-f7d89f3cf6d4","Type":"ContainerStarted","Data":"a5ec61ec42a7cb4261c2019b0425f5978adb11f2142e5fd8b69842033985614b"}
Jul 24 17:48:47.098766 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:47.098637    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-b77c4b-5db8fdd6bb-96tjm"
Jul 24 17:48:47.114735 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:47.114664    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b77c4b-7bc6547b6d-7s4rt" podStartSLOduration=1.114642442 podStartE2EDuration="1.114642442s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:48:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:48:47.113747274 +0000 UTC m=+2717.929721977" watchObservedRunningTime="2026-07-24 17:48:47.114642442 +0000 UTC m=+2717.930617055"
Jul 24 17:48:47.131986 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:47.131939    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-b77c4b-5db8fdd6bb-96tjm" podStartSLOduration=1.131921621 podStartE2EDuration="1.131921621s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:48:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:48:47.130289439 +0000 UTC m=+2717.946264064" watchObservedRunningTime="2026-07-24 17:48:47.131921621 +0000 UTC m=+2717.947896236"
Jul 24 17:48:48.105863 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:48.105831    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77c4b-696dc4df8-ldxrv" event={"ID":"d4c8c00c-4f2f-4700-b353-93e13acdb8f8","Type":"ContainerStarted","Data":"bbd35a32112ab0d9b7513f6aa27544924d316cece6430e10778ba67c9a54cf7a"}
Jul 24 17:48:48.130384 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:48.128601    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77c4b-696dc4df8-ldxrv" podStartSLOduration=0.820546735 podStartE2EDuration="3.128582643s" totalImagesPullingTime="2.308035908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:48:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:48:48.123077357 +0000 UTC m=+2718.939051973" watchObservedRunningTime="2026-07-24 17:48:48.128582643 +0000 UTC m=+2718.944557259"
Jul 24 17:48:49.111011 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:49.110977    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77c4b-696dc4df8-ldxrv"
Jul 24 17:48:50.475683 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:50.475647    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:48:55.122462 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:55.122433    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77c4b-696dc4df8-ldxrv"
Jul 24 17:48:58.108081 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:58.108044    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-b77c4b-5db8fdd6bb-96tjm"
Jul 24 17:48:58.108594 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:48:58.108478    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b77c4b-7bc6547b6d-7s4rt"
Jul 24 17:49:06.972887 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:49:06.972851    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-b77c4b-5db8fdd6bb-96tjm_b20208e8-ac4d-475b-b951-f7d89f3cf6d4/payload-processing/0.log"
Jul 24 17:49:29.981533 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:49:29.981494    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:49:52.195323 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:49:52.195234    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:50:04.017316 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:04.017283    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-052d9d-f96595bbb-l89w7_0bd0b76e-7019-4b9f-b120-7bc8ac4c27c8/payload-processing/0.log"
Jul 24 17:50:04.266988 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:04.266959    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-b77c4b-5db8fdd6bb-96tjm_b20208e8-ac4d-475b-b951-f7d89f3cf6d4/payload-processing/0.log"
Jul 24 17:50:07.560848 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:07.560817    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9bc868-76b65b5cf-9bmlv"]
Jul 24 17:50:07.563155 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:07.563139    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9bc868-76b65b5cf-9bmlv"
Jul 24 17:50:07.565530 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:07.565505    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert-e2e-ipp-cleanup-9bc868\""
Jul 24 17:50:07.581529 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:07.581503    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9bc868-76b65b5cf-9bmlv"]
Jul 24 17:50:07.622452 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:07.622422    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59f4b0f8-653c-4215-bffa-9ef8e28865bb-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-9bc868-76b65b5cf-9bmlv\" (UID: \"59f4b0f8-653c-4215-bffa-9ef8e28865bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9bc868-76b65b5cf-9bmlv"
Jul 24 17:50:07.622647 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:07.622462    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2jxw\" (UniqueName: \"kubernetes.io/projected/59f4b0f8-653c-4215-bffa-9ef8e28865bb-kube-api-access-h2jxw\") pod \"maas-api-e2e-ipp-cleanup-9bc868-76b65b5cf-9bmlv\" (UID: \"59f4b0f8-653c-4215-bffa-9ef8e28865bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9bc868-76b65b5cf-9bmlv"
Jul 24 17:50:07.622647 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:07.622520    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59f4b0f8-653c-4215-bffa-9ef8e28865bb-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-9bc868-76b65b5cf-9bmlv\" (UID: \"59f4b0f8-653c-4215-bffa-9ef8e28865bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9bc868-76b65b5cf-9bmlv"
Jul 24 17:50:07.723852 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:07.723813    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59f4b0f8-653c-4215-bffa-9ef8e28865bb-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-9bc868-76b65b5cf-9bmlv\" (UID: \"59f4b0f8-653c-4215-bffa-9ef8e28865bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9bc868-76b65b5cf-9bmlv"
Jul 24 17:50:07.724030 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:07.723899    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59f4b0f8-653c-4215-bffa-9ef8e28865bb-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-9bc868-76b65b5cf-9bmlv\" (UID: \"59f4b0f8-653c-4215-bffa-9ef8e28865bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9bc868-76b65b5cf-9bmlv"
Jul 24 17:50:07.724030 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:07.723927    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2jxw\" (UniqueName: \"kubernetes.io/projected/59f4b0f8-653c-4215-bffa-9ef8e28865bb-kube-api-access-h2jxw\") pod \"maas-api-e2e-ipp-cleanup-9bc868-76b65b5cf-9bmlv\" (UID: \"59f4b0f8-653c-4215-bffa-9ef8e28865bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9bc868-76b65b5cf-9bmlv"
Jul 24 17:50:07.724030 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:50:07.723966    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert-e2e-ipp-cleanup-9bc868: secret "maas-api-serving-cert-e2e-ipp-cleanup-9bc868" not found
Jul 24 17:50:07.724156 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:50:07.724042    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59f4b0f8-653c-4215-bffa-9ef8e28865bb-maas-api-tls podName:59f4b0f8-653c-4215-bffa-9ef8e28865bb nodeName:}" failed. No retries permitted until 2026-07-24 17:50:08.224026496 +0000 UTC m=+2799.040001088 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/59f4b0f8-653c-4215-bffa-9ef8e28865bb-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-9bc868-76b65b5cf-9bmlv" (UID: "59f4b0f8-653c-4215-bffa-9ef8e28865bb") : secret "maas-api-serving-cert-e2e-ipp-cleanup-9bc868" not found
Jul 24 17:50:07.724576 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:07.724558    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59f4b0f8-653c-4215-bffa-9ef8e28865bb-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-9bc868-76b65b5cf-9bmlv\" (UID: \"59f4b0f8-653c-4215-bffa-9ef8e28865bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9bc868-76b65b5cf-9bmlv"
Jul 24 17:50:07.748059 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:07.748029    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2jxw\" (UniqueName: \"kubernetes.io/projected/59f4b0f8-653c-4215-bffa-9ef8e28865bb-kube-api-access-h2jxw\") pod \"maas-api-e2e-ipp-cleanup-9bc868-76b65b5cf-9bmlv\" (UID: \"59f4b0f8-653c-4215-bffa-9ef8e28865bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9bc868-76b65b5cf-9bmlv"
Jul 24 17:50:08.228361 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:08.228331    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59f4b0f8-653c-4215-bffa-9ef8e28865bb-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-9bc868-76b65b5cf-9bmlv\" (UID: \"59f4b0f8-653c-4215-bffa-9ef8e28865bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9bc868-76b65b5cf-9bmlv"
Jul 24 17:50:08.230746 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:08.230723    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59f4b0f8-653c-4215-bffa-9ef8e28865bb-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-9bc868-76b65b5cf-9bmlv\" (UID: \"59f4b0f8-653c-4215-bffa-9ef8e28865bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9bc868-76b65b5cf-9bmlv"
Jul 24 17:50:08.372967 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:08.372933    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9bc868-78db78d6b8-nq55z"]
Jul 24 17:50:08.375232 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:08.375216    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9bc868-78db78d6b8-nq55z"
Jul 24 17:50:08.381137 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:08.381113    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-9bc868\""
Jul 24 17:50:08.382097 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:08.382074    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-9bc868-dockercfg-2c9wn\""
Jul 24 17:50:08.391860 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:08.391797    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9bc868-78db78d6b8-nq55z"]
Jul 24 17:50:08.429372 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:08.429339    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9dba615-d835-4583-b21e-17c11a1c3c94-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-9bc868-78db78d6b8-nq55z\" (UID: \"f9dba615-d835-4583-b21e-17c11a1c3c94\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9bc868-78db78d6b8-nq55z"
Jul 24 17:50:08.429547 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:08.429377    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srdvx\" (UniqueName: \"kubernetes.io/projected/f9dba615-d835-4583-b21e-17c11a1c3c94-kube-api-access-srdvx\") pod \"payload-pre-processing-e2e-ipp-cleanup-9bc868-78db78d6b8-nq55z\" (UID: \"f9dba615-d835-4583-b21e-17c11a1c3c94\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9bc868-78db78d6b8-nq55z"
Jul 24 17:50:08.474231 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:08.474191    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9bc868-76b65b5cf-9bmlv"
Jul 24 17:50:08.530497 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:08.530303    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9dba615-d835-4583-b21e-17c11a1c3c94-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-9bc868-78db78d6b8-nq55z\" (UID: \"f9dba615-d835-4583-b21e-17c11a1c3c94\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9bc868-78db78d6b8-nq55z"
Jul 24 17:50:08.530497 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:08.530357    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srdvx\" (UniqueName: \"kubernetes.io/projected/f9dba615-d835-4583-b21e-17c11a1c3c94-kube-api-access-srdvx\") pod \"payload-pre-processing-e2e-ipp-cleanup-9bc868-78db78d6b8-nq55z\" (UID: \"f9dba615-d835-4583-b21e-17c11a1c3c94\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9bc868-78db78d6b8-nq55z"
Jul 24 17:50:08.531157 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:08.531133    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9dba615-d835-4583-b21e-17c11a1c3c94-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-9bc868-78db78d6b8-nq55z\" (UID: \"f9dba615-d835-4583-b21e-17c11a1c3c94\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9bc868-78db78d6b8-nq55z"
Jul 24 17:50:08.539051 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:08.539019    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srdvx\" (UniqueName: \"kubernetes.io/projected/f9dba615-d835-4583-b21e-17c11a1c3c94-kube-api-access-srdvx\") pod \"payload-pre-processing-e2e-ipp-cleanup-9bc868-78db78d6b8-nq55z\" (UID: \"f9dba615-d835-4583-b21e-17c11a1c3c94\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9bc868-78db78d6b8-nq55z"
Jul 24 17:50:08.614698 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:08.614657    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9bc868-76b65b5cf-9bmlv"]
Jul 24 17:50:08.616405 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:50:08.616381    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59f4b0f8_653c_4215_bffa_9ef8e28865bb.slice/crio-da77f844d7808e7fad66f4ba680870260f39ea25e5416f200ce46b745b267170 WatchSource:0}: Error finding container da77f844d7808e7fad66f4ba680870260f39ea25e5416f200ce46b745b267170: Status 404 returned error can't find the container with id da77f844d7808e7fad66f4ba680870260f39ea25e5416f200ce46b745b267170
Jul 24 17:50:08.685842 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:08.685794    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9bc868-78db78d6b8-nq55z"
Jul 24 17:50:08.822099 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:08.822077    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9bc868-78db78d6b8-nq55z"]
Jul 24 17:50:08.824010 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:50:08.823971    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9dba615_d835_4583_b21e_17c11a1c3c94.slice/crio-003527ba08870c97466d8b78670b8c527b372bb0f14cb9af28d57b9287ef2b9e WatchSource:0}: Error finding container 003527ba08870c97466d8b78670b8c527b372bb0f14cb9af28d57b9287ef2b9e: Status 404 returned error can't find the container with id 003527ba08870c97466d8b78670b8c527b372bb0f14cb9af28d57b9287ef2b9e
Jul 24 17:50:09.548879 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:09.548845    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9bc868-78db78d6b8-nq55z" event={"ID":"f9dba615-d835-4583-b21e-17c11a1c3c94","Type":"ContainerStarted","Data":"28cdd0bbd46800dce06ff685b2c2007b106261638cb8d978665662ec5a3c9d4f"}
Jul 24 17:50:09.549089 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:09.548931    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9bc868-78db78d6b8-nq55z" event={"ID":"f9dba615-d835-4583-b21e-17c11a1c3c94","Type":"ContainerStarted","Data":"003527ba08870c97466d8b78670b8c527b372bb0f14cb9af28d57b9287ef2b9e"}
Jul 24 17:50:09.549089 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:09.548960    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9bc868-78db78d6b8-nq55z"
Jul 24 17:50:09.550534 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:09.550501    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9bc868-76b65b5cf-9bmlv" event={"ID":"59f4b0f8-653c-4215-bffa-9ef8e28865bb","Type":"ContainerStarted","Data":"3d8e779bed6b57b2fe442e2ce49450cbfe36516ed63b51771eac4ed3f8ac8379"}
Jul 24 17:50:09.550663 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:09.550543    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9bc868-76b65b5cf-9bmlv" event={"ID":"59f4b0f8-653c-4215-bffa-9ef8e28865bb","Type":"ContainerStarted","Data":"da77f844d7808e7fad66f4ba680870260f39ea25e5416f200ce46b745b267170"}
Jul 24 17:50:09.550663 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:09.550562    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9bc868-76b65b5cf-9bmlv"
Jul 24 17:50:09.566752 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:09.566707    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9bc868-78db78d6b8-nq55z" podStartSLOduration=1.566693421 podStartE2EDuration="1.566693421s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:50:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:50:09.563918643 +0000 UTC m=+2800.379893331" watchObservedRunningTime="2026-07-24 17:50:09.566693421 +0000 UTC m=+2800.382668032"
Jul 24 17:50:09.581238 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:09.581197    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9bc868-76b65b5cf-9bmlv" podStartSLOduration=2.1976434 podStartE2EDuration="2.581183832s" totalImagesPullingTime="383.540432ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:50:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:50:09.580034649 +0000 UTC m=+2800.396009264" watchObservedRunningTime="2026-07-24 17:50:09.581183832 +0000 UTC m=+2800.397158446"
Jul 24 17:50:12.488753 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:12.488711    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:50:15.561663 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:15.561627    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9bc868-76b65b5cf-9bmlv"
Jul 24 17:50:20.558663 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:20.558630    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9bc868-78db78d6b8-nq55z"
Jul 24 17:50:22.973414 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:22.973378    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9bc868-kmrf8"]
Jul 24 17:50:22.975850 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:22.975831    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9bc868-kmrf8"
Jul 24 17:50:22.978258 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:22.978241    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tdqg2\""
Jul 24 17:50:22.983982 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:22.983932    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9bc868-kmrf8"]
Jul 24 17:50:23.056258 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:23.056220    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/03a23370-fecd-445c-956d-30b65a1ddd16-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-9bc868-kmrf8\" (UID: \"03a23370-fecd-445c-956d-30b65a1ddd16\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9bc868-kmrf8"
Jul 24 17:50:23.156809 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:23.156778    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/03a23370-fecd-445c-956d-30b65a1ddd16-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-9bc868-kmrf8\" (UID: \"03a23370-fecd-445c-956d-30b65a1ddd16\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9bc868-kmrf8"
Jul 24 17:50:23.157341 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:23.157324    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/03a23370-fecd-445c-956d-30b65a1ddd16-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-9bc868-kmrf8\" (UID: \"03a23370-fecd-445c-956d-30b65a1ddd16\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9bc868-kmrf8"
Jul 24 17:50:23.287721 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:23.287689    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9bc868-kmrf8"
Jul 24 17:50:23.415401 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:23.415374    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9bc868-kmrf8"]
Jul 24 17:50:23.416182 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:50:23.416157    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03a23370_fecd_445c_956d_30b65a1ddd16.slice/crio-b81db28328715c094928d7df7258d396da0e009b0bf1db4ecb7c967f8c0c2a11 WatchSource:0}: Error finding container b81db28328715c094928d7df7258d396da0e009b0bf1db4ecb7c967f8c0c2a11: Status 404 returned error can't find the container with id b81db28328715c094928d7df7258d396da0e009b0bf1db4ecb7c967f8c0c2a11
Jul 24 17:50:23.627898 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:23.627863    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9bc868-kmrf8" event={"ID":"03a23370-fecd-445c-956d-30b65a1ddd16","Type":"ContainerStarted","Data":"b81db28328715c094928d7df7258d396da0e009b0bf1db4ecb7c967f8c0c2a11"}
Jul 24 17:50:24.635346 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:24.635234    2582 generic.go:356] "Generic (PLEG): container finished" podID="03a23370-fecd-445c-956d-30b65a1ddd16" containerID="42e90b11d438f499bd7227096b6049c4f1db1043763672a6f9dea5b91748275e" exitCode=0
Jul 24 17:50:24.635346 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:24.635322    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9bc868-kmrf8" event={"ID":"03a23370-fecd-445c-956d-30b65a1ddd16","Type":"ContainerDied","Data":"42e90b11d438f499bd7227096b6049c4f1db1043763672a6f9dea5b91748275e"}
Jul 24 17:50:25.770087 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:25.770065    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9bc868-kmrf8"
Jul 24 17:50:25.879709 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:25.879663    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/03a23370-fecd-445c-956d-30b65a1ddd16-maas-api-service-ca\") pod \"03a23370-fecd-445c-956d-30b65a1ddd16\" (UID: \"03a23370-fecd-445c-956d-30b65a1ddd16\") "
Jul 24 17:50:25.880009 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:25.879983    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03a23370-fecd-445c-956d-30b65a1ddd16-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "03a23370-fecd-445c-956d-30b65a1ddd16" (UID: "03a23370-fecd-445c-956d-30b65a1ddd16"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:50:25.980334 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:25.980253    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/03a23370-fecd-445c-956d-30b65a1ddd16-maas-api-service-ca\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:50:26.647012 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:26.646978    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9bc868-kmrf8" event={"ID":"03a23370-fecd-445c-956d-30b65a1ddd16","Type":"ContainerDied","Data":"b81db28328715c094928d7df7258d396da0e009b0bf1db4ecb7c967f8c0c2a11"}
Jul 24 17:50:26.647012 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:26.646996    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9bc868-kmrf8"
Jul 24 17:50:26.647228 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:26.647023    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b81db28328715c094928d7df7258d396da0e009b0bf1db4ecb7c967f8c0c2a11"
Jul 24 17:50:33.386390 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:33.386353    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9bc868-76b65b5cf-9bmlv"]
Jul 24 17:50:33.386821 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:33.386688    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9bc868-76b65b5cf-9bmlv" podUID="59f4b0f8-653c-4215-bffa-9ef8e28865bb" containerName="maas-api" containerID="cri-o://3d8e779bed6b57b2fe442e2ce49450cbfe36516ed63b51771eac4ed3f8ac8379" gracePeriod=30
Jul 24 17:50:33.444448 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:33.444412    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9bc868-78db78d6b8-nq55z"]
Jul 24 17:50:33.444727 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:33.444652    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9bc868-78db78d6b8-nq55z" podUID="f9dba615-d835-4583-b21e-17c11a1c3c94" containerName="payload-pre-processing" containerID="cri-o://28cdd0bbd46800dce06ff685b2c2007b106261638cb8d978665662ec5a3c9d4f" gracePeriod=30
Jul 24 17:50:33.687090 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:33.687059    2582 generic.go:356] "Generic (PLEG): container finished" podID="f9dba615-d835-4583-b21e-17c11a1c3c94" containerID="28cdd0bbd46800dce06ff685b2c2007b106261638cb8d978665662ec5a3c9d4f" exitCode=0
Jul 24 17:50:33.687218 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:33.687123    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9bc868-78db78d6b8-nq55z" event={"ID":"f9dba615-d835-4583-b21e-17c11a1c3c94","Type":"ContainerDied","Data":"28cdd0bbd46800dce06ff685b2c2007b106261638cb8d978665662ec5a3c9d4f"}
Jul 24 17:50:33.688442 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:33.688422    2582 generic.go:356] "Generic (PLEG): container finished" podID="59f4b0f8-653c-4215-bffa-9ef8e28865bb" containerID="3d8e779bed6b57b2fe442e2ce49450cbfe36516ed63b51771eac4ed3f8ac8379" exitCode=0
Jul 24 17:50:33.688532 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:33.688459    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9bc868-76b65b5cf-9bmlv" event={"ID":"59f4b0f8-653c-4215-bffa-9ef8e28865bb","Type":"ContainerDied","Data":"3d8e779bed6b57b2fe442e2ce49450cbfe36516ed63b51771eac4ed3f8ac8379"}
Jul 24 17:50:33.708882 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:33.708856    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9bc868-76b65b5cf-9bmlv"
Jul 24 17:50:33.713744 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:33.713716    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9bc868-78db78d6b8-nq55z"
Jul 24 17:50:33.845313 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:33.845283    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59f4b0f8-653c-4215-bffa-9ef8e28865bb-openshift-service-ca\") pod \"59f4b0f8-653c-4215-bffa-9ef8e28865bb\" (UID: \"59f4b0f8-653c-4215-bffa-9ef8e28865bb\") "
Jul 24 17:50:33.845313 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:33.845314    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9dba615-d835-4583-b21e-17c11a1c3c94-plugins-config-volume\") pod \"f9dba615-d835-4583-b21e-17c11a1c3c94\" (UID: \"f9dba615-d835-4583-b21e-17c11a1c3c94\") "
Jul 24 17:50:33.845497 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:33.845354    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2jxw\" (UniqueName: \"kubernetes.io/projected/59f4b0f8-653c-4215-bffa-9ef8e28865bb-kube-api-access-h2jxw\") pod \"59f4b0f8-653c-4215-bffa-9ef8e28865bb\" (UID: \"59f4b0f8-653c-4215-bffa-9ef8e28865bb\") "
Jul 24 17:50:33.845497 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:33.845392    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srdvx\" (UniqueName: \"kubernetes.io/projected/f9dba615-d835-4583-b21e-17c11a1c3c94-kube-api-access-srdvx\") pod \"f9dba615-d835-4583-b21e-17c11a1c3c94\" (UID: \"f9dba615-d835-4583-b21e-17c11a1c3c94\") "
Jul 24 17:50:33.845497 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:33.845483    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59f4b0f8-653c-4215-bffa-9ef8e28865bb-maas-api-tls\") pod \"59f4b0f8-653c-4215-bffa-9ef8e28865bb\" (UID: \"59f4b0f8-653c-4215-bffa-9ef8e28865bb\") "
Jul 24 17:50:33.845723 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:33.845700    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59f4b0f8-653c-4215-bffa-9ef8e28865bb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "59f4b0f8-653c-4215-bffa-9ef8e28865bb" (UID: "59f4b0f8-653c-4215-bffa-9ef8e28865bb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:50:33.845817 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:33.845725    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9dba615-d835-4583-b21e-17c11a1c3c94-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f9dba615-d835-4583-b21e-17c11a1c3c94" (UID: "f9dba615-d835-4583-b21e-17c11a1c3c94"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:50:33.847453 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:33.847424    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9dba615-d835-4583-b21e-17c11a1c3c94-kube-api-access-srdvx" (OuterVolumeSpecName: "kube-api-access-srdvx") pod "f9dba615-d835-4583-b21e-17c11a1c3c94" (UID: "f9dba615-d835-4583-b21e-17c11a1c3c94"). InnerVolumeSpecName "kube-api-access-srdvx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:50:33.847537 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:33.847508    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59f4b0f8-653c-4215-bffa-9ef8e28865bb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "59f4b0f8-653c-4215-bffa-9ef8e28865bb" (UID: "59f4b0f8-653c-4215-bffa-9ef8e28865bb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:50:33.847588 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:33.847568    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59f4b0f8-653c-4215-bffa-9ef8e28865bb-kube-api-access-h2jxw" (OuterVolumeSpecName: "kube-api-access-h2jxw") pod "59f4b0f8-653c-4215-bffa-9ef8e28865bb" (UID: "59f4b0f8-653c-4215-bffa-9ef8e28865bb"). InnerVolumeSpecName "kube-api-access-h2jxw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:50:33.946367 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:33.946306    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59f4b0f8-653c-4215-bffa-9ef8e28865bb-openshift-service-ca\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:50:33.946367 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:33.946328    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9dba615-d835-4583-b21e-17c11a1c3c94-plugins-config-volume\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:50:33.946367 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:33.946338    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2jxw\" (UniqueName: \"kubernetes.io/projected/59f4b0f8-653c-4215-bffa-9ef8e28865bb-kube-api-access-h2jxw\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:50:33.946367 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:33.946347    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srdvx\" (UniqueName: \"kubernetes.io/projected/f9dba615-d835-4583-b21e-17c11a1c3c94-kube-api-access-srdvx\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:50:33.946367 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:33.946356    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59f4b0f8-653c-4215-bffa-9ef8e28865bb-maas-api-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:50:34.695288 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:34.695209    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9bc868-78db78d6b8-nq55z"
Jul 24 17:50:34.695288 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:34.695209    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9bc868-78db78d6b8-nq55z" event={"ID":"f9dba615-d835-4583-b21e-17c11a1c3c94","Type":"ContainerDied","Data":"003527ba08870c97466d8b78670b8c527b372bb0f14cb9af28d57b9287ef2b9e"}
Jul 24 17:50:34.695789 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:34.695345    2582 scope.go:117] "RemoveContainer" containerID="28cdd0bbd46800dce06ff685b2c2007b106261638cb8d978665662ec5a3c9d4f"
Jul 24 17:50:34.696762 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:34.696531    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9bc868-76b65b5cf-9bmlv"
Jul 24 17:50:34.696762 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:34.696581    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9bc868-76b65b5cf-9bmlv" event={"ID":"59f4b0f8-653c-4215-bffa-9ef8e28865bb","Type":"ContainerDied","Data":"da77f844d7808e7fad66f4ba680870260f39ea25e5416f200ce46b745b267170"}
Jul 24 17:50:34.704382 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:34.704366    2582 scope.go:117] "RemoveContainer" containerID="3d8e779bed6b57b2fe442e2ce49450cbfe36516ed63b51771eac4ed3f8ac8379"
Jul 24 17:50:34.720894 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:34.720873    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9bc868-78db78d6b8-nq55z"]
Jul 24 17:50:34.724606 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:34.724587    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9bc868-78db78d6b8-nq55z"]
Jul 24 17:50:34.734416 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:34.734391    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9bc868-76b65b5cf-9bmlv"]
Jul 24 17:50:34.739921 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:34.739902    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-9bc868-76b65b5cf-9bmlv"]
Jul 24 17:50:35.763350 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:35.763319    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59f4b0f8-653c-4215-bffa-9ef8e28865bb" path="/var/lib/kubelet/pods/59f4b0f8-653c-4215-bffa-9ef8e28865bb/volumes"
Jul 24 17:50:35.763801 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:35.763700    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9dba615-d835-4583-b21e-17c11a1c3c94" path="/var/lib/kubelet/pods/f9dba615-d835-4583-b21e-17c11a1c3c94/volumes"
Jul 24 17:50:38.049155 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:38.049116    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9bc868-kmrf8"]
Jul 24 17:50:38.051952 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:38.051923    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9bc868-kmrf8"]
Jul 24 17:50:38.778930 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:38.778893    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:50:39.764125 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:39.764093    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03a23370-fecd-445c-956d-30b65a1ddd16" path="/var/lib/kubelet/pods/03a23370-fecd-445c-956d-30b65a1ddd16/volumes"
Jul 24 17:50:48.582941 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:48.582904    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-052d9d-4thml"]
Jul 24 17:50:48.583324 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:48.583269    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59f4b0f8-653c-4215-bffa-9ef8e28865bb" containerName="maas-api"
Jul 24 17:50:48.583324 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:48.583279    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="59f4b0f8-653c-4215-bffa-9ef8e28865bb" containerName="maas-api"
Jul 24 17:50:48.583324 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:48.583296    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9dba615-d835-4583-b21e-17c11a1c3c94" containerName="payload-pre-processing"
Jul 24 17:50:48.583324 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:48.583301    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9dba615-d835-4583-b21e-17c11a1c3c94" containerName="payload-pre-processing"
Jul 24 17:50:48.583324 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:48.583307    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03a23370-fecd-445c-956d-30b65a1ddd16" containerName="revoke-keys"
Jul 24 17:50:48.583324 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:48.583312    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="03a23370-fecd-445c-956d-30b65a1ddd16" containerName="revoke-keys"
Jul 24 17:50:48.583513 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:48.583371    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9dba615-d835-4583-b21e-17c11a1c3c94" containerName="payload-pre-processing"
Jul 24 17:50:48.583513 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:48.583378    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="03a23370-fecd-445c-956d-30b65a1ddd16" containerName="revoke-keys"
Jul 24 17:50:48.583513 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:48.583385    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="59f4b0f8-653c-4215-bffa-9ef8e28865bb" containerName="maas-api"
Jul 24 17:50:48.585431 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:48.585414    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-052d9d-4thml"
Jul 24 17:50:48.588114 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:48.588092    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tdqg2\""
Jul 24 17:50:48.606961 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:48.606939    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-052d9d-4thml"]
Jul 24 17:50:48.675844 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:48.675804    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0585e6d0-a491-4d66-91d4-6a9033d99b70-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-052d9d-4thml\" (UID: \"0585e6d0-a491-4d66-91d4-6a9033d99b70\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-052d9d-4thml"
Jul 24 17:50:48.776825 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:48.776796    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0585e6d0-a491-4d66-91d4-6a9033d99b70-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-052d9d-4thml\" (UID: \"0585e6d0-a491-4d66-91d4-6a9033d99b70\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-052d9d-4thml"
Jul 24 17:50:48.777423 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:48.777398    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0585e6d0-a491-4d66-91d4-6a9033d99b70-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-052d9d-4thml\" (UID: \"0585e6d0-a491-4d66-91d4-6a9033d99b70\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-052d9d-4thml"
Jul 24 17:50:48.895152 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:48.895071    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-052d9d-4thml"
Jul 24 17:50:49.026605 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:49.026577    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-052d9d-4thml"]
Jul 24 17:50:49.027460 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:50:49.027434    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0585e6d0_a491_4d66_91d4_6a9033d99b70.slice/crio-830d10b0fb8f830e4c463e3b8e8d216cf3c66a6360c092baa99b2764c4e2d683 WatchSource:0}: Error finding container 830d10b0fb8f830e4c463e3b8e8d216cf3c66a6360c092baa99b2764c4e2d683: Status 404 returned error can't find the container with id 830d10b0fb8f830e4c463e3b8e8d216cf3c66a6360c092baa99b2764c4e2d683
Jul 24 17:50:49.782813 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:49.782776    2582 generic.go:356] "Generic (PLEG): container finished" podID="0585e6d0-a491-4d66-91d4-6a9033d99b70" containerID="d062665b4df75d9848fadf622a9feb48277b2236dd2ce667aae4770f30557dd8" exitCode=0
Jul 24 17:50:49.783202 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:49.782832    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-052d9d-4thml" event={"ID":"0585e6d0-a491-4d66-91d4-6a9033d99b70","Type":"ContainerDied","Data":"d062665b4df75d9848fadf622a9feb48277b2236dd2ce667aae4770f30557dd8"}
Jul 24 17:50:49.783202 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:49.782883    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-052d9d-4thml" event={"ID":"0585e6d0-a491-4d66-91d4-6a9033d99b70","Type":"ContainerStarted","Data":"830d10b0fb8f830e4c463e3b8e8d216cf3c66a6360c092baa99b2764c4e2d683"}
Jul 24 17:50:50.920518 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:50.920494    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-052d9d-4thml"
Jul 24 17:50:51.097881 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:51.097792    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0585e6d0-a491-4d66-91d4-6a9033d99b70-maas-api-service-ca\") pod \"0585e6d0-a491-4d66-91d4-6a9033d99b70\" (UID: \"0585e6d0-a491-4d66-91d4-6a9033d99b70\") "
Jul 24 17:50:51.098128 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:51.098104    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0585e6d0-a491-4d66-91d4-6a9033d99b70-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0585e6d0-a491-4d66-91d4-6a9033d99b70" (UID: "0585e6d0-a491-4d66-91d4-6a9033d99b70"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:50:51.199298 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:51.199261    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0585e6d0-a491-4d66-91d4-6a9033d99b70-maas-api-service-ca\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:50:51.795184 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:51.795158    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-052d9d-4thml"
Jul 24 17:50:51.795338 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:51.795190    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-052d9d-4thml" event={"ID":"0585e6d0-a491-4d66-91d4-6a9033d99b70","Type":"ContainerDied","Data":"830d10b0fb8f830e4c463e3b8e8d216cf3c66a6360c092baa99b2764c4e2d683"}
Jul 24 17:50:51.795338 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:50:51.795230    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="830d10b0fb8f830e4c463e3b8e8d216cf3c66a6360c092baa99b2764c4e2d683"
Jul 24 17:51:03.374516 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:51:03.374478    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:51:04.146020 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:51:04.145987    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-052d9d-f96595bbb-l89w7"]
Jul 24 17:51:04.146259 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:51:04.146234    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-052d9d-f96595bbb-l89w7" podUID="0bd0b76e-7019-4b9f-b120-7bc8ac4c27c8" containerName="payload-processing" containerID="cri-o://53a8bc2f03419820305821ea342076399077c2fcb64b52e29373f6c51b76f8ad" gracePeriod=30
Jul 24 17:51:04.151752 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:51:04.151722    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-052d9d-59474c7df6-w974w"]
Jul 24 17:51:04.152030 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:51:04.151980    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-052d9d-59474c7df6-w974w" podUID="39761f36-756d-43dc-b0d7-d86f4530dad4" containerName="payload-pre-processing" containerID="cri-o://8b4eab48020db9cb56268f36e0cd30a433d6c94e78bb50a7eb542941d2a400bd" gracePeriod=30
Jul 24 17:51:04.406338 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:51:04.406282    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-052d9d-f96595bbb-l89w7"
Jul 24 17:51:04.410930 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:51:04.410906    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwh9t\" (UniqueName: \"kubernetes.io/projected/0bd0b76e-7019-4b9f-b120-7bc8ac4c27c8-kube-api-access-kwh9t\") pod \"0bd0b76e-7019-4b9f-b120-7bc8ac4c27c8\" (UID: \"0bd0b76e-7019-4b9f-b120-7bc8ac4c27c8\") "
Jul 24 17:51:04.411027 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:51:04.411013    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0bd0b76e-7019-4b9f-b120-7bc8ac4c27c8-plugins-config-volume\") pod \"0bd0b76e-7019-4b9f-b120-7bc8ac4c27c8\" (UID: \"0bd0b76e-7019-4b9f-b120-7bc8ac4c27c8\") "
Jul 24 17:51:04.411349 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:51:04.411328    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bd0b76e-7019-4b9f-b120-7bc8ac4c27c8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0bd0b76e-7019-4b9f-b120-7bc8ac4c27c8" (UID: "0bd0b76e-7019-4b9f-b120-7bc8ac4c27c8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:51:04.412775 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:51:04.412747    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bd0b76e-7019-4b9f-b120-7bc8ac4c27c8-kube-api-access-kwh9t" (OuterVolumeSpecName: "kube-api-access-kwh9t") pod "0bd0b76e-7019-4b9f-b120-7bc8ac4c27c8" (UID: "0bd0b76e-7019-4b9f-b120-7bc8ac4c27c8"). InnerVolumeSpecName "kube-api-access-kwh9t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:51:04.425729 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:51:04.425708    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-052d9d-59474c7df6-w974w"
Jul 24 17:51:04.511686 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:51:04.511633    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39761f36-756d-43dc-b0d7-d86f4530dad4-plugins-config-volume\") pod \"39761f36-756d-43dc-b0d7-d86f4530dad4\" (UID: \"39761f36-756d-43dc-b0d7-d86f4530dad4\") "
Jul 24 17:51:04.511855 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:51:04.511710    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nb5xw\" (UniqueName: \"kubernetes.io/projected/39761f36-756d-43dc-b0d7-d86f4530dad4-kube-api-access-nb5xw\") pod \"39761f36-756d-43dc-b0d7-d86f4530dad4\" (UID: \"39761f36-756d-43dc-b0d7-d86f4530dad4\") "
Jul 24 17:51:04.511917 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:51:04.511905    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwh9t\" (UniqueName: \"kubernetes.io/projected/0bd0b76e-7019-4b9f-b120-7bc8ac4c27c8-kube-api-access-kwh9t\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:51:04.511956 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:51:04.511920    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0bd0b76e-7019-4b9f-b120-7bc8ac4c27c8-plugins-config-volume\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:51:04.512022 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:51:04.512000    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39761f36-756d-43dc-b0d7-d86f4530dad4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "39761f36-756d-43dc-b0d7-d86f4530dad4" (UID: "39761f36-756d-43dc-b0d7-d86f4530dad4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:51:04.513648 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:51:04.513618    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39761f36-756d-43dc-b0d7-d86f4530dad4-kube-api-access-nb5xw" (OuterVolumeSpecName: "kube-api-access-nb5xw") pod "39761f36-756d-43dc-b0d7-d86f4530dad4" (UID: "39761f36-756d-43dc-b0d7-d86f4530dad4"). InnerVolumeSpecName "kube-api-access-nb5xw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:51:04.612815 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:51:04.612784    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39761f36-756d-43dc-b0d7-d86f4530dad4-plugins-config-volume\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:51:04.612815 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:51:04.612809    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nb5xw\" (UniqueName: \"kubernetes.io/projected/39761f36-756d-43dc-b0d7-d86f4530dad4-kube-api-access-nb5xw\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:51:04.864178 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:51:04.864148    2582 generic.go:356] "Generic (PLEG): container finished" podID="39761f36-756d-43dc-b0d7-d86f4530dad4" containerID="8b4eab48020db9cb56268f36e0cd30a433d6c94e78bb50a7eb542941d2a400bd" exitCode=0
Jul 24 17:51:04.864370 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:51:04.864202    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-052d9d-59474c7df6-w974w"
Jul 24 17:51:04.864370 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:51:04.864238    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-052d9d-59474c7df6-w974w" event={"ID":"39761f36-756d-43dc-b0d7-d86f4530dad4","Type":"ContainerDied","Data":"8b4eab48020db9cb56268f36e0cd30a433d6c94e78bb50a7eb542941d2a400bd"}
Jul 24 17:51:04.864370 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:51:04.864303    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-052d9d-59474c7df6-w974w" event={"ID":"39761f36-756d-43dc-b0d7-d86f4530dad4","Type":"ContainerDied","Data":"e8ac7ba71dee90e24431431647ec0103af7208d19e8f4b258d41e22b338b7ce6"}
Jul 24 17:51:04.864370 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:51:04.864334    2582 scope.go:117] "RemoveContainer" containerID="8b4eab48020db9cb56268f36e0cd30a433d6c94e78bb50a7eb542941d2a400bd"
Jul 24 17:51:04.865559 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:51:04.865535    2582 generic.go:356] "Generic (PLEG): container finished" podID="0bd0b76e-7019-4b9f-b120-7bc8ac4c27c8" containerID="53a8bc2f03419820305821ea342076399077c2fcb64b52e29373f6c51b76f8ad" exitCode=0
Jul 24 17:51:04.865639 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:51:04.865580    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-052d9d-f96595bbb-l89w7"
Jul 24 17:51:04.865639 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:51:04.865595    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-052d9d-f96595bbb-l89w7" event={"ID":"0bd0b76e-7019-4b9f-b120-7bc8ac4c27c8","Type":"ContainerDied","Data":"53a8bc2f03419820305821ea342076399077c2fcb64b52e29373f6c51b76f8ad"}
Jul 24 17:51:04.865639 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:51:04.865627    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-052d9d-f96595bbb-l89w7" event={"ID":"0bd0b76e-7019-4b9f-b120-7bc8ac4c27c8","Type":"ContainerDied","Data":"54bb7a21404cc6f99a4da2d293a33d01c11e0d0dbc11a0e29c308a82016b1c51"}
Jul 24 17:51:04.874144 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:51:04.874128    2582 scope.go:117] "RemoveContainer" containerID="8b4eab48020db9cb56268f36e0cd30a433d6c94e78bb50a7eb542941d2a400bd"
Jul 24 17:51:04.874403 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:51:04.874379    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b4eab48020db9cb56268f36e0cd30a433d6c94e78bb50a7eb542941d2a400bd\": container with ID starting with 8b4eab48020db9cb56268f36e0cd30a433d6c94e78bb50a7eb542941d2a400bd not found: ID does not exist" containerID="8b4eab48020db9cb56268f36e0cd30a433d6c94e78bb50a7eb542941d2a400bd"
Jul 24 17:51:04.874488 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:51:04.874413    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b4eab48020db9cb56268f36e0cd30a433d6c94e78bb50a7eb542941d2a400bd"} err="failed to get container status \"8b4eab48020db9cb56268f36e0cd30a433d6c94e78bb50a7eb542941d2a400bd\": rpc error: code = NotFound desc = could not find container \"8b4eab48020db9cb56268f36e0cd30a433d6c94e78bb50a7eb542941d2a400bd\": container with ID starting with 8b4eab48020db9cb56268f36e0cd30a433d6c94e78bb50a7eb542941d2a400bd not found: ID does not exist"
Jul 24 17:51:04.874488 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:51:04.874437    2582 scope.go:117] "RemoveContainer" containerID="53a8bc2f03419820305821ea342076399077c2fcb64b52e29373f6c51b76f8ad"
Jul 24 17:51:04.884683 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:51:04.884648    2582 scope.go:117] "RemoveContainer" containerID="53a8bc2f03419820305821ea342076399077c2fcb64b52e29373f6c51b76f8ad"
Jul 24 17:51:04.884923 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:51:04.884902    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53a8bc2f03419820305821ea342076399077c2fcb64b52e29373f6c51b76f8ad\": container with ID starting with 53a8bc2f03419820305821ea342076399077c2fcb64b52e29373f6c51b76f8ad not found: ID does not exist" containerID="53a8bc2f03419820305821ea342076399077c2fcb64b52e29373f6c51b76f8ad"
Jul 24 17:51:04.884984 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:51:04.884929    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53a8bc2f03419820305821ea342076399077c2fcb64b52e29373f6c51b76f8ad"} err="failed to get container status \"53a8bc2f03419820305821ea342076399077c2fcb64b52e29373f6c51b76f8ad\": rpc error: code = NotFound desc = could not find container \"53a8bc2f03419820305821ea342076399077c2fcb64b52e29373f6c51b76f8ad\": container with ID starting with 53a8bc2f03419820305821ea342076399077c2fcb64b52e29373f6c51b76f8ad not found: ID does not exist"
Jul 24 17:51:04.894606 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:51:04.894588    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-052d9d-59474c7df6-w974w"]
Jul 24 17:51:04.899819 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:51:04.899799    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-052d9d-59474c7df6-w974w"]
Jul 24 17:51:04.909705 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:51:04.909684    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-052d9d-f96595bbb-l89w7"]
Jul 24 17:51:04.913629 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:51:04.913610    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-052d9d-f96595bbb-l89w7"]
Jul 24 17:51:05.763486 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:51:05.763454    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bd0b76e-7019-4b9f-b120-7bc8ac4c27c8" path="/var/lib/kubelet/pods/0bd0b76e-7019-4b9f-b120-7bc8ac4c27c8/volumes"
Jul 24 17:51:05.763893 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:51:05.763818    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39761f36-756d-43dc-b0d7-d86f4530dad4" path="/var/lib/kubelet/pods/39761f36-756d-43dc-b0d7-d86f4530dad4/volumes"
Jul 24 17:51:08.701290 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:51:08.701259    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-052d9d-4thml"]
Jul 24 17:51:08.704582 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:51:08.704555    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-052d9d-4thml"]
Jul 24 17:51:09.764567 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:51:09.764531    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0585e6d0-a491-4d66-91d4-6a9033d99b70" path="/var/lib/kubelet/pods/0585e6d0-a491-4d66-91d4-6a9033d99b70/volumes"
Jul 24 17:51:13.780277 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:51:13.780241    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:52:03.907061 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:03.907025    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b77c4b-n5zkf"]
Jul 24 17:52:03.907525 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:03.907374    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39761f36-756d-43dc-b0d7-d86f4530dad4" containerName="payload-pre-processing"
Jul 24 17:52:03.907525 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:03.907384    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="39761f36-756d-43dc-b0d7-d86f4530dad4" containerName="payload-pre-processing"
Jul 24 17:52:03.907525 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:03.907404    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bd0b76e-7019-4b9f-b120-7bc8ac4c27c8" containerName="payload-processing"
Jul 24 17:52:03.907525 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:03.907410    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bd0b76e-7019-4b9f-b120-7bc8ac4c27c8" containerName="payload-processing"
Jul 24 17:52:03.907525 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:03.907418    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0585e6d0-a491-4d66-91d4-6a9033d99b70" containerName="revoke-keys"
Jul 24 17:52:03.907525 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:03.907424    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0585e6d0-a491-4d66-91d4-6a9033d99b70" containerName="revoke-keys"
Jul 24 17:52:03.907525 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:03.907477    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="39761f36-756d-43dc-b0d7-d86f4530dad4" containerName="payload-pre-processing"
Jul 24 17:52:03.907525 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:03.907488    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bd0b76e-7019-4b9f-b120-7bc8ac4c27c8" containerName="payload-processing"
Jul 24 17:52:03.907525 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:03.907494    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0585e6d0-a491-4d66-91d4-6a9033d99b70" containerName="revoke-keys"
Jul 24 17:52:03.910613 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:03.910597    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b77c4b-n5zkf"
Jul 24 17:52:03.913119 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:03.913095    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tdqg2\""
Jul 24 17:52:03.919905 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:03.919878    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b77c4b-n5zkf"]
Jul 24 17:52:03.928526 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:03.928498    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbf2b18d-1ec1-47be-bf51-2295f148127c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-b77c4b-n5zkf\" (UID: \"cbf2b18d-1ec1-47be-bf51-2295f148127c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b77c4b-n5zkf"
Jul 24 17:52:04.029064 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:04.029021    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbf2b18d-1ec1-47be-bf51-2295f148127c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-b77c4b-n5zkf\" (UID: \"cbf2b18d-1ec1-47be-bf51-2295f148127c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b77c4b-n5zkf"
Jul 24 17:52:04.029613 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:04.029594    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbf2b18d-1ec1-47be-bf51-2295f148127c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-b77c4b-n5zkf\" (UID: \"cbf2b18d-1ec1-47be-bf51-2295f148127c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b77c4b-n5zkf"
Jul 24 17:52:04.221956 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:04.221863    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b77c4b-n5zkf"
Jul 24 17:52:04.351367 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:04.351340    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b77c4b-n5zkf"]
Jul 24 17:52:04.352641 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:52:04.352613    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbf2b18d_1ec1_47be_bf51_2295f148127c.slice/crio-86557133e0425766744852d8b4c930c65a4037d6d0e4707052c73f92234b1402 WatchSource:0}: Error finding container 86557133e0425766744852d8b4c930c65a4037d6d0e4707052c73f92234b1402: Status 404 returned error can't find the container with id 86557133e0425766744852d8b4c930c65a4037d6d0e4707052c73f92234b1402
Jul 24 17:52:05.175361 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:05.175322    2582 generic.go:356] "Generic (PLEG): container finished" podID="cbf2b18d-1ec1-47be-bf51-2295f148127c" containerID="cebddf9363ca82aa67cb21c4ba29d30fc1889b864015bd13ba272c589613f63d" exitCode=0
Jul 24 17:52:05.175823 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:05.175410    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b77c4b-n5zkf" event={"ID":"cbf2b18d-1ec1-47be-bf51-2295f148127c","Type":"ContainerDied","Data":"cebddf9363ca82aa67cb21c4ba29d30fc1889b864015bd13ba272c589613f63d"}
Jul 24 17:52:05.175823 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:05.175465    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b77c4b-n5zkf" event={"ID":"cbf2b18d-1ec1-47be-bf51-2295f148127c","Type":"ContainerStarted","Data":"86557133e0425766744852d8b4c930c65a4037d6d0e4707052c73f92234b1402"}
Jul 24 17:52:06.309909 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:06.309882    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b77c4b-n5zkf"
Jul 24 17:52:06.347423 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:06.347387    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbf2b18d-1ec1-47be-bf51-2295f148127c-maas-api-service-ca\") pod \"cbf2b18d-1ec1-47be-bf51-2295f148127c\" (UID: \"cbf2b18d-1ec1-47be-bf51-2295f148127c\") "
Jul 24 17:52:06.347723 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:06.347704    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbf2b18d-1ec1-47be-bf51-2295f148127c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cbf2b18d-1ec1-47be-bf51-2295f148127c" (UID: "cbf2b18d-1ec1-47be-bf51-2295f148127c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:52:06.448771 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:06.448655    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbf2b18d-1ec1-47be-bf51-2295f148127c-maas-api-service-ca\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:52:07.186401 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:07.186372    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b77c4b-n5zkf"
Jul 24 17:52:07.186576 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:07.186417    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b77c4b-n5zkf" event={"ID":"cbf2b18d-1ec1-47be-bf51-2295f148127c","Type":"ContainerDied","Data":"86557133e0425766744852d8b4c930c65a4037d6d0e4707052c73f92234b1402"}
Jul 24 17:52:07.186576 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:07.186462    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="86557133e0425766744852d8b4c930c65a4037d6d0e4707052c73f92234b1402"
Jul 24 17:52:14.317094 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:14.317062    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77c4b-696dc4df8-ldxrv"]
Jul 24 17:52:14.317482 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:14.317285    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77c4b-696dc4df8-ldxrv" podUID="d4c8c00c-4f2f-4700-b353-93e13acdb8f8" containerName="maas-api" containerID="cri-o://bbd35a32112ab0d9b7513f6aa27544924d316cece6430e10778ba67c9a54cf7a" gracePeriod=30
Jul 24 17:52:14.368706 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:14.368659    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-b77c4b-5db8fdd6bb-96tjm"]
Jul 24 17:52:14.368968 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:14.368928    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-b77c4b-5db8fdd6bb-96tjm" podUID="b20208e8-ac4d-475b-b951-f7d89f3cf6d4" containerName="payload-processing" containerID="cri-o://7e6a2f81b38f610cd0f42d919c225b538b67b1a2e3a4d3e3bf0db253c469224a" gracePeriod=30
Jul 24 17:52:14.376917 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:14.376868    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-b77c4b-7bc6547b6d-7s4rt"]
Jul 24 17:52:14.377139 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:14.377114    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b77c4b-7bc6547b6d-7s4rt" podUID="42b38ad6-77b6-4380-a30c-b2ea3df13232" containerName="payload-pre-processing" containerID="cri-o://9adbe6a57eabaab5f01cdcf78d28005cfc821f0b7ca2c9246a15d5b6ab66369b" gracePeriod=30
Jul 24 17:52:14.637821 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:14.637798    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-b77c4b-5db8fdd6bb-96tjm"
Jul 24 17:52:14.649344 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:14.649323    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77c4b-696dc4df8-ldxrv"
Jul 24 17:52:14.657793 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:14.657642    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b77c4b-7bc6547b6d-7s4rt"
Jul 24 17:52:14.724846 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:14.724812    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ls8zg\" (UniqueName: \"kubernetes.io/projected/d4c8c00c-4f2f-4700-b353-93e13acdb8f8-kube-api-access-ls8zg\") pod \"d4c8c00c-4f2f-4700-b353-93e13acdb8f8\" (UID: \"d4c8c00c-4f2f-4700-b353-93e13acdb8f8\") "
Jul 24 17:52:14.724846 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:14.724848    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4c8c00c-4f2f-4700-b353-93e13acdb8f8-openshift-service-ca\") pod \"d4c8c00c-4f2f-4700-b353-93e13acdb8f8\" (UID: \"d4c8c00c-4f2f-4700-b353-93e13acdb8f8\") "
Jul 24 17:52:14.725124 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:14.724896    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hlgds\" (UniqueName: \"kubernetes.io/projected/42b38ad6-77b6-4380-a30c-b2ea3df13232-kube-api-access-hlgds\") pod \"42b38ad6-77b6-4380-a30c-b2ea3df13232\" (UID: \"42b38ad6-77b6-4380-a30c-b2ea3df13232\") "
Jul 24 17:52:14.725124 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:14.725088    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4c8c00c-4f2f-4700-b353-93e13acdb8f8-maas-api-tls\") pod \"d4c8c00c-4f2f-4700-b353-93e13acdb8f8\" (UID: \"d4c8c00c-4f2f-4700-b353-93e13acdb8f8\") "
Jul 24 17:52:14.725242 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:14.725171    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b20208e8-ac4d-475b-b951-f7d89f3cf6d4-plugins-config-volume\") pod \"b20208e8-ac4d-475b-b951-f7d89f3cf6d4\" (UID: \"b20208e8-ac4d-475b-b951-f7d89f3cf6d4\") "
Jul 24 17:52:14.725242 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:14.725229    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzm95\" (UniqueName: \"kubernetes.io/projected/b20208e8-ac4d-475b-b951-f7d89f3cf6d4-kube-api-access-lzm95\") pod \"b20208e8-ac4d-475b-b951-f7d89f3cf6d4\" (UID: \"b20208e8-ac4d-475b-b951-f7d89f3cf6d4\") "
Jul 24 17:52:14.725326 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:14.725269    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42b38ad6-77b6-4380-a30c-b2ea3df13232-plugins-config-volume\") pod \"42b38ad6-77b6-4380-a30c-b2ea3df13232\" (UID: \"42b38ad6-77b6-4380-a30c-b2ea3df13232\") "
Jul 24 17:52:14.725416 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:14.725267    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4c8c00c-4f2f-4700-b353-93e13acdb8f8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d4c8c00c-4f2f-4700-b353-93e13acdb8f8" (UID: "d4c8c00c-4f2f-4700-b353-93e13acdb8f8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:52:14.725584 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:14.725563    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4c8c00c-4f2f-4700-b353-93e13acdb8f8-openshift-service-ca\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:52:14.725714 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:14.725649    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b20208e8-ac4d-475b-b951-f7d89f3cf6d4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b20208e8-ac4d-475b-b951-f7d89f3cf6d4" (UID: "b20208e8-ac4d-475b-b951-f7d89f3cf6d4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:52:14.725785 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:14.725719    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42b38ad6-77b6-4380-a30c-b2ea3df13232-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "42b38ad6-77b6-4380-a30c-b2ea3df13232" (UID: "42b38ad6-77b6-4380-a30c-b2ea3df13232"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:52:14.727166 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:14.727145    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b20208e8-ac4d-475b-b951-f7d89f3cf6d4-kube-api-access-lzm95" (OuterVolumeSpecName: "kube-api-access-lzm95") pod "b20208e8-ac4d-475b-b951-f7d89f3cf6d4" (UID: "b20208e8-ac4d-475b-b951-f7d89f3cf6d4"). InnerVolumeSpecName "kube-api-access-lzm95". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:52:14.727166 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:14.727149    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4c8c00c-4f2f-4700-b353-93e13acdb8f8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d4c8c00c-4f2f-4700-b353-93e13acdb8f8" (UID: "d4c8c00c-4f2f-4700-b353-93e13acdb8f8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:52:14.727426 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:14.727406    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42b38ad6-77b6-4380-a30c-b2ea3df13232-kube-api-access-hlgds" (OuterVolumeSpecName: "kube-api-access-hlgds") pod "42b38ad6-77b6-4380-a30c-b2ea3df13232" (UID: "42b38ad6-77b6-4380-a30c-b2ea3df13232"). InnerVolumeSpecName "kube-api-access-hlgds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:52:14.727481 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:14.727409    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4c8c00c-4f2f-4700-b353-93e13acdb8f8-kube-api-access-ls8zg" (OuterVolumeSpecName: "kube-api-access-ls8zg") pod "d4c8c00c-4f2f-4700-b353-93e13acdb8f8" (UID: "d4c8c00c-4f2f-4700-b353-93e13acdb8f8"). InnerVolumeSpecName "kube-api-access-ls8zg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:52:14.826068 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:14.825986    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlgds\" (UniqueName: \"kubernetes.io/projected/42b38ad6-77b6-4380-a30c-b2ea3df13232-kube-api-access-hlgds\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:52:14.826068 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:14.826016    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4c8c00c-4f2f-4700-b353-93e13acdb8f8-maas-api-tls\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:52:14.826068 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:14.826026    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b20208e8-ac4d-475b-b951-f7d89f3cf6d4-plugins-config-volume\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:52:14.826068 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:14.826035    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzm95\" (UniqueName: \"kubernetes.io/projected/b20208e8-ac4d-475b-b951-f7d89f3cf6d4-kube-api-access-lzm95\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:52:14.826068 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:14.826043    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42b38ad6-77b6-4380-a30c-b2ea3df13232-plugins-config-volume\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:52:14.826068 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:14.826051    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ls8zg\" (UniqueName: \"kubernetes.io/projected/d4c8c00c-4f2f-4700-b353-93e13acdb8f8-kube-api-access-ls8zg\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:52:15.230632 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:15.230539    2582 generic.go:356] "Generic (PLEG): container finished" podID="d4c8c00c-4f2f-4700-b353-93e13acdb8f8" containerID="bbd35a32112ab0d9b7513f6aa27544924d316cece6430e10778ba67c9a54cf7a" exitCode=0
Jul 24 17:52:15.230632 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:15.230583    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77c4b-696dc4df8-ldxrv"
Jul 24 17:52:15.230897 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:15.230626    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77c4b-696dc4df8-ldxrv" event={"ID":"d4c8c00c-4f2f-4700-b353-93e13acdb8f8","Type":"ContainerDied","Data":"bbd35a32112ab0d9b7513f6aa27544924d316cece6430e10778ba67c9a54cf7a"}
Jul 24 17:52:15.230897 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:15.230711    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77c4b-696dc4df8-ldxrv" event={"ID":"d4c8c00c-4f2f-4700-b353-93e13acdb8f8","Type":"ContainerDied","Data":"802163dbf96a4afafb9002b148447674e6eaba0c0d1bd4bb334ad5f9c80ff3ff"}
Jul 24 17:52:15.230897 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:15.230742    2582 scope.go:117] "RemoveContainer" containerID="bbd35a32112ab0d9b7513f6aa27544924d316cece6430e10778ba67c9a54cf7a"
Jul 24 17:52:15.232268 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:15.232245    2582 generic.go:356] "Generic (PLEG): container finished" podID="42b38ad6-77b6-4380-a30c-b2ea3df13232" containerID="9adbe6a57eabaab5f01cdcf78d28005cfc821f0b7ca2c9246a15d5b6ab66369b" exitCode=0
Jul 24 17:52:15.232387 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:15.232283    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b77c4b-7bc6547b6d-7s4rt"
Jul 24 17:52:15.232387 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:15.232330    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b77c4b-7bc6547b6d-7s4rt" event={"ID":"42b38ad6-77b6-4380-a30c-b2ea3df13232","Type":"ContainerDied","Data":"9adbe6a57eabaab5f01cdcf78d28005cfc821f0b7ca2c9246a15d5b6ab66369b"}
Jul 24 17:52:15.232387 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:15.232383    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b77c4b-7bc6547b6d-7s4rt" event={"ID":"42b38ad6-77b6-4380-a30c-b2ea3df13232","Type":"ContainerDied","Data":"148632706c069838afaad5eef6e54b77fd481f08f414c66d7e18e5fbc581ac8d"}
Jul 24 17:52:15.233729 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:15.233705    2582 generic.go:356] "Generic (PLEG): container finished" podID="b20208e8-ac4d-475b-b951-f7d89f3cf6d4" containerID="7e6a2f81b38f610cd0f42d919c225b538b67b1a2e3a4d3e3bf0db253c469224a" exitCode=0
Jul 24 17:52:15.233895 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:15.233747    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-b77c4b-5db8fdd6bb-96tjm"
Jul 24 17:52:15.233895 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:15.233765    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-b77c4b-5db8fdd6bb-96tjm" event={"ID":"b20208e8-ac4d-475b-b951-f7d89f3cf6d4","Type":"ContainerDied","Data":"7e6a2f81b38f610cd0f42d919c225b538b67b1a2e3a4d3e3bf0db253c469224a"}
Jul 24 17:52:15.233895 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:15.233802    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-b77c4b-5db8fdd6bb-96tjm" event={"ID":"b20208e8-ac4d-475b-b951-f7d89f3cf6d4","Type":"ContainerDied","Data":"a5ec61ec42a7cb4261c2019b0425f5978adb11f2142e5fd8b69842033985614b"}
Jul 24 17:52:15.241854 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:15.241838    2582 scope.go:117] "RemoveContainer" containerID="bbd35a32112ab0d9b7513f6aa27544924d316cece6430e10778ba67c9a54cf7a"
Jul 24 17:52:15.242105 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:52:15.242087    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbd35a32112ab0d9b7513f6aa27544924d316cece6430e10778ba67c9a54cf7a\": container with ID starting with bbd35a32112ab0d9b7513f6aa27544924d316cece6430e10778ba67c9a54cf7a not found: ID does not exist" containerID="bbd35a32112ab0d9b7513f6aa27544924d316cece6430e10778ba67c9a54cf7a"
Jul 24 17:52:15.242175 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:15.242113    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbd35a32112ab0d9b7513f6aa27544924d316cece6430e10778ba67c9a54cf7a"} err="failed to get container status \"bbd35a32112ab0d9b7513f6aa27544924d316cece6430e10778ba67c9a54cf7a\": rpc error: code = NotFound desc = could not find container \"bbd35a32112ab0d9b7513f6aa27544924d316cece6430e10778ba67c9a54cf7a\": container with ID starting with bbd35a32112ab0d9b7513f6aa27544924d316cece6430e10778ba67c9a54cf7a not found: ID does not exist"
Jul 24 17:52:15.242175 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:15.242130    2582 scope.go:117] "RemoveContainer" containerID="9adbe6a57eabaab5f01cdcf78d28005cfc821f0b7ca2c9246a15d5b6ab66369b"
Jul 24 17:52:15.249960 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:15.249947    2582 scope.go:117] "RemoveContainer" containerID="9adbe6a57eabaab5f01cdcf78d28005cfc821f0b7ca2c9246a15d5b6ab66369b"
Jul 24 17:52:15.250199 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:52:15.250183    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9adbe6a57eabaab5f01cdcf78d28005cfc821f0b7ca2c9246a15d5b6ab66369b\": container with ID starting with 9adbe6a57eabaab5f01cdcf78d28005cfc821f0b7ca2c9246a15d5b6ab66369b not found: ID does not exist" containerID="9adbe6a57eabaab5f01cdcf78d28005cfc821f0b7ca2c9246a15d5b6ab66369b"
Jul 24 17:52:15.250248 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:15.250204    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9adbe6a57eabaab5f01cdcf78d28005cfc821f0b7ca2c9246a15d5b6ab66369b"} err="failed to get container status \"9adbe6a57eabaab5f01cdcf78d28005cfc821f0b7ca2c9246a15d5b6ab66369b\": rpc error: code = NotFound desc = could not find container \"9adbe6a57eabaab5f01cdcf78d28005cfc821f0b7ca2c9246a15d5b6ab66369b\": container with ID starting with 9adbe6a57eabaab5f01cdcf78d28005cfc821f0b7ca2c9246a15d5b6ab66369b not found: ID does not exist"
Jul 24 17:52:15.250248 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:15.250218    2582 scope.go:117] "RemoveContainer" containerID="7e6a2f81b38f610cd0f42d919c225b538b67b1a2e3a4d3e3bf0db253c469224a"
Jul 24 17:52:15.256470 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:15.256446    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77c4b-696dc4df8-ldxrv"]
Jul 24 17:52:15.259268 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:15.259251    2582 scope.go:117] "RemoveContainer" containerID="7e6a2f81b38f610cd0f42d919c225b538b67b1a2e3a4d3e3bf0db253c469224a"
Jul 24 17:52:15.259505 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:52:15.259488    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e6a2f81b38f610cd0f42d919c225b538b67b1a2e3a4d3e3bf0db253c469224a\": container with ID starting with 7e6a2f81b38f610cd0f42d919c225b538b67b1a2e3a4d3e3bf0db253c469224a not found: ID does not exist" containerID="7e6a2f81b38f610cd0f42d919c225b538b67b1a2e3a4d3e3bf0db253c469224a"
Jul 24 17:52:15.259555 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:15.259512    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e6a2f81b38f610cd0f42d919c225b538b67b1a2e3a4d3e3bf0db253c469224a"} err="failed to get container status \"7e6a2f81b38f610cd0f42d919c225b538b67b1a2e3a4d3e3bf0db253c469224a\": rpc error: code = NotFound desc = could not find container \"7e6a2f81b38f610cd0f42d919c225b538b67b1a2e3a4d3e3bf0db253c469224a\": container with ID starting with 7e6a2f81b38f610cd0f42d919c225b538b67b1a2e3a4d3e3bf0db253c469224a not found: ID does not exist"
Jul 24 17:52:15.260848 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:15.260830    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-b77c4b-696dc4df8-ldxrv"]
Jul 24 17:52:15.270129 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:15.270105    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-b77c4b-7bc6547b6d-7s4rt"]
Jul 24 17:52:15.274376 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:15.274360    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-b77c4b-7bc6547b6d-7s4rt"]
Jul 24 17:52:15.284852 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:15.284833    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-b77c4b-5db8fdd6bb-96tjm"]
Jul 24 17:52:15.288615 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:15.288595    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-b77c4b-5db8fdd6bb-96tjm"]
Jul 24 17:52:15.764299 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:15.764266    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42b38ad6-77b6-4380-a30c-b2ea3df13232" path="/var/lib/kubelet/pods/42b38ad6-77b6-4380-a30c-b2ea3df13232/volumes"
Jul 24 17:52:15.764699 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:15.764659    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b20208e8-ac4d-475b-b951-f7d89f3cf6d4" path="/var/lib/kubelet/pods/b20208e8-ac4d-475b-b951-f7d89f3cf6d4/volumes"
Jul 24 17:52:15.765073 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:15.765059    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4c8c00c-4f2f-4700-b353-93e13acdb8f8" path="/var/lib/kubelet/pods/d4c8c00c-4f2f-4700-b353-93e13acdb8f8/volumes"
Jul 24 17:52:17.776612 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:17.776577    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:52:19.001239 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:19.001201    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b77c4b-n5zkf"]
Jul 24 17:52:19.006963 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:19.006926    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b77c4b-n5zkf"]
Jul 24 17:52:19.764620 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:19.764588    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbf2b18d-1ec1-47be-bf51-2295f148127c" path="/var/lib/kubelet/pods/cbf2b18d-1ec1-47be-bf51-2295f148127c/volumes"
Jul 24 17:52:26.038372 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:26.038336    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-028d4b-nd624"]
Jul 24 17:52:26.038931 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:26.038661    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4c8c00c-4f2f-4700-b353-93e13acdb8f8" containerName="maas-api"
Jul 24 17:52:26.038931 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:26.038683    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4c8c00c-4f2f-4700-b353-93e13acdb8f8" containerName="maas-api"
Jul 24 17:52:26.038931 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:26.038695    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbf2b18d-1ec1-47be-bf51-2295f148127c" containerName="revoke-keys"
Jul 24 17:52:26.038931 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:26.038701    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbf2b18d-1ec1-47be-bf51-2295f148127c" containerName="revoke-keys"
Jul 24 17:52:26.038931 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:26.038713    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b20208e8-ac4d-475b-b951-f7d89f3cf6d4" containerName="payload-processing"
Jul 24 17:52:26.038931 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:26.038719    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b20208e8-ac4d-475b-b951-f7d89f3cf6d4" containerName="payload-processing"
Jul 24 17:52:26.038931 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:26.038731    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42b38ad6-77b6-4380-a30c-b2ea3df13232" containerName="payload-pre-processing"
Jul 24 17:52:26.038931 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:26.038736    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="42b38ad6-77b6-4380-a30c-b2ea3df13232" containerName="payload-pre-processing"
Jul 24 17:52:26.038931 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:26.038796    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b20208e8-ac4d-475b-b951-f7d89f3cf6d4" containerName="payload-processing"
Jul 24 17:52:26.038931 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:26.038805    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="42b38ad6-77b6-4380-a30c-b2ea3df13232" containerName="payload-pre-processing"
Jul 24 17:52:26.038931 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:26.038814    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4c8c00c-4f2f-4700-b353-93e13acdb8f8" containerName="maas-api"
Jul 24 17:52:26.038931 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:26.038819    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbf2b18d-1ec1-47be-bf51-2295f148127c" containerName="revoke-keys"
Jul 24 17:52:26.043217 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:26.043201    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-028d4b-nd624"
Jul 24 17:52:26.045620 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:26.045599    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 17:52:26.045886 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:26.045872    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tdqg2\""
Jul 24 17:52:26.050910 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:26.050888    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-028d4b-nd624"]
Jul 24 17:52:26.122857 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:26.122830    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3607fa8-5262-44b8-89d8-be31125457f3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-028d4b-nd624\" (UID: \"e3607fa8-5262-44b8-89d8-be31125457f3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-028d4b-nd624"
Jul 24 17:52:26.223442 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:26.223413    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3607fa8-5262-44b8-89d8-be31125457f3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-028d4b-nd624\" (UID: \"e3607fa8-5262-44b8-89d8-be31125457f3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-028d4b-nd624"
Jul 24 17:52:26.224057 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:26.224040    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3607fa8-5262-44b8-89d8-be31125457f3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-028d4b-nd624\" (UID: \"e3607fa8-5262-44b8-89d8-be31125457f3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-028d4b-nd624"
Jul 24 17:52:26.353631 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:26.353561    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-028d4b-nd624"
Jul 24 17:52:26.494953 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:26.494919    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-028d4b-nd624"]
Jul 24 17:52:26.495542 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:52:26.495518    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3607fa8_5262_44b8_89d8_be31125457f3.slice/crio-459c7bca79da0bf3618a3f8d0ab619c59e329a390bace2cb1a3c8a94990fe541 WatchSource:0}: Error finding container 459c7bca79da0bf3618a3f8d0ab619c59e329a390bace2cb1a3c8a94990fe541: Status 404 returned error can't find the container with id 459c7bca79da0bf3618a3f8d0ab619c59e329a390bace2cb1a3c8a94990fe541
Jul 24 17:52:27.297535 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:27.297500    2582 generic.go:356] "Generic (PLEG): container finished" podID="e3607fa8-5262-44b8-89d8-be31125457f3" containerID="9380778c56708465a16c23c9f3c77bf2efb6c642a4717fa0abd26c01c43cda17" exitCode=0
Jul 24 17:52:27.297959 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:27.297577    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-028d4b-nd624" event={"ID":"e3607fa8-5262-44b8-89d8-be31125457f3","Type":"ContainerDied","Data":"9380778c56708465a16c23c9f3c77bf2efb6c642a4717fa0abd26c01c43cda17"}
Jul 24 17:52:27.297959 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:27.297623    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-028d4b-nd624" event={"ID":"e3607fa8-5262-44b8-89d8-be31125457f3","Type":"ContainerStarted","Data":"459c7bca79da0bf3618a3f8d0ab619c59e329a390bace2cb1a3c8a94990fe541"}
Jul 24 17:52:28.431468 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:28.431445    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-028d4b-nd624"
Jul 24 17:52:28.546266 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:28.546232    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3607fa8-5262-44b8-89d8-be31125457f3-maas-api-service-ca\") pod \"e3607fa8-5262-44b8-89d8-be31125457f3\" (UID: \"e3607fa8-5262-44b8-89d8-be31125457f3\") "
Jul 24 17:52:28.546580 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:28.546559    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3607fa8-5262-44b8-89d8-be31125457f3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e3607fa8-5262-44b8-89d8-be31125457f3" (UID: "e3607fa8-5262-44b8-89d8-be31125457f3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:52:28.647683 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:28.647594    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3607fa8-5262-44b8-89d8-be31125457f3-maas-api-service-ca\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:52:29.309728 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:29.309695    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-028d4b-nd624"
Jul 24 17:52:29.309728 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:29.309712    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-028d4b-nd624" event={"ID":"e3607fa8-5262-44b8-89d8-be31125457f3","Type":"ContainerDied","Data":"459c7bca79da0bf3618a3f8d0ab619c59e329a390bace2cb1a3c8a94990fe541"}
Jul 24 17:52:29.309934 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:29.309785    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="459c7bca79da0bf3618a3f8d0ab619c59e329a390bace2cb1a3c8a94990fe541"
Jul 24 17:52:36.595952 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:36.595920    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-028d4b-29748585-vg6fc"]
Jul 24 17:52:36.599518 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:36.599490    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-028d4b-29748585-vg6fc"]
Jul 24 17:52:36.634501 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:36.634472    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-028d4b-786956f876-wkttw"]
Jul 24 17:52:36.634740 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:36.634658    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-028d4b-786956f876-wkttw" podUID="c9fc141f-8210-4571-a0ac-241964ddef24" containerName="payload-pre-processing" containerID="cri-o://ac61aa4ce14d437082295ac053c4ce6876665b54ca9c1c2d0dcd14a6c624dda7" gracePeriod=30
Jul 24 17:52:36.892084 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:36.892060    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-028d4b-786956f876-wkttw"
Jul 24 17:52:37.018147 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:37.018113    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mp2jn\" (UniqueName: \"kubernetes.io/projected/c9fc141f-8210-4571-a0ac-241964ddef24-kube-api-access-mp2jn\") pod \"c9fc141f-8210-4571-a0ac-241964ddef24\" (UID: \"c9fc141f-8210-4571-a0ac-241964ddef24\") "
Jul 24 17:52:37.018341 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:37.018196    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9fc141f-8210-4571-a0ac-241964ddef24-plugins-config-volume\") pod \"c9fc141f-8210-4571-a0ac-241964ddef24\" (UID: \"c9fc141f-8210-4571-a0ac-241964ddef24\") "
Jul 24 17:52:37.018560 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:37.018533    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9fc141f-8210-4571-a0ac-241964ddef24-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c9fc141f-8210-4571-a0ac-241964ddef24" (UID: "c9fc141f-8210-4571-a0ac-241964ddef24"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:52:37.020141 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:37.020122    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9fc141f-8210-4571-a0ac-241964ddef24-kube-api-access-mp2jn" (OuterVolumeSpecName: "kube-api-access-mp2jn") pod "c9fc141f-8210-4571-a0ac-241964ddef24" (UID: "c9fc141f-8210-4571-a0ac-241964ddef24"). InnerVolumeSpecName "kube-api-access-mp2jn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:52:37.118890 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:37.118855    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mp2jn\" (UniqueName: \"kubernetes.io/projected/c9fc141f-8210-4571-a0ac-241964ddef24-kube-api-access-mp2jn\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:52:37.118890 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:37.118884    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9fc141f-8210-4571-a0ac-241964ddef24-plugins-config-volume\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:52:37.351007 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:37.350974    2582 generic.go:356] "Generic (PLEG): container finished" podID="c9fc141f-8210-4571-a0ac-241964ddef24" containerID="ac61aa4ce14d437082295ac053c4ce6876665b54ca9c1c2d0dcd14a6c624dda7" exitCode=0
Jul 24 17:52:37.351169 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:37.351020    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-028d4b-786956f876-wkttw"
Jul 24 17:52:37.351169 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:37.351058    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-028d4b-786956f876-wkttw" event={"ID":"c9fc141f-8210-4571-a0ac-241964ddef24","Type":"ContainerDied","Data":"ac61aa4ce14d437082295ac053c4ce6876665b54ca9c1c2d0dcd14a6c624dda7"}
Jul 24 17:52:37.351169 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:37.351108    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-028d4b-786956f876-wkttw" event={"ID":"c9fc141f-8210-4571-a0ac-241964ddef24","Type":"ContainerDied","Data":"11b84a5ae88d6d2b93cd47ff50d804af2b2ec3ba2cc19b70b655fab18959cbb8"}
Jul 24 17:52:37.351169 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:37.351129    2582 scope.go:117] "RemoveContainer" containerID="ac61aa4ce14d437082295ac053c4ce6876665b54ca9c1c2d0dcd14a6c624dda7"
Jul 24 17:52:37.359873 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:37.359849    2582 scope.go:117] "RemoveContainer" containerID="ac61aa4ce14d437082295ac053c4ce6876665b54ca9c1c2d0dcd14a6c624dda7"
Jul 24 17:52:37.360110 ip-10-0-134-152 kubenswrapper[2582]: E0724 17:52:37.360089    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac61aa4ce14d437082295ac053c4ce6876665b54ca9c1c2d0dcd14a6c624dda7\": container with ID starting with ac61aa4ce14d437082295ac053c4ce6876665b54ca9c1c2d0dcd14a6c624dda7 not found: ID does not exist" containerID="ac61aa4ce14d437082295ac053c4ce6876665b54ca9c1c2d0dcd14a6c624dda7"
Jul 24 17:52:37.360179 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:37.360121    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac61aa4ce14d437082295ac053c4ce6876665b54ca9c1c2d0dcd14a6c624dda7"} err="failed to get container status \"ac61aa4ce14d437082295ac053c4ce6876665b54ca9c1c2d0dcd14a6c624dda7\": rpc error: code = NotFound desc = could not find container \"ac61aa4ce14d437082295ac053c4ce6876665b54ca9c1c2d0dcd14a6c624dda7\": container with ID starting with ac61aa4ce14d437082295ac053c4ce6876665b54ca9c1c2d0dcd14a6c624dda7 not found: ID does not exist"
Jul 24 17:52:37.371926 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:37.371907    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-028d4b-786956f876-wkttw"]
Jul 24 17:52:37.375169 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:37.375151    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-028d4b-786956f876-wkttw"]
Jul 24 17:52:37.763144 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:37.763107    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36838d7c-57f4-448a-9d91-fe95830a5611" path="/var/lib/kubelet/pods/36838d7c-57f4-448a-9d91-fe95830a5611/volumes"
Jul 24 17:52:37.763640 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:37.763540    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9fc141f-8210-4571-a0ac-241964ddef24" path="/var/lib/kubelet/pods/c9fc141f-8210-4571-a0ac-241964ddef24/volumes"
Jul 24 17:52:39.784392 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:39.784364    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:52:41.119014 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:41.118975    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-028d4b-nd624"]
Jul 24 17:52:41.123101 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:41.123067    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-028d4b-nd624"]
Jul 24 17:52:41.763246 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:41.763212    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3607fa8-5262-44b8-89d8-be31125457f3" path="/var/lib/kubelet/pods/e3607fa8-5262-44b8-89d8-be31125457f3/volumes"
Jul 24 17:52:48.649867 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:48.649828    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a11aa7-xkff9"]
Jul 24 17:52:48.650245 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:48.650150    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9fc141f-8210-4571-a0ac-241964ddef24" containerName="payload-pre-processing"
Jul 24 17:52:48.650245 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:48.650162    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9fc141f-8210-4571-a0ac-241964ddef24" containerName="payload-pre-processing"
Jul 24 17:52:48.650245 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:48.650184    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3607fa8-5262-44b8-89d8-be31125457f3" containerName="revoke-keys"
Jul 24 17:52:48.650245 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:48.650190    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3607fa8-5262-44b8-89d8-be31125457f3" containerName="revoke-keys"
Jul 24 17:52:48.650245 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:48.650240    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9fc141f-8210-4571-a0ac-241964ddef24" containerName="payload-pre-processing"
Jul 24 17:52:48.650417 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:48.650248    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3607fa8-5262-44b8-89d8-be31125457f3" containerName="revoke-keys"
Jul 24 17:52:48.653247 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:48.653232    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a11aa7-xkff9"
Jul 24 17:52:48.655445 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:48.655423    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tdqg2\""
Jul 24 17:52:48.655557 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:48.655423    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 17:52:48.664318 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:48.664297    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a11aa7-xkff9"]
Jul 24 17:52:48.714839 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:48.714808    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bcc900db-8b6d-4944-bf00-843120d56f92-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-a11aa7-xkff9\" (UID: \"bcc900db-8b6d-4944-bf00-843120d56f92\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a11aa7-xkff9"
Jul 24 17:52:48.816274 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:48.816214    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bcc900db-8b6d-4944-bf00-843120d56f92-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-a11aa7-xkff9\" (UID: \"bcc900db-8b6d-4944-bf00-843120d56f92\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a11aa7-xkff9"
Jul 24 17:52:48.816934 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:48.816911    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bcc900db-8b6d-4944-bf00-843120d56f92-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-a11aa7-xkff9\" (UID: \"bcc900db-8b6d-4944-bf00-843120d56f92\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a11aa7-xkff9"
Jul 24 17:52:48.962907 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:48.962759    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a11aa7-xkff9"
Jul 24 17:52:49.099571 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:49.099546    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a11aa7-xkff9"]
Jul 24 17:52:49.101158 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:52:49.101130    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcc900db_8b6d_4944_bf00_843120d56f92.slice/crio-4f36ce107034847376ae304d8516a47bc1ae77751387c3ea873a0df634577fa7 WatchSource:0}: Error finding container 4f36ce107034847376ae304d8516a47bc1ae77751387c3ea873a0df634577fa7: Status 404 returned error can't find the container with id 4f36ce107034847376ae304d8516a47bc1ae77751387c3ea873a0df634577fa7
Jul 24 17:52:49.413481 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:49.413442    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a11aa7-xkff9" event={"ID":"bcc900db-8b6d-4944-bf00-843120d56f92","Type":"ContainerStarted","Data":"f55281839f614660f7781f8f3e5b1bd3fc6c65d6c6b17f5c16466def39dee08d"}
Jul 24 17:52:49.413708 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:49.413493    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a11aa7-xkff9" event={"ID":"bcc900db-8b6d-4944-bf00-843120d56f92","Type":"ContainerStarted","Data":"4f36ce107034847376ae304d8516a47bc1ae77751387c3ea873a0df634577fa7"}
Jul 24 17:52:49.431649 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:49.431593    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a11aa7-xkff9" podStartSLOduration=1.431578512 podStartE2EDuration="1.431578512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:52:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:52:49.430356745 +0000 UTC m=+2960.246331358" watchObservedRunningTime="2026-07-24 17:52:49.431578512 +0000 UTC m=+2960.247553124"
Jul 24 17:52:50.419556 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:50.419521    2582 generic.go:356] "Generic (PLEG): container finished" podID="bcc900db-8b6d-4944-bf00-843120d56f92" containerID="f55281839f614660f7781f8f3e5b1bd3fc6c65d6c6b17f5c16466def39dee08d" exitCode=0
Jul 24 17:52:50.420004 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:50.419616    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a11aa7-xkff9" event={"ID":"bcc900db-8b6d-4944-bf00-843120d56f92","Type":"ContainerDied","Data":"f55281839f614660f7781f8f3e5b1bd3fc6c65d6c6b17f5c16466def39dee08d"}
Jul 24 17:52:51.549918 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:51.549894    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a11aa7-xkff9"
Jul 24 17:52:51.637878 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:51.637844    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bcc900db-8b6d-4944-bf00-843120d56f92-maas-api-service-ca\") pod \"bcc900db-8b6d-4944-bf00-843120d56f92\" (UID: \"bcc900db-8b6d-4944-bf00-843120d56f92\") "
Jul 24 17:52:51.638211 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:51.638191    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcc900db-8b6d-4944-bf00-843120d56f92-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bcc900db-8b6d-4944-bf00-843120d56f92" (UID: "bcc900db-8b6d-4944-bf00-843120d56f92"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:52:51.738732 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:51.738636    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bcc900db-8b6d-4944-bf00-843120d56f92-maas-api-service-ca\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:52:52.430893 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:52.430864    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a11aa7-xkff9"
Jul 24 17:52:52.431069 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:52.430862    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a11aa7-xkff9" event={"ID":"bcc900db-8b6d-4944-bf00-843120d56f92","Type":"ContainerDied","Data":"4f36ce107034847376ae304d8516a47bc1ae77751387c3ea873a0df634577fa7"}
Jul 24 17:52:52.431069 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:52.430990    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4f36ce107034847376ae304d8516a47bc1ae77751387c3ea873a0df634577fa7"
Jul 24 17:52:59.225268 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:59.225225    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a11aa7-29748585-l4fwl"]
Jul 24 17:52:59.227205 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:59.227184    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a11aa7-29748585-l4fwl"]
Jul 24 17:52:59.258985 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:59.258954    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-a11aa7-5b6bf9d4b8-9jqbl"]
Jul 24 17:52:59.259330 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:59.259274    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a11aa7-5b6bf9d4b8-9jqbl" podUID="c4fcc7b9-5c2a-429b-9b7b-9facbde67c2a" containerName="payload-pre-processing" containerID="cri-o://efda88f3a04e2ddb82ea60de15b12d4cc98ccf2089a903f99e0a3eb36832d8d1" gracePeriod=30
Jul 24 17:52:59.468591 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:59.468559    2582 generic.go:356] "Generic (PLEG): container finished" podID="c4fcc7b9-5c2a-429b-9b7b-9facbde67c2a" containerID="efda88f3a04e2ddb82ea60de15b12d4cc98ccf2089a903f99e0a3eb36832d8d1" exitCode=0
Jul 24 17:52:59.468777 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:59.468634    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a11aa7-5b6bf9d4b8-9jqbl" event={"ID":"c4fcc7b9-5c2a-429b-9b7b-9facbde67c2a","Type":"ContainerDied","Data":"efda88f3a04e2ddb82ea60de15b12d4cc98ccf2089a903f99e0a3eb36832d8d1"}
Jul 24 17:52:59.506786 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:59.506762    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a11aa7-5b6bf9d4b8-9jqbl"
Jul 24 17:52:59.597930 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:59.597907    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4fcc7b9-5c2a-429b-9b7b-9facbde67c2a-plugins-config-volume\") pod \"c4fcc7b9-5c2a-429b-9b7b-9facbde67c2a\" (UID: \"c4fcc7b9-5c2a-429b-9b7b-9facbde67c2a\") "
Jul 24 17:52:59.598090 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:59.597942    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6fhc\" (UniqueName: \"kubernetes.io/projected/c4fcc7b9-5c2a-429b-9b7b-9facbde67c2a-kube-api-access-w6fhc\") pod \"c4fcc7b9-5c2a-429b-9b7b-9facbde67c2a\" (UID: \"c4fcc7b9-5c2a-429b-9b7b-9facbde67c2a\") "
Jul 24 17:52:59.598271 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:59.598249    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4fcc7b9-5c2a-429b-9b7b-9facbde67c2a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c4fcc7b9-5c2a-429b-9b7b-9facbde67c2a" (UID: "c4fcc7b9-5c2a-429b-9b7b-9facbde67c2a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:52:59.599968 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:59.599947    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4fcc7b9-5c2a-429b-9b7b-9facbde67c2a-kube-api-access-w6fhc" (OuterVolumeSpecName: "kube-api-access-w6fhc") pod "c4fcc7b9-5c2a-429b-9b7b-9facbde67c2a" (UID: "c4fcc7b9-5c2a-429b-9b7b-9facbde67c2a"). InnerVolumeSpecName "kube-api-access-w6fhc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:52:59.698741 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:59.698708    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4fcc7b9-5c2a-429b-9b7b-9facbde67c2a-plugins-config-volume\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:52:59.698741 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:59.698734    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6fhc\" (UniqueName: \"kubernetes.io/projected/c4fcc7b9-5c2a-429b-9b7b-9facbde67c2a-kube-api-access-w6fhc\") on node \"ip-10-0-134-152.ec2.internal\" DevicePath \"\""
Jul 24 17:52:59.764383 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:52:59.764350    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5793042-ec6b-45b6-b875-63dc4303c274" path="/var/lib/kubelet/pods/a5793042-ec6b-45b6-b875-63dc4303c274/volumes"
Jul 24 17:53:00.476026 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:00.475984    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a11aa7-5b6bf9d4b8-9jqbl"
Jul 24 17:53:00.476504 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:00.475984    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-a11aa7-5b6bf9d4b8-9jqbl" event={"ID":"c4fcc7b9-5c2a-429b-9b7b-9facbde67c2a","Type":"ContainerDied","Data":"8bd1c8c060ecffcb7ddf31525f393003d71a10a49536ec6c1ab07d5ed77474a0"}
Jul 24 17:53:00.476504 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:00.476164    2582 scope.go:117] "RemoveContainer" containerID="efda88f3a04e2ddb82ea60de15b12d4cc98ccf2089a903f99e0a3eb36832d8d1"
Jul 24 17:53:00.493361 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:00.493335    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-a11aa7-5b6bf9d4b8-9jqbl"]
Jul 24 17:53:00.498094 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:00.498071    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-a11aa7-5b6bf9d4b8-9jqbl"]
Jul 24 17:53:01.763310 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:01.763278    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4fcc7b9-5c2a-429b-9b7b-9facbde67c2a" path="/var/lib/kubelet/pods/c4fcc7b9-5c2a-429b-9b7b-9facbde67c2a/volumes"
Jul 24 17:53:02.774752 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:02.774715    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ts924"]
Jul 24 17:53:03.712222 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:03.712180    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a11aa7-xkff9"]
Jul 24 17:53:03.714415 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:03.714389    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a11aa7-xkff9"]
Jul 24 17:53:03.763834 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:03.763806    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcc900db-8b6d-4944-bf00-843120d56f92" path="/var/lib/kubelet/pods/bcc900db-8b6d-4944-bf00-843120d56f92/volumes"
Jul 24 17:53:16.509041 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:16.508997    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-6qd5f_8a4bf84f-4c30-490b-983a-883ae343d837/manager/0.log"
Jul 24 17:53:17.354805 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:17.354776    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bc8c4649b-p9dkg_9ef58556-b59b-4eab-816e-b0dfa48e15fc/copy-manifests/0.log"
Jul 24 17:53:17.372167 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:17.372124    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bc8c4649b-p9dkg_9ef58556-b59b-4eab-816e-b0dfa48e15fc/manager/0.log"
Jul 24 17:53:17.832419 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:17.832389    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29748555-w7562_b86ac69c-9754-4aa9-91c8-56d65b0e3036/cleanup/0.log"
Jul 24 17:53:17.936659 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:17.936634    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29748570-dkn8q_13d4ee84-9d27-4c0e-8c6f-3239cc098b7e/cleanup/0.log"
Jul 24 17:53:18.047155 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:18.047112    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29748585-phbb7_4c824b25-de6c-43b3-8254-9c6e936c9a6d/cleanup/0.log"
Jul 24 17:53:18.910791 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:18.910761    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ccbzq_464d2872-3e18-44d1-8a8f-62b396be809d/util/0.log"
Jul 24 17:53:18.917144 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:18.917119    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ccbzq_464d2872-3e18-44d1-8a8f-62b396be809d/pull/0.log"
Jul 24 17:53:18.923741 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:18.923714    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ccbzq_464d2872-3e18-44d1-8a8f-62b396be809d/extract/0.log"
Jul 24 17:53:19.038189 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:19.038158    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cbdp_607befef-a5aa-4e9a-8d93-1ef4f87e196f/util/0.log"
Jul 24 17:53:19.045778 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:19.045756    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cbdp_607befef-a5aa-4e9a-8d93-1ef4f87e196f/pull/0.log"
Jul 24 17:53:19.053438 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:19.053419    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cbdp_607befef-a5aa-4e9a-8d93-1ef4f87e196f/extract/0.log"
Jul 24 17:53:19.173557 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:19.173476    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tr5px_86d6d822-1f60-42af-bf60-8fab9ffb0c84/util/0.log"
Jul 24 17:53:19.181871 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:19.181841    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tr5px_86d6d822-1f60-42af-bf60-8fab9ffb0c84/pull/0.log"
Jul 24 17:53:19.189325 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:19.189301    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tr5px_86d6d822-1f60-42af-bf60-8fab9ffb0c84/extract/0.log"
Jul 24 17:53:19.305349 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:19.305319    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hknb4_e318229b-75be-421d-a406-b6e82ce86b65/pull/0.log"
Jul 24 17:53:19.311461 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:19.311435    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hknb4_e318229b-75be-421d-a406-b6e82ce86b65/extract/0.log"
Jul 24 17:53:19.317243 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:19.317219    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hknb4_e318229b-75be-421d-a406-b6e82ce86b65/util/0.log"
Jul 24 17:53:20.105271 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:20.105239    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-ts924_fcb05ced-0e16-406d-8fba-6a682de945e4/limitador/0.log"
Jul 24 17:53:20.695561 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:20.695526    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-9dhs2_7dab9c37-aefd-499d-af97-188de50db77a/discovery/0.log"
Jul 24 17:53:21.940930 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:21.940896    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-twkgz_45941db4-67a7-4176-b724-2af100aba887/main/0.log"
Jul 24 17:53:22.158939 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:22.158908    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-zcl2x_8e02ba4f-6552-4cc9-a285-a2da3666b719/main/0.log"
Jul 24 17:53:29.901602 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:29.901578    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d6w2m_9f3e23c6-31a7-4e7b-83df-d6eee1335b7a/ovn-acl-logging/0.log"
Jul 24 17:53:29.911593 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:29.911573    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d6w2m_9f3e23c6-31a7-4e7b-83df-d6eee1335b7a/ovn-acl-logging/0.log"
Jul 24 17:53:30.153140 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:30.153056    2582 scope.go:117] "RemoveContainer" containerID="8a629a7798352cd21faa0b2cbe1c42289305d58dce1a6d7a2ddbffae88d94126"
Jul 24 17:53:30.161230 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:30.161211    2582 scope.go:117] "RemoveContainer" containerID="68e3b32cbbd868118dff41dc000b323766f27d0694a9d6482deb13a218dc4adb"
Jul 24 17:53:30.590164 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:30.590135    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mhjb8_3cced35a-4cd2-4520-a5c4-9e0f5e0e891b/global-pull-secret-syncer/0.log"
Jul 24 17:53:30.719567 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:30.719529    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-npqrh_911b3acf-4ae2-46c1-a53d-c59027fa44c5/konnectivity-agent/0.log"
Jul 24 17:53:30.777207 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:30.777169    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-152.ec2.internal_5769d40c696eb94e1a1746849e9cb1ff/haproxy/0.log"
Jul 24 17:53:35.158535 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:35.158505    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ccbzq_464d2872-3e18-44d1-8a8f-62b396be809d/extract/0.log"
Jul 24 17:53:35.189204 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:35.189166    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ccbzq_464d2872-3e18-44d1-8a8f-62b396be809d/util/0.log"
Jul 24 17:53:35.215253 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:35.215206    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ccbzq_464d2872-3e18-44d1-8a8f-62b396be809d/pull/0.log"
Jul 24 17:53:35.245141 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:35.245110    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cbdp_607befef-a5aa-4e9a-8d93-1ef4f87e196f/extract/0.log"
Jul 24 17:53:35.275967 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:35.275937    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cbdp_607befef-a5aa-4e9a-8d93-1ef4f87e196f/util/0.log"
Jul 24 17:53:35.301045 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:35.301004    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07cbdp_607befef-a5aa-4e9a-8d93-1ef4f87e196f/pull/0.log"
Jul 24 17:53:35.331254 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:35.331230    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tr5px_86d6d822-1f60-42af-bf60-8fab9ffb0c84/extract/0.log"
Jul 24 17:53:35.357431 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:35.357400    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tr5px_86d6d822-1f60-42af-bf60-8fab9ffb0c84/util/0.log"
Jul 24 17:53:35.383083 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:35.383055    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tr5px_86d6d822-1f60-42af-bf60-8fab9ffb0c84/pull/0.log"
Jul 24 17:53:35.440578 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:35.440502    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hknb4_e318229b-75be-421d-a406-b6e82ce86b65/extract/0.log"
Jul 24 17:53:35.465431 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:35.465405    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hknb4_e318229b-75be-421d-a406-b6e82ce86b65/util/0.log"
Jul 24 17:53:35.490071 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:35.490044    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hknb4_e318229b-75be-421d-a406-b6e82ce86b65/pull/0.log"
Jul 24 17:53:36.154925 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:36.154897    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-ts924_fcb05ced-0e16-406d-8fba-6a682de945e4/limitador/0.log"
Jul 24 17:53:38.040223 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:38.040188    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_405b43e0-f3d1-4c4c-8c71-82a129548098/alertmanager/0.log"
Jul 24 17:53:38.066184 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:38.066139    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_405b43e0-f3d1-4c4c-8c71-82a129548098/config-reloader/0.log"
Jul 24 17:53:38.089748 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:38.089662    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_405b43e0-f3d1-4c4c-8c71-82a129548098/kube-rbac-proxy-web/0.log"
Jul 24 17:53:38.118359 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:38.118328    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_405b43e0-f3d1-4c4c-8c71-82a129548098/kube-rbac-proxy/0.log"
Jul 24 17:53:38.157362 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:38.157336    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_405b43e0-f3d1-4c4c-8c71-82a129548098/kube-rbac-proxy-metric/0.log"
Jul 24 17:53:38.190009 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:38.189986    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_405b43e0-f3d1-4c4c-8c71-82a129548098/prom-label-proxy/0.log"
Jul 24 17:53:38.246877 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:38.246843    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_405b43e0-f3d1-4c4c-8c71-82a129548098/init-config-reloader/0.log"
Jul 24 17:53:38.386895 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:38.386810    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-47l2w_d2b401ae-454d-481a-b747-18ed02fa1562/kube-state-metrics/0.log"
Jul 24 17:53:38.444019 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:38.443989    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-47l2w_d2b401ae-454d-481a-b747-18ed02fa1562/kube-rbac-proxy-main/0.log"
Jul 24 17:53:38.499613 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:38.499576    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-47l2w_d2b401ae-454d-481a-b747-18ed02fa1562/kube-rbac-proxy-self/0.log"
Jul 24 17:53:38.598707 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:38.598677    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9l4xs_99b728f8-210e-4921-be29-da27e7c93b83/node-exporter/0.log"
Jul 24 17:53:38.633259 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:38.633230    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9l4xs_99b728f8-210e-4921-be29-da27e7c93b83/kube-rbac-proxy/0.log"
Jul 24 17:53:38.653821 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:38.653751    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9l4xs_99b728f8-210e-4921-be29-da27e7c93b83/init-textfile/0.log"
Jul 24 17:53:39.184350 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:39.184324    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-98r8l_3f8ac37c-9864-4b69-9612-ffba83957c08/prometheus-operator/0.log"
Jul 24 17:53:39.208868 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:39.208837    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-98r8l_3f8ac37c-9864-4b69-9612-ffba83957c08/kube-rbac-proxy/0.log"
Jul 24 17:53:40.105813 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:40.105754    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jgdcp/perf-node-gather-daemonset-zb42m"]
Jul 24 17:53:40.106237 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:40.106212    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcc900db-8b6d-4944-bf00-843120d56f92" containerName="revoke-keys"
Jul 24 17:53:40.106237 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:40.106238    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcc900db-8b6d-4944-bf00-843120d56f92" containerName="revoke-keys"
Jul 24 17:53:40.106452 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:40.106269    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4fcc7b9-5c2a-429b-9b7b-9facbde67c2a" containerName="payload-pre-processing"
Jul 24 17:53:40.106452 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:40.106277    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4fcc7b9-5c2a-429b-9b7b-9facbde67c2a" containerName="payload-pre-processing"
Jul 24 17:53:40.106452 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:40.106367    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4fcc7b9-5c2a-429b-9b7b-9facbde67c2a" containerName="payload-pre-processing"
Jul 24 17:53:40.106452 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:40.106377    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcc900db-8b6d-4944-bf00-843120d56f92" containerName="revoke-keys"
Jul 24 17:53:40.109071 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:40.109057    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-zb42m"
Jul 24 17:53:40.111211 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:40.111184    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jgdcp\"/\"kube-root-ca.crt\""
Jul 24 17:53:40.111320 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:40.111216    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jgdcp\"/\"openshift-service-ca.crt\""
Jul 24 17:53:40.111320 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:40.111230    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jgdcp\"/\"default-dockercfg-6zhq5\""
Jul 24 17:53:40.118519 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:40.118490    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jgdcp/perf-node-gather-daemonset-zb42m"]
Jul 24 17:53:40.237986 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:40.237959    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dc3eb454-dcad-4ae0-a326-5adb4f21d99d-lib-modules\") pod \"perf-node-gather-daemonset-zb42m\" (UID: \"dc3eb454-dcad-4ae0-a326-5adb4f21d99d\") " pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-zb42m"
Jul 24 17:53:40.238389 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:40.237997    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dc3eb454-dcad-4ae0-a326-5adb4f21d99d-proc\") pod \"perf-node-gather-daemonset-zb42m\" (UID: \"dc3eb454-dcad-4ae0-a326-5adb4f21d99d\") " pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-zb42m"
Jul 24 17:53:40.238389 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:40.238037    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dc3eb454-dcad-4ae0-a326-5adb4f21d99d-podres\") pod \"perf-node-gather-daemonset-zb42m\" (UID: \"dc3eb454-dcad-4ae0-a326-5adb4f21d99d\") " pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-zb42m"
Jul 24 17:53:40.238389 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:40.238106    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc3eb454-dcad-4ae0-a326-5adb4f21d99d-sys\") pod \"perf-node-gather-daemonset-zb42m\" (UID: \"dc3eb454-dcad-4ae0-a326-5adb4f21d99d\") " pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-zb42m"
Jul 24 17:53:40.238389 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:40.238155    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jb74\" (UniqueName: \"kubernetes.io/projected/dc3eb454-dcad-4ae0-a326-5adb4f21d99d-kube-api-access-6jb74\") pod \"perf-node-gather-daemonset-zb42m\" (UID: \"dc3eb454-dcad-4ae0-a326-5adb4f21d99d\") " pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-zb42m"
Jul 24 17:53:40.338956 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:40.338908    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dc3eb454-dcad-4ae0-a326-5adb4f21d99d-podres\") pod \"perf-node-gather-daemonset-zb42m\" (UID: \"dc3eb454-dcad-4ae0-a326-5adb4f21d99d\") " pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-zb42m"
Jul 24 17:53:40.339133 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:40.338993    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc3eb454-dcad-4ae0-a326-5adb4f21d99d-sys\") pod \"perf-node-gather-daemonset-zb42m\" (UID: \"dc3eb454-dcad-4ae0-a326-5adb4f21d99d\") " pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-zb42m"
Jul 24 17:53:40.339133 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:40.339042    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jb74\" (UniqueName: \"kubernetes.io/projected/dc3eb454-dcad-4ae0-a326-5adb4f21d99d-kube-api-access-6jb74\") pod \"perf-node-gather-daemonset-zb42m\" (UID: \"dc3eb454-dcad-4ae0-a326-5adb4f21d99d\") " pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-zb42m"
Jul 24 17:53:40.339133 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:40.339072    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dc3eb454-dcad-4ae0-a326-5adb4f21d99d-lib-modules\") pod \"perf-node-gather-daemonset-zb42m\" (UID: \"dc3eb454-dcad-4ae0-a326-5adb4f21d99d\") " pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-zb42m"
Jul 24 17:53:40.339133 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:40.339096    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dc3eb454-dcad-4ae0-a326-5adb4f21d99d-podres\") pod \"perf-node-gather-daemonset-zb42m\" (UID: \"dc3eb454-dcad-4ae0-a326-5adb4f21d99d\") " pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-zb42m"
Jul 24 17:53:40.339133 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:40.339111    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc3eb454-dcad-4ae0-a326-5adb4f21d99d-sys\") pod \"perf-node-gather-daemonset-zb42m\" (UID: \"dc3eb454-dcad-4ae0-a326-5adb4f21d99d\") " pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-zb42m"
Jul 24 17:53:40.339133 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:40.339103    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dc3eb454-dcad-4ae0-a326-5adb4f21d99d-proc\") pod \"perf-node-gather-daemonset-zb42m\" (UID: \"dc3eb454-dcad-4ae0-a326-5adb4f21d99d\") " pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-zb42m"
Jul 24 17:53:40.339352 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:40.339147    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dc3eb454-dcad-4ae0-a326-5adb4f21d99d-proc\") pod \"perf-node-gather-daemonset-zb42m\" (UID: \"dc3eb454-dcad-4ae0-a326-5adb4f21d99d\") " pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-zb42m"
Jul 24 17:53:40.339352 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:40.339210    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dc3eb454-dcad-4ae0-a326-5adb4f21d99d-lib-modules\") pod \"perf-node-gather-daemonset-zb42m\" (UID: \"dc3eb454-dcad-4ae0-a326-5adb4f21d99d\") " pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-zb42m"
Jul 24 17:53:40.347725 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:40.347704    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jb74\" (UniqueName: \"kubernetes.io/projected/dc3eb454-dcad-4ae0-a326-5adb4f21d99d-kube-api-access-6jb74\") pod \"perf-node-gather-daemonset-zb42m\" (UID: \"dc3eb454-dcad-4ae0-a326-5adb4f21d99d\") " pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-zb42m"
Jul 24 17:53:40.419422 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:40.419326    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-zb42m"
Jul 24 17:53:40.549365 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:40.549334    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jgdcp/perf-node-gather-daemonset-zb42m"]
Jul 24 17:53:40.553047 ip-10-0-134-152 kubenswrapper[2582]: W0724 17:53:40.553010    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddc3eb454_dcad_4ae0_a326_5adb4f21d99d.slice/crio-0ea8ab37df93d369904766a7345b2a4b6bdfa16a2881be9c77657e057b76d6f3 WatchSource:0}: Error finding container 0ea8ab37df93d369904766a7345b2a4b6bdfa16a2881be9c77657e057b76d6f3: Status 404 returned error can't find the container with id 0ea8ab37df93d369904766a7345b2a4b6bdfa16a2881be9c77657e057b76d6f3
Jul 24 17:53:40.684098 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:40.684021    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-zb42m" event={"ID":"dc3eb454-dcad-4ae0-a326-5adb4f21d99d","Type":"ContainerStarted","Data":"26b94f741760562a52e47685e759a98e37ab350ff67c597c603b02efe0c716dd"}
Jul 24 17:53:40.684098 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:40.684069    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-zb42m" event={"ID":"dc3eb454-dcad-4ae0-a326-5adb4f21d99d","Type":"ContainerStarted","Data":"0ea8ab37df93d369904766a7345b2a4b6bdfa16a2881be9c77657e057b76d6f3"}
Jul 24 17:53:40.684303 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:40.684155    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-zb42m"
Jul 24 17:53:40.698739 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:40.698637    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-zb42m" podStartSLOduration=0.698619716 podStartE2EDuration="698.619716ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:53:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:53:40.697826595 +0000 UTC m=+3011.513801222" watchObservedRunningTime="2026-07-24 17:53:40.698619716 +0000 UTC m=+3011.514594332"
Jul 24 17:53:43.221722 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:43.221694    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gzmft_ecca6ab2-75a3-44b2-86b4-cf1b12317f43/dns/0.log"
Jul 24 17:53:43.243604 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:43.243579    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gzmft_ecca6ab2-75a3-44b2-86b4-cf1b12317f43/kube-rbac-proxy/0.log"
Jul 24 17:53:43.371971 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:43.371943    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6jbmb_70860e4d-6426-4b8d-9034-20447104e662/dns-node-resolver/0.log"
Jul 24 17:53:43.958445 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:43.958416    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-68756f9b9c-qlbf5_84117059-507c-48da-80e6-f6822543ca19/registry/0.log"
Jul 24 17:53:43.985884 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:43.985855    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5sgm4_08370467-8020-420e-a2e1-16dd3fb5ec66/node-ca/0.log"
Jul 24 17:53:45.224354 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:45.224320    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-9dhs2_7dab9c37-aefd-499d-af97-188de50db77a/discovery/0.log"
Jul 24 17:53:46.305948 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:46.305916    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4s9ql_de4d9895-940a-4610-bd34-e1cd1dd3d7e1/serve-healthcheck-canary/0.log"
Jul 24 17:53:46.699361 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:46.699295    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jgdcp/perf-node-gather-daemonset-zb42m"
Jul 24 17:53:46.893140 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:46.893112    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jmnfs_d4ab348a-370a-47c2-91f9-ae50a3a2f332/kube-rbac-proxy/0.log"
Jul 24 17:53:46.913093 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:46.913061    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jmnfs_d4ab348a-370a-47c2-91f9-ae50a3a2f332/exporter/0.log"
Jul 24 17:53:46.934430 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:46.934391    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jmnfs_d4ab348a-370a-47c2-91f9-ae50a3a2f332/extractor/0.log"
Jul 24 17:53:49.293756 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:49.293729    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-6qd5f_8a4bf84f-4c30-490b-983a-883ae343d837/manager/0.log"
Jul 24 17:53:50.041773 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:50.041737    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bc8c4649b-p9dkg_9ef58556-b59b-4eab-816e-b0dfa48e15fc/manager/0.log"
Jul 24 17:53:50.101214 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:50.101190    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bc8c4649b-p9dkg_9ef58556-b59b-4eab-816e-b0dfa48e15fc/copy-manifests/0.log"
Jul 24 17:53:51.062175 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:51.062144    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-9dhs2_7dab9c37-aefd-499d-af97-188de50db77a/discovery/0.log"
Jul 24 17:53:51.302977 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:51.302945    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-65bbc66f6-4vvzh_8f9d7e4e-f561-43a3-a2ba-f540307bd68e/manager/0.log"
Jul 24 17:53:52.991900 ip-10-0-134-152 kubenswrapper[2582]: I0724 17:53:52.991868    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-9dhs2_7dab9c37-aefd-499d-af97-188de50db77a/discovery/0.log"