Jul 29 04:01:49.273687 ip-10-0-130-4 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 29 04:01:49.273703 ip-10-0-130-4 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 29 04:01:49.273712 ip-10-0-130-4 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 29 04:01:49.274038 ip-10-0-130-4 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 29 04:01:59.001331 ip-10-0-130-4 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found.
Jul 29 04:01:59.001345 ip-10-0-130-4 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 5baf156aa86046ec9364207c26bf7368 --
Jul 29 04:03:51.952714 ip-10-0-130-4 systemd[1]: Starting Kubernetes Kubelet...
Jul 29 04:03:52.423712 ip-10-0-130-4 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 04:03:52.423712 ip-10-0-130-4 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 29 04:03:52.423712 ip-10-0-130-4 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 04:03:52.423712 ip-10-0-130-4 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 29 04:03:52.423712 ip-10-0-130-4 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 04:03:52.426839 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.426717    2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 29 04:03:52.431580 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431563    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 04:03:52.431580 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431581    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 04:03:52.431674 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431585    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 04:03:52.431674 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431588    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 04:03:52.431674 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431592    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 04:03:52.431674 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431594    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 04:03:52.431674 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431597    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 04:03:52.431674 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431600    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 04:03:52.431674 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431603    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 04:03:52.431674 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431606    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 04:03:52.431674 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431609    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 04:03:52.431674 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431612    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 04:03:52.431674 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431614    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 04:03:52.431674 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431617    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 04:03:52.431674 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431620    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 04:03:52.431674 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431622    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 04:03:52.431674 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431625    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 04:03:52.431674 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431627    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 04:03:52.431674 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431636    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 04:03:52.431674 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431639    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 04:03:52.431674 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431642    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 04:03:52.431674 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431644    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 04:03:52.432183 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431648    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 04:03:52.432183 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431650    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 04:03:52.432183 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431653    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 04:03:52.432183 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431655    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 04:03:52.432183 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431658    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 04:03:52.432183 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431661    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 04:03:52.432183 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431664    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 04:03:52.432183 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431667    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 04:03:52.432183 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431670    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 04:03:52.432183 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431672    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 04:03:52.432183 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431675    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 04:03:52.432183 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431678    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 04:03:52.432183 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431681    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 04:03:52.432183 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431684    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 04:03:52.432183 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431686    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 04:03:52.432183 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431689    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 04:03:52.432183 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431692    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 04:03:52.432183 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431694    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 04:03:52.432183 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431697    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 04:03:52.432183 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431699    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 04:03:52.432681 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431702    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 04:03:52.432681 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431704    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 04:03:52.432681 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431707    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 04:03:52.432681 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431709    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 04:03:52.432681 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431712    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 04:03:52.432681 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431714    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 04:03:52.432681 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431717    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 04:03:52.432681 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431719    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 04:03:52.432681 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431722    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 04:03:52.432681 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431724    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 04:03:52.432681 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431727    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 04:03:52.432681 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431729    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 04:03:52.432681 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431733    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 04:03:52.432681 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431735    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 04:03:52.432681 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431738    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 04:03:52.432681 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431741    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 04:03:52.432681 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431743    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 04:03:52.432681 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431746    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 04:03:52.432681 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431749    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 04:03:52.432681 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431751    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 04:03:52.433167 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431754    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 04:03:52.433167 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431756    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 04:03:52.433167 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431758    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 04:03:52.433167 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431761    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 04:03:52.433167 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431763    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 04:03:52.433167 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431766    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 04:03:52.433167 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431768    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 04:03:52.433167 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431773    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 04:03:52.433167 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431777    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 04:03:52.433167 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431780    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 04:03:52.433167 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431783    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 04:03:52.433167 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431785    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 04:03:52.433167 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431789    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 04:03:52.433167 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431793    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 04:03:52.433167 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431796    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 04:03:52.433167 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431798    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 04:03:52.433167 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431801    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 04:03:52.433167 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431803    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 04:03:52.433167 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431806    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 04:03:52.433647 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431810    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 04:03:52.433647 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431813    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 04:03:52.433647 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431816    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 04:03:52.433647 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431818    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 04:03:52.433647 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431821    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 04:03:52.433647 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431824    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 04:03:52.433647 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431827    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 04:03:52.433647 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431829    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 04:03:52.433647 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431832    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 04:03:52.433647 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431834    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 04:03:52.433647 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431837    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 04:03:52.433647 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431839    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 04:03:52.433647 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431842    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 04:03:52.433647 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431844    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 04:03:52.433647 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431847    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 04:03:52.433647 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431849    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 04:03:52.433647 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431851    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 04:03:52.433647 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.431854    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 04:03:52.433647 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432575    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 04:03:52.434099 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432583    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 04:03:52.434099 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432585    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 04:03:52.434099 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432589    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 04:03:52.434099 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432592    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 04:03:52.434099 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432595    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 04:03:52.434099 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432598    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 04:03:52.434099 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432600    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 04:03:52.434099 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432603    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 04:03:52.434099 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432606    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 04:03:52.434099 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432609    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 04:03:52.434099 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432611    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 04:03:52.434099 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432614    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 04:03:52.434099 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432616    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 04:03:52.434099 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432619    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 04:03:52.434099 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432622    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 04:03:52.434099 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432624    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 04:03:52.434099 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432627    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 04:03:52.434099 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432629    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 04:03:52.434099 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432632    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 04:03:52.434099 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432635    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 04:03:52.434647 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432638    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 04:03:52.434647 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432640    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 04:03:52.434647 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432643    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 04:03:52.434647 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432646    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 04:03:52.434647 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432649    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 04:03:52.434647 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432653    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 04:03:52.434647 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432657    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 04:03:52.434647 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432661    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 04:03:52.434647 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432664    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 04:03:52.434647 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432666    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 04:03:52.434647 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432669    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 04:03:52.434647 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432672    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 04:03:52.434647 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432675    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 04:03:52.434647 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432677    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 04:03:52.434647 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432680    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 04:03:52.434647 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432682    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 04:03:52.434647 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432686    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 04:03:52.434647 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432689    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 04:03:52.434647 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432692    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 04:03:52.435105 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432694    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 04:03:52.435105 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432698    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 04:03:52.435105 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432700    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 04:03:52.435105 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432703    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 04:03:52.435105 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432705    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 04:03:52.435105 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432708    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 04:03:52.435105 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432711    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 04:03:52.435105 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432714    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 04:03:52.435105 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432717    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 04:03:52.435105 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432721    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 04:03:52.435105 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432724    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 04:03:52.435105 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432727    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 04:03:52.435105 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432730    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 04:03:52.435105 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432733    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 04:03:52.435105 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432735    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 04:03:52.435105 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432738    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 04:03:52.435105 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432740    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 04:03:52.435105 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432743    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 04:03:52.435105 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432746    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 04:03:52.435105 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432748    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 04:03:52.435602 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432753    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 04:03:52.435602 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432756    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 04:03:52.435602 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432758    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 04:03:52.435602 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432761    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 04:03:52.435602 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432765    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 04:03:52.435602 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432768    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 04:03:52.435602 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432771    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 04:03:52.435602 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432773    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 04:03:52.435602 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432776    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 04:03:52.435602 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432779    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 04:03:52.435602 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432781    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 04:03:52.435602 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432784    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 04:03:52.435602 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432787    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 04:03:52.435602 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432789    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 04:03:52.435602 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432792    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 04:03:52.435602 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432795    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 04:03:52.435602 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432798    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 04:03:52.435602 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432800    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 04:03:52.435602 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432803    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 04:03:52.435602 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432805    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 04:03:52.436082 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432808    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 04:03:52.436082 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432811    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 04:03:52.436082 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432813    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 04:03:52.436082 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432816    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 04:03:52.436082 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432818    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 04:03:52.436082 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432821    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 04:03:52.436082 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432823    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 04:03:52.436082 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432826    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 04:03:52.436082 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432828    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 04:03:52.436082 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432831    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 04:03:52.436082 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432833    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 04:03:52.436082 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432835    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 04:03:52.436082 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432838    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 04:03:52.436082 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432841    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 04:03:52.436082 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432843    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 04:03:52.436082 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432845    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 04:03:52.436082 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432848    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 04:03:52.436082 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432851    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 04:03:52.436082 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.432853    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 04:03:52.436082 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433230    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 04:03:52.436589 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433235    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 04:03:52.436589 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433238    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 04:03:52.436589 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433240    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 04:03:52.436589 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433246    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 04:03:52.436589 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433249    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 04:03:52.436589 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433252    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 04:03:52.436589 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433254    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 04:03:52.436589 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433257    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 04:03:52.436589 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433260    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 04:03:52.436589 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433262    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 04:03:52.436589 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433266    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 04:03:52.436589 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433268    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 04:03:52.436589 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433271    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 04:03:52.436589 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433274    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 04:03:52.436589 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433276    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 04:03:52.436589 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433279    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 04:03:52.436589 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433281    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 04:03:52.436589 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433284    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 04:03:52.436589 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433286    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 04:03:52.436589 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433291    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 04:03:52.437071 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433294    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 04:03:52.437071 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433297    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 04:03:52.437071 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433300    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 04:03:52.437071 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433303    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 04:03:52.437071 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433305    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 04:03:52.437071 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433308    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 04:03:52.437071 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433311    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 04:03:52.437071 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433314    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 04:03:52.437071 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433316    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 04:03:52.437071 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433319    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 04:03:52.437071 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433321    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 04:03:52.437071 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433324    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 04:03:52.437071 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433326    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 04:03:52.437071 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433329    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 04:03:52.437071 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433331    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 04:03:52.437071 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433334    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 04:03:52.437071 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433337    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 04:03:52.437071 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433339    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 04:03:52.437071 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433342    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 04:03:52.437071 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433344    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 04:03:52.437575 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433347    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 04:03:52.437575 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433349    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 04:03:52.437575 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433352    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 04:03:52.437575 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433354    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 04:03:52.437575 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433357    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 04:03:52.437575 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433360    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 04:03:52.437575 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433362    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 04:03:52.437575 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433365    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 04:03:52.437575 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433367    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 04:03:52.437575 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433370    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 04:03:52.437575 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433372    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 04:03:52.437575 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433375    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 04:03:52.437575 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433377    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 04:03:52.437575 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433380    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 04:03:52.437575 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433382    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 04:03:52.437575 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433385    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 04:03:52.437575 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433387    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 04:03:52.437575 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433390    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 04:03:52.437575 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433392    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 04:03:52.437575 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433395    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 04:03:52.438140 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433397    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 04:03:52.438140 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433400    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 04:03:52.438140 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433402    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 04:03:52.438140 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433422    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 04:03:52.438140 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433427    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 04:03:52.438140 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433430    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 04:03:52.438140 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433433    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 04:03:52.438140 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433435    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 04:03:52.438140 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433439    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 04:03:52.438140 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433442    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 04:03:52.438140 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433444    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 04:03:52.438140 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433447    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 04:03:52.438140 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433449    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 04:03:52.438140 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433452    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 04:03:52.438140 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433457    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 04:03:52.438140 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433461    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 04:03:52.438140 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433464    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 04:03:52.438140 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433466    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 04:03:52.438140 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433469    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 04:03:52.438140 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433472    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 04:03:52.438666 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433474    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 04:03:52.438666 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433477    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 04:03:52.438666 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433481    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 04:03:52.438666 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433484    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 04:03:52.438666 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433487    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 04:03:52.438666 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433489    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 04:03:52.438666 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433492    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 04:03:52.438666 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433494    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 04:03:52.438666 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433497    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 04:03:52.438666 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433500    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 04:03:52.438666 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433502    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 04:03:52.438666 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433505    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 04:03:52.438666 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433507    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 04:03:52.438666 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433509    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 04:03:52.438666 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433512    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 04:03:52.438666 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433514    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 04:03:52.438666 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433518    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 04:03:52.438666 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.433521    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 04:03:52.438666 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433598    2572 flags.go:64] FLAG: --address="0.0.0.0"
Jul 29 04:03:52.438666 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433609    2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 29 04:03:52.439144 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433617    2572 flags.go:64] FLAG: --anonymous-auth="true"
Jul 29 04:03:52.439144 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433624    2572 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 29 04:03:52.439144 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433631    2572 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 29 04:03:52.439144 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433636    2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 29 04:03:52.439144 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433642    2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 29 04:03:52.439144 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433649    2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 29 04:03:52.439144 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433655    2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 29 04:03:52.439144 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433658    2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 29 04:03:52.439144 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433662    2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 29 04:03:52.439144 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433665    2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 29 04:03:52.439144 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433668    2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 29 04:03:52.439144 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433671    2572 flags.go:64] FLAG: --cgroup-root=""
Jul 29 04:03:52.439144 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433674    2572 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 29 04:03:52.439144 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433677    2572 flags.go:64] FLAG: --client-ca-file=""
Jul 29 04:03:52.439144 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433679    2572 flags.go:64] FLAG: --cloud-provider="external"
Jul 29 04:03:52.439144 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433682    2572 flags.go:64] FLAG: --cluster-dns="[]"
Jul 29 04:03:52.439144 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433687    2572 flags.go:64] FLAG: --cluster-domain=""
Jul 29 04:03:52.439144 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433690    2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 29 04:03:52.439144 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433693    2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 29 04:03:52.439144 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433696    2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 29 04:03:52.439144 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433700    2572 flags.go:64] FLAG: --container-log-max-files="5"
Jul 29 04:03:52.439144 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433703    2572 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 29 04:03:52.439144 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433706    2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 29 04:03:52.439698 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433709    2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 29 04:03:52.439698 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433712    2572 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 29 04:03:52.439698 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433715    2572 flags.go:64] FLAG: --contention-profiling="false"
Jul 29 04:03:52.439698 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433718    2572 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 29 04:03:52.439698 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433721    2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 29 04:03:52.439698 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433727    2572 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 29 04:03:52.439698 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433730    2572 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 29 04:03:52.439698 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433734    2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 29 04:03:52.439698 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433736    2572 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 29 04:03:52.439698 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433739    2572 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 29 04:03:52.439698 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433742    2572 flags.go:64] FLAG: --enable-load-reader="false"
Jul 29 04:03:52.439698 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433745    2572 flags.go:64] FLAG: --enable-server="true"
Jul 29 04:03:52.439698 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433749    2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 29 04:03:52.439698 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433753    2572 flags.go:64] FLAG: --event-burst="100"
Jul 29 04:03:52.439698 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433756    2572 flags.go:64] FLAG: --event-qps="50"
Jul 29 04:03:52.439698 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433760    2572 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 29 04:03:52.439698 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433763    2572 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 29 04:03:52.439698 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433766    2572 flags.go:64] FLAG: --eviction-hard=""
Jul 29 04:03:52.439698 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433769    2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 29 04:03:52.439698 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433772    2572 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 29 04:03:52.439698 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433775    2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 29 04:03:52.439698 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433778    2572 flags.go:64] FLAG: --eviction-soft=""
Jul 29 04:03:52.439698 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433781    2572 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 29 04:03:52.439698 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433784    2572 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 29 04:03:52.439698 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433786    2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 29 04:03:52.440348 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433789    2572 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 29 04:03:52.440348 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433792    2572 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 29 04:03:52.440348 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433795    2572 flags.go:64] FLAG: --fail-swap-on="true"
Jul 29 04:03:52.440348 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433798    2572 flags.go:64] FLAG: --feature-gates=""
Jul 29 04:03:52.440348 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433802    2572 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 29 04:03:52.440348 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433804    2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 29 04:03:52.440348 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433807    2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 29 04:03:52.440348 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433810    2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 29 04:03:52.440348 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433813    2572 flags.go:64] FLAG: --healthz-port="10248"
Jul 29 04:03:52.440348 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433816    2572 flags.go:64] FLAG: --help="false"
Jul 29 04:03:52.440348 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433819    2572 flags.go:64] FLAG: --hostname-override="ip-10-0-130-4.ec2.internal"
Jul 29 04:03:52.440348 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433822    2572 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 29 04:03:52.440348 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433826    2572 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 29 04:03:52.440348 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433829    2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 29 04:03:52.440348 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433832    2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 29 04:03:52.440348 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433835    2572 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 29 04:03:52.440348 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433838    2572 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 29 04:03:52.440348 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433841    2572 flags.go:64] FLAG: --image-service-endpoint=""
Jul 29 04:03:52.440348 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433844    2572 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 29 04:03:52.440348 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433847    2572 flags.go:64] FLAG: --kube-api-burst="100"
Jul 29 04:03:52.440348 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433851    2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 29 04:03:52.440348 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433854    2572 flags.go:64] FLAG: --kube-api-qps="50"
Jul 29 04:03:52.440348 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433859    2572 flags.go:64] FLAG: --kube-reserved=""
Jul 29 04:03:52.440348 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433862    2572 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 29 04:03:52.440952 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433865    2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 29 04:03:52.440952 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433868    2572 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 29 04:03:52.440952 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433870    2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 29 04:03:52.440952 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433873    2572 flags.go:64] FLAG: --lock-file=""
Jul 29 04:03:52.440952 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433876    2572 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 29 04:03:52.440952 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433879    2572 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 29 04:03:52.440952 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433882    2572 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 29 04:03:52.440952 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433887    2572 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 29 04:03:52.440952 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433890    2572 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 29 04:03:52.440952 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433893    2572 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 29 04:03:52.440952 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433895    2572 flags.go:64] FLAG: --logging-format="text"
Jul 29 04:03:52.440952 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433898    2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 29 04:03:52.440952 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433901    2572 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 29 04:03:52.440952 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433904    2572 flags.go:64] FLAG: --manifest-url=""
Jul 29 04:03:52.440952 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433907    2572 flags.go:64] FLAG: --manifest-url-header=""
Jul 29 04:03:52.440952 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433911    2572 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 29 04:03:52.440952 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433914    2572 flags.go:64] FLAG: --max-open-files="1000000"
Jul 29 04:03:52.440952 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433918    2572 flags.go:64] FLAG: --max-pods="110"
Jul 29 04:03:52.440952 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433921    2572 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 29 04:03:52.440952 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433924    2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 29 04:03:52.440952 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433928    2572 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 29 04:03:52.440952 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433931    2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 29 04:03:52.440952 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433934    2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 29 04:03:52.440952 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433937    2572 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 29 04:03:52.440952 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433940    2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 29 04:03:52.441579 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433947    2572 flags.go:64] FLAG: --node-status-max-images="50"
Jul 29 04:03:52.441579 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433950    2572 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 29 04:03:52.441579 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433953    2572 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 29 04:03:52.441579 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433956    2572 flags.go:64] FLAG: --pod-cidr=""
Jul 29 04:03:52.441579 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433962    2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 29 04:03:52.441579 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433972    2572 flags.go:64] FLAG: --pod-manifest-path=""
Jul 29 04:03:52.441579 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433976    2572 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 29 04:03:52.441579 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433979    2572 flags.go:64] FLAG: --pods-per-core="0"
Jul 29 04:03:52.441579 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433982    2572 flags.go:64] FLAG: --port="10250"
Jul 29 04:03:52.441579 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433985    2572 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 29 04:03:52.441579 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433988    2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a05d8e89e70cfbc8"
Jul 29 04:03:52.441579 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433991    2572 flags.go:64] FLAG: --qos-reserved=""
Jul 29 04:03:52.441579 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433994    2572 flags.go:64] FLAG: --read-only-port="10255"
Jul 29 04:03:52.441579 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.433996    2572 flags.go:64] FLAG: --register-node="true"
Jul 29 04:03:52.441579 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.434000    2572 flags.go:64] FLAG: --register-with-taints=""
Jul 29 04:03:52.441579 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.434007    2572 flags.go:64] FLAG: --registry-burst="10"
Jul 29 04:03:52.441579 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.434010    2572 flags.go:64] FLAG: --registry-qps="5"
Jul 29 04:03:52.441579 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.434012    2572 flags.go:64] FLAG: --reserved-cpus=""
Jul 29 04:03:52.441579 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.434015    2572 flags.go:64] FLAG: --reserved-memory=""
Jul 29 04:03:52.441579 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.434019    2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 29 04:03:52.441579 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.434022    2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 29 04:03:52.441579 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.434025    2572 flags.go:64] FLAG: --rotate-certificates="false"
Jul 29 04:03:52.441579 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.434027    2572 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 29 04:03:52.441579 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.434030    2572 flags.go:64] FLAG: --runonce="false"
Jul 29 04:03:52.441579 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.434033    2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 29 04:03:52.442171 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.434036    2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 29 04:03:52.442171 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.434039    2572 flags.go:64] FLAG: --seccomp-default="false"
Jul 29 04:03:52.442171 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.434043    2572 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 29 04:03:52.442171 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.434046    2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 29 04:03:52.442171 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.434049    2572 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 29 04:03:52.442171 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.434052    2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 29 04:03:52.442171 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.434055    2572 flags.go:64] FLAG: --storage-driver-password="root"
Jul 29 04:03:52.442171 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.434057    2572 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 29 04:03:52.442171 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.434060    2572 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 29 04:03:52.442171 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.434063    2572 flags.go:64] FLAG: --storage-driver-user="root"
Jul 29 04:03:52.442171 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.434066    2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 29 04:03:52.442171 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.434069    2572 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 29 04:03:52.442171 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.434072    2572 flags.go:64] FLAG: --system-cgroups=""
Jul 29 04:03:52.442171 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.434076    2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 29 04:03:52.442171 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.434081    2572 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 29 04:03:52.442171 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.434084    2572 flags.go:64] FLAG: --tls-cert-file=""
Jul 29 04:03:52.442171 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.434086    2572 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 29 04:03:52.442171 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.434091    2572 flags.go:64] FLAG: --tls-min-version=""
Jul 29 04:03:52.442171 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.434094    2572 flags.go:64] FLAG: --tls-private-key-file=""
Jul 29 04:03:52.442171 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.434096    2572 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 29 04:03:52.442171 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.434099    2572 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 29 04:03:52.442171 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.434102    2572 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 29 04:03:52.442171 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.434105    2572 flags.go:64] FLAG: --v="2"
Jul 29 04:03:52.442171 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.434110    2572 flags.go:64] FLAG: --version="false"
Jul 29 04:03:52.442171 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.434114    2572 flags.go:64] FLAG: --vmodule=""
Jul 29 04:03:52.442841 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.434117    2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 29 04:03:52.442841 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.434120    2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 29 04:03:52.442841 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434237    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 04:03:52.442841 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434241    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 04:03:52.442841 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434244    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 04:03:52.442841 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434247    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 04:03:52.442841 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434250    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 04:03:52.442841 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434252    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 04:03:52.442841 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434255    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 04:03:52.442841 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434258    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 04:03:52.442841 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434261    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 04:03:52.442841 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434265    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 04:03:52.442841 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434269    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 04:03:52.442841 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434272    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 04:03:52.442841 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434274    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 04:03:52.442841 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434277    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 04:03:52.442841 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434280    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 04:03:52.442841 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434282    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 04:03:52.442841 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434285    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 04:03:52.443307 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434287    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 04:03:52.443307 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434296    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 04:03:52.443307 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434299    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 04:03:52.443307 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434302    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 04:03:52.443307 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434304    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 04:03:52.443307 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434307    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 04:03:52.443307 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434309    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 04:03:52.443307 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434312    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 04:03:52.443307 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434314    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 04:03:52.443307 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434317    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 04:03:52.443307 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434319    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 04:03:52.443307 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434322    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 04:03:52.443307 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434324    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 04:03:52.443307 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434327    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 04:03:52.443307 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434330    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 04:03:52.443307 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434334    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 04:03:52.443307 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434337    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 04:03:52.443307 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434339    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 04:03:52.443307 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434342    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 04:03:52.443825 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434344    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 04:03:52.443825 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434347    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 04:03:52.443825 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434349    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 04:03:52.443825 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434353    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 04:03:52.443825 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434355    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 04:03:52.443825 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434358    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 04:03:52.443825 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434360    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 04:03:52.443825 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434363    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 04:03:52.443825 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434365    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 04:03:52.443825 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434368    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 04:03:52.443825 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434370    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 04:03:52.443825 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434373    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 04:03:52.443825 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434375    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 04:03:52.443825 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434377    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 04:03:52.443825 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434380    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 04:03:52.443825 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434390    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 04:03:52.443825 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434393    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 04:03:52.443825 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434395    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 04:03:52.443825 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434398    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 04:03:52.443825 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434401    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 04:03:52.444302 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434418    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 04:03:52.444302 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434422    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 04:03:52.444302 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434426    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 04:03:52.444302 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434429    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 04:03:52.444302 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434432    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 04:03:52.444302 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434435    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 04:03:52.444302 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434437    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 04:03:52.444302 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434440    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 04:03:52.444302 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434443    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 04:03:52.444302 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434446    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 04:03:52.444302 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434449    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 04:03:52.444302 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434451    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 04:03:52.444302 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434453    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 04:03:52.444302 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434456    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 04:03:52.444302 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434458    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 04:03:52.444302 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434462    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 04:03:52.444302 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434465    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 04:03:52.444302 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434468    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 04:03:52.444302 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434470    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 04:03:52.444302 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434473    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 04:03:52.444792 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434476    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 04:03:52.444792 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434478    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 04:03:52.444792 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434481    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 04:03:52.444792 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434483    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 04:03:52.444792 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434485    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 04:03:52.444792 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434488    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 04:03:52.444792 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434499    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 04:03:52.444792 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434502    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 04:03:52.444792 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434508    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 04:03:52.444792 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434511    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 04:03:52.444792 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434514    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 04:03:52.444792 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434516    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 04:03:52.444792 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434519    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 04:03:52.444792 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434521    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 04:03:52.444792 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434524    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 04:03:52.444792 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434526    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 04:03:52.444792 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434529    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 04:03:52.444792 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434531    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 04:03:52.444792 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434534    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 04:03:52.444792 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434536    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 04:03:52.445269 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434539    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 04:03:52.445269 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434541    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 04:03:52.445269 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.434543    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 04:03:52.445269 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.435267    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 04:03:52.445269 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.442206    2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 29 04:03:52.445269 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.442222    2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 29 04:03:52.445269 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.442241    2572 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 29 04:03:52.445269 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.442247    2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 29 04:03:52.445269 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442304    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 04:03:52.445269 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442309    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 04:03:52.445269 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442313    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 04:03:52.445269 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442316    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 04:03:52.445269 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442319    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 04:03:52.445269 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442323    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 04:03:52.445269 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442326    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 04:03:52.445724 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442329    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 04:03:52.445724 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442331    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 04:03:52.445724 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442334    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 04:03:52.445724 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442336    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 04:03:52.445724 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442339    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 04:03:52.445724 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442341    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 04:03:52.445724 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442344    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 04:03:52.445724 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442347    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 04:03:52.445724 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442350    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 04:03:52.445724 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442352    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 04:03:52.445724 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442355    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 04:03:52.445724 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442358    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 04:03:52.445724 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442360    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 04:03:52.445724 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442363    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 04:03:52.445724 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442366    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 04:03:52.445724 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442368    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 04:03:52.445724 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442370    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 04:03:52.445724 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442375    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 04:03:52.445724 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442378    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 04:03:52.446376 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442381    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 04:03:52.446376 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442385    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 04:03:52.446376 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442387    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 04:03:52.446376 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442392    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 04:03:52.446376 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442395    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 04:03:52.446376 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442398    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 04:03:52.446376 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442401    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 04:03:52.446376 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442421    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 04:03:52.446376 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442425    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 04:03:52.446376 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442428    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 04:03:52.446376 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442430    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 04:03:52.446376 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442433    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 04:03:52.446376 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442436    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 04:03:52.446376 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442439    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 04:03:52.446376 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442442    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 04:03:52.446376 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442444    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 04:03:52.446376 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442446    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 04:03:52.446376 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442449    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 04:03:52.446376 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442451    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 04:03:52.446376 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442454    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 04:03:52.446376 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442457    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 04:03:52.446928 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442459    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 04:03:52.446928 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442462    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 04:03:52.446928 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442464    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 04:03:52.446928 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442467    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 04:03:52.446928 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442469    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 04:03:52.446928 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442471    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 04:03:52.446928 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442474    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 04:03:52.446928 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442476    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 04:03:52.446928 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442479    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 04:03:52.446928 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442483    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 04:03:52.446928 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442486    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 04:03:52.446928 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442495    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 04:03:52.446928 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442499    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 04:03:52.446928 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442502    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 04:03:52.446928 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442505    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 04:03:52.446928 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442509    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 04:03:52.446928 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442511    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 04:03:52.446928 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442514    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 04:03:52.446928 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442516    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 04:03:52.447430 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442519    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 04:03:52.447430 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442521    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 04:03:52.447430 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442524    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 04:03:52.447430 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442526    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 04:03:52.447430 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442529    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 04:03:52.447430 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442531    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 04:03:52.447430 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442534    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 04:03:52.447430 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442536    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 04:03:52.447430 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442539    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 04:03:52.447430 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442541    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 04:03:52.447430 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442544    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 04:03:52.447430 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442547    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 04:03:52.447430 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442550    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 04:03:52.447430 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442552    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 04:03:52.447430 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442554    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 04:03:52.447430 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442557    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 04:03:52.447430 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442560    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 04:03:52.447430 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442562    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 04:03:52.447430 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442565    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 04:03:52.447891 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442568    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 04:03:52.447891 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442572    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 04:03:52.447891 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442575    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 04:03:52.447891 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442578    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 04:03:52.447891 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442580    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 04:03:52.447891 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442583    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 04:03:52.447891 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442586    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 04:03:52.447891 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442589    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 04:03:52.447891 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442592    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 04:03:52.447891 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442595    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 04:03:52.447891 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442598    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 04:03:52.447891 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442600    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 04:03:52.447891 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442603    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 04:03:52.447891 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442605    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 04:03:52.447891 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.442610    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 04:03:52.448258 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442726    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 04:03:52.448258 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442731    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 04:03:52.448258 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442733    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 04:03:52.448258 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442736    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 04:03:52.448258 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442739    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 04:03:52.448258 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442742    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 04:03:52.448258 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442744    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 04:03:52.448258 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442748    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 04:03:52.448258 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442752    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 04:03:52.448258 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442755    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 04:03:52.448258 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442757    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 04:03:52.448258 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442760    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 04:03:52.448258 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442762    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 04:03:52.448258 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442765    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 04:03:52.448258 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442767    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 04:03:52.448258 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442771    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 04:03:52.448258 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442773    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 04:03:52.448258 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442776    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 04:03:52.448258 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442779    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 04:03:52.448740 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442781    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 04:03:52.448740 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442784    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 04:03:52.448740 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442786    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 04:03:52.448740 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442789    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 04:03:52.448740 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442791    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 04:03:52.448740 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442794    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 04:03:52.448740 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442797    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 04:03:52.448740 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442799    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 04:03:52.448740 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442802    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 04:03:52.448740 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442805    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 04:03:52.448740 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442808    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 04:03:52.448740 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442810    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 04:03:52.448740 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442813    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 04:03:52.448740 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442815    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 04:03:52.448740 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442818    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 04:03:52.448740 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442820    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 04:03:52.448740 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442823    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 04:03:52.448740 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442825    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 04:03:52.448740 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442828    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 04:03:52.448740 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442830    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 04:03:52.449205 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442833    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 04:03:52.449205 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442835    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 04:03:52.449205 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442838    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 04:03:52.449205 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442840    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 04:03:52.449205 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442842    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 04:03:52.449205 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442845    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 04:03:52.449205 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442847    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 04:03:52.449205 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442850    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 04:03:52.449205 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442853    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 04:03:52.449205 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442855    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 04:03:52.449205 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442858    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 04:03:52.449205 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442860    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 04:03:52.449205 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442863    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 04:03:52.449205 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442865    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 04:03:52.449205 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442868    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 04:03:52.449205 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442871    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 04:03:52.449205 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442873    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 04:03:52.449205 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442875    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 04:03:52.449205 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442878    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 04:03:52.449205 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442880    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 04:03:52.449797 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442882    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 04:03:52.449797 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442885    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 04:03:52.449797 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442888    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 04:03:52.449797 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442890    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 04:03:52.449797 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442893    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 04:03:52.449797 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442895    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 04:03:52.449797 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442897    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 04:03:52.449797 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442900    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 04:03:52.449797 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442902    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 04:03:52.449797 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442904    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 04:03:52.449797 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442907    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 04:03:52.449797 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442909    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 04:03:52.449797 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442913    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 04:03:52.449797 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442916    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 04:03:52.449797 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442918    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 04:03:52.449797 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442921    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 04:03:52.449797 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442923    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 04:03:52.449797 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442925    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 04:03:52.449797 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442928    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 04:03:52.450250 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442931    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 04:03:52.450250 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442933    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 04:03:52.450250 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442936    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 04:03:52.450250 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442938    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 04:03:52.450250 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442940    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 04:03:52.450250 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442943    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 04:03:52.450250 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442945    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 04:03:52.450250 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442948    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 04:03:52.450250 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442951    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 04:03:52.450250 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442953    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 04:03:52.450250 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442956    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 04:03:52.450250 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442958    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 04:03:52.450250 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442961    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 04:03:52.450250 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442963    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 04:03:52.450250 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442966    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 04:03:52.450250 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442968    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 04:03:52.450250 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442971    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 04:03:52.450250 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442973    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 04:03:52.450250 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442976    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 04:03:52.450250 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442978    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 04:03:52.450749 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:52.442981    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 04:03:52.450749 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.442986    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 04:03:52.450749 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.443091    2572 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 29 04:03:52.450749 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.447986    2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 29 04:03:52.450749 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.449526    2572 server.go:1019] "Starting client certificate rotation"
Jul 29 04:03:52.450749 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.449622    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 04:03:52.450749 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.449653    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 04:03:52.452336 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.452323    2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 04:03:52.455264 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.455251    2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 04:03:52.463672 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.463655    2572 log.go:25] "Validated CRI v1 runtime API"
Jul 29 04:03:52.468363 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.468350    2572 log.go:25] "Validated CRI v1 image API"
Jul 29 04:03:52.470557 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.470541    2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 29 04:03:52.475120 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.475099    2572 fs.go:135] Filesystem UUIDs: map[446d4c9e-4592-4466-baca-ad60a6a7918f:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 de05d313-b07a-43f5-bf8d-1beb6cdab9f1:/dev/nvme0n1p4]
Jul 29 04:03:52.475194 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.475121    2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 29 04:03:52.481013 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.480986    2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 04:03:52.481365 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.480638    2572 manager.go:216] Machine: {Timestamp:2026-07-29 04:03:52.479133788 +0000 UTC m=+0.386264422 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099694 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec292f79c1ced58bb462c480f40b1445 SystemUUID:ec292f79-c1ce-d58b-b462-c480f40b1445 BootID:5baf156a-a860-46ec-9364-207c26bf7368 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:65:03:8b:0a:7d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:65:03:8b:0a:7d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5a:0f:f6:10:37:bc Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 29 04:03:52.481483 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.481364    2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 29 04:03:52.481539 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.481522    2572 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 29 04:03:52.486292 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.486097    2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 29 04:03:52.486452 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.486297    2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-4.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 29 04:03:52.487141 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.487131    2572 topology_manager.go:138] "Creating topology manager with none policy"
Jul 29 04:03:52.487176 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.487144    2572 container_manager_linux.go:309] "Creating device plugin manager"
Jul 29 04:03:52.487176 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.487152    2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 04:03:52.487971 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.487961    2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 04:03:52.488982 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.488972    2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 29 04:03:52.491298 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.491287    2572 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 04:03:52.491490 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.491480    2572 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 29 04:03:52.491522 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.491515    2572 kubelet.go:486] "Attempting to sync node with API server"
Jul 29 04:03:52.491558 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.491537    2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 29 04:03:52.491586 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.491568    2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 29 04:03:52.491586 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.491581    2572 kubelet.go:398] "Adding apiserver pod source"
Jul 29 04:03:52.491639 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.491594    2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 29 04:03:52.492046 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.492034    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 04:03:52.492082 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.492066    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 04:03:52.494572 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.494556    2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 29 04:03:52.496990 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.496966    2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 29 04:03:52.497047 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.497001    2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 29 04:03:52.499258 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.499245    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 29 04:03:52.499315 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.499261    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 29 04:03:52.499315 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.499267    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 29 04:03:52.499315 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.499272    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 29 04:03:52.499315 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.499281    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 29 04:03:52.499315 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.499287    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 29 04:03:52.499315 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.499297    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 29 04:03:52.499315 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.499305    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 29 04:03:52.499315 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.499315    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 29 04:03:52.499556 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.499321    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 29 04:03:52.499556 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.499330    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 29 04:03:52.499556 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.499335    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 29 04:03:52.500878 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.500866    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 29 04:03:52.500912 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.500880    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 29 04:03:52.501837 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:52.501813    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 29 04:03:52.501974 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:52.501953    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-4.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 29 04:03:52.503632 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.503615    2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h4qvt"
Jul 29 04:03:52.504139 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.504125    2572 server.go:1268] "Started kubelet"
Jul 29 04:03:52.504267 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.504210    2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 29 04:03:52.504320 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.504297    2572 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 29 04:03:52.504600 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.504390    2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 29 04:03:52.505161 ip-10-0-130-4 systemd[1]: Started Kubernetes Kubelet.
Jul 29 04:03:52.507057 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.507042    2572 server.go:310] "Adding debug handlers to kubelet server"
Jul 29 04:03:52.508932 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.508916    2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 29 04:03:52.509363 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.509348    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h4qvt"
Jul 29 04:03:52.513875 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.513854    2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-4.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 29 04:03:52.513875 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:52.513857    2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 29 04:03:52.514917 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:52.513834    2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-4.ec2.internal.18c6a6eb74ae80eb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-4.ec2.internal,UID:ip-10-0-130-4.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-4.ec2.internal,},FirstTimestamp:2026-07-29 04:03:52.504099051 +0000 UTC m=+0.411229687,LastTimestamp:2026-07-29 04:03:52.504099051 +0000 UTC m=+0.411229687,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-4.ec2.internal,}"
Jul 29 04:03:52.518798 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.518778    2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 29 04:03:52.518888 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.518783    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 29 04:03:52.519120 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:52.519101    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-4.ec2.internal\" not found"
Jul 29 04:03:52.519540 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.519519    2572 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 29 04:03:52.519629 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.519544    2572 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 29 04:03:52.519629 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.519611    2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 29 04:03:52.520392 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.520354    2572 reconstruct.go:97] "Volume reconstruction finished"
Jul 29 04:03:52.520392 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.520388    2572 reconciler.go:29] "Reconciler: start to sync state"
Jul 29 04:03:52.520561 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.520529    2572 factory.go:55] Registering systemd factory
Jul 29 04:03:52.520561 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.520553    2572 factory.go:223] Registration of the systemd container factory successfully
Jul 29 04:03:52.521606 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:52.521580    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 29 04:03:52.522554 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.522531    2572 factory.go:153] Registering CRI-O factory
Jul 29 04:03:52.522554 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.522556    2572 factory.go:223] Registration of the crio container factory successfully
Jul 29 04:03:52.522694 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.522643    2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 29 04:03:52.522694 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.522668    2572 factory.go:103] Registering Raw factory
Jul 29 04:03:52.522694 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.522682    2572 manager.go:1196] Started watching for new ooms in manager
Jul 29 04:03:52.523650 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.523633    2572 manager.go:349] Starting recovery of all containers
Jul 29 04:03:52.529561 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.529528    2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 29 04:03:52.534043 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:52.534016    2572 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-130-4.ec2.internal\" not found" node="ip-10-0-130-4.ec2.internal"
Jul 29 04:03:52.534248 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.534233    2572 manager.go:354] Recovery completed
Jul 29 04:03:52.538231 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.538219    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 04:03:52.540247 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.540230    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 04:03:52.540322 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.540263    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 04:03:52.540322 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.540278    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeHasSufficientPID"
Jul 29 04:03:52.540865 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.540853    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 04:03:52.540930 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.540853    2572 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 29 04:03:52.540930 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.540915    2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 29 04:03:52.540999 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.540933    2572 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 04:03:52.541567 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.541553    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 04:03:52.541615 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.541581    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 04:03:52.541615 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.541613    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeHasSufficientPID"
Jul 29 04:03:52.542881 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.542870    2572 policy_none.go:49] "None policy: Start"
Jul 29 04:03:52.542919 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.542886    2572 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 29 04:03:52.542919 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.542896    2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 29 04:03:52.544417 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.544394    2572 policy_none.go:47] "Start"
Jul 29 04:03:52.581112 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.580936    2572 manager.go:337] "Starting Device Plugin manager"
Jul 29 04:03:52.581223 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:52.581137    2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 29 04:03:52.581223 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.581152    2572 server.go:87] "Starting device plugin registration server"
Jul 29 04:03:52.581431 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.581401    2572 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 29 04:03:52.581475 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.581435    2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 29 04:03:52.581562 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.581541    2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 29 04:03:52.581685 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.581634    2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 29 04:03:52.581685 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.581649    2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 29 04:03:52.582112 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:52.582092    2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 29 04:03:52.582180 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:52.582139    2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-4.ec2.internal\" not found"
Jul 29 04:03:52.667089 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.667055    2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 29 04:03:52.668285 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.667106    2572 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 29 04:03:52.668285 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.667128    2572 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 29 04:03:52.668285 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:52.667165    2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 29 04:03:52.669615 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.669598    2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 04:03:52.681714 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.681660    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 04:03:52.683531 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.683507    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 04:03:52.683620 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.683548    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 04:03:52.683620 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.683565    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeHasSufficientPID"
Jul 29 04:03:52.683620 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.683591    2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-4.ec2.internal"
Jul 29 04:03:52.691550 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.691528    2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-4.ec2.internal"
Jul 29 04:03:52.691632 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:52.691553    2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-4.ec2.internal\": node \"ip-10-0-130-4.ec2.internal\" not found"
Jul 29 04:03:52.703917 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:52.703897    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-4.ec2.internal\" not found"
Jul 29 04:03:52.768161 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.768132    2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-4.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-4.ec2.internal"]
Jul 29 04:03:52.768247 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.768222    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 04:03:52.769944 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.769929    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 04:03:52.770004 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.769957    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 04:03:52.770004 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.769968    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeHasSufficientPID"
Jul 29 04:03:52.771290 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.771276    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 04:03:52.771475 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.771458    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-4.ec2.internal"
Jul 29 04:03:52.771542 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.771501    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 04:03:52.772217 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.772202    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 04:03:52.772304 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.772227    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 04:03:52.772304 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.772241    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeHasSufficientPID"
Jul 29 04:03:52.772304 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.772275    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 04:03:52.772304 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.772293    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 04:03:52.772304 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.772302    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeHasSufficientPID"
Jul 29 04:03:52.773501 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.773474    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-4.ec2.internal"
Jul 29 04:03:52.773587 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.773506    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 04:03:52.774397 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.774381    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 04:03:52.774506 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.774420    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 04:03:52.774506 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:52.774442    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeHasSufficientPID"
Jul 29 04:03:52.795256 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:52.795221    2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-4.ec2.internal\" not found" node="ip-10-0-130-4.ec2.internal"
Jul 29 04:03:52.799888 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:52.799869    2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-4.ec2.internal\" not found" node="ip-10-0-130-4.ec2.internal"
Jul 29 04:03:52.804932 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:52.804916    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-4.ec2.internal\" not found"
Jul 29 04:03:54.379487 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:54.379463    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-4.ec2.internal\" not found"
Jul 29 04:03:54.395893 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:54.395869    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/66a3408ad1007acac3a6a8bc92311bca-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-4.ec2.internal\" (UID: \"66a3408ad1007acac3a6a8bc92311bca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-4.ec2.internal"
Jul 29 04:03:54.395952 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:54.395898    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66a3408ad1007acac3a6a8bc92311bca-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-4.ec2.internal\" (UID: \"66a3408ad1007acac3a6a8bc92311bca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-4.ec2.internal"
Jul 29 04:03:54.395952 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:54.395917    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9c7cb484c0a90a7b37dbbc2d4d151971-config\") pod \"kube-apiserver-proxy-ip-10-0-130-4.ec2.internal\" (UID: \"9c7cb484c0a90a7b37dbbc2d4d151971\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-4.ec2.internal"
Jul 29 04:03:54.480357 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:54.480271    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-4.ec2.internal\" not found"
Jul 29 04:03:54.496636 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:54.496611    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/66a3408ad1007acac3a6a8bc92311bca-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-4.ec2.internal\" (UID: \"66a3408ad1007acac3a6a8bc92311bca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-4.ec2.internal"
Jul 29 04:03:54.496697 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:54.496640    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66a3408ad1007acac3a6a8bc92311bca-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-4.ec2.internal\" (UID: \"66a3408ad1007acac3a6a8bc92311bca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-4.ec2.internal"
Jul 29 04:03:54.496697 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:54.496658    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9c7cb484c0a90a7b37dbbc2d4d151971-config\") pod \"kube-apiserver-proxy-ip-10-0-130-4.ec2.internal\" (UID: \"9c7cb484c0a90a7b37dbbc2d4d151971\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-4.ec2.internal"
Jul 29 04:03:54.496758 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:54.496716    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66a3408ad1007acac3a6a8bc92311bca-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-4.ec2.internal\" (UID: \"66a3408ad1007acac3a6a8bc92311bca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-4.ec2.internal"
Jul 29 04:03:54.496758 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:54.496725    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/66a3408ad1007acac3a6a8bc92311bca-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-4.ec2.internal\" (UID: \"66a3408ad1007acac3a6a8bc92311bca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-4.ec2.internal"
Jul 29 04:03:54.496820 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:54.496771    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9c7cb484c0a90a7b37dbbc2d4d151971-config\") pod \"kube-apiserver-proxy-ip-10-0-130-4.ec2.internal\" (UID: \"9c7cb484c0a90a7b37dbbc2d4d151971\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-4.ec2.internal"
Jul 29 04:03:54.573804 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:54.573769    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-4.ec2.internal"
Jul 29 04:03:54.578834 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:54.578820    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-4.ec2.internal"
Jul 29 04:03:54.580954 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:54.580931    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-4.ec2.internal\" not found"
Jul 29 04:03:54.681744 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:54.681698    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-4.ec2.internal\" not found"
Jul 29 04:03:54.782340 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:54.782267    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-4.ec2.internal\" not found"
Jul 29 04:03:54.882797 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:54.882757    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-4.ec2.internal\" not found"
Jul 29 04:03:54.923317 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:54.923289    2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 29 04:03:54.923752 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:54.923428    2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 04:03:54.971771 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:54.971743    2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 04:03:54.990208 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:54.990167    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 03:58:53 +0000 UTC" deadline="2028-01-25 16:15:41.287280409 +0000 UTC"
Jul 29 04:03:54.990208 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:54.990206    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13092h11m46.297076537s"
Jul 29 04:03:54.993818 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:54.993791    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 29 04:03:54.993818 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:54.993809    2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-4.ec2.internal"
Jul 29 04:03:55.004708 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:55.004681    2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 04:03:55.006739 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:55.006720    2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-4.ec2.internal"
Jul 29 04:03:55.006831 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:55.006770    2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 04:03:55.016907 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:55.016893    2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 04:03:55.030460 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:55.030436    2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7f84b"
Jul 29 04:03:55.038911 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:55.038857    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7f84b"
Jul 29 04:03:55.089623 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:55.089598    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c7cb484c0a90a7b37dbbc2d4d151971.slice/crio-774eaff90508beb0347cbc4458ba53ea8f3cb6f115af20190f5aab7681157670 WatchSource:0}: Error finding container 774eaff90508beb0347cbc4458ba53ea8f3cb6f115af20190f5aab7681157670: Status 404 returned error can't find the container with id 774eaff90508beb0347cbc4458ba53ea8f3cb6f115af20190f5aab7681157670
Jul 29 04:03:55.089889 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:55.089872    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66a3408ad1007acac3a6a8bc92311bca.slice/crio-f00393c66c8c6e90385ded22efffaaf08c45b43db4bd099df2e2fcbb6b2bb9de WatchSource:0}: Error finding container f00393c66c8c6e90385ded22efffaaf08c45b43db4bd099df2e2fcbb6b2bb9de: Status 404 returned error can't find the container with id f00393c66c8c6e90385ded22efffaaf08c45b43db4bd099df2e2fcbb6b2bb9de
Jul 29 04:03:55.094818 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:55.094805    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 04:03:55.144476 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:55.144419    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-4.ec2.internal" event={"ID":"9c7cb484c0a90a7b37dbbc2d4d151971","Type":"ContainerStarted","Data":"774eaff90508beb0347cbc4458ba53ea8f3cb6f115af20190f5aab7681157670"}
Jul 29 04:03:55.145537 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:55.145493    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-4.ec2.internal" event={"ID":"66a3408ad1007acac3a6a8bc92311bca","Type":"ContainerStarted","Data":"f00393c66c8c6e90385ded22efffaaf08c45b43db4bd099df2e2fcbb6b2bb9de"}
Jul 29 04:03:55.325290 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:55.325209    2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 04:03:55.414895 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:55.414871    2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 04:03:55.966197 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:55.966164    2572 apiserver.go:52] "Watching apiserver"
Jul 29 04:03:55.975517 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:55.974541    2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 29 04:03:55.975517 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:55.975069    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-548lx","kube-system/kube-apiserver-proxy-ip-10-0-130-4.ec2.internal","openshift-dns/node-resolver-dnkkq","openshift-image-registry/node-ca-mtfx7","openshift-multus/multus-additional-cni-plugins-kg9jl","openshift-network-diagnostics/network-check-target-b2gqf","openshift-ovn-kubernetes/ovnkube-node-6z6p8","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ww64c","openshift-cluster-node-tuning-operator/tuned-4sxfh","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-4.ec2.internal","openshift-multus/multus-lmjvb","openshift-multus/network-metrics-daemon-glpbr","openshift-network-operator/iptables-alerter-ghl98","kube-system/global-pull-secret-syncer-ftvjm"]
Jul 29 04:03:55.979792 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:55.979766    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:55.981327 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:55.981308    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ghl98"
Jul 29 04:03:55.983008 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:55.982994    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dnkkq"
Jul 29 04:03:55.984432 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:55.984415    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mtfx7"
Jul 29 04:03:55.986083 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:55.986071    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kg9jl"
Jul 29 04:03:55.987769 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:55.987568    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2gqf"
Jul 29 04:03:55.987769 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:55.987633    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b2gqf" podUID="91c78bb4-6179-4fcf-b449-f18b90e0a4f2"
Jul 29 04:03:55.989114 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:55.989093    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:55.990915 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:55.990899    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-548lx"
Jul 29 04:03:55.996949 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:55.993278    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 29 04:03:55.996949 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:55.993342    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 29 04:03:55.996949 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:55.993465    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 29 04:03:55.996949 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:55.993481    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 29 04:03:55.996949 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:55.993619    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ctd6g\""
Jul 29 04:03:55.996949 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:55.993725    2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 04:03:55.997339 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:55.997318    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:03:55.997444 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:55.997393    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvjm" podUID="ad8e0e9f-d912-40df-98b5-5e17f77aa631"
Jul 29 04:03:55.999605 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:55.998783    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 29 04:03:55.999605 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:55.999057    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 29 04:03:55.999605 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:55.999216    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 29 04:03:55.999605 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:55.999341    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5rtzq\""
Jul 29 04:03:55.999605 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:55.999468    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 29 04:03:56.000227 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.000054    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 29 04:03:56.000227 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.000124    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 29 04:03:56.000374 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.000272    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 29 04:03:56.000374 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.000281    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.000629 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.000600    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 29 04:03:56.000734 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.000667    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 29 04:03:56.000830 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.000814    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 29 04:03:56.002594 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.001467    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 29 04:03:56.002594 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.001561    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-998k7\""
Jul 29 04:03:56.002594 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.001598    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zvr6g\""
Jul 29 04:03:56.002594 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.001682    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 29 04:03:56.002594 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.001467    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 29 04:03:56.002594 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.001824    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 29 04:03:56.002594 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.001853    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 29 04:03:56.002594 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.001860    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nc5xd\""
Jul 29 04:03:56.002594 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.001748    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 29 04:03:56.002594 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.002001    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-l9hbz\""
Jul 29 04:03:56.002594 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.002339    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 29 04:03:56.002594 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.002398    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 29 04:03:56.002594 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.002410    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glpbr"
Jul 29 04:03:56.002594 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.002450    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5vddp\""
Jul 29 04:03:56.002594 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:56.002489    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glpbr" podUID="790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec"
Jul 29 04:03:56.003369 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.003187    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 29 04:03:56.003561 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.003541    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ww64c"
Jul 29 04:03:56.004876 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.004856    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f5975794-9295-4748-9bce-2b0ef3fbeb8d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kg9jl\" (UID: \"f5975794-9295-4748-9bce-2b0ef3fbeb8d\") " pod="openshift-multus/multus-additional-cni-plugins-kg9jl"
Jul 29 04:03:56.004967 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.004889    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-var-lib-openvswitch\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.004967 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.004920    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-host-run-ovn-kubernetes\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.005061 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.005016    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/585dfe10-b366-4228-a697-a56b25e4eade-host-slash\") pod \"iptables-alerter-ghl98\" (UID: \"585dfe10-b366-4228-a697-a56b25e4eade\") " pod="openshift-network-operator/iptables-alerter-ghl98"
Jul 29 04:03:56.005061 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.005045    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-run-systemd\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.005127 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.005074    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0974adfa-35b7-4dc6-a422-375514f65dc9-lib-modules\") pod \"tuned-4sxfh\" (UID: \"0974adfa-35b7-4dc6-a422-375514f65dc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:56.005127 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.005104    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0974adfa-35b7-4dc6-a422-375514f65dc9-etc-sysctl-conf\") pod \"tuned-4sxfh\" (UID: \"0974adfa-35b7-4dc6-a422-375514f65dc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:56.005198 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.005138    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0974adfa-35b7-4dc6-a422-375514f65dc9-run\") pod \"tuned-4sxfh\" (UID: \"0974adfa-35b7-4dc6-a422-375514f65dc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:56.005198 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.005170    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0974adfa-35b7-4dc6-a422-375514f65dc9-sys\") pod \"tuned-4sxfh\" (UID: \"0974adfa-35b7-4dc6-a422-375514f65dc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:56.005198 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.005193    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0974adfa-35b7-4dc6-a422-375514f65dc9-var-lib-kubelet\") pod \"tuned-4sxfh\" (UID: \"0974adfa-35b7-4dc6-a422-375514f65dc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:56.005323 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.005244    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 29 04:03:56.005428 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.005409    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6887w\""
Jul 29 04:03:56.005471 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.005232    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-etc-openvswitch\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.005540 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.005469    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-host-cni-bin\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.005540 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.005493    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fn2z\" (UniqueName: \"kubernetes.io/projected/91c78bb4-6179-4fcf-b449-f18b90e0a4f2-kube-api-access-5fn2z\") pod \"network-check-target-b2gqf\" (UID: \"91c78bb4-6179-4fcf-b449-f18b90e0a4f2\") " pod="openshift-network-diagnostics/network-check-target-b2gqf"
Jul 29 04:03:56.005948 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.005906    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f0431314-54c9-4235-a9b8-6cde6d840fe9-hosts-file\") pod \"node-resolver-dnkkq\" (UID: \"f0431314-54c9-4235-a9b8-6cde6d840fe9\") " pod="openshift-dns/node-resolver-dnkkq"
Jul 29 04:03:56.006026 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.005993    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f5975794-9295-4748-9bce-2b0ef3fbeb8d-os-release\") pod \"multus-additional-cni-plugins-kg9jl\" (UID: \"f5975794-9295-4748-9bce-2b0ef3fbeb8d\") " pod="openshift-multus/multus-additional-cni-plugins-kg9jl"
Jul 29 04:03:56.006074 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.006028    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-host-run-netns\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.006074 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.006064    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0974adfa-35b7-4dc6-a422-375514f65dc9-etc-systemd\") pod \"tuned-4sxfh\" (UID: \"0974adfa-35b7-4dc6-a422-375514f65dc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:56.006190 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.006174    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ad8e0e9f-d912-40df-98b5-5e17f77aa631-dbus\") pod \"global-pull-secret-syncer-ftvjm\" (UID: \"ad8e0e9f-d912-40df-98b5-5e17f77aa631\") " pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:03:56.006299 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.006206    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dddb6b6e-32b5-4bcf-85d8-8c4d57451fe9-agent-certs\") pod \"konnectivity-agent-548lx\" (UID: \"dddb6b6e-32b5-4bcf-85d8-8c4d57451fe9\") " pod="kube-system/konnectivity-agent-548lx"
Jul 29 04:03:56.006784 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.006743    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dvm5p\""
Jul 29 04:03:56.007067 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.007005    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 29 04:03:56.007801 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.007333    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 29 04:03:56.007903 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.007856    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ad8e0e9f-d912-40df-98b5-5e17f77aa631-kubelet-config\") pod \"global-pull-secret-syncer-ftvjm\" (UID: \"ad8e0e9f-d912-40df-98b5-5e17f77aa631\") " pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:03:56.007975 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.007938    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/585dfe10-b366-4228-a697-a56b25e4eade-iptables-alerter-script\") pod \"iptables-alerter-ghl98\" (UID: \"585dfe10-b366-4228-a697-a56b25e4eade\") " pod="openshift-network-operator/iptables-alerter-ghl98"
Jul 29 04:03:56.008074 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.007993    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wszvj\" (UniqueName: \"kubernetes.io/projected/0974adfa-35b7-4dc6-a422-375514f65dc9-kube-api-access-wszvj\") pod \"tuned-4sxfh\" (UID: \"0974adfa-35b7-4dc6-a422-375514f65dc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:56.008074 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.008023    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dddb6b6e-32b5-4bcf-85d8-8c4d57451fe9-konnectivity-ca\") pod \"konnectivity-agent-548lx\" (UID: \"dddb6b6e-32b5-4bcf-85d8-8c4d57451fe9\") " pod="kube-system/konnectivity-agent-548lx"
Jul 29 04:03:56.008074 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.008069    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhbht\" (UniqueName: \"kubernetes.io/projected/585dfe10-b366-4228-a697-a56b25e4eade-kube-api-access-vhbht\") pod \"iptables-alerter-ghl98\" (UID: \"585dfe10-b366-4228-a697-a56b25e4eade\") " pod="openshift-network-operator/iptables-alerter-ghl98"
Jul 29 04:03:56.008219 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.008098    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5975794-9295-4748-9bce-2b0ef3fbeb8d-system-cni-dir\") pod \"multus-additional-cni-plugins-kg9jl\" (UID: \"f5975794-9295-4748-9bce-2b0ef3fbeb8d\") " pod="openshift-multus/multus-additional-cni-plugins-kg9jl"
Jul 29 04:03:56.008219 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.008150    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-host-cni-netd\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.008219 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.008203    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0974adfa-35b7-4dc6-a422-375514f65dc9-etc-modprobe-d\") pod \"tuned-4sxfh\" (UID: \"0974adfa-35b7-4dc6-a422-375514f65dc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:56.008358 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.008342    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-run-openvswitch\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.008454 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.008440    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-host-slash\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.008541 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.008526    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f5975794-9295-4748-9bce-2b0ef3fbeb8d-cnibin\") pod \"multus-additional-cni-plugins-kg9jl\" (UID: \"f5975794-9295-4748-9bce-2b0ef3fbeb8d\") " pod="openshift-multus/multus-additional-cni-plugins-kg9jl"
Jul 29 04:03:56.008606 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.008562    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-run-ovn\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.008653 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.008610    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-log-socket\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.008708 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.008656    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.008780 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.008738    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp7lq\" (UniqueName: \"kubernetes.io/projected/f0431314-54c9-4235-a9b8-6cde6d840fe9-kube-api-access-sp7lq\") pod \"node-resolver-dnkkq\" (UID: \"f0431314-54c9-4235-a9b8-6cde6d840fe9\") " pod="openshift-dns/node-resolver-dnkkq"
Jul 29 04:03:56.008861 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.008832    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f5975794-9295-4748-9bce-2b0ef3fbeb8d-cni-binary-copy\") pod \"multus-additional-cni-plugins-kg9jl\" (UID: \"f5975794-9295-4748-9bce-2b0ef3fbeb8d\") " pod="openshift-multus/multus-additional-cni-plugins-kg9jl"
Jul 29 04:03:56.008907 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.008879    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-host-kubelet\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.008969 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.008921    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad8e0e9f-d912-40df-98b5-5e17f77aa631-original-pull-secret\") pod \"global-pull-secret-syncer-ftvjm\" (UID: \"ad8e0e9f-d912-40df-98b5-5e17f77aa631\") " pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:03:56.008969 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.008949    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0974adfa-35b7-4dc6-a422-375514f65dc9-etc-sysctl-d\") pod \"tuned-4sxfh\" (UID: \"0974adfa-35b7-4dc6-a422-375514f65dc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:56.009060 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.008970    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0974adfa-35b7-4dc6-a422-375514f65dc9-etc-tuned\") pod \"tuned-4sxfh\" (UID: \"0974adfa-35b7-4dc6-a422-375514f65dc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:56.009060 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.009013    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f5975794-9295-4748-9bce-2b0ef3fbeb8d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kg9jl\" (UID: \"f5975794-9295-4748-9bce-2b0ef3fbeb8d\") " pod="openshift-multus/multus-additional-cni-plugins-kg9jl"
Jul 29 04:03:56.009151 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.009058    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-systemd-units\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.009151 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.009083    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-node-log\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.009151 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.009132    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3228b431-6b56-463f-ab47-5cd22ba06905-ovnkube-script-lib\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.010379 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.009271    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4e738e9c-9ec3-4eee-ba0c-98a66f23cb15-serviceca\") pod \"node-ca-mtfx7\" (UID: \"4e738e9c-9ec3-4eee-ba0c-98a66f23cb15\") " pod="openshift-image-registry/node-ca-mtfx7"
Jul 29 04:03:56.010379 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.009323    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtgz7\" (UniqueName: \"kubernetes.io/projected/4e738e9c-9ec3-4eee-ba0c-98a66f23cb15-kube-api-access-qtgz7\") pod \"node-ca-mtfx7\" (UID: \"4e738e9c-9ec3-4eee-ba0c-98a66f23cb15\") " pod="openshift-image-registry/node-ca-mtfx7"
Jul 29 04:03:56.010379 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.009417    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0974adfa-35b7-4dc6-a422-375514f65dc9-etc-kubernetes\") pod \"tuned-4sxfh\" (UID: \"0974adfa-35b7-4dc6-a422-375514f65dc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:56.010379 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.009456    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0974adfa-35b7-4dc6-a422-375514f65dc9-tmp\") pod \"tuned-4sxfh\" (UID: \"0974adfa-35b7-4dc6-a422-375514f65dc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:56.010379 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.009553    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f5975794-9295-4748-9bce-2b0ef3fbeb8d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kg9jl\" (UID: \"f5975794-9295-4748-9bce-2b0ef3fbeb8d\") " pod="openshift-multus/multus-additional-cni-plugins-kg9jl"
Jul 29 04:03:56.010379 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.009584    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3228b431-6b56-463f-ab47-5cd22ba06905-ovnkube-config\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.010379 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.009609    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3228b431-6b56-463f-ab47-5cd22ba06905-env-overrides\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.010379 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.009663    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3228b431-6b56-463f-ab47-5cd22ba06905-ovn-node-metrics-cert\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.010379 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.009698    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmp2d\" (UniqueName: \"kubernetes.io/projected/3228b431-6b56-463f-ab47-5cd22ba06905-kube-api-access-gmp2d\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.010379 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.009702    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 29 04:03:56.010379 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.009744    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4e738e9c-9ec3-4eee-ba0c-98a66f23cb15-host\") pod \"node-ca-mtfx7\" (UID: \"4e738e9c-9ec3-4eee-ba0c-98a66f23cb15\") " pod="openshift-image-registry/node-ca-mtfx7"
Jul 29 04:03:56.010379 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.009774    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0974adfa-35b7-4dc6-a422-375514f65dc9-etc-sysconfig\") pod \"tuned-4sxfh\" (UID: \"0974adfa-35b7-4dc6-a422-375514f65dc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:56.010379 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.009821    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0431314-54c9-4235-a9b8-6cde6d840fe9-tmp-dir\") pod \"node-resolver-dnkkq\" (UID: \"f0431314-54c9-4235-a9b8-6cde6d840fe9\") " pod="openshift-dns/node-resolver-dnkkq"
Jul 29 04:03:56.010379 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.009870    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-966t4\" (UniqueName: \"kubernetes.io/projected/f5975794-9295-4748-9bce-2b0ef3fbeb8d-kube-api-access-966t4\") pod \"multus-additional-cni-plugins-kg9jl\" (UID: \"f5975794-9295-4748-9bce-2b0ef3fbeb8d\") " pod="openshift-multus/multus-additional-cni-plugins-kg9jl"
Jul 29 04:03:56.010379 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.009926    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0974adfa-35b7-4dc6-a422-375514f65dc9-host\") pod \"tuned-4sxfh\" (UID: \"0974adfa-35b7-4dc6-a422-375514f65dc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:56.040807 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.040748    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 03:58:55 +0000 UTC" deadline="2028-03-04 02:39:00.931030705 +0000 UTC"
Jul 29 04:03:56.040921 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.040808    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14014h35m4.890227374s"
Jul 29 04:03:56.095831 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.095803    2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 29 04:03:56.110570 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.110404    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp7lq\" (UniqueName: \"kubernetes.io/projected/f0431314-54c9-4235-a9b8-6cde6d840fe9-kube-api-access-sp7lq\") pod \"node-resolver-dnkkq\" (UID: \"f0431314-54c9-4235-a9b8-6cde6d840fe9\") " pod="openshift-dns/node-resolver-dnkkq"
Jul 29 04:03:56.110723 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.110590    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f5975794-9295-4748-9bce-2b0ef3fbeb8d-cni-binary-copy\") pod \"multus-additional-cni-plugins-kg9jl\" (UID: \"f5975794-9295-4748-9bce-2b0ef3fbeb8d\") " pod="openshift-multus/multus-additional-cni-plugins-kg9jl"
Jul 29 04:03:56.110723 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.110619    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-host-kubelet\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.110723 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.110649    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad8e0e9f-d912-40df-98b5-5e17f77aa631-original-pull-secret\") pod \"global-pull-secret-syncer-ftvjm\" (UID: \"ad8e0e9f-d912-40df-98b5-5e17f77aa631\") " pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:03:56.110723 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.110677    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8644f436-c5c4-433f-92d7-bdc490fe95be-host-var-lib-cni-bin\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.110723 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.110703    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0974adfa-35b7-4dc6-a422-375514f65dc9-etc-sysctl-d\") pod \"tuned-4sxfh\" (UID: \"0974adfa-35b7-4dc6-a422-375514f65dc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:56.111042 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.110728    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0974adfa-35b7-4dc6-a422-375514f65dc9-etc-tuned\") pod \"tuned-4sxfh\" (UID: \"0974adfa-35b7-4dc6-a422-375514f65dc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:56.111042 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.110728    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-host-kubelet\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.111042 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.110753    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f5975794-9295-4748-9bce-2b0ef3fbeb8d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kg9jl\" (UID: \"f5975794-9295-4748-9bce-2b0ef3fbeb8d\") " pod="openshift-multus/multus-additional-cni-plugins-kg9jl"
Jul 29 04:03:56.111042 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.110827    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-systemd-units\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.111042 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.110854    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-node-log\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.111042 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.110877    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3228b431-6b56-463f-ab47-5cd22ba06905-ovnkube-script-lib\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.111326 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.111253    2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 29 04:03:56.111380 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.111341    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f5975794-9295-4748-9bce-2b0ef3fbeb8d-cni-binary-copy\") pod \"multus-additional-cni-plugins-kg9jl\" (UID: \"f5975794-9295-4748-9bce-2b0ef3fbeb8d\") " pod="openshift-multus/multus-additional-cni-plugins-kg9jl"
Jul 29 04:03:56.111554 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.111532    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3228b431-6b56-463f-ab47-5cd22ba06905-ovnkube-script-lib\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.112119 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.112096    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f5975794-9295-4748-9bce-2b0ef3fbeb8d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kg9jl\" (UID: \"f5975794-9295-4748-9bce-2b0ef3fbeb8d\") " pod="openshift-multus/multus-additional-cni-plugins-kg9jl"
Jul 29 04:03:56.112212 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.112194    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-systemd-units\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.112270 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.112255    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-node-log\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.112390 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:56.112376    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 04:03:56.112470 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:56.112453    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad8e0e9f-d912-40df-98b5-5e17f77aa631-original-pull-secret podName:ad8e0e9f-d912-40df-98b5-5e17f77aa631 nodeName:}" failed. No retries permitted until 2026-07-29 04:03:56.612420602 +0000 UTC m=+3.045458693 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ad8e0e9f-d912-40df-98b5-5e17f77aa631-original-pull-secret") pod "global-pull-secret-syncer-ftvjm" (UID: "ad8e0e9f-d912-40df-98b5-5e17f77aa631") : object "kube-system"/"original-pull-secret" not registered
Jul 29 04:03:56.112577 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.112560    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4e738e9c-9ec3-4eee-ba0c-98a66f23cb15-serviceca\") pod \"node-ca-mtfx7\" (UID: \"4e738e9c-9ec3-4eee-ba0c-98a66f23cb15\") " pod="openshift-image-registry/node-ca-mtfx7"
Jul 29 04:03:56.112660 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.112544    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0974adfa-35b7-4dc6-a422-375514f65dc9-etc-sysctl-d\") pod \"tuned-4sxfh\" (UID: \"0974adfa-35b7-4dc6-a422-375514f65dc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:56.112749 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.112607    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtgz7\" (UniqueName: \"kubernetes.io/projected/4e738e9c-9ec3-4eee-ba0c-98a66f23cb15-kube-api-access-qtgz7\") pod \"node-ca-mtfx7\" (UID: \"4e738e9c-9ec3-4eee-ba0c-98a66f23cb15\") " pod="openshift-image-registry/node-ca-mtfx7"
Jul 29 04:03:56.112781 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.112771    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0974adfa-35b7-4dc6-a422-375514f65dc9-etc-kubernetes\") pod \"tuned-4sxfh\" (UID: \"0974adfa-35b7-4dc6-a422-375514f65dc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:56.112819 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.112796    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0974adfa-35b7-4dc6-a422-375514f65dc9-tmp\") pod \"tuned-4sxfh\" (UID: \"0974adfa-35b7-4dc6-a422-375514f65dc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:56.112856 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.112821    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f5975794-9295-4748-9bce-2b0ef3fbeb8d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kg9jl\" (UID: \"f5975794-9295-4748-9bce-2b0ef3fbeb8d\") " pod="openshift-multus/multus-additional-cni-plugins-kg9jl"
Jul 29 04:03:56.112856 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.112843    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3228b431-6b56-463f-ab47-5cd22ba06905-ovnkube-config\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.112937 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.112862    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3228b431-6b56-463f-ab47-5cd22ba06905-env-overrides\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.112937 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.112882    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3228b431-6b56-463f-ab47-5cd22ba06905-ovn-node-metrics-cert\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.112937 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.112907    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmp2d\" (UniqueName: \"kubernetes.io/projected/3228b431-6b56-463f-ab47-5cd22ba06905-kube-api-access-gmp2d\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.112937 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.112929    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4e738e9c-9ec3-4eee-ba0c-98a66f23cb15-host\") pod \"node-ca-mtfx7\" (UID: \"4e738e9c-9ec3-4eee-ba0c-98a66f23cb15\") " pod="openshift-image-registry/node-ca-mtfx7"
Jul 29 04:03:56.113058 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.112958    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0974adfa-35b7-4dc6-a422-375514f65dc9-etc-sysconfig\") pod \"tuned-4sxfh\" (UID: \"0974adfa-35b7-4dc6-a422-375514f65dc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:56.113058 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.112983    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0431314-54c9-4235-a9b8-6cde6d840fe9-tmp-dir\") pod \"node-resolver-dnkkq\" (UID: \"f0431314-54c9-4235-a9b8-6cde6d840fe9\") " pod="openshift-dns/node-resolver-dnkkq"
Jul 29 04:03:56.113058 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.113003    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-966t4\" (UniqueName: \"kubernetes.io/projected/f5975794-9295-4748-9bce-2b0ef3fbeb8d-kube-api-access-966t4\") pod \"multus-additional-cni-plugins-kg9jl\" (UID: \"f5975794-9295-4748-9bce-2b0ef3fbeb8d\") " pod="openshift-multus/multus-additional-cni-plugins-kg9jl"
Jul 29 04:03:56.113058 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.113024    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0974adfa-35b7-4dc6-a422-375514f65dc9-host\") pod \"tuned-4sxfh\" (UID: \"0974adfa-35b7-4dc6-a422-375514f65dc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:56.113058 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.113049    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5308636d-29f2-493b-bec2-22ae9d554fa6-socket-dir\") pod \"aws-ebs-csi-driver-node-ww64c\" (UID: \"5308636d-29f2-493b-bec2-22ae9d554fa6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ww64c"
Jul 29 04:03:56.113225 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.113073    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8644f436-c5c4-433f-92d7-bdc490fe95be-host-run-netns\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.113225 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.113115    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f5975794-9295-4748-9bce-2b0ef3fbeb8d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kg9jl\" (UID: \"f5975794-9295-4748-9bce-2b0ef3fbeb8d\") " pod="openshift-multus/multus-additional-cni-plugins-kg9jl"
Jul 29 04:03:56.113225 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.113155    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-var-lib-openvswitch\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.113225 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.113181    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-host-run-ovn-kubernetes\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.113225 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.113207    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/585dfe10-b366-4228-a697-a56b25e4eade-host-slash\") pod \"iptables-alerter-ghl98\" (UID: \"585dfe10-b366-4228-a697-a56b25e4eade\") " pod="openshift-network-operator/iptables-alerter-ghl98"
Jul 29 04:03:56.113443 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.113231    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5308636d-29f2-493b-bec2-22ae9d554fa6-registration-dir\") pod \"aws-ebs-csi-driver-node-ww64c\" (UID: \"5308636d-29f2-493b-bec2-22ae9d554fa6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ww64c"
Jul 29 04:03:56.113443 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.113257    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5308636d-29f2-493b-bec2-22ae9d554fa6-sys-fs\") pod \"aws-ebs-csi-driver-node-ww64c\" (UID: \"5308636d-29f2-493b-bec2-22ae9d554fa6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ww64c"
Jul 29 04:03:56.113443 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.113279    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8644f436-c5c4-433f-92d7-bdc490fe95be-os-release\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.113443 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.113310    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wt8b\" (UniqueName: \"kubernetes.io/projected/790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec-kube-api-access-5wt8b\") pod \"network-metrics-daemon-glpbr\" (UID: \"790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec\") " pod="openshift-multus/network-metrics-daemon-glpbr"
Jul 29 04:03:56.113443 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.113312    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4e738e9c-9ec3-4eee-ba0c-98a66f23cb15-serviceca\") pod \"node-ca-mtfx7\" (UID: \"4e738e9c-9ec3-4eee-ba0c-98a66f23cb15\") " pod="openshift-image-registry/node-ca-mtfx7"
Jul 29 04:03:56.113443 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.113338    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-run-systemd\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.113443 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.113366    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0974adfa-35b7-4dc6-a422-375514f65dc9-lib-modules\") pod \"tuned-4sxfh\" (UID: \"0974adfa-35b7-4dc6-a422-375514f65dc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:56.113443 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.113392    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5308636d-29f2-493b-bec2-22ae9d554fa6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ww64c\" (UID: \"5308636d-29f2-493b-bec2-22ae9d554fa6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ww64c"
Jul 29 04:03:56.113443 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.113417    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8644f436-c5c4-433f-92d7-bdc490fe95be-system-cni-dir\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.113772 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.113441    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8644f436-c5c4-433f-92d7-bdc490fe95be-multus-daemon-config\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.113772 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.113479    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0974adfa-35b7-4dc6-a422-375514f65dc9-etc-sysctl-conf\") pod \"tuned-4sxfh\" (UID: \"0974adfa-35b7-4dc6-a422-375514f65dc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:56.113772 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.113522    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0974adfa-35b7-4dc6-a422-375514f65dc9-run\") pod \"tuned-4sxfh\" (UID: \"0974adfa-35b7-4dc6-a422-375514f65dc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:56.113772 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.113543    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0974adfa-35b7-4dc6-a422-375514f65dc9-sys\") pod \"tuned-4sxfh\" (UID: \"0974adfa-35b7-4dc6-a422-375514f65dc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:56.113772 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.113569    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0974adfa-35b7-4dc6-a422-375514f65dc9-var-lib-kubelet\") pod \"tuned-4sxfh\" (UID: \"0974adfa-35b7-4dc6-a422-375514f65dc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:56.113772 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.113613    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8644f436-c5c4-433f-92d7-bdc490fe95be-multus-cni-dir\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.113772 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.113618    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0974adfa-35b7-4dc6-a422-375514f65dc9-etc-kubernetes\") pod \"tuned-4sxfh\" (UID: \"0974adfa-35b7-4dc6-a422-375514f65dc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:56.113772 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.113635    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8644f436-c5c4-433f-92d7-bdc490fe95be-cnibin\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.113772 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.113665    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-etc-openvswitch\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.113772 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.113701    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-host-cni-bin\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.113772 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.113728    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fn2z\" (UniqueName: \"kubernetes.io/projected/91c78bb4-6179-4fcf-b449-f18b90e0a4f2-kube-api-access-5fn2z\") pod \"network-check-target-b2gqf\" (UID: \"91c78bb4-6179-4fcf-b449-f18b90e0a4f2\") " pod="openshift-network-diagnostics/network-check-target-b2gqf"
Jul 29 04:03:56.113772 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.113764    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f0431314-54c9-4235-a9b8-6cde6d840fe9-hosts-file\") pod \"node-resolver-dnkkq\" (UID: \"f0431314-54c9-4235-a9b8-6cde6d840fe9\") " pod="openshift-dns/node-resolver-dnkkq"
Jul 29 04:03:56.114164 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.113787    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f5975794-9295-4748-9bce-2b0ef3fbeb8d-os-release\") pod \"multus-additional-cni-plugins-kg9jl\" (UID: \"f5975794-9295-4748-9bce-2b0ef3fbeb8d\") " pod="openshift-multus/multus-additional-cni-plugins-kg9jl"
Jul 29 04:03:56.114164 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.113819    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-host-run-netns\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.114164 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.113840    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0974adfa-35b7-4dc6-a422-375514f65dc9-etc-systemd\") pod \"tuned-4sxfh\" (UID: \"0974adfa-35b7-4dc6-a422-375514f65dc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:56.114164 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.113880    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ad8e0e9f-d912-40df-98b5-5e17f77aa631-dbus\") pod \"global-pull-secret-syncer-ftvjm\" (UID: \"ad8e0e9f-d912-40df-98b5-5e17f77aa631\") " pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:03:56.114164 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.113908    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8644f436-c5c4-433f-92d7-bdc490fe95be-multus-socket-dir-parent\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.114164 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.113940    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8644f436-c5c4-433f-92d7-bdc490fe95be-host-var-lib-kubelet\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.114164 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.113972    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8644f436-c5c4-433f-92d7-bdc490fe95be-multus-conf-dir\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.114164 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.114004    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dddb6b6e-32b5-4bcf-85d8-8c4d57451fe9-agent-certs\") pod \"konnectivity-agent-548lx\" (UID: \"dddb6b6e-32b5-4bcf-85d8-8c4d57451fe9\") " pod="kube-system/konnectivity-agent-548lx"
Jul 29 04:03:56.114164 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.114029    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ad8e0e9f-d912-40df-98b5-5e17f77aa631-kubelet-config\") pod \"global-pull-secret-syncer-ftvjm\" (UID: \"ad8e0e9f-d912-40df-98b5-5e17f77aa631\") " pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:03:56.114164 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.114037    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0974adfa-35b7-4dc6-a422-375514f65dc9-host\") pod \"tuned-4sxfh\" (UID: \"0974adfa-35b7-4dc6-a422-375514f65dc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:56.114164 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.114053    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/585dfe10-b366-4228-a697-a56b25e4eade-iptables-alerter-script\") pod \"iptables-alerter-ghl98\" (UID: \"585dfe10-b366-4228-a697-a56b25e4eade\") " pod="openshift-network-operator/iptables-alerter-ghl98"
Jul 29 04:03:56.114164 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.114091    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5308636d-29f2-493b-bec2-22ae9d554fa6-device-dir\") pod \"aws-ebs-csi-driver-node-ww64c\" (UID: \"5308636d-29f2-493b-bec2-22ae9d554fa6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ww64c"
Jul 29 04:03:56.114656 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.114343    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f5975794-9295-4748-9bce-2b0ef3fbeb8d-os-release\") pod \"multus-additional-cni-plugins-kg9jl\" (UID: \"f5975794-9295-4748-9bce-2b0ef3fbeb8d\") " pod="openshift-multus/multus-additional-cni-plugins-kg9jl"
Jul 29 04:03:56.114656 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.114336    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4e738e9c-9ec3-4eee-ba0c-98a66f23cb15-host\") pod \"node-ca-mtfx7\" (UID: \"4e738e9c-9ec3-4eee-ba0c-98a66f23cb15\") " pod="openshift-image-registry/node-ca-mtfx7"
Jul 29 04:03:56.114656 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.114390    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-host-run-netns\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.114656 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.114460    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0974adfa-35b7-4dc6-a422-375514f65dc9-etc-systemd\") pod \"tuned-4sxfh\" (UID: \"0974adfa-35b7-4dc6-a422-375514f65dc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:56.114656 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.114462    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0974adfa-35b7-4dc6-a422-375514f65dc9-lib-modules\") pod \"tuned-4sxfh\" (UID: \"0974adfa-35b7-4dc6-a422-375514f65dc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:56.114656 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.114534    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ad8e0e9f-d912-40df-98b5-5e17f77aa631-dbus\") pod \"global-pull-secret-syncer-ftvjm\" (UID: \"ad8e0e9f-d912-40df-98b5-5e17f77aa631\") " pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:03:56.114656 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.114610    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ad8e0e9f-d912-40df-98b5-5e17f77aa631-kubelet-config\") pod \"global-pull-secret-syncer-ftvjm\" (UID: \"ad8e0e9f-d912-40df-98b5-5e17f77aa631\") " pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:03:56.114971 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.114735    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/585dfe10-b366-4228-a697-a56b25e4eade-host-slash\") pod \"iptables-alerter-ghl98\" (UID: \"585dfe10-b366-4228-a697-a56b25e4eade\") " pod="openshift-network-operator/iptables-alerter-ghl98"
Jul 29 04:03:56.114971 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.114939    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-run-systemd\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.115078 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.114977    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/585dfe10-b366-4228-a697-a56b25e4eade-iptables-alerter-script\") pod \"iptables-alerter-ghl98\" (UID: \"585dfe10-b366-4228-a697-a56b25e4eade\") " pod="openshift-network-operator/iptables-alerter-ghl98"
Jul 29 04:03:56.115078 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.115034    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8644f436-c5c4-433f-92d7-bdc490fe95be-host-run-k8s-cni-cncf-io\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.115191 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.115087    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8644f436-c5c4-433f-92d7-bdc490fe95be-hostroot\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.115191 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.115096    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0974adfa-35b7-4dc6-a422-375514f65dc9-etc-sysctl-conf\") pod \"tuned-4sxfh\" (UID: \"0974adfa-35b7-4dc6-a422-375514f65dc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:56.115191 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.115115    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8644f436-c5c4-433f-92d7-bdc490fe95be-etc-kubernetes\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.115191 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.115143    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0974adfa-35b7-4dc6-a422-375514f65dc9-sys\") pod \"tuned-4sxfh\" (UID: \"0974adfa-35b7-4dc6-a422-375514f65dc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:56.115191 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.115148    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wszvj\" (UniqueName: \"kubernetes.io/projected/0974adfa-35b7-4dc6-a422-375514f65dc9-kube-api-access-wszvj\") pod \"tuned-4sxfh\" (UID: \"0974adfa-35b7-4dc6-a422-375514f65dc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:56.115569 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.115219    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dddb6b6e-32b5-4bcf-85d8-8c4d57451fe9-konnectivity-ca\") pod \"konnectivity-agent-548lx\" (UID: \"dddb6b6e-32b5-4bcf-85d8-8c4d57451fe9\") " pod="kube-system/konnectivity-agent-548lx"
Jul 29 04:03:56.115569 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.115198    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-etc-openvswitch\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.115569 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.115253    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhbht\" (UniqueName: \"kubernetes.io/projected/585dfe10-b366-4228-a697-a56b25e4eade-kube-api-access-vhbht\") pod \"iptables-alerter-ghl98\" (UID: \"585dfe10-b366-4228-a697-a56b25e4eade\") " pod="openshift-network-operator/iptables-alerter-ghl98"
Jul 29 04:03:56.115569 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.115274    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-host-cni-bin\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.115569 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.114982    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0431314-54c9-4235-a9b8-6cde6d840fe9-tmp-dir\") pod \"node-resolver-dnkkq\" (UID: \"f0431314-54c9-4235-a9b8-6cde6d840fe9\") " pod="openshift-dns/node-resolver-dnkkq"
Jul 29 04:03:56.115569 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.115417    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3228b431-6b56-463f-ab47-5cd22ba06905-ovnkube-config\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.115569 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.115468    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0974adfa-35b7-4dc6-a422-375514f65dc9-var-lib-kubelet\") pod \"tuned-4sxfh\" (UID: \"0974adfa-35b7-4dc6-a422-375514f65dc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:56.115569 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.115527    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-host-run-ovn-kubernetes\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.115569 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.115547    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0974adfa-35b7-4dc6-a422-375514f65dc9-run\") pod \"tuned-4sxfh\" (UID: \"0974adfa-35b7-4dc6-a422-375514f65dc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:56.115569 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.115589    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f0431314-54c9-4235-a9b8-6cde6d840fe9-hosts-file\") pod \"node-resolver-dnkkq\" (UID: \"f0431314-54c9-4235-a9b8-6cde6d840fe9\") " pod="openshift-dns/node-resolver-dnkkq"
Jul 29 04:03:56.116140 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.115635    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8644f436-c5c4-433f-92d7-bdc490fe95be-host-run-multus-certs\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.116140 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.115671    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5975794-9295-4748-9bce-2b0ef3fbeb8d-system-cni-dir\") pod \"multus-additional-cni-plugins-kg9jl\" (UID: \"f5975794-9295-4748-9bce-2b0ef3fbeb8d\") " pod="openshift-multus/multus-additional-cni-plugins-kg9jl"
Jul 29 04:03:56.116140 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.115699    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-host-cni-netd\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.116140 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.115725    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0974adfa-35b7-4dc6-a422-375514f65dc9-etc-modprobe-d\") pod \"tuned-4sxfh\" (UID: \"0974adfa-35b7-4dc6-a422-375514f65dc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:56.116140 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.115753    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db9rg\" (UniqueName: \"kubernetes.io/projected/5308636d-29f2-493b-bec2-22ae9d554fa6-kube-api-access-db9rg\") pod \"aws-ebs-csi-driver-node-ww64c\" (UID: \"5308636d-29f2-493b-bec2-22ae9d554fa6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ww64c"
Jul 29 04:03:56.116140 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.115780    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-run-openvswitch\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.116140 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.115830    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5308636d-29f2-493b-bec2-22ae9d554fa6-etc-selinux\") pod \"aws-ebs-csi-driver-node-ww64c\" (UID: \"5308636d-29f2-493b-bec2-22ae9d554fa6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ww64c"
Jul 29 04:03:56.116140 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.115857    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-host-slash\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.116140 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.115885    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8644f436-c5c4-433f-92d7-bdc490fe95be-host-var-lib-cni-multus\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.116140 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.115916    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbtfb\" (UniqueName: \"kubernetes.io/projected/8644f436-c5c4-433f-92d7-bdc490fe95be-kube-api-access-qbtfb\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.116140 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.115942    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec-metrics-certs\") pod \"network-metrics-daemon-glpbr\" (UID: \"790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec\") " pod="openshift-multus/network-metrics-daemon-glpbr"
Jul 29 04:03:56.116140 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.115957    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-var-lib-openvswitch\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.116140 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.115975    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f5975794-9295-4748-9bce-2b0ef3fbeb8d-cnibin\") pod \"multus-additional-cni-plugins-kg9jl\" (UID: \"f5975794-9295-4748-9bce-2b0ef3fbeb8d\") " pod="openshift-multus/multus-additional-cni-plugins-kg9jl"
Jul 29 04:03:56.116140 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.116023    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f5975794-9295-4748-9bce-2b0ef3fbeb8d-cnibin\") pod \"multus-additional-cni-plugins-kg9jl\" (UID: \"f5975794-9295-4748-9bce-2b0ef3fbeb8d\") " pod="openshift-multus/multus-additional-cni-plugins-kg9jl"
Jul 29 04:03:56.116140 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.116058    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-run-openvswitch\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.116140 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.116059    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3228b431-6b56-463f-ab47-5cd22ba06905-env-overrides\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.117026 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.116183    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f5975794-9295-4748-9bce-2b0ef3fbeb8d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kg9jl\" (UID: \"f5975794-9295-4748-9bce-2b0ef3fbeb8d\") " pod="openshift-multus/multus-additional-cni-plugins-kg9jl"
Jul 29 04:03:56.117026 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.115915    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f5975794-9295-4748-9bce-2b0ef3fbeb8d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kg9jl\" (UID: \"f5975794-9295-4748-9bce-2b0ef3fbeb8d\") " pod="openshift-multus/multus-additional-cni-plugins-kg9jl"
Jul 29 04:03:56.117026 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.116221    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dddb6b6e-32b5-4bcf-85d8-8c4d57451fe9-konnectivity-ca\") pod \"konnectivity-agent-548lx\" (UID: \"dddb6b6e-32b5-4bcf-85d8-8c4d57451fe9\") " pod="kube-system/konnectivity-agent-548lx"
Jul 29 04:03:56.117026 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.116250    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-run-ovn\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.117026 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.116375    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5975794-9295-4748-9bce-2b0ef3fbeb8d-system-cni-dir\") pod \"multus-additional-cni-plugins-kg9jl\" (UID: \"f5975794-9295-4748-9bce-2b0ef3fbeb8d\") " pod="openshift-multus/multus-additional-cni-plugins-kg9jl"
Jul 29 04:03:56.117026 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.116408    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-host-cni-netd\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.117026 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.116428    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0974adfa-35b7-4dc6-a422-375514f65dc9-etc-sysconfig\") pod \"tuned-4sxfh\" (UID: \"0974adfa-35b7-4dc6-a422-375514f65dc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:56.117026 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.116465    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-log-socket\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.117026 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.116520    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0974adfa-35b7-4dc6-a422-375514f65dc9-etc-modprobe-d\") pod \"tuned-4sxfh\" (UID: \"0974adfa-35b7-4dc6-a422-375514f65dc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:56.117026 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.116525    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.117026 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.116572    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8644f436-c5c4-433f-92d7-bdc490fe95be-cni-binary-copy\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.117026 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.116621    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-host-slash\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.117026 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.116675    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-log-socket\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.117026 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.116722    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-run-ovn\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.117026 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.116768    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3228b431-6b56-463f-ab47-5cd22ba06905-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.117832 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.117690    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dddb6b6e-32b5-4bcf-85d8-8c4d57451fe9-agent-certs\") pod \"konnectivity-agent-548lx\" (UID: \"dddb6b6e-32b5-4bcf-85d8-8c4d57451fe9\") " pod="kube-system/konnectivity-agent-548lx"
Jul 29 04:03:56.118292 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.118270    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0974adfa-35b7-4dc6-a422-375514f65dc9-etc-tuned\") pod \"tuned-4sxfh\" (UID: \"0974adfa-35b7-4dc6-a422-375514f65dc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:56.119232 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.119189    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3228b431-6b56-463f-ab47-5cd22ba06905-ovn-node-metrics-cert\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.120066 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:56.119899    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 04:03:56.120066 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:56.119924    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 04:03:56.120066 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:56.119936    2572 projected.go:196] Error preparing data for projected volume kube-api-access-5fn2z for pod openshift-network-diagnostics/network-check-target-b2gqf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 04:03:56.120066 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:56.120041    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91c78bb4-6179-4fcf-b449-f18b90e0a4f2-kube-api-access-5fn2z podName:91c78bb4-6179-4fcf-b449-f18b90e0a4f2 nodeName:}" failed. No retries permitted until 2026-07-29 04:03:56.620023079 +0000 UTC m=+3.053061186 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5fn2z" (UniqueName: "kubernetes.io/projected/91c78bb4-6179-4fcf-b449-f18b90e0a4f2-kube-api-access-5fn2z") pod "network-check-target-b2gqf" (UID: "91c78bb4-6179-4fcf-b449-f18b90e0a4f2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 04:03:56.121454 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.121166    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0974adfa-35b7-4dc6-a422-375514f65dc9-tmp\") pod \"tuned-4sxfh\" (UID: \"0974adfa-35b7-4dc6-a422-375514f65dc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:56.121454 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.121380    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-966t4\" (UniqueName: \"kubernetes.io/projected/f5975794-9295-4748-9bce-2b0ef3fbeb8d-kube-api-access-966t4\") pod \"multus-additional-cni-plugins-kg9jl\" (UID: \"f5975794-9295-4748-9bce-2b0ef3fbeb8d\") " pod="openshift-multus/multus-additional-cni-plugins-kg9jl"
Jul 29 04:03:56.121632 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.121460    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtgz7\" (UniqueName: \"kubernetes.io/projected/4e738e9c-9ec3-4eee-ba0c-98a66f23cb15-kube-api-access-qtgz7\") pod \"node-ca-mtfx7\" (UID: \"4e738e9c-9ec3-4eee-ba0c-98a66f23cb15\") " pod="openshift-image-registry/node-ca-mtfx7"
Jul 29 04:03:56.125526 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.123111    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmp2d\" (UniqueName: \"kubernetes.io/projected/3228b431-6b56-463f-ab47-5cd22ba06905-kube-api-access-gmp2d\") pod \"ovnkube-node-6z6p8\" (UID: \"3228b431-6b56-463f-ab47-5cd22ba06905\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.125526 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.123481    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp7lq\" (UniqueName: \"kubernetes.io/projected/f0431314-54c9-4235-a9b8-6cde6d840fe9-kube-api-access-sp7lq\") pod \"node-resolver-dnkkq\" (UID: \"f0431314-54c9-4235-a9b8-6cde6d840fe9\") " pod="openshift-dns/node-resolver-dnkkq"
Jul 29 04:03:56.125526 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.125244    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wszvj\" (UniqueName: \"kubernetes.io/projected/0974adfa-35b7-4dc6-a422-375514f65dc9-kube-api-access-wszvj\") pod \"tuned-4sxfh\" (UID: \"0974adfa-35b7-4dc6-a422-375514f65dc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:56.127558 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.127530    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhbht\" (UniqueName: \"kubernetes.io/projected/585dfe10-b366-4228-a697-a56b25e4eade-kube-api-access-vhbht\") pod \"iptables-alerter-ghl98\" (UID: \"585dfe10-b366-4228-a697-a56b25e4eade\") " pod="openshift-network-operator/iptables-alerter-ghl98"
Jul 29 04:03:56.217182 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.217107    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8644f436-c5c4-433f-92d7-bdc490fe95be-host-run-multus-certs\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.217182 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.217146    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db9rg\" (UniqueName: \"kubernetes.io/projected/5308636d-29f2-493b-bec2-22ae9d554fa6-kube-api-access-db9rg\") pod \"aws-ebs-csi-driver-node-ww64c\" (UID: \"5308636d-29f2-493b-bec2-22ae9d554fa6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ww64c"
Jul 29 04:03:56.217182 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.217175    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5308636d-29f2-493b-bec2-22ae9d554fa6-etc-selinux\") pod \"aws-ebs-csi-driver-node-ww64c\" (UID: \"5308636d-29f2-493b-bec2-22ae9d554fa6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ww64c"
Jul 29 04:03:56.217412 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.217200    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8644f436-c5c4-433f-92d7-bdc490fe95be-host-var-lib-cni-multus\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.217412 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.217224    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbtfb\" (UniqueName: \"kubernetes.io/projected/8644f436-c5c4-433f-92d7-bdc490fe95be-kube-api-access-qbtfb\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.217412 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.217243    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec-metrics-certs\") pod \"network-metrics-daemon-glpbr\" (UID: \"790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec\") " pod="openshift-multus/network-metrics-daemon-glpbr"
Jul 29 04:03:56.217412 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.217260    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8644f436-c5c4-433f-92d7-bdc490fe95be-cni-binary-copy\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.217412 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.217297    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8644f436-c5c4-433f-92d7-bdc490fe95be-host-var-lib-cni-bin\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.217412 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.217336    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5308636d-29f2-493b-bec2-22ae9d554fa6-etc-selinux\") pod \"aws-ebs-csi-driver-node-ww64c\" (UID: \"5308636d-29f2-493b-bec2-22ae9d554fa6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ww64c"
Jul 29 04:03:56.217412 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.217337    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5308636d-29f2-493b-bec2-22ae9d554fa6-socket-dir\") pod \"aws-ebs-csi-driver-node-ww64c\" (UID: \"5308636d-29f2-493b-bec2-22ae9d554fa6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ww64c"
Jul 29 04:03:56.217412 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.217389    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8644f436-c5c4-433f-92d7-bdc490fe95be-host-run-netns\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.217412 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.217407    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5308636d-29f2-493b-bec2-22ae9d554fa6-registration-dir\") pod \"aws-ebs-csi-driver-node-ww64c\" (UID: \"5308636d-29f2-493b-bec2-22ae9d554fa6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ww64c"
Jul 29 04:03:56.217816 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.217423    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5308636d-29f2-493b-bec2-22ae9d554fa6-sys-fs\") pod \"aws-ebs-csi-driver-node-ww64c\" (UID: \"5308636d-29f2-493b-bec2-22ae9d554fa6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ww64c"
Jul 29 04:03:56.217816 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.217440    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8644f436-c5c4-433f-92d7-bdc490fe95be-os-release\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.217816 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.217452    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5308636d-29f2-493b-bec2-22ae9d554fa6-socket-dir\") pod \"aws-ebs-csi-driver-node-ww64c\" (UID: \"5308636d-29f2-493b-bec2-22ae9d554fa6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ww64c"
Jul 29 04:03:56.217816 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.217518    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8644f436-c5c4-433f-92d7-bdc490fe95be-host-run-netns\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.217816 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.217523    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8644f436-c5c4-433f-92d7-bdc490fe95be-os-release\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.217816 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.217536    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5308636d-29f2-493b-bec2-22ae9d554fa6-sys-fs\") pod \"aws-ebs-csi-driver-node-ww64c\" (UID: \"5308636d-29f2-493b-bec2-22ae9d554fa6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ww64c"
Jul 29 04:03:56.217816 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.217555    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5308636d-29f2-493b-bec2-22ae9d554fa6-registration-dir\") pod \"aws-ebs-csi-driver-node-ww64c\" (UID: \"5308636d-29f2-493b-bec2-22ae9d554fa6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ww64c"
Jul 29 04:03:56.217816 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.217564    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8644f436-c5c4-433f-92d7-bdc490fe95be-host-var-lib-cni-multus\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.217816 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:56.217632    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 04:03:56.217816 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:56.217682    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec-metrics-certs podName:790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec nodeName:}" failed. No retries permitted until 2026-07-29 04:03:56.717665477 +0000 UTC m=+3.150703568 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec-metrics-certs") pod "network-metrics-daemon-glpbr" (UID: "790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 04:03:56.217816 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.217220    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8644f436-c5c4-433f-92d7-bdc490fe95be-host-run-multus-certs\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.217816 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.217781    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8644f436-c5c4-433f-92d7-bdc490fe95be-host-var-lib-cni-bin\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.217816 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.217815    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wt8b\" (UniqueName: \"kubernetes.io/projected/790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec-kube-api-access-5wt8b\") pod \"network-metrics-daemon-glpbr\" (UID: \"790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec\") " pod="openshift-multus/network-metrics-daemon-glpbr"
Jul 29 04:03:56.218371 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.217846    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5308636d-29f2-493b-bec2-22ae9d554fa6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ww64c\" (UID: \"5308636d-29f2-493b-bec2-22ae9d554fa6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ww64c"
Jul 29 04:03:56.218371 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.217869    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8644f436-c5c4-433f-92d7-bdc490fe95be-system-cni-dir\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.218371 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.217892    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8644f436-c5c4-433f-92d7-bdc490fe95be-multus-daemon-config\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.218371 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.217926    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8644f436-c5c4-433f-92d7-bdc490fe95be-multus-cni-dir\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.218371 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.217948    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8644f436-c5c4-433f-92d7-bdc490fe95be-cnibin\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.218371 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.217991    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8644f436-c5c4-433f-92d7-bdc490fe95be-multus-socket-dir-parent\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.218371 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.218015    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8644f436-c5c4-433f-92d7-bdc490fe95be-host-var-lib-kubelet\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.218371 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.218023    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8644f436-c5c4-433f-92d7-bdc490fe95be-system-cni-dir\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.218371 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.218037    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8644f436-c5c4-433f-92d7-bdc490fe95be-multus-conf-dir\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.218371 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.218066    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5308636d-29f2-493b-bec2-22ae9d554fa6-device-dir\") pod \"aws-ebs-csi-driver-node-ww64c\" (UID: \"5308636d-29f2-493b-bec2-22ae9d554fa6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ww64c"
Jul 29 04:03:56.218371 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.218073    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5308636d-29f2-493b-bec2-22ae9d554fa6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ww64c\" (UID: \"5308636d-29f2-493b-bec2-22ae9d554fa6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ww64c"
Jul 29 04:03:56.218371 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.218079    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8644f436-c5c4-433f-92d7-bdc490fe95be-cnibin\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.218371 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.218089    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8644f436-c5c4-433f-92d7-bdc490fe95be-host-run-k8s-cni-cncf-io\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.218371 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.218112    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8644f436-c5c4-433f-92d7-bdc490fe95be-hostroot\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.218371 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.218121    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8644f436-c5c4-433f-92d7-bdc490fe95be-multus-cni-dir\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.218371 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.218038    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8644f436-c5c4-433f-92d7-bdc490fe95be-cni-binary-copy\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.218371 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.218134    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8644f436-c5c4-433f-92d7-bdc490fe95be-etc-kubernetes\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.218371 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.218192    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8644f436-c5c4-433f-92d7-bdc490fe95be-host-run-k8s-cni-cncf-io\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.218997 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.218198    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8644f436-c5c4-433f-92d7-bdc490fe95be-multus-conf-dir\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.218997 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.218237    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5308636d-29f2-493b-bec2-22ae9d554fa6-device-dir\") pod \"aws-ebs-csi-driver-node-ww64c\" (UID: \"5308636d-29f2-493b-bec2-22ae9d554fa6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ww64c"
Jul 29 04:03:56.218997 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.218236    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8644f436-c5c4-433f-92d7-bdc490fe95be-hostroot\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.218997 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.218274    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8644f436-c5c4-433f-92d7-bdc490fe95be-etc-kubernetes\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.218997 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.218283    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8644f436-c5c4-433f-92d7-bdc490fe95be-multus-socket-dir-parent\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.218997 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.218304    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8644f436-c5c4-433f-92d7-bdc490fe95be-host-var-lib-kubelet\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.218997 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.218531    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8644f436-c5c4-433f-92d7-bdc490fe95be-multus-daemon-config\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.226249 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.226226    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-db9rg\" (UniqueName: \"kubernetes.io/projected/5308636d-29f2-493b-bec2-22ae9d554fa6-kube-api-access-db9rg\") pod \"aws-ebs-csi-driver-node-ww64c\" (UID: \"5308636d-29f2-493b-bec2-22ae9d554fa6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ww64c"
Jul 29 04:03:56.226559 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.226531    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbtfb\" (UniqueName: \"kubernetes.io/projected/8644f436-c5c4-433f-92d7-bdc490fe95be-kube-api-access-qbtfb\") pod \"multus-lmjvb\" (UID: \"8644f436-c5c4-433f-92d7-bdc490fe95be\") " pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.227017 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.226993    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wt8b\" (UniqueName: \"kubernetes.io/projected/790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec-kube-api-access-5wt8b\") pod \"network-metrics-daemon-glpbr\" (UID: \"790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec\") " pod="openshift-multus/network-metrics-daemon-glpbr"
Jul 29 04:03:56.290484 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.290443    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:03:56.298437 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.298414    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ghl98"
Jul 29 04:03:56.313281 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.313255    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dnkkq"
Jul 29 04:03:56.320167 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.320146    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mtfx7"
Jul 29 04:03:56.330463 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.330444    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kg9jl"
Jul 29 04:03:56.337224 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.337205    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4sxfh"
Jul 29 04:03:56.345147 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.345130    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-548lx"
Jul 29 04:03:56.352904 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.352882    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lmjvb"
Jul 29 04:03:56.359696 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.359674    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ww64c"
Jul 29 04:03:56.621376 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.621347    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad8e0e9f-d912-40df-98b5-5e17f77aa631-original-pull-secret\") pod \"global-pull-secret-syncer-ftvjm\" (UID: \"ad8e0e9f-d912-40df-98b5-5e17f77aa631\") " pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:03:56.621551 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.621400    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fn2z\" (UniqueName: \"kubernetes.io/projected/91c78bb4-6179-4fcf-b449-f18b90e0a4f2-kube-api-access-5fn2z\") pod \"network-check-target-b2gqf\" (UID: \"91c78bb4-6179-4fcf-b449-f18b90e0a4f2\") " pod="openshift-network-diagnostics/network-check-target-b2gqf"
Jul 29 04:03:56.621551 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:56.621493    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 04:03:56.621644 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:56.621558    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 04:03:56.621644 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:56.621577    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad8e0e9f-d912-40df-98b5-5e17f77aa631-original-pull-secret podName:ad8e0e9f-d912-40df-98b5-5e17f77aa631 nodeName:}" failed. No retries permitted until 2026-07-29 04:03:57.621559275 +0000 UTC m=+4.054597380 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ad8e0e9f-d912-40df-98b5-5e17f77aa631-original-pull-secret") pod "global-pull-secret-syncer-ftvjm" (UID: "ad8e0e9f-d912-40df-98b5-5e17f77aa631") : object "kube-system"/"original-pull-secret" not registered
Jul 29 04:03:56.621644 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:56.621578    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 04:03:56.621644 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:56.621593    2572 projected.go:196] Error preparing data for projected volume kube-api-access-5fn2z for pod openshift-network-diagnostics/network-check-target-b2gqf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 04:03:56.621644 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:56.621629    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91c78bb4-6179-4fcf-b449-f18b90e0a4f2-kube-api-access-5fn2z podName:91c78bb4-6179-4fcf-b449-f18b90e0a4f2 nodeName:}" failed. No retries permitted until 2026-07-29 04:03:57.621617216 +0000 UTC m=+4.054655306 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5fn2z" (UniqueName: "kubernetes.io/projected/91c78bb4-6179-4fcf-b449-f18b90e0a4f2-kube-api-access-5fn2z") pod "network-check-target-b2gqf" (UID: "91c78bb4-6179-4fcf-b449-f18b90e0a4f2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 04:03:56.722689 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:56.722654    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec-metrics-certs\") pod \"network-metrics-daemon-glpbr\" (UID: \"790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec\") " pod="openshift-multus/network-metrics-daemon-glpbr"
Jul 29 04:03:56.722850 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:56.722783    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 04:03:56.722934 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:56.722853    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec-metrics-certs podName:790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec nodeName:}" failed. No retries permitted until 2026-07-29 04:03:57.722831798 +0000 UTC m=+4.155869892 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec-metrics-certs") pod "network-metrics-daemon-glpbr" (UID: "790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 04:03:57.041561 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:57.041444    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 03:58:55 +0000 UTC" deadline="2028-02-28 12:49:38.593319131 +0000 UTC"
Jul 29 04:03:57.041561 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:57.041518    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13904h45m41.551824735s"
Jul 29 04:03:57.123165 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:57.123133    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod585dfe10_b366_4228_a697_a56b25e4eade.slice/crio-cf2c7a35a30163403225f48ad6bcc9efa2c86594cbe1c5f5dbcc370604547ca4 WatchSource:0}: Error finding container cf2c7a35a30163403225f48ad6bcc9efa2c86594cbe1c5f5dbcc370604547ca4: Status 404 returned error can't find the container with id cf2c7a35a30163403225f48ad6bcc9efa2c86594cbe1c5f5dbcc370604547ca4
Jul 29 04:03:57.124932 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:57.124520    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5308636d_29f2_493b_bec2_22ae9d554fa6.slice/crio-498552a525afe60d2bc4aba37f9515f564128e4e31a163c6947771576b35c90a WatchSource:0}: Error finding container 498552a525afe60d2bc4aba37f9515f564128e4e31a163c6947771576b35c90a: Status 404 returned error can't find the container with id 498552a525afe60d2bc4aba37f9515f564128e4e31a163c6947771576b35c90a
Jul 29 04:03:57.128628 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:57.128602    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0974adfa_35b7_4dc6_a422_375514f65dc9.slice/crio-4f0f8271732e48e790ba73d1a291ce8d9369b49e7230bec56bd6cb3fdd41bf68 WatchSource:0}: Error finding container 4f0f8271732e48e790ba73d1a291ce8d9369b49e7230bec56bd6cb3fdd41bf68: Status 404 returned error can't find the container with id 4f0f8271732e48e790ba73d1a291ce8d9369b49e7230bec56bd6cb3fdd41bf68
Jul 29 04:03:57.130761 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:57.130738    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3228b431_6b56_463f_ab47_5cd22ba06905.slice/crio-6165ffb515952909587cde1b0596a44dcb43eb76b03e0726281bfa959d451643 WatchSource:0}: Error finding container 6165ffb515952909587cde1b0596a44dcb43eb76b03e0726281bfa959d451643: Status 404 returned error can't find the container with id 6165ffb515952909587cde1b0596a44dcb43eb76b03e0726281bfa959d451643
Jul 29 04:03:57.132178 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:57.132157    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0431314_54c9_4235_a9b8_6cde6d840fe9.slice/crio-ddc408c5ce6af9e3548f24fa033eaebaaa931ef75e697ce5a1df88525ef36cb2 WatchSource:0}: Error finding container ddc408c5ce6af9e3548f24fa033eaebaaa931ef75e697ce5a1df88525ef36cb2: Status 404 returned error can't find the container with id ddc408c5ce6af9e3548f24fa033eaebaaa931ef75e697ce5a1df88525ef36cb2
Jul 29 04:03:57.132424 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:57.132395    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddddb6b6e_32b5_4bcf_85d8_8c4d57451fe9.slice/crio-4b8ceaeec9f7b69038d810513a3de63ac8844e4829f13d60f1c0c3070f216096 WatchSource:0}: Error finding container 4b8ceaeec9f7b69038d810513a3de63ac8844e4829f13d60f1c0c3070f216096: Status 404 returned error can't find the container with id 4b8ceaeec9f7b69038d810513a3de63ac8844e4829f13d60f1c0c3070f216096
Jul 29 04:03:57.133707 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:03:57.133477    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8644f436_c5c4_433f_92d7_bdc490fe95be.slice/crio-2c2dbd68c7044e5abe558f1a080d3251d0a207553854fb760b1ba581016a07be WatchSource:0}: Error finding container 2c2dbd68c7044e5abe558f1a080d3251d0a207553854fb760b1ba581016a07be: Status 404 returned error can't find the container with id 2c2dbd68c7044e5abe558f1a080d3251d0a207553854fb760b1ba581016a07be
Jul 29 04:03:57.149363 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:57.149334    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-548lx" event={"ID":"dddb6b6e-32b5-4bcf-85d8-8c4d57451fe9","Type":"ContainerStarted","Data":"4b8ceaeec9f7b69038d810513a3de63ac8844e4829f13d60f1c0c3070f216096"}
Jul 29 04:03:57.153421 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:57.153394    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dnkkq" event={"ID":"f0431314-54c9-4235-a9b8-6cde6d840fe9","Type":"ContainerStarted","Data":"ddc408c5ce6af9e3548f24fa033eaebaaa931ef75e697ce5a1df88525ef36cb2"}
Jul 29 04:03:57.154836 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:57.154816    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8" event={"ID":"3228b431-6b56-463f-ab47-5cd22ba06905","Type":"ContainerStarted","Data":"6165ffb515952909587cde1b0596a44dcb43eb76b03e0726281bfa959d451643"}
Jul 29 04:03:57.155983 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:57.155965    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4sxfh" event={"ID":"0974adfa-35b7-4dc6-a422-375514f65dc9","Type":"ContainerStarted","Data":"4f0f8271732e48e790ba73d1a291ce8d9369b49e7230bec56bd6cb3fdd41bf68"}
Jul 29 04:03:57.156951 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:57.156933    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ww64c" event={"ID":"5308636d-29f2-493b-bec2-22ae9d554fa6","Type":"ContainerStarted","Data":"498552a525afe60d2bc4aba37f9515f564128e4e31a163c6947771576b35c90a"}
Jul 29 04:03:57.157886 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:57.157868    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ghl98" event={"ID":"585dfe10-b366-4228-a697-a56b25e4eade","Type":"ContainerStarted","Data":"cf2c7a35a30163403225f48ad6bcc9efa2c86594cbe1c5f5dbcc370604547ca4"}
Jul 29 04:03:57.158960 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:57.158942    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg9jl" event={"ID":"f5975794-9295-4748-9bce-2b0ef3fbeb8d","Type":"ContainerStarted","Data":"f5a28eda7a48ecc4860e666cc7c96d2b15c5870a1ccf9191cde8bd446ca19ef9"}
Jul 29 04:03:57.159987 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:57.159959    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mtfx7" event={"ID":"4e738e9c-9ec3-4eee-ba0c-98a66f23cb15","Type":"ContainerStarted","Data":"c8d80730955781a6176bc52419df2b6d3485a8fa59955caca924acf1c29984d5"}
Jul 29 04:03:57.160935 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:57.160916    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lmjvb" event={"ID":"8644f436-c5c4-433f-92d7-bdc490fe95be","Type":"ContainerStarted","Data":"2c2dbd68c7044e5abe558f1a080d3251d0a207553854fb760b1ba581016a07be"}
Jul 29 04:03:57.629704 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:57.629012    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad8e0e9f-d912-40df-98b5-5e17f77aa631-original-pull-secret\") pod \"global-pull-secret-syncer-ftvjm\" (UID: \"ad8e0e9f-d912-40df-98b5-5e17f77aa631\") " pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:03:57.629704 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:57.629292    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 04:03:57.629704 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:57.629335    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fn2z\" (UniqueName: \"kubernetes.io/projected/91c78bb4-6179-4fcf-b449-f18b90e0a4f2-kube-api-access-5fn2z\") pod \"network-check-target-b2gqf\" (UID: \"91c78bb4-6179-4fcf-b449-f18b90e0a4f2\") " pod="openshift-network-diagnostics/network-check-target-b2gqf"
Jul 29 04:03:57.629704 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:57.629373    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad8e0e9f-d912-40df-98b5-5e17f77aa631-original-pull-secret podName:ad8e0e9f-d912-40df-98b5-5e17f77aa631 nodeName:}" failed. No retries permitted until 2026-07-29 04:03:59.629349885 +0000 UTC m=+6.062388000 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ad8e0e9f-d912-40df-98b5-5e17f77aa631-original-pull-secret") pod "global-pull-secret-syncer-ftvjm" (UID: "ad8e0e9f-d912-40df-98b5-5e17f77aa631") : object "kube-system"/"original-pull-secret" not registered
Jul 29 04:03:57.629704 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:57.629450    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 04:03:57.629704 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:57.629468    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 04:03:57.629704 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:57.629479    2572 projected.go:196] Error preparing data for projected volume kube-api-access-5fn2z for pod openshift-network-diagnostics/network-check-target-b2gqf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 04:03:57.629704 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:57.629552    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91c78bb4-6179-4fcf-b449-f18b90e0a4f2-kube-api-access-5fn2z podName:91c78bb4-6179-4fcf-b449-f18b90e0a4f2 nodeName:}" failed. No retries permitted until 2026-07-29 04:03:59.629534342 +0000 UTC m=+6.062572436 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5fn2z" (UniqueName: "kubernetes.io/projected/91c78bb4-6179-4fcf-b449-f18b90e0a4f2-kube-api-access-5fn2z") pod "network-check-target-b2gqf" (UID: "91c78bb4-6179-4fcf-b449-f18b90e0a4f2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 04:03:57.730589 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:57.729942    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec-metrics-certs\") pod \"network-metrics-daemon-glpbr\" (UID: \"790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec\") " pod="openshift-multus/network-metrics-daemon-glpbr"
Jul 29 04:03:57.730589 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:57.730147    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 04:03:57.730589 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:57.730219    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec-metrics-certs podName:790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec nodeName:}" failed. No retries permitted until 2026-07-29 04:03:59.730198584 +0000 UTC m=+6.163236691 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec-metrics-certs") pod "network-metrics-daemon-glpbr" (UID: "790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 04:03:58.142705 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:58.142675    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2gqf"
Jul 29 04:03:58.142705 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:58.142703    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glpbr"
Jul 29 04:03:58.143186 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:58.142686    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:03:58.143186 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:58.142796    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b2gqf" podUID="91c78bb4-6179-4fcf-b449-f18b90e0a4f2"
Jul 29 04:03:58.143186 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:58.142935    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvjm" podUID="ad8e0e9f-d912-40df-98b5-5e17f77aa631"
Jul 29 04:03:58.143186 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:58.143052    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glpbr" podUID="790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec"
Jul 29 04:03:58.167386 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:58.167351    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-4.ec2.internal" event={"ID":"9c7cb484c0a90a7b37dbbc2d4d151971","Type":"ContainerStarted","Data":"205175bb5a4d1204af4b3ef794d6f338220cc41c3f53145dd5c709efc388dbe1"}
Jul 29 04:03:58.180771 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:58.180738    2572 generic.go:356] "Generic (PLEG): container finished" podID="66a3408ad1007acac3a6a8bc92311bca" containerID="f656eef0950e58a3b1da14c9140bb17333328aa2dbe8443f6fe9a3b2b1788893" exitCode=0
Jul 29 04:03:58.180942 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:58.180784    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-4.ec2.internal" event={"ID":"66a3408ad1007acac3a6a8bc92311bca","Type":"ContainerDied","Data":"f656eef0950e58a3b1da14c9140bb17333328aa2dbe8443f6fe9a3b2b1788893"}
Jul 29 04:03:58.185315 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:58.185258    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-4.ec2.internal" podStartSLOduration=4.185234862 podStartE2EDuration="4.185234862s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 04:03:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:03:58.184838241 +0000 UTC m=+4.617876359" watchObservedRunningTime="2026-07-29 04:03:58.185234862 +0000 UTC m=+4.618272977"
Jul 29 04:03:59.219264 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:59.219198    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-4.ec2.internal" event={"ID":"66a3408ad1007acac3a6a8bc92311bca","Type":"ContainerStarted","Data":"b2a5c80072e208bcff79fb7ebd2391ce45aa170b66f5a94e29b8ddc37b206c69"}
Jul 29 04:03:59.234365 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:59.234308    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-4.ec2.internal" podStartSLOduration=4.234285492 podStartE2EDuration="4.234285492s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 04:03:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:03:59.233642293 +0000 UTC m=+5.666680406" watchObservedRunningTime="2026-07-29 04:03:59.234285492 +0000 UTC m=+5.667323606"
Jul 29 04:03:59.647222 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:59.646394    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fn2z\" (UniqueName: \"kubernetes.io/projected/91c78bb4-6179-4fcf-b449-f18b90e0a4f2-kube-api-access-5fn2z\") pod \"network-check-target-b2gqf\" (UID: \"91c78bb4-6179-4fcf-b449-f18b90e0a4f2\") " pod="openshift-network-diagnostics/network-check-target-b2gqf"
Jul 29 04:03:59.647222 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:59.646470    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad8e0e9f-d912-40df-98b5-5e17f77aa631-original-pull-secret\") pod \"global-pull-secret-syncer-ftvjm\" (UID: \"ad8e0e9f-d912-40df-98b5-5e17f77aa631\") " pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:03:59.647222 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:59.646606    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 04:03:59.647222 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:59.646666    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad8e0e9f-d912-40df-98b5-5e17f77aa631-original-pull-secret podName:ad8e0e9f-d912-40df-98b5-5e17f77aa631 nodeName:}" failed. No retries permitted until 2026-07-29 04:04:03.646647904 +0000 UTC m=+10.079685999 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ad8e0e9f-d912-40df-98b5-5e17f77aa631-original-pull-secret") pod "global-pull-secret-syncer-ftvjm" (UID: "ad8e0e9f-d912-40df-98b5-5e17f77aa631") : object "kube-system"/"original-pull-secret" not registered
Jul 29 04:03:59.647222 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:59.647089    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 04:03:59.647222 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:59.647112    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 04:03:59.647222 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:59.647126    2572 projected.go:196] Error preparing data for projected volume kube-api-access-5fn2z for pod openshift-network-diagnostics/network-check-target-b2gqf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 04:03:59.647222 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:59.647173    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91c78bb4-6179-4fcf-b449-f18b90e0a4f2-kube-api-access-5fn2z podName:91c78bb4-6179-4fcf-b449-f18b90e0a4f2 nodeName:}" failed. No retries permitted until 2026-07-29 04:04:03.647157945 +0000 UTC m=+10.080196039 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5fn2z" (UniqueName: "kubernetes.io/projected/91c78bb4-6179-4fcf-b449-f18b90e0a4f2-kube-api-access-5fn2z") pod "network-check-target-b2gqf" (UID: "91c78bb4-6179-4fcf-b449-f18b90e0a4f2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 04:03:59.746982 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:03:59.746954    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec-metrics-certs\") pod \"network-metrics-daemon-glpbr\" (UID: \"790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec\") " pod="openshift-multus/network-metrics-daemon-glpbr"
Jul 29 04:03:59.747162 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:59.747127    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 04:03:59.747228 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:03:59.747203    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec-metrics-certs podName:790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec nodeName:}" failed. No retries permitted until 2026-07-29 04:04:03.747182044 +0000 UTC m=+10.180220148 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec-metrics-certs") pod "network-metrics-daemon-glpbr" (UID: "790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 04:04:00.144049 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:00.143636    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:04:00.144049 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:00.143764    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvjm" podUID="ad8e0e9f-d912-40df-98b5-5e17f77aa631"
Jul 29 04:04:00.144049 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:00.143825    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2gqf"
Jul 29 04:04:00.144049 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:00.143932    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b2gqf" podUID="91c78bb4-6179-4fcf-b449-f18b90e0a4f2"
Jul 29 04:04:00.144049 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:00.143641    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glpbr"
Jul 29 04:04:00.144437 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:00.144122    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glpbr" podUID="790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec"
Jul 29 04:04:02.141811 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:02.141774    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2gqf"
Jul 29 04:04:02.142236 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:02.141902    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b2gqf" podUID="91c78bb4-6179-4fcf-b449-f18b90e0a4f2"
Jul 29 04:04:02.142328 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:02.142289    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:04:02.142420 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:02.142387    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvjm" podUID="ad8e0e9f-d912-40df-98b5-5e17f77aa631"
Jul 29 04:04:02.142568 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:02.142466    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glpbr"
Jul 29 04:04:02.142634 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:02.142576    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glpbr" podUID="790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec"
Jul 29 04:04:03.686784 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:03.686727    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad8e0e9f-d912-40df-98b5-5e17f77aa631-original-pull-secret\") pod \"global-pull-secret-syncer-ftvjm\" (UID: \"ad8e0e9f-d912-40df-98b5-5e17f77aa631\") " pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:04:03.687280 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:03.686809    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fn2z\" (UniqueName: \"kubernetes.io/projected/91c78bb4-6179-4fcf-b449-f18b90e0a4f2-kube-api-access-5fn2z\") pod \"network-check-target-b2gqf\" (UID: \"91c78bb4-6179-4fcf-b449-f18b90e0a4f2\") " pod="openshift-network-diagnostics/network-check-target-b2gqf"
Jul 29 04:04:03.687280 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:03.686959    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 04:04:03.687280 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:03.686976    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 04:04:03.687280 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:03.686988    2572 projected.go:196] Error preparing data for projected volume kube-api-access-5fn2z for pod openshift-network-diagnostics/network-check-target-b2gqf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 04:04:03.687280 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:03.687057    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91c78bb4-6179-4fcf-b449-f18b90e0a4f2-kube-api-access-5fn2z podName:91c78bb4-6179-4fcf-b449-f18b90e0a4f2 nodeName:}" failed. No retries permitted until 2026-07-29 04:04:11.687039543 +0000 UTC m=+18.120077650 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5fn2z" (UniqueName: "kubernetes.io/projected/91c78bb4-6179-4fcf-b449-f18b90e0a4f2-kube-api-access-5fn2z") pod "network-check-target-b2gqf" (UID: "91c78bb4-6179-4fcf-b449-f18b90e0a4f2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 04:04:03.687591 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:03.687417    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 04:04:03.687591 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:03.687452    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad8e0e9f-d912-40df-98b5-5e17f77aa631-original-pull-secret podName:ad8e0e9f-d912-40df-98b5-5e17f77aa631 nodeName:}" failed. No retries permitted until 2026-07-29 04:04:11.687443314 +0000 UTC m=+18.120481405 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ad8e0e9f-d912-40df-98b5-5e17f77aa631-original-pull-secret") pod "global-pull-secret-syncer-ftvjm" (UID: "ad8e0e9f-d912-40df-98b5-5e17f77aa631") : object "kube-system"/"original-pull-secret" not registered
Jul 29 04:04:03.787742 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:03.787628    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec-metrics-certs\") pod \"network-metrics-daemon-glpbr\" (UID: \"790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec\") " pod="openshift-multus/network-metrics-daemon-glpbr"
Jul 29 04:04:03.787920 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:03.787792    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 04:04:03.787920 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:03.787863    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec-metrics-certs podName:790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec nodeName:}" failed. No retries permitted until 2026-07-29 04:04:11.787846867 +0000 UTC m=+18.220884961 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec-metrics-certs") pod "network-metrics-daemon-glpbr" (UID: "790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 04:04:04.144289 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:04.144257    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:04:04.144289 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:04.144260    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glpbr"
Jul 29 04:04:04.145323 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:04.145293    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2gqf"
Jul 29 04:04:04.145438 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:04.145405    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvjm" podUID="ad8e0e9f-d912-40df-98b5-5e17f77aa631"
Jul 29 04:04:04.145709 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:04.145547    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glpbr" podUID="790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec"
Jul 29 04:04:04.145709 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:04.145644    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b2gqf" podUID="91c78bb4-6179-4fcf-b449-f18b90e0a4f2"
Jul 29 04:04:06.142053 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:06.142015    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glpbr"
Jul 29 04:04:06.142468 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:06.142174    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glpbr" podUID="790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec"
Jul 29 04:04:06.142591 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:06.142566    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2gqf"
Jul 29 04:04:06.142691 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:06.142666    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b2gqf" podUID="91c78bb4-6179-4fcf-b449-f18b90e0a4f2"
Jul 29 04:04:06.142813 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:06.142799    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:04:06.142902 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:06.142885    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvjm" podUID="ad8e0e9f-d912-40df-98b5-5e17f77aa631"
Jul 29 04:04:08.142403 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:08.142369    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glpbr"
Jul 29 04:04:08.142803 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:08.142373    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:04:08.142803 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:08.142515    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2gqf"
Jul 29 04:04:08.142803 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:08.142494    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glpbr" podUID="790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec"
Jul 29 04:04:08.142803 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:08.142577    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvjm" podUID="ad8e0e9f-d912-40df-98b5-5e17f77aa631"
Jul 29 04:04:08.142803 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:08.142648    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b2gqf" podUID="91c78bb4-6179-4fcf-b449-f18b90e0a4f2"
Jul 29 04:04:10.141524 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:10.141477    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:04:10.141524 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:10.141477    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glpbr"
Jul 29 04:04:10.142044 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:10.141547    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2gqf"
Jul 29 04:04:10.142044 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:10.141659    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glpbr" podUID="790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec"
Jul 29 04:04:10.142044 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:10.141707    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b2gqf" podUID="91c78bb4-6179-4fcf-b449-f18b90e0a4f2"
Jul 29 04:04:10.142044 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:10.141805    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvjm" podUID="ad8e0e9f-d912-40df-98b5-5e17f77aa631"
Jul 29 04:04:11.748801 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:11.748763    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad8e0e9f-d912-40df-98b5-5e17f77aa631-original-pull-secret\") pod \"global-pull-secret-syncer-ftvjm\" (UID: \"ad8e0e9f-d912-40df-98b5-5e17f77aa631\") " pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:04:11.749352 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:11.748845    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fn2z\" (UniqueName: \"kubernetes.io/projected/91c78bb4-6179-4fcf-b449-f18b90e0a4f2-kube-api-access-5fn2z\") pod \"network-check-target-b2gqf\" (UID: \"91c78bb4-6179-4fcf-b449-f18b90e0a4f2\") " pod="openshift-network-diagnostics/network-check-target-b2gqf"
Jul 29 04:04:11.749352 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:11.749014    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 04:04:11.749352 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:11.749032    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 04:04:11.749352 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:11.749047    2572 projected.go:196] Error preparing data for projected volume kube-api-access-5fn2z for pod openshift-network-diagnostics/network-check-target-b2gqf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 04:04:11.749352 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:11.749106    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91c78bb4-6179-4fcf-b449-f18b90e0a4f2-kube-api-access-5fn2z podName:91c78bb4-6179-4fcf-b449-f18b90e0a4f2 nodeName:}" failed. No retries permitted until 2026-07-29 04:04:27.749086509 +0000 UTC m=+34.182124626 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5fn2z" (UniqueName: "kubernetes.io/projected/91c78bb4-6179-4fcf-b449-f18b90e0a4f2-kube-api-access-5fn2z") pod "network-check-target-b2gqf" (UID: "91c78bb4-6179-4fcf-b449-f18b90e0a4f2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 04:04:11.749589 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:11.749525    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 04:04:11.749589 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:11.749576    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad8e0e9f-d912-40df-98b5-5e17f77aa631-original-pull-secret podName:ad8e0e9f-d912-40df-98b5-5e17f77aa631 nodeName:}" failed. No retries permitted until 2026-07-29 04:04:27.749562286 +0000 UTC m=+34.182600376 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ad8e0e9f-d912-40df-98b5-5e17f77aa631-original-pull-secret") pod "global-pull-secret-syncer-ftvjm" (UID: "ad8e0e9f-d912-40df-98b5-5e17f77aa631") : object "kube-system"/"original-pull-secret" not registered
Jul 29 04:04:11.852459 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:11.852405    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec-metrics-certs\") pod \"network-metrics-daemon-glpbr\" (UID: \"790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec\") " pod="openshift-multus/network-metrics-daemon-glpbr"
Jul 29 04:04:11.852831 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:11.852806    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 04:04:11.852930 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:11.852888    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec-metrics-certs podName:790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec nodeName:}" failed. No retries permitted until 2026-07-29 04:04:27.852870489 +0000 UTC m=+34.285908579 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec-metrics-certs") pod "network-metrics-daemon-glpbr" (UID: "790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 04:04:12.141653 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:12.141612    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2gqf"
Jul 29 04:04:12.141843 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:12.141613    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:04:12.141843 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:12.141770    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b2gqf" podUID="91c78bb4-6179-4fcf-b449-f18b90e0a4f2"
Jul 29 04:04:12.141843 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:12.141824    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glpbr"
Jul 29 04:04:12.142028 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:12.142004    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvjm" podUID="ad8e0e9f-d912-40df-98b5-5e17f77aa631"
Jul 29 04:04:12.142116 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:12.142094    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glpbr" podUID="790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec"
Jul 29 04:04:14.142129 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:14.142095    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glpbr"
Jul 29 04:04:14.142639 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:14.142098    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:04:14.142639 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:14.142230    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glpbr" podUID="790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec"
Jul 29 04:04:14.142639 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:14.142278    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvjm" podUID="ad8e0e9f-d912-40df-98b5-5e17f77aa631"
Jul 29 04:04:14.142639 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:14.142101    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2gqf"
Jul 29 04:04:14.142639 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:14.142371    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b2gqf" podUID="91c78bb4-6179-4fcf-b449-f18b90e0a4f2"
Jul 29 04:04:16.142600 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:16.142404    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glpbr"
Jul 29 04:04:16.143303 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:16.142425    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2gqf"
Jul 29 04:04:16.143303 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:16.142696    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glpbr" podUID="790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec"
Jul 29 04:04:16.143303 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:16.142472    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:04:16.143303 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:16.142794    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b2gqf" podUID="91c78bb4-6179-4fcf-b449-f18b90e0a4f2"
Jul 29 04:04:16.143303 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:16.142871    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvjm" podUID="ad8e0e9f-d912-40df-98b5-5e17f77aa631"
Jul 29 04:04:16.255522 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:16.255239    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dnkkq" event={"ID":"f0431314-54c9-4235-a9b8-6cde6d840fe9","Type":"ContainerStarted","Data":"316bef95dbd339d69f9e7f970af6cbf2a624682e128fd8c80277e56f3f8f4356"}
Jul 29 04:04:16.257712 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:16.257483    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8" event={"ID":"3228b431-6b56-463f-ab47-5cd22ba06905","Type":"ContainerStarted","Data":"c55b9cdfc6415c31146609653817becdda535f4cc7034d7d37abb16c18dcd20c"}
Jul 29 04:04:16.257712 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:16.257584    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8" event={"ID":"3228b431-6b56-463f-ab47-5cd22ba06905","Type":"ContainerStarted","Data":"4445c1935f4e629d9665eed2b661ad8be606b13b0a1b2b4b0d6c2e54f138191e"}
Jul 29 04:04:16.261183 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:16.261154    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4sxfh" event={"ID":"0974adfa-35b7-4dc6-a422-375514f65dc9","Type":"ContainerStarted","Data":"78bbc53dc563ed89ddf60491f315e4ae3b472f19e9f5ae2fd54779c9845f2863"}
Jul 29 04:04:16.263546 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:16.263525    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ww64c" event={"ID":"5308636d-29f2-493b-bec2-22ae9d554fa6","Type":"ContainerStarted","Data":"408a3a5d828b3068a7739c1fb9c0e47b3384b2b775cc5bbf49d91369174ec1eb"}
Jul 29 04:04:16.265401 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:16.265373    2572 generic.go:356] "Generic (PLEG): container finished" podID="f5975794-9295-4748-9bce-2b0ef3fbeb8d" containerID="b8455283897947fa0a660c1d7a26badaf04b48e58751e2328861f3d180ca1747" exitCode=0
Jul 29 04:04:16.265586 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:16.265414    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg9jl" event={"ID":"f5975794-9295-4748-9bce-2b0ef3fbeb8d","Type":"ContainerDied","Data":"b8455283897947fa0a660c1d7a26badaf04b48e58751e2328861f3d180ca1747"}
Jul 29 04:04:16.268916 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:16.267402    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mtfx7" event={"ID":"4e738e9c-9ec3-4eee-ba0c-98a66f23cb15","Type":"ContainerStarted","Data":"3a0d1daeacca7ba6dfd413fba6397c69376c8d8bb27d859ad29474a1c13d0c67"}
Jul 29 04:04:16.269482 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:16.269452    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lmjvb" event={"ID":"8644f436-c5c4-433f-92d7-bdc490fe95be","Type":"ContainerStarted","Data":"147276cb38d617dac7c1c2d47cd141a815dc6e85207c097f08698d76f71785eb"}
Jul 29 04:04:16.271237 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:16.271216    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-548lx" event={"ID":"dddb6b6e-32b5-4bcf-85d8-8c4d57451fe9","Type":"ContainerStarted","Data":"759ec4573ccc0aec7038eb34a9cf1629d460e6f72f6c16512dcce565d9985f04"}
Jul 29 04:04:16.276236 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:16.276193    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dnkkq" podStartSLOduration=3.5589009640000002 podStartE2EDuration="22.276180277s" totalImagesPullingTime="18.717279313s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 04:03:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:04:16.275465765 +0000 UTC m=+22.708503880" watchObservedRunningTime="2026-07-29 04:04:16.276180277 +0000 UTC m=+22.709218389"
Jul 29 04:04:16.294088 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:16.294045    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4sxfh" podStartSLOduration=3.574513874 podStartE2EDuration="22.294028339s" totalImagesPullingTime="18.719514465s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 04:03:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:04:16.293407092 +0000 UTC m=+22.726445205" watchObservedRunningTime="2026-07-29 04:04:16.294028339 +0000 UTC m=+22.727066452"
Jul 29 04:04:16.343096 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:16.343046    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-lmjvb" podStartSLOduration=3.558350644 podStartE2EDuration="22.343026642s" totalImagesPullingTime="18.784675998s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 04:03:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:04:16.342529193 +0000 UTC m=+22.775567306" watchObservedRunningTime="2026-07-29 04:04:16.343026642 +0000 UTC m=+22.776064754"
Jul 29 04:04:16.343273 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:16.343238    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-548lx" podStartSLOduration=3.620496359 podStartE2EDuration="22.343233066s" totalImagesPullingTime="18.722736707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:03:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:04:16.315515705 +0000 UTC m=+22.748553811" watchObservedRunningTime="2026-07-29 04:04:16.343233066 +0000 UTC m=+22.776271179"
Jul 29 04:04:16.356865 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:16.356818    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mtfx7" podStartSLOduration=3.637868327 podStartE2EDuration="22.356803105s" totalImagesPullingTime="18.718934778s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 04:03:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:04:16.356567335 +0000 UTC m=+22.789605427" watchObservedRunningTime="2026-07-29 04:04:16.356803105 +0000 UTC m=+22.789841217"
Jul 29 04:04:17.276853 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:17.276813    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8" event={"ID":"3228b431-6b56-463f-ab47-5cd22ba06905","Type":"ContainerStarted","Data":"5d5ef9a249ccd0fcb501b0e4bcfecb0280521cb1f831ea7dbe23f28c4559b266"}
Jul 29 04:04:17.277379 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:17.276938    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8" event={"ID":"3228b431-6b56-463f-ab47-5cd22ba06905","Type":"ContainerStarted","Data":"e538a1fa6136885ac959e7b03dbeaf96031e38daf82eb96ea4888a57df8b513b"}
Jul 29 04:04:17.277379 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:17.276980    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8" event={"ID":"3228b431-6b56-463f-ab47-5cd22ba06905","Type":"ContainerStarted","Data":"b503ddbd5b8796e4166efc60273454614720222bd9fee3ba99f84504f90e11c8"}
Jul 29 04:04:17.277379 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:17.277016    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8" event={"ID":"3228b431-6b56-463f-ab47-5cd22ba06905","Type":"ContainerStarted","Data":"0a08390206e74c14cab700d8550dcbe147b89607284ae8fe183a8437c310fe73"}
Jul 29 04:04:17.770808 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:17.770775    2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 29 04:04:18.070549 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:18.070396    2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T04:04:17.77080266Z","UUID":"e6d2f233-a7f3-4dea-80d6-42c2d06caae9","Handler":null,"Name":"","Endpoint":""}
Jul 29 04:04:18.072074 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:18.072048    2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 29 04:04:18.072224 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:18.072099    2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 29 04:04:18.142284 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:18.142248    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2gqf"
Jul 29 04:04:18.142466 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:18.142248    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:04:18.142466 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:18.142374    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b2gqf" podUID="91c78bb4-6179-4fcf-b449-f18b90e0a4f2"
Jul 29 04:04:18.142466 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:18.142248    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glpbr"
Jul 29 04:04:18.142466 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:18.142444    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvjm" podUID="ad8e0e9f-d912-40df-98b5-5e17f77aa631"
Jul 29 04:04:18.142714 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:18.142528    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glpbr" podUID="790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec"
Jul 29 04:04:18.282489 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:18.282451    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ww64c" event={"ID":"5308636d-29f2-493b-bec2-22ae9d554fa6","Type":"ContainerStarted","Data":"d74a045102fa30f0615df8d4794603287c9bbfb4d483666c578b24abf649b176"}
Jul 29 04:04:18.284891 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:18.284859    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ghl98" event={"ID":"585dfe10-b366-4228-a697-a56b25e4eade","Type":"ContainerStarted","Data":"7e6dd5fdddcb8b5dbc8168b465db4270477344e2f97b532938580f46e79eaab9"}
Jul 29 04:04:18.300813 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:18.300747    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ghl98" podStartSLOduration=5.564965441 podStartE2EDuration="24.300726026s" totalImagesPullingTime="18.735760585s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 04:03:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:04:18.300321443 +0000 UTC m=+24.733359557" watchObservedRunningTime="2026-07-29 04:04:18.300726026 +0000 UTC m=+24.733764141"
Jul 29 04:04:18.498935 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:18.498899    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dnkkq_f0431314-54c9-4235-a9b8-6cde6d840fe9/dns-node-resolver/0.log"
Jul 29 04:04:19.290983 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:19.290938    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8" event={"ID":"3228b431-6b56-463f-ab47-5cd22ba06905","Type":"ContainerStarted","Data":"509285c4ddac39f0e09a59e23be2347709092f87b3435ee2a9d3664db9462444"}
Jul 29 04:04:19.477759 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:19.477729    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mtfx7_4e738e9c-9ec3-4eee-ba0c-98a66f23cb15/node-ca/0.log"
Jul 29 04:04:20.142050 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:20.141822    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glpbr"
Jul 29 04:04:20.142050 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:20.141958    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2gqf"
Jul 29 04:04:20.142050 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:20.141971    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glpbr" podUID="790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec"
Jul 29 04:04:20.142050 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:20.141989    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:04:20.142402 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:20.142077    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b2gqf" podUID="91c78bb4-6179-4fcf-b449-f18b90e0a4f2"
Jul 29 04:04:20.142402 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:20.142173    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvjm" podUID="ad8e0e9f-d912-40df-98b5-5e17f77aa631"
Jul 29 04:04:20.318122 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:20.318090    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-548lx"
Jul 29 04:04:20.318718 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:20.318694    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-548lx"
Jul 29 04:04:21.302576 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:21.302351    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8" event={"ID":"3228b431-6b56-463f-ab47-5cd22ba06905","Type":"ContainerStarted","Data":"0a36fc0b8c6af42ddd06a676eed30088fb2e8bbe9afdcb444e84af8ae8b457ee"}
Jul 29 04:04:21.302777 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:21.302666    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:04:21.302777 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:21.302717    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:04:21.304527 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:21.304474    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ww64c" event={"ID":"5308636d-29f2-493b-bec2-22ae9d554fa6","Type":"ContainerStarted","Data":"5284bec3feff471090e546d617978dbf63b0e1e2fbd374435783ac6bd586d9c5"}
Jul 29 04:04:21.306432 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:21.306399    2572 generic.go:356] "Generic (PLEG): container finished" podID="f5975794-9295-4748-9bce-2b0ef3fbeb8d" containerID="7bcfb02f79cda33be158c23689960baa33beb48bc2cd208ca6ddcf61a92b1f75" exitCode=0
Jul 29 04:04:21.306575 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:21.306462    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg9jl" event={"ID":"f5975794-9295-4748-9bce-2b0ef3fbeb8d","Type":"ContainerDied","Data":"7bcfb02f79cda33be158c23689960baa33beb48bc2cd208ca6ddcf61a92b1f75"}
Jul 29 04:04:21.307077 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:21.306828    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-548lx"
Jul 29 04:04:21.307232 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:21.307159    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-548lx"
Jul 29 04:04:21.319214 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:21.319192    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:04:21.331008 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:21.330961    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8" podStartSLOduration=8.543446409 podStartE2EDuration="27.330947748s" totalImagesPullingTime="18.787501339s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 04:03:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:04:21.329792122 +0000 UTC m=+27.762830235" watchObservedRunningTime="2026-07-29 04:04:21.330947748 +0000 UTC m=+27.763985862"
Jul 29 04:04:21.376681 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:21.376624    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ww64c" podStartSLOduration=4.344981766 podStartE2EDuration="27.376608315s" totalImagesPullingTime="23.031626549s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 04:03:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:04:21.37629092 +0000 UTC m=+27.809329034" watchObservedRunningTime="2026-07-29 04:04:21.376608315 +0000 UTC m=+27.809646427"
Jul 29 04:04:22.142157 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:22.142126    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glpbr"
Jul 29 04:04:22.142341 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:22.142126    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2gqf"
Jul 29 04:04:22.142341 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:22.142246    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glpbr" podUID="790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec"
Jul 29 04:04:22.142341 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:22.142126    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:04:22.142463 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:22.142300    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b2gqf" podUID="91c78bb4-6179-4fcf-b449-f18b90e0a4f2"
Jul 29 04:04:22.142463 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:22.142383    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvjm" podUID="ad8e0e9f-d912-40df-98b5-5e17f77aa631"
Jul 29 04:04:22.308997 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:22.308973    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:04:22.324249 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:22.324219    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:04:23.313200 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:23.312971    2572 generic.go:356] "Generic (PLEG): container finished" podID="f5975794-9295-4748-9bce-2b0ef3fbeb8d" containerID="1fc1bd808b4fe6beaca6806d8a6339f6ae9b123c9a4272e8a0049ecb0b639d73" exitCode=0
Jul 29 04:04:23.313381 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:23.313043    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg9jl" event={"ID":"f5975794-9295-4748-9bce-2b0ef3fbeb8d","Type":"ContainerDied","Data":"1fc1bd808b4fe6beaca6806d8a6339f6ae9b123c9a4272e8a0049ecb0b639d73"}
Jul 29 04:04:24.143229 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:24.143190    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2gqf"
Jul 29 04:04:24.143717 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:24.143276    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b2gqf" podUID="91c78bb4-6179-4fcf-b449-f18b90e0a4f2"
Jul 29 04:04:24.143717 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:24.143286    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:04:24.143717 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:24.143353    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glpbr"
Jul 29 04:04:24.143717 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:24.143451    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glpbr" podUID="790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec"
Jul 29 04:04:24.143717 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:24.143582    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvjm" podUID="ad8e0e9f-d912-40df-98b5-5e17f77aa631"
Jul 29 04:04:25.319933 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:25.319900    2572 generic.go:356] "Generic (PLEG): container finished" podID="f5975794-9295-4748-9bce-2b0ef3fbeb8d" containerID="f951d541af0eaa023eb1e7a47c1da0bfb155a7b46e9a28d0f9ac494debfe6b4e" exitCode=0
Jul 29 04:04:25.320275 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:25.319944    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg9jl" event={"ID":"f5975794-9295-4748-9bce-2b0ef3fbeb8d","Type":"ContainerDied","Data":"f951d541af0eaa023eb1e7a47c1da0bfb155a7b46e9a28d0f9ac494debfe6b4e"}
Jul 29 04:04:26.142551 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:26.142517    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2gqf"
Jul 29 04:04:26.142727 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:26.142517    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:04:26.142727 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:26.142630    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b2gqf" podUID="91c78bb4-6179-4fcf-b449-f18b90e0a4f2"
Jul 29 04:04:26.142802 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:26.142725    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvjm" podUID="ad8e0e9f-d912-40df-98b5-5e17f77aa631"
Jul 29 04:04:26.142802 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:26.142521    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glpbr"
Jul 29 04:04:26.142863 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:26.142831    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glpbr" podUID="790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec"
Jul 29 04:04:27.776765 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:27.776720    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fn2z\" (UniqueName: \"kubernetes.io/projected/91c78bb4-6179-4fcf-b449-f18b90e0a4f2-kube-api-access-5fn2z\") pod \"network-check-target-b2gqf\" (UID: \"91c78bb4-6179-4fcf-b449-f18b90e0a4f2\") " pod="openshift-network-diagnostics/network-check-target-b2gqf"
Jul 29 04:04:27.777220 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:27.776799    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad8e0e9f-d912-40df-98b5-5e17f77aa631-original-pull-secret\") pod \"global-pull-secret-syncer-ftvjm\" (UID: \"ad8e0e9f-d912-40df-98b5-5e17f77aa631\") " pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:04:27.777220 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:27.776899    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 04:04:27.777220 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:27.776898    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 04:04:27.777220 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:27.776923    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 04:04:27.777220 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:27.776935    2572 projected.go:196] Error preparing data for projected volume kube-api-access-5fn2z for pod openshift-network-diagnostics/network-check-target-b2gqf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 04:04:27.777220 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:27.776968    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad8e0e9f-d912-40df-98b5-5e17f77aa631-original-pull-secret podName:ad8e0e9f-d912-40df-98b5-5e17f77aa631 nodeName:}" failed. No retries permitted until 2026-07-29 04:04:59.776949053 +0000 UTC m=+66.209987162 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ad8e0e9f-d912-40df-98b5-5e17f77aa631-original-pull-secret") pod "global-pull-secret-syncer-ftvjm" (UID: "ad8e0e9f-d912-40df-98b5-5e17f77aa631") : object "kube-system"/"original-pull-secret" not registered
Jul 29 04:04:27.777220 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:27.776986    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91c78bb4-6179-4fcf-b449-f18b90e0a4f2-kube-api-access-5fn2z podName:91c78bb4-6179-4fcf-b449-f18b90e0a4f2 nodeName:}" failed. No retries permitted until 2026-07-29 04:04:59.776977564 +0000 UTC m=+66.210015660 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5fn2z" (UniqueName: "kubernetes.io/projected/91c78bb4-6179-4fcf-b449-f18b90e0a4f2-kube-api-access-5fn2z") pod "network-check-target-b2gqf" (UID: "91c78bb4-6179-4fcf-b449-f18b90e0a4f2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 04:04:27.878111 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:27.878073    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec-metrics-certs\") pod \"network-metrics-daemon-glpbr\" (UID: \"790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec\") " pod="openshift-multus/network-metrics-daemon-glpbr"
Jul 29 04:04:27.878279 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:27.878234    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 04:04:27.878331 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:27.878318    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec-metrics-certs podName:790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec nodeName:}" failed. No retries permitted until 2026-07-29 04:04:59.878296208 +0000 UTC m=+66.311334302 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec-metrics-certs") pod "network-metrics-daemon-glpbr" (UID: "790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 04:04:28.141617 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:28.141582    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2gqf"
Jul 29 04:04:28.141812 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:28.141582    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glpbr"
Jul 29 04:04:28.141812 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:28.141710    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b2gqf" podUID="91c78bb4-6179-4fcf-b449-f18b90e0a4f2"
Jul 29 04:04:28.141812 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:28.141595    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:04:28.141983 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:28.141819    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glpbr" podUID="790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec"
Jul 29 04:04:28.141983 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:28.141917    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvjm" podUID="ad8e0e9f-d912-40df-98b5-5e17f77aa631"
Jul 29 04:04:30.142125 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:30.142096    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:04:30.142595 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:30.142131    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glpbr"
Jul 29 04:04:30.142595 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:30.142096    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2gqf"
Jul 29 04:04:30.142595 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:30.142232    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvjm" podUID="ad8e0e9f-d912-40df-98b5-5e17f77aa631"
Jul 29 04:04:30.142595 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:30.142304    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b2gqf" podUID="91c78bb4-6179-4fcf-b449-f18b90e0a4f2"
Jul 29 04:04:30.142595 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:30.142404    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glpbr" podUID="790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec"
Jul 29 04:04:30.333451 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:30.333416    2572 generic.go:356] "Generic (PLEG): container finished" podID="f5975794-9295-4748-9bce-2b0ef3fbeb8d" containerID="5ce1274defe01e62615dd2e170ebb30ad48be73ad89356f5ff815684f4c41599" exitCode=0
Jul 29 04:04:30.333652 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:30.333471    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg9jl" event={"ID":"f5975794-9295-4748-9bce-2b0ef3fbeb8d","Type":"ContainerDied","Data":"5ce1274defe01e62615dd2e170ebb30ad48be73ad89356f5ff815684f4c41599"}
Jul 29 04:04:31.338051 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:31.338018    2572 generic.go:356] "Generic (PLEG): container finished" podID="f5975794-9295-4748-9bce-2b0ef3fbeb8d" containerID="73dbd89395092c6be02b8711689d8231e0ea8e55cbb2b20c1156006399e0019f" exitCode=0
Jul 29 04:04:31.338409 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:31.338085    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg9jl" event={"ID":"f5975794-9295-4748-9bce-2b0ef3fbeb8d","Type":"ContainerDied","Data":"73dbd89395092c6be02b8711689d8231e0ea8e55cbb2b20c1156006399e0019f"}
Jul 29 04:04:32.142301 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:32.142265    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:04:32.142466 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:32.142274    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glpbr"
Jul 29 04:04:32.142466 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:32.142390    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvjm" podUID="ad8e0e9f-d912-40df-98b5-5e17f77aa631"
Jul 29 04:04:32.142466 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:32.142417    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2gqf"
Jul 29 04:04:32.142660 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:32.142518    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glpbr" podUID="790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec"
Jul 29 04:04:32.142660 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:32.142621    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b2gqf" podUID="91c78bb4-6179-4fcf-b449-f18b90e0a4f2"
Jul 29 04:04:32.344238 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:32.344207    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg9jl" event={"ID":"f5975794-9295-4748-9bce-2b0ef3fbeb8d","Type":"ContainerStarted","Data":"d8799d57ca49e979831e6789cc31ae1e10fb2134f51ba5435e9aee4e873a9010"}
Jul 29 04:04:32.364172 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:32.364126    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kg9jl" podStartSLOduration=8.614294079 podStartE2EDuration="38.364110627s" totalImagesPullingTime="29.749816548s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 04:03:54 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:04:32.363923672 +0000 UTC m=+38.796961786" watchObservedRunningTime="2026-07-29 04:04:32.364110627 +0000 UTC m=+38.797148740"
Jul 29 04:04:34.144950 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:34.144921    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2gqf"
Jul 29 04:04:34.145298 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:34.144932    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glpbr"
Jul 29 04:04:34.145298 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:34.145000    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b2gqf" podUID="91c78bb4-6179-4fcf-b449-f18b90e0a4f2"
Jul 29 04:04:34.145298 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:34.145085    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glpbr" podUID="790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec"
Jul 29 04:04:34.145298 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:34.144931    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:04:34.145298 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:34.145162    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvjm" podUID="ad8e0e9f-d912-40df-98b5-5e17f77aa631"
Jul 29 04:04:36.142321 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:36.142289    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2gqf"
Jul 29 04:04:36.142710 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:36.142294    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:04:36.142710 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:36.142399    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b2gqf" podUID="91c78bb4-6179-4fcf-b449-f18b90e0a4f2"
Jul 29 04:04:36.142710 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:36.142470    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvjm" podUID="ad8e0e9f-d912-40df-98b5-5e17f77aa631"
Jul 29 04:04:36.142710 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:36.142293    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glpbr"
Jul 29 04:04:36.142710 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:36.142569    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glpbr" podUID="790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec"
Jul 29 04:04:38.142102 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:38.142074    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2gqf"
Jul 29 04:04:38.142544 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:38.142074    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:04:38.142544 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:38.142184    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b2gqf" podUID="91c78bb4-6179-4fcf-b449-f18b90e0a4f2"
Jul 29 04:04:38.142544 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:38.142231    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glpbr"
Jul 29 04:04:38.142544 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:38.142348    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvjm" podUID="ad8e0e9f-d912-40df-98b5-5e17f77aa631"
Jul 29 04:04:38.142544 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:38.142466    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glpbr" podUID="790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec"
Jul 29 04:04:40.142100 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:40.142069    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:04:40.142798 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:40.142079    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glpbr"
Jul 29 04:04:40.142946 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:40.142808    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvjm" podUID="ad8e0e9f-d912-40df-98b5-5e17f77aa631"
Jul 29 04:04:40.142946 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:40.142149    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2gqf"
Jul 29 04:04:40.143047 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:40.142941    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glpbr" podUID="790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec"
Jul 29 04:04:40.143047 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:40.142956    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b2gqf" podUID="91c78bb4-6179-4fcf-b449-f18b90e0a4f2"
Jul 29 04:04:41.358363 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:41.358130    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ftvjm"]
Jul 29 04:04:41.358893 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:41.358453    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:04:41.358893 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:41.358588    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvjm" podUID="ad8e0e9f-d912-40df-98b5-5e17f77aa631"
Jul 29 04:04:41.361746 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:41.361313    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-b2gqf"]
Jul 29 04:04:41.361746 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:41.361431    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2gqf"
Jul 29 04:04:41.361746 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:41.361560    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b2gqf" podUID="91c78bb4-6179-4fcf-b449-f18b90e0a4f2"
Jul 29 04:04:41.366625 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:41.366548    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-glpbr"]
Jul 29 04:04:41.366948 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:41.366930    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glpbr"
Jul 29 04:04:41.367305 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:41.367257    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glpbr" podUID="790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec"
Jul 29 04:04:43.141696 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:43.141660    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:04:43.141696 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:43.141702    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glpbr"
Jul 29 04:04:43.142216 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:43.141703    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2gqf"
Jul 29 04:04:43.142216 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:43.141794    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvjm" podUID="ad8e0e9f-d912-40df-98b5-5e17f77aa631"
Jul 29 04:04:43.142216 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:43.141913    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glpbr" podUID="790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec"
Jul 29 04:04:43.142216 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:43.141964    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b2gqf" podUID="91c78bb4-6179-4fcf-b449-f18b90e0a4f2"
Jul 29 04:04:45.141623 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:45.141592    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:04:45.141623 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:45.141620    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2gqf"
Jul 29 04:04:45.142023 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:45.141623    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glpbr"
Jul 29 04:04:45.142023 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:45.141689    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftvjm" podUID="ad8e0e9f-d912-40df-98b5-5e17f77aa631"
Jul 29 04:04:45.142023 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:45.141787    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glpbr" podUID="790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec"
Jul 29 04:04:45.142023 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:45.141864    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b2gqf" podUID="91c78bb4-6179-4fcf-b449-f18b90e0a4f2"
Jul 29 04:04:45.916327 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:45.916299    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-4.ec2.internal" event="NodeReady"
Jul 29 04:04:45.916585 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:45.916427    2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 29 04:04:45.957807 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:45.957774    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-f2tq9"]
Jul 29 04:04:45.977920 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:45.977893    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-55jls"]
Jul 29 04:04:45.978065 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:45.978020    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f2tq9"
Jul 29 04:04:45.980160 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:45.980138    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7m6rk\""
Jul 29 04:04:45.982458 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:45.980553    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 29 04:04:45.982458 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:45.980616    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 29 04:04:45.999712 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:45.999683    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f2tq9"]
Jul 29 04:04:45.999813 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:45.999722    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-55jls"]
Jul 29 04:04:45.999813 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:45.999795    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-55jls"
Jul 29 04:04:46.001839 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.001809    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 29 04:04:46.001953 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.001891    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-p8dgx\""
Jul 29 04:04:46.002094 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.002081    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 29 04:04:46.002348 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.002301    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 29 04:04:46.008466 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.008448    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lxr8\" (UniqueName: \"kubernetes.io/projected/19251c81-52a7-4281-872d-3ad2ad32b2e2-kube-api-access-8lxr8\") pod \"ingress-canary-55jls\" (UID: \"19251c81-52a7-4281-872d-3ad2ad32b2e2\") " pod="openshift-ingress-canary/ingress-canary-55jls"
Jul 29 04:04:46.008579 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.008472    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19251c81-52a7-4281-872d-3ad2ad32b2e2-cert\") pod \"ingress-canary-55jls\" (UID: \"19251c81-52a7-4281-872d-3ad2ad32b2e2\") " pod="openshift-ingress-canary/ingress-canary-55jls"
Jul 29 04:04:46.008579 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.008492    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4c4b3a0f-6a1e-49e9-9566-60cca5f58cde-config-volume\") pod \"dns-default-f2tq9\" (UID: \"4c4b3a0f-6a1e-49e9-9566-60cca5f58cde\") " pod="openshift-dns/dns-default-f2tq9"
Jul 29 04:04:46.008686 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.008646    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c4b3a0f-6a1e-49e9-9566-60cca5f58cde-metrics-tls\") pod \"dns-default-f2tq9\" (UID: \"4c4b3a0f-6a1e-49e9-9566-60cca5f58cde\") " pod="openshift-dns/dns-default-f2tq9"
Jul 29 04:04:46.008686 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.008674    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnlgq\" (UniqueName: \"kubernetes.io/projected/4c4b3a0f-6a1e-49e9-9566-60cca5f58cde-kube-api-access-pnlgq\") pod \"dns-default-f2tq9\" (UID: \"4c4b3a0f-6a1e-49e9-9566-60cca5f58cde\") " pod="openshift-dns/dns-default-f2tq9"
Jul 29 04:04:46.008764 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.008703    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c4b3a0f-6a1e-49e9-9566-60cca5f58cde-tmp-dir\") pod \"dns-default-f2tq9\" (UID: \"4c4b3a0f-6a1e-49e9-9566-60cca5f58cde\") " pod="openshift-dns/dns-default-f2tq9"
Jul 29 04:04:46.062890 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.062866    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2mknl"]
Jul 29 04:04:46.083616 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.083592    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2mknl"]
Jul 29 04:04:46.083747 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.083714    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2mknl"
Jul 29 04:04:46.086148 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.086131    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 29 04:04:46.086148 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.086142    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 29 04:04:46.086319 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.086190    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2xj8k\""
Jul 29 04:04:46.086460 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.086444    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 29 04:04:46.086528 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.086455    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 29 04:04:46.109469 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.109446    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19251c81-52a7-4281-872d-3ad2ad32b2e2-cert\") pod \"ingress-canary-55jls\" (UID: \"19251c81-52a7-4281-872d-3ad2ad32b2e2\") " pod="openshift-ingress-canary/ingress-canary-55jls"
Jul 29 04:04:46.109570 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.109478    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9rq5\" (UniqueName: \"kubernetes.io/projected/30460d33-1c48-4aae-abfd-0573702aa066-kube-api-access-t9rq5\") pod \"insights-runtime-extractor-2mknl\" (UID: \"30460d33-1c48-4aae-abfd-0573702aa066\") " pod="openshift-insights/insights-runtime-extractor-2mknl"
Jul 29 04:04:46.109570 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.109520    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4c4b3a0f-6a1e-49e9-9566-60cca5f58cde-config-volume\") pod \"dns-default-f2tq9\" (UID: \"4c4b3a0f-6a1e-49e9-9566-60cca5f58cde\") " pod="openshift-dns/dns-default-f2tq9"
Jul 29 04:04:46.109652 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.109633    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/30460d33-1c48-4aae-abfd-0573702aa066-crio-socket\") pod \"insights-runtime-extractor-2mknl\" (UID: \"30460d33-1c48-4aae-abfd-0573702aa066\") " pod="openshift-insights/insights-runtime-extractor-2mknl"
Jul 29 04:04:46.109697 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.109678    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/30460d33-1c48-4aae-abfd-0573702aa066-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2mknl\" (UID: \"30460d33-1c48-4aae-abfd-0573702aa066\") " pod="openshift-insights/insights-runtime-extractor-2mknl"
Jul 29 04:04:46.109774 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.109756    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/30460d33-1c48-4aae-abfd-0573702aa066-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2mknl\" (UID: \"30460d33-1c48-4aae-abfd-0573702aa066\") " pod="openshift-insights/insights-runtime-extractor-2mknl"
Jul 29 04:04:46.109814 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.109792    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c4b3a0f-6a1e-49e9-9566-60cca5f58cde-metrics-tls\") pod \"dns-default-f2tq9\" (UID: \"4c4b3a0f-6a1e-49e9-9566-60cca5f58cde\") " pod="openshift-dns/dns-default-f2tq9"
Jul 29 04:04:46.109855 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.109811    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnlgq\" (UniqueName: \"kubernetes.io/projected/4c4b3a0f-6a1e-49e9-9566-60cca5f58cde-kube-api-access-pnlgq\") pod \"dns-default-f2tq9\" (UID: \"4c4b3a0f-6a1e-49e9-9566-60cca5f58cde\") " pod="openshift-dns/dns-default-f2tq9"
Jul 29 04:04:46.109855 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.109837    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c4b3a0f-6a1e-49e9-9566-60cca5f58cde-tmp-dir\") pod \"dns-default-f2tq9\" (UID: \"4c4b3a0f-6a1e-49e9-9566-60cca5f58cde\") " pod="openshift-dns/dns-default-f2tq9"
Jul 29 04:04:46.109965 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.109947    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/30460d33-1c48-4aae-abfd-0573702aa066-data-volume\") pod \"insights-runtime-extractor-2mknl\" (UID: \"30460d33-1c48-4aae-abfd-0573702aa066\") " pod="openshift-insights/insights-runtime-extractor-2mknl"
Jul 29 04:04:46.110017 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.109999    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lxr8\" (UniqueName: \"kubernetes.io/projected/19251c81-52a7-4281-872d-3ad2ad32b2e2-kube-api-access-8lxr8\") pod \"ingress-canary-55jls\" (UID: \"19251c81-52a7-4281-872d-3ad2ad32b2e2\") " pod="openshift-ingress-canary/ingress-canary-55jls"
Jul 29 04:04:46.110097 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.110076    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4c4b3a0f-6a1e-49e9-9566-60cca5f58cde-config-volume\") pod \"dns-default-f2tq9\" (UID: \"4c4b3a0f-6a1e-49e9-9566-60cca5f58cde\") " pod="openshift-dns/dns-default-f2tq9"
Jul 29 04:04:46.110144 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.110083    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c4b3a0f-6a1e-49e9-9566-60cca5f58cde-tmp-dir\") pod \"dns-default-f2tq9\" (UID: \"4c4b3a0f-6a1e-49e9-9566-60cca5f58cde\") " pod="openshift-dns/dns-default-f2tq9"
Jul 29 04:04:46.113771 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.113745    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19251c81-52a7-4281-872d-3ad2ad32b2e2-cert\") pod \"ingress-canary-55jls\" (UID: \"19251c81-52a7-4281-872d-3ad2ad32b2e2\") " pod="openshift-ingress-canary/ingress-canary-55jls"
Jul 29 04:04:46.113857 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.113748    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c4b3a0f-6a1e-49e9-9566-60cca5f58cde-metrics-tls\") pod \"dns-default-f2tq9\" (UID: \"4c4b3a0f-6a1e-49e9-9566-60cca5f58cde\") " pod="openshift-dns/dns-default-f2tq9"
Jul 29 04:04:46.117849 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.117814    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnlgq\" (UniqueName: \"kubernetes.io/projected/4c4b3a0f-6a1e-49e9-9566-60cca5f58cde-kube-api-access-pnlgq\") pod \"dns-default-f2tq9\" (UID: \"4c4b3a0f-6a1e-49e9-9566-60cca5f58cde\") " pod="openshift-dns/dns-default-f2tq9"
Jul 29 04:04:46.117956 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.117851    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lxr8\" (UniqueName: \"kubernetes.io/projected/19251c81-52a7-4281-872d-3ad2ad32b2e2-kube-api-access-8lxr8\") pod \"ingress-canary-55jls\" (UID: \"19251c81-52a7-4281-872d-3ad2ad32b2e2\") " pod="openshift-ingress-canary/ingress-canary-55jls"
Jul 29 04:04:46.210942 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.210870    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/30460d33-1c48-4aae-abfd-0573702aa066-crio-socket\") pod \"insights-runtime-extractor-2mknl\" (UID: \"30460d33-1c48-4aae-abfd-0573702aa066\") " pod="openshift-insights/insights-runtime-extractor-2mknl"
Jul 29 04:04:46.210942 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.210914    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/30460d33-1c48-4aae-abfd-0573702aa066-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2mknl\" (UID: \"30460d33-1c48-4aae-abfd-0573702aa066\") " pod="openshift-insights/insights-runtime-extractor-2mknl"
Jul 29 04:04:46.211696 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.210953    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/30460d33-1c48-4aae-abfd-0573702aa066-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2mknl\" (UID: \"30460d33-1c48-4aae-abfd-0573702aa066\") " pod="openshift-insights/insights-runtime-extractor-2mknl"
Jul 29 04:04:46.211696 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.210994    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/30460d33-1c48-4aae-abfd-0573702aa066-data-volume\") pod \"insights-runtime-extractor-2mknl\" (UID: \"30460d33-1c48-4aae-abfd-0573702aa066\") " pod="openshift-insights/insights-runtime-extractor-2mknl"
Jul 29 04:04:46.211696 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.211056    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9rq5\" (UniqueName: \"kubernetes.io/projected/30460d33-1c48-4aae-abfd-0573702aa066-kube-api-access-t9rq5\") pod \"insights-runtime-extractor-2mknl\" (UID: \"30460d33-1c48-4aae-abfd-0573702aa066\") " pod="openshift-insights/insights-runtime-extractor-2mknl"
Jul 29 04:04:46.211696 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.211086    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/30460d33-1c48-4aae-abfd-0573702aa066-crio-socket\") pod \"insights-runtime-extractor-2mknl\" (UID: \"30460d33-1c48-4aae-abfd-0573702aa066\") " pod="openshift-insights/insights-runtime-extractor-2mknl"
Jul 29 04:04:46.211696 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.211305    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/30460d33-1c48-4aae-abfd-0573702aa066-data-volume\") pod \"insights-runtime-extractor-2mknl\" (UID: \"30460d33-1c48-4aae-abfd-0573702aa066\") " pod="openshift-insights/insights-runtime-extractor-2mknl"
Jul 29 04:04:46.211696 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.211629    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/30460d33-1c48-4aae-abfd-0573702aa066-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2mknl\" (UID: \"30460d33-1c48-4aae-abfd-0573702aa066\") " pod="openshift-insights/insights-runtime-extractor-2mknl"
Jul 29 04:04:46.213381 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.213361    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/30460d33-1c48-4aae-abfd-0573702aa066-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2mknl\" (UID: \"30460d33-1c48-4aae-abfd-0573702aa066\") " pod="openshift-insights/insights-runtime-extractor-2mknl"
Jul 29 04:04:46.219883 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.219852    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9rq5\" (UniqueName: \"kubernetes.io/projected/30460d33-1c48-4aae-abfd-0573702aa066-kube-api-access-t9rq5\") pod \"insights-runtime-extractor-2mknl\" (UID: \"30460d33-1c48-4aae-abfd-0573702aa066\") " pod="openshift-insights/insights-runtime-extractor-2mknl"
Jul 29 04:04:46.288743 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.288708    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f2tq9"
Jul 29 04:04:46.307852 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.307825    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-55jls"
Jul 29 04:04:46.393580 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.393106    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2mknl"
Jul 29 04:04:46.510094 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.510062    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f2tq9"]
Jul 29 04:04:46.514424 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.514395    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-55jls"]
Jul 29 04:04:46.514610 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:04:46.514587    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c4b3a0f_6a1e_49e9_9566_60cca5f58cde.slice/crio-092fe402f3b424be075e80d7ba094cc2a648bf619fb6f7e8546429503deabf9c WatchSource:0}: Error finding container 092fe402f3b424be075e80d7ba094cc2a648bf619fb6f7e8546429503deabf9c: Status 404 returned error can't find the container with id 092fe402f3b424be075e80d7ba094cc2a648bf619fb6f7e8546429503deabf9c
Jul 29 04:04:46.518915 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:04:46.518894    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19251c81_52a7_4281_872d_3ad2ad32b2e2.slice/crio-60bd112cda9d9fed33fd4e93384bf0743f8495b9fd5e67feb881464aacbc7c18 WatchSource:0}: Error finding container 60bd112cda9d9fed33fd4e93384bf0743f8495b9fd5e67feb881464aacbc7c18: Status 404 returned error can't find the container with id 60bd112cda9d9fed33fd4e93384bf0743f8495b9fd5e67feb881464aacbc7c18
Jul 29 04:04:46.558634 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:46.558596    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2mknl"]
Jul 29 04:04:46.561926 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:04:46.561902    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30460d33_1c48_4aae_abfd_0573702aa066.slice/crio-92f61c2d0794a9456b5505bfa4e953db78184ac3b7449f8ec69bd34db49a303a WatchSource:0}: Error finding container 92f61c2d0794a9456b5505bfa4e953db78184ac3b7449f8ec69bd34db49a303a: Status 404 returned error can't find the container with id 92f61c2d0794a9456b5505bfa4e953db78184ac3b7449f8ec69bd34db49a303a
Jul 29 04:04:47.142093 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:47.142063    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glpbr"
Jul 29 04:04:47.142261 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:47.142066    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2gqf"
Jul 29 04:04:47.142261 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:47.142218    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:04:47.144959 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:47.144766    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 04:04:47.146127 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:47.145538    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 04:04:47.146127 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:47.145546    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 04:04:47.146127 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:47.145580    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bzqwr\""
Jul 29 04:04:47.146127 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:47.145859    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 04:04:47.146127 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:47.146018    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mrbfg\""
Jul 29 04:04:47.380284 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:47.380246    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2mknl" event={"ID":"30460d33-1c48-4aae-abfd-0573702aa066","Type":"ContainerStarted","Data":"92f61c2d0794a9456b5505bfa4e953db78184ac3b7449f8ec69bd34db49a303a"}
Jul 29 04:04:47.383244 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:47.383212    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-55jls" event={"ID":"19251c81-52a7-4281-872d-3ad2ad32b2e2","Type":"ContainerStarted","Data":"60bd112cda9d9fed33fd4e93384bf0743f8495b9fd5e67feb881464aacbc7c18"}
Jul 29 04:04:47.385228 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:47.385112    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f2tq9" event={"ID":"4c4b3a0f-6a1e-49e9-9566-60cca5f58cde","Type":"ContainerStarted","Data":"092fe402f3b424be075e80d7ba094cc2a648bf619fb6f7e8546429503deabf9c"}
Jul 29 04:04:47.623040 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:47.623009    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-n2sbd"]
Jul 29 04:04:47.635486 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:47.635454    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-n2sbd"]
Jul 29 04:04:47.635651 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:47.635594    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-n2sbd"
Jul 29 04:04:47.638571 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:47.638275    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-nvqv7\""
Jul 29 04:04:47.638571 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:47.638454    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 29 04:04:47.724553 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:47.724434    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ddc1c31c-c048-4dc1-868d-92378b66d759-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-n2sbd\" (UID: \"ddc1c31c-c048-4dc1-868d-92378b66d759\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-n2sbd"
Jul 29 04:04:47.825789 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:47.825268    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ddc1c31c-c048-4dc1-868d-92378b66d759-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-n2sbd\" (UID: \"ddc1c31c-c048-4dc1-868d-92378b66d759\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-n2sbd"
Jul 29 04:04:47.825789 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:47.825456    2572 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 29 04:04:47.825789 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:47.825549    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddc1c31c-c048-4dc1-868d-92378b66d759-tls-certificates podName:ddc1c31c-c048-4dc1-868d-92378b66d759 nodeName:}" failed. No retries permitted until 2026-07-29 04:04:48.325529146 +0000 UTC m=+54.758567251 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/ddc1c31c-c048-4dc1-868d-92378b66d759-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-n2sbd" (UID: "ddc1c31c-c048-4dc1-868d-92378b66d759") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 29 04:04:48.331000 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:48.330347    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ddc1c31c-c048-4dc1-868d-92378b66d759-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-n2sbd\" (UID: \"ddc1c31c-c048-4dc1-868d-92378b66d759\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-n2sbd"
Jul 29 04:04:48.331000 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:48.330538    2572 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 29 04:04:48.331000 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:48.330614    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddc1c31c-c048-4dc1-868d-92378b66d759-tls-certificates podName:ddc1c31c-c048-4dc1-868d-92378b66d759 nodeName:}" failed. No retries permitted until 2026-07-29 04:04:49.330591884 +0000 UTC m=+55.763629998 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/ddc1c31c-c048-4dc1-868d-92378b66d759-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-n2sbd" (UID: "ddc1c31c-c048-4dc1-868d-92378b66d759") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 29 04:04:49.337079 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:49.336983    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ddc1c31c-c048-4dc1-868d-92378b66d759-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-n2sbd\" (UID: \"ddc1c31c-c048-4dc1-868d-92378b66d759\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-n2sbd"
Jul 29 04:04:49.341844 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:49.341814    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ddc1c31c-c048-4dc1-868d-92378b66d759-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-n2sbd\" (UID: \"ddc1c31c-c048-4dc1-868d-92378b66d759\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-n2sbd"
Jul 29 04:04:49.448846 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:49.448810    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-n2sbd"
Jul 29 04:04:52.468563 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:52.467953    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-n2sbd"]
Jul 29 04:04:52.474794 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:04:52.474760    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddc1c31c_c048_4dc1_868d_92378b66d759.slice/crio-302a91d50540be05802f7938f7f077cbad3404b872e0aa775a311f25bf5854b4 WatchSource:0}: Error finding container 302a91d50540be05802f7938f7f077cbad3404b872e0aa775a311f25bf5854b4: Status 404 returned error can't find the container with id 302a91d50540be05802f7938f7f077cbad3404b872e0aa775a311f25bf5854b4
Jul 29 04:04:53.403899 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:53.403858    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-55jls" event={"ID":"19251c81-52a7-4281-872d-3ad2ad32b2e2","Type":"ContainerStarted","Data":"571695e464cbf834a4bdf8d78a5d787e3a68c63cc543627de6ca0caad7b0cb77"}
Jul 29 04:04:53.406303 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:53.406268    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-n2sbd" event={"ID":"ddc1c31c-c048-4dc1-868d-92378b66d759","Type":"ContainerStarted","Data":"302a91d50540be05802f7938f7f077cbad3404b872e0aa775a311f25bf5854b4"}
Jul 29 04:04:53.408691 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:53.408665    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f2tq9" event={"ID":"4c4b3a0f-6a1e-49e9-9566-60cca5f58cde","Type":"ContainerStarted","Data":"6701dc3d165e097c797568e9fb2bf02f5eb2c3dabf388fffbb4bb90e91401790"}
Jul 29 04:04:53.408828 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:53.408728    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f2tq9" event={"ID":"4c4b3a0f-6a1e-49e9-9566-60cca5f58cde","Type":"ContainerStarted","Data":"b800136aece14c26594923b6c61af884fb96e98fcb8dd9a33c6e79cbbce6c2ba"}
Jul 29 04:04:53.408828 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:53.408769    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-f2tq9"
Jul 29 04:04:53.411244 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:53.411210    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2mknl" event={"ID":"30460d33-1c48-4aae-abfd-0573702aa066","Type":"ContainerStarted","Data":"fe5289f1b5f9d461afde34e094a61ddf35b78ee5b27e275d01c6b02562076c68"}
Jul 29 04:04:53.433291 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:53.433248    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-f2tq9" podStartSLOduration=2.943379867 podStartE2EDuration="8.433233056s" totalImagesPullingTime="5.489853189s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:04:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:04:53.431933033 +0000 UTC m=+59.864971149" watchObservedRunningTime="2026-07-29 04:04:53.433233056 +0000 UTC m=+59.866271169"
Jul 29 04:04:53.433424 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:53.433338    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-55jls" podStartSLOduration=2.62262479 podStartE2EDuration="8.433330265s" totalImagesPullingTime="5.810705475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:04:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:04:53.418456611 +0000 UTC m=+59.851494725" watchObservedRunningTime="2026-07-29 04:04:53.433330265 +0000 UTC m=+59.866368379"
Jul 29 04:04:54.332413 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:54.332377    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6z6p8"
Jul 29 04:04:54.416675 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:54.416636    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-n2sbd" event={"ID":"ddc1c31c-c048-4dc1-868d-92378b66d759","Type":"ContainerStarted","Data":"259865e227bdcdc0b599530d95150010279a58925e0fb7bdd3a103baf4dc87f5"}
Jul 29 04:04:54.416984 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:54.416960    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-n2sbd"
Jul 29 04:04:54.424167 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:54.424141    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-n2sbd"
Jul 29 04:04:54.433749 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:54.433684    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-n2sbd" podStartSLOduration=6.330037324 podStartE2EDuration="7.433582971s" totalImagesPullingTime="1.103545647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:04:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:04:54.433095972 +0000 UTC m=+60.866134091" watchObservedRunningTime="2026-07-29 04:04:54.433582971 +0000 UTC m=+60.866621082"
Jul 29 04:04:54.693533 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:54.693483    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-fpn2n"]
Jul 29 04:04:54.714381 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:54.714352    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-fpn2n"]
Jul 29 04:04:54.714536 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:54.714451    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-fpn2n"
Jul 29 04:04:54.716809 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:54.716775    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-6whjb\""
Jul 29 04:04:54.716809 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:54.716800    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 29 04:04:54.717118 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:54.717099    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 29 04:04:54.718126 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:54.718106    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 29 04:04:54.718221 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:54.718130    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 29 04:04:54.718281 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:54.718263    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 29 04:04:54.782714 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:54.782673    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e4e57029-e4b1-4a9b-a2c7-7482eb5a1a83-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-fpn2n\" (UID: \"e4e57029-e4b1-4a9b-a2c7-7482eb5a1a83\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-fpn2n"
Jul 29 04:04:54.782899 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:54.782781    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87hhl\" (UniqueName: \"kubernetes.io/projected/e4e57029-e4b1-4a9b-a2c7-7482eb5a1a83-kube-api-access-87hhl\") pod \"prometheus-operator-84d69f794d-fpn2n\" (UID: \"e4e57029-e4b1-4a9b-a2c7-7482eb5a1a83\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-fpn2n"
Jul 29 04:04:54.782899 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:54.782849    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4e57029-e4b1-4a9b-a2c7-7482eb5a1a83-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-fpn2n\" (UID: \"e4e57029-e4b1-4a9b-a2c7-7482eb5a1a83\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-fpn2n"
Jul 29 04:04:54.783007 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:54.782910    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4e57029-e4b1-4a9b-a2c7-7482eb5a1a83-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-fpn2n\" (UID: \"e4e57029-e4b1-4a9b-a2c7-7482eb5a1a83\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-fpn2n"
Jul 29 04:04:54.883843 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:54.883803    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87hhl\" (UniqueName: \"kubernetes.io/projected/e4e57029-e4b1-4a9b-a2c7-7482eb5a1a83-kube-api-access-87hhl\") pod \"prometheus-operator-84d69f794d-fpn2n\" (UID: \"e4e57029-e4b1-4a9b-a2c7-7482eb5a1a83\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-fpn2n"
Jul 29 04:04:54.884098 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:54.883873    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4e57029-e4b1-4a9b-a2c7-7482eb5a1a83-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-fpn2n\" (UID: \"e4e57029-e4b1-4a9b-a2c7-7482eb5a1a83\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-fpn2n"
Jul 29 04:04:54.884098 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:54.883933    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4e57029-e4b1-4a9b-a2c7-7482eb5a1a83-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-fpn2n\" (UID: \"e4e57029-e4b1-4a9b-a2c7-7482eb5a1a83\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-fpn2n"
Jul 29 04:04:54.884098 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:54.883996    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e4e57029-e4b1-4a9b-a2c7-7482eb5a1a83-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-fpn2n\" (UID: \"e4e57029-e4b1-4a9b-a2c7-7482eb5a1a83\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-fpn2n"
Jul 29 04:04:54.884098 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:54.884015    2572 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 29 04:04:54.884098 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:54.884087    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4e57029-e4b1-4a9b-a2c7-7482eb5a1a83-prometheus-operator-tls podName:e4e57029-e4b1-4a9b-a2c7-7482eb5a1a83 nodeName:}" failed. No retries permitted until 2026-07-29 04:04:55.384071216 +0000 UTC m=+61.817109326 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/e4e57029-e4b1-4a9b-a2c7-7482eb5a1a83-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-fpn2n" (UID: "e4e57029-e4b1-4a9b-a2c7-7482eb5a1a83") : secret "prometheus-operator-tls" not found
Jul 29 04:04:54.884762 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:54.884732    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4e57029-e4b1-4a9b-a2c7-7482eb5a1a83-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-fpn2n\" (UID: \"e4e57029-e4b1-4a9b-a2c7-7482eb5a1a83\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-fpn2n"
Jul 29 04:04:54.886936 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:54.886895    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e4e57029-e4b1-4a9b-a2c7-7482eb5a1a83-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-fpn2n\" (UID: \"e4e57029-e4b1-4a9b-a2c7-7482eb5a1a83\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-fpn2n"
Jul 29 04:04:54.894346 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:54.894324    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87hhl\" (UniqueName: \"kubernetes.io/projected/e4e57029-e4b1-4a9b-a2c7-7482eb5a1a83-kube-api-access-87hhl\") pod \"prometheus-operator-84d69f794d-fpn2n\" (UID: \"e4e57029-e4b1-4a9b-a2c7-7482eb5a1a83\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-fpn2n"
Jul 29 04:04:55.387872 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:55.387826    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4e57029-e4b1-4a9b-a2c7-7482eb5a1a83-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-fpn2n\" (UID: \"e4e57029-e4b1-4a9b-a2c7-7482eb5a1a83\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-fpn2n"
Jul 29 04:04:55.388284 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:55.387977    2572 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 29 04:04:55.388284 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:04:55.388057    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4e57029-e4b1-4a9b-a2c7-7482eb5a1a83-prometheus-operator-tls podName:e4e57029-e4b1-4a9b-a2c7-7482eb5a1a83 nodeName:}" failed. No retries permitted until 2026-07-29 04:04:56.388039811 +0000 UTC m=+62.821077924 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/e4e57029-e4b1-4a9b-a2c7-7482eb5a1a83-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-fpn2n" (UID: "e4e57029-e4b1-4a9b-a2c7-7482eb5a1a83") : secret "prometheus-operator-tls" not found
Jul 29 04:04:56.394173 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:56.394131    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4e57029-e4b1-4a9b-a2c7-7482eb5a1a83-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-fpn2n\" (UID: \"e4e57029-e4b1-4a9b-a2c7-7482eb5a1a83\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-fpn2n"
Jul 29 04:04:56.396903 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:56.396872    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4e57029-e4b1-4a9b-a2c7-7482eb5a1a83-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-fpn2n\" (UID: \"e4e57029-e4b1-4a9b-a2c7-7482eb5a1a83\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-fpn2n"
Jul 29 04:04:56.523368 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:56.523320    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-fpn2n"
Jul 29 04:04:56.761310 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:56.761279    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-fpn2n"]
Jul 29 04:04:56.764176 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:04:56.764151    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4e57029_e4b1_4a9b_a2c7_7482eb5a1a83.slice/crio-cd0ddf36f140132e68f61836a793f5ab7fa1c9443a8ec9bfdcf0df1bfe3e6b36 WatchSource:0}: Error finding container cd0ddf36f140132e68f61836a793f5ab7fa1c9443a8ec9bfdcf0df1bfe3e6b36: Status 404 returned error can't find the container with id cd0ddf36f140132e68f61836a793f5ab7fa1c9443a8ec9bfdcf0df1bfe3e6b36
Jul 29 04:04:57.427779 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:57.427737    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-fpn2n" event={"ID":"e4e57029-e4b1-4a9b-a2c7-7482eb5a1a83","Type":"ContainerStarted","Data":"cd0ddf36f140132e68f61836a793f5ab7fa1c9443a8ec9bfdcf0df1bfe3e6b36"}
Jul 29 04:04:57.429936 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:57.429828    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2mknl" event={"ID":"30460d33-1c48-4aae-abfd-0573702aa066","Type":"ContainerStarted","Data":"57ef10f4c091fb29d9029034ea994183a049b5561d3e2c91a32e0c635c6ef81e"}
Jul 29 04:04:58.437356 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:58.437308    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-fpn2n" event={"ID":"e4e57029-e4b1-4a9b-a2c7-7482eb5a1a83","Type":"ContainerStarted","Data":"d520a4927b929f68295c5d3d01c260cfed49bcde19b8c3ae89ab01c3c1f8f245"}
Jul 29 04:04:58.437753 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:58.437401    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-fpn2n" event={"ID":"e4e57029-e4b1-4a9b-a2c7-7482eb5a1a83","Type":"ContainerStarted","Data":"63fa8c6a6e2f2c0a642f56f59390b5d18fe8457582c8381b304f7967c766b2be"}
Jul 29 04:04:58.455538 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:58.454562    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-fpn2n" podStartSLOduration=2.997967937 podStartE2EDuration="4.454538508s" totalImagesPullingTime="1.456570571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:04:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:04:58.45378026 +0000 UTC m=+64.886818374" watchObservedRunningTime="2026-07-29 04:04:58.454538508 +0000 UTC m=+64.887576622"
Jul 29 04:04:59.827918 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:59.827871    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fn2z\" (UniqueName: \"kubernetes.io/projected/91c78bb4-6179-4fcf-b449-f18b90e0a4f2-kube-api-access-5fn2z\") pod \"network-check-target-b2gqf\" (UID: \"91c78bb4-6179-4fcf-b449-f18b90e0a4f2\") " pod="openshift-network-diagnostics/network-check-target-b2gqf"
Jul 29 04:04:59.828475 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:59.827971    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad8e0e9f-d912-40df-98b5-5e17f77aa631-original-pull-secret\") pod \"global-pull-secret-syncer-ftvjm\" (UID: \"ad8e0e9f-d912-40df-98b5-5e17f77aa631\") " pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:04:59.830625 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:59.830595    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 04:04:59.830773 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:59.830659    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 04:04:59.840776 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:59.840739    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 04:04:59.842072 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:59.842044    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad8e0e9f-d912-40df-98b5-5e17f77aa631-original-pull-secret\") pod \"global-pull-secret-syncer-ftvjm\" (UID: \"ad8e0e9f-d912-40df-98b5-5e17f77aa631\") " pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:04:59.852234 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:59.852208    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fn2z\" (UniqueName: \"kubernetes.io/projected/91c78bb4-6179-4fcf-b449-f18b90e0a4f2-kube-api-access-5fn2z\") pod \"network-check-target-b2gqf\" (UID: \"91c78bb4-6179-4fcf-b449-f18b90e0a4f2\") " pod="openshift-network-diagnostics/network-check-target-b2gqf"
Jul 29 04:04:59.928555 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:59.928492    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec-metrics-certs\") pod \"network-metrics-daemon-glpbr\" (UID: \"790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec\") " pod="openshift-multus/network-metrics-daemon-glpbr"
Jul 29 04:04:59.931204 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:59.931179    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 04:04:59.941628 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:04:59.941602    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec-metrics-certs\") pod \"network-metrics-daemon-glpbr\" (UID: \"790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec\") " pod="openshift-multus/network-metrics-daemon-glpbr"
Jul 29 04:05:00.028519 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.028455    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-mgwlp"]
Jul 29 04:05:00.052133 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.052099    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-mgwlp"]
Jul 29 04:05:00.052298 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.052162    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-2tsrx"]
Jul 29 04:05:00.052366 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.052323    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-mgwlp"
Jul 29 04:05:00.055358 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.055281    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-449vn\""
Jul 29 04:05:00.055535 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.055284    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 29 04:05:00.056047 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.056022    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 29 04:05:00.057632 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.057607    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2tsrx"
Jul 29 04:05:00.057798 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.057779    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mrbfg\""
Jul 29 04:05:00.059865 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.059841    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 29 04:05:00.060321 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.060282    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-phmdt\""
Jul 29 04:05:00.060430 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.060354    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 29 04:05:00.060520 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.060467    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 29 04:05:00.065819 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.065799    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glpbr"
Jul 29 04:05:00.067218 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.066553    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bzqwr\""
Jul 29 04:05:00.067722 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.067700    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nvlt9"]
Jul 29 04:05:00.071603 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.071376    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftvjm"
Jul 29 04:05:00.072379 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.072165    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-2tsrx"]
Jul 29 04:05:00.072379 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.072294    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nvlt9"
Jul 29 04:05:00.074736 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.074713    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b2gqf"
Jul 29 04:05:00.075274 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.075116    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 29 04:05:00.075774 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.075699    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dqgcw\""
Jul 29 04:05:00.076233 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.076212    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 29 04:05:00.076427 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.076413    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 29 04:05:00.129916 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.129879    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0e36ed56-ec3e-413f-8cd7-b4955804d557-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-2tsrx\" (UID: \"0e36ed56-ec3e-413f-8cd7-b4955804d557\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2tsrx"
Jul 29 04:05:00.130150 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.129921    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/07f13065-7fae-4b45-b8de-f3a093c67ae7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-mgwlp\" (UID: \"07f13065-7fae-4b45-b8de-f3a093c67ae7\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-mgwlp"
Jul 29 04:05:00.130150 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.129951    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9365ba50-d29a-42ed-a00c-d90acac83158-node-exporter-accelerators-collector-config\") pod \"node-exporter-nvlt9\" (UID: \"9365ba50-d29a-42ed-a00c-d90acac83158\") " pod="openshift-monitoring/node-exporter-nvlt9"
Jul 29 04:05:00.130150 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.129977    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/07f13065-7fae-4b45-b8de-f3a093c67ae7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-mgwlp\" (UID: \"07f13065-7fae-4b45-b8de-f3a093c67ae7\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-mgwlp"
Jul 29 04:05:00.130150 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.130031    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0e36ed56-ec3e-413f-8cd7-b4955804d557-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-2tsrx\" (UID: \"0e36ed56-ec3e-413f-8cd7-b4955804d557\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2tsrx"
Jul 29 04:05:00.130150 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.130066    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e36ed56-ec3e-413f-8cd7-b4955804d557-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-2tsrx\" (UID: \"0e36ed56-ec3e-413f-8cd7-b4955804d557\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2tsrx"
Jul 29 04:05:00.130150 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.130096    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9365ba50-d29a-42ed-a00c-d90acac83158-root\") pod \"node-exporter-nvlt9\" (UID: \"9365ba50-d29a-42ed-a00c-d90acac83158\") " pod="openshift-monitoring/node-exporter-nvlt9"
Jul 29 04:05:00.130150 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.130125    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrx6l\" (UniqueName: \"kubernetes.io/projected/07f13065-7fae-4b45-b8de-f3a093c67ae7-kube-api-access-vrx6l\") pod \"openshift-state-metrics-b8f49f5c6-mgwlp\" (UID: \"07f13065-7fae-4b45-b8de-f3a093c67ae7\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-mgwlp"
Jul 29 04:05:00.130150 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.130143    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9365ba50-d29a-42ed-a00c-d90acac83158-node-exporter-tls\") pod \"node-exporter-nvlt9\" (UID: \"9365ba50-d29a-42ed-a00c-d90acac83158\") " pod="openshift-monitoring/node-exporter-nvlt9"
Jul 29 04:05:00.130523 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.130166    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e36ed56-ec3e-413f-8cd7-b4955804d557-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-2tsrx\" (UID: \"0e36ed56-ec3e-413f-8cd7-b4955804d557\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2tsrx"
Jul 29 04:05:00.130523 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.130207    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9365ba50-d29a-42ed-a00c-d90acac83158-sys\") pod \"node-exporter-nvlt9\" (UID: \"9365ba50-d29a-42ed-a00c-d90acac83158\") " pod="openshift-monitoring/node-exporter-nvlt9"
Jul 29 04:05:00.130523 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.130230    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0e36ed56-ec3e-413f-8cd7-b4955804d557-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-2tsrx\" (UID: \"0e36ed56-ec3e-413f-8cd7-b4955804d557\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2tsrx"
Jul 29 04:05:00.130523 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.130259    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9365ba50-d29a-42ed-a00c-d90acac83158-node-exporter-textfile\") pod \"node-exporter-nvlt9\" (UID: \"9365ba50-d29a-42ed-a00c-d90acac83158\") " pod="openshift-monitoring/node-exporter-nvlt9"
Jul 29 04:05:00.130523 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.130295    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27fxl\" (UniqueName: \"kubernetes.io/projected/0e36ed56-ec3e-413f-8cd7-b4955804d557-kube-api-access-27fxl\") pod \"kube-state-metrics-56d9f944b4-2tsrx\" (UID: \"0e36ed56-ec3e-413f-8cd7-b4955804d557\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2tsrx"
Jul 29 04:05:00.130523 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.130323    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9365ba50-d29a-42ed-a00c-d90acac83158-node-exporter-wtmp\") pod \"node-exporter-nvlt9\" (UID: \"9365ba50-d29a-42ed-a00c-d90acac83158\") " pod="openshift-monitoring/node-exporter-nvlt9"
Jul 29 04:05:00.130523 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.130342    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9365ba50-d29a-42ed-a00c-d90acac83158-metrics-client-ca\") pod \"node-exporter-nvlt9\" (UID: \"9365ba50-d29a-42ed-a00c-d90acac83158\") " pod="openshift-monitoring/node-exporter-nvlt9"
Jul 29 04:05:00.130523 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.130384    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07f13065-7fae-4b45-b8de-f3a093c67ae7-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-mgwlp\" (UID: \"07f13065-7fae-4b45-b8de-f3a093c67ae7\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-mgwlp"
Jul 29 04:05:00.130523 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.130439    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lm7tl\" (UniqueName: \"kubernetes.io/projected/9365ba50-d29a-42ed-a00c-d90acac83158-kube-api-access-lm7tl\") pod \"node-exporter-nvlt9\" (UID: \"9365ba50-d29a-42ed-a00c-d90acac83158\") " pod="openshift-monitoring/node-exporter-nvlt9"
Jul 29 04:05:00.130523 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.130482    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9365ba50-d29a-42ed-a00c-d90acac83158-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nvlt9\" (UID: \"9365ba50-d29a-42ed-a00c-d90acac83158\") " pod="openshift-monitoring/node-exporter-nvlt9"
Jul 29 04:05:00.231321 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.231267    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27fxl\" (UniqueName: \"kubernetes.io/projected/0e36ed56-ec3e-413f-8cd7-b4955804d557-kube-api-access-27fxl\") pod \"kube-state-metrics-56d9f944b4-2tsrx\" (UID: \"0e36ed56-ec3e-413f-8cd7-b4955804d557\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2tsrx"
Jul 29 04:05:00.231543 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.231327    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9365ba50-d29a-42ed-a00c-d90acac83158-node-exporter-wtmp\") pod \"node-exporter-nvlt9\" (UID: \"9365ba50-d29a-42ed-a00c-d90acac83158\") " pod="openshift-monitoring/node-exporter-nvlt9"
Jul 29 04:05:00.231543 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.231353    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9365ba50-d29a-42ed-a00c-d90acac83158-metrics-client-ca\") pod \"node-exporter-nvlt9\" (UID: \"9365ba50-d29a-42ed-a00c-d90acac83158\") " pod="openshift-monitoring/node-exporter-nvlt9"
Jul 29 04:05:00.231543 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.231369    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07f13065-7fae-4b45-b8de-f3a093c67ae7-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-mgwlp\" (UID: \"07f13065-7fae-4b45-b8de-f3a093c67ae7\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-mgwlp"
Jul 29 04:05:00.231665 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.231583    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9365ba50-d29a-42ed-a00c-d90acac83158-node-exporter-wtmp\") pod \"node-exporter-nvlt9\" (UID: \"9365ba50-d29a-42ed-a00c-d90acac83158\") " pod="openshift-monitoring/node-exporter-nvlt9"
Jul 29 04:05:00.231665 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.231635    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lm7tl\" (UniqueName: \"kubernetes.io/projected/9365ba50-d29a-42ed-a00c-d90acac83158-kube-api-access-lm7tl\") pod \"node-exporter-nvlt9\" (UID: \"9365ba50-d29a-42ed-a00c-d90acac83158\") " pod="openshift-monitoring/node-exporter-nvlt9"
Jul 29 04:05:00.231727 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.231672    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9365ba50-d29a-42ed-a00c-d90acac83158-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nvlt9\" (UID: \"9365ba50-d29a-42ed-a00c-d90acac83158\") " pod="openshift-monitoring/node-exporter-nvlt9"
Jul 29 04:05:00.231759 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.231721    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0e36ed56-ec3e-413f-8cd7-b4955804d557-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-2tsrx\" (UID: \"0e36ed56-ec3e-413f-8cd7-b4955804d557\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2tsrx"
Jul 29 04:05:00.231794 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.231760    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/07f13065-7fae-4b45-b8de-f3a093c67ae7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-mgwlp\" (UID: \"07f13065-7fae-4b45-b8de-f3a093c67ae7\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-mgwlp"
Jul 29 04:05:00.231794 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.231783    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9365ba50-d29a-42ed-a00c-d90acac83158-node-exporter-accelerators-collector-config\") pod \"node-exporter-nvlt9\" (UID: \"9365ba50-d29a-42ed-a00c-d90acac83158\") " pod="openshift-monitoring/node-exporter-nvlt9"
Jul 29 04:05:00.231853 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.231812    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/07f13065-7fae-4b45-b8de-f3a093c67ae7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-mgwlp\" (UID: \"07f13065-7fae-4b45-b8de-f3a093c67ae7\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-mgwlp"
Jul 29 04:05:00.231853 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.231839    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0e36ed56-ec3e-413f-8cd7-b4955804d557-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-2tsrx\" (UID: \"0e36ed56-ec3e-413f-8cd7-b4955804d557\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2tsrx"
Jul 29 04:05:00.231912 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.231874    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e36ed56-ec3e-413f-8cd7-b4955804d557-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-2tsrx\" (UID: \"0e36ed56-ec3e-413f-8cd7-b4955804d557\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2tsrx"
Jul 29 04:05:00.231912 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.231898    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9365ba50-d29a-42ed-a00c-d90acac83158-root\") pod \"node-exporter-nvlt9\" (UID: \"9365ba50-d29a-42ed-a00c-d90acac83158\") " pod="openshift-monitoring/node-exporter-nvlt9"
Jul 29 04:05:00.231972 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.231938    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrx6l\" (UniqueName: \"kubernetes.io/projected/07f13065-7fae-4b45-b8de-f3a093c67ae7-kube-api-access-vrx6l\") pod \"openshift-state-metrics-b8f49f5c6-mgwlp\" (UID: \"07f13065-7fae-4b45-b8de-f3a093c67ae7\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-mgwlp"
Jul 29 04:05:00.231972 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.231963    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9365ba50-d29a-42ed-a00c-d90acac83158-node-exporter-tls\") pod \"node-exporter-nvlt9\" (UID: \"9365ba50-d29a-42ed-a00c-d90acac83158\") " pod="openshift-monitoring/node-exporter-nvlt9"
Jul 29 04:05:00.232033 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.231982    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07f13065-7fae-4b45-b8de-f3a093c67ae7-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-mgwlp\" (UID: \"07f13065-7fae-4b45-b8de-f3a093c67ae7\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-mgwlp"
Jul 29 04:05:00.232033 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.231992    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e36ed56-ec3e-413f-8cd7-b4955804d557-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-2tsrx\" (UID: \"0e36ed56-ec3e-413f-8cd7-b4955804d557\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2tsrx"
Jul 29 04:05:00.232033 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.232026    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9365ba50-d29a-42ed-a00c-d90acac83158-sys\") pod \"node-exporter-nvlt9\" (UID: \"9365ba50-d29a-42ed-a00c-d90acac83158\") " pod="openshift-monitoring/node-exporter-nvlt9"
Jul 29 04:05:00.232118 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.232052    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0e36ed56-ec3e-413f-8cd7-b4955804d557-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-2tsrx\" (UID: \"0e36ed56-ec3e-413f-8cd7-b4955804d557\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2tsrx"
Jul 29 04:05:00.232118 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.232071    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9365ba50-d29a-42ed-a00c-d90acac83158-node-exporter-textfile\") pod \"node-exporter-nvlt9\" (UID: \"9365ba50-d29a-42ed-a00c-d90acac83158\") " pod="openshift-monitoring/node-exporter-nvlt9"
Jul 29 04:05:00.232235 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.232212    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9365ba50-d29a-42ed-a00c-d90acac83158-metrics-client-ca\") pod \"node-exporter-nvlt9\" (UID: \"9365ba50-d29a-42ed-a00c-d90acac83158\") " pod="openshift-monitoring/node-exporter-nvlt9"
Jul 29 04:05:00.232269 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.232256    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9365ba50-d29a-42ed-a00c-d90acac83158-node-exporter-textfile\") pod \"node-exporter-nvlt9\" (UID: \"9365ba50-d29a-42ed-a00c-d90acac83158\") " pod="openshift-monitoring/node-exporter-nvlt9"
Jul 29 04:05:00.233048 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.232434    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9365ba50-d29a-42ed-a00c-d90acac83158-root\") pod \"node-exporter-nvlt9\" (UID: \"9365ba50-d29a-42ed-a00c-d90acac83158\") " pod="openshift-monitoring/node-exporter-nvlt9"
Jul 29 04:05:00.233048 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.232516    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9365ba50-d29a-42ed-a00c-d90acac83158-sys\") pod \"node-exporter-nvlt9\" (UID: \"9365ba50-d29a-42ed-a00c-d90acac83158\") " pod="openshift-monitoring/node-exporter-nvlt9"
Jul 29 04:05:00.233048 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.232599    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0e36ed56-ec3e-413f-8cd7-b4955804d557-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-2tsrx\" (UID: \"0e36ed56-ec3e-413f-8cd7-b4955804d557\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2tsrx"
Jul 29 04:05:00.233293 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.233149    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9365ba50-d29a-42ed-a00c-d90acac83158-node-exporter-accelerators-collector-config\") pod \"node-exporter-nvlt9\" (UID: \"9365ba50-d29a-42ed-a00c-d90acac83158\") " pod="openshift-monitoring/node-exporter-nvlt9"
Jul 29 04:05:00.233423 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.233399    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e36ed56-ec3e-413f-8cd7-b4955804d557-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-2tsrx\" (UID: \"0e36ed56-ec3e-413f-8cd7-b4955804d557\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2tsrx"
Jul 29 04:05:00.233483 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.233454    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0e36ed56-ec3e-413f-8cd7-b4955804d557-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-2tsrx\" (UID: \"0e36ed56-ec3e-413f-8cd7-b4955804d557\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2tsrx"
Jul 29 04:05:00.235613 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.235568    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0e36ed56-ec3e-413f-8cd7-b4955804d557-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-2tsrx\" (UID: \"0e36ed56-ec3e-413f-8cd7-b4955804d557\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2tsrx"
Jul 29 04:05:00.235613 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.235587    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/07f13065-7fae-4b45-b8de-f3a093c67ae7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-mgwlp\" (UID: \"07f13065-7fae-4b45-b8de-f3a093c67ae7\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-mgwlp"
Jul 29 04:05:00.236082 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.236058    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9365ba50-d29a-42ed-a00c-d90acac83158-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nvlt9\" (UID: \"9365ba50-d29a-42ed-a00c-d90acac83158\") " pod="openshift-monitoring/node-exporter-nvlt9"
Jul 29 04:05:00.236522 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.236476    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e36ed56-ec3e-413f-8cd7-b4955804d557-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-2tsrx\" (UID: \"0e36ed56-ec3e-413f-8cd7-b4955804d557\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2tsrx"
Jul 29 04:05:00.236650 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.236628    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9365ba50-d29a-42ed-a00c-d90acac83158-node-exporter-tls\") pod \"node-exporter-nvlt9\" (UID: \"9365ba50-d29a-42ed-a00c-d90acac83158\") " pod="openshift-monitoring/node-exporter-nvlt9"
Jul 29 04:05:00.236928 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.236908    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/07f13065-7fae-4b45-b8de-f3a093c67ae7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-mgwlp\" (UID: \"07f13065-7fae-4b45-b8de-f3a093c67ae7\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-mgwlp"
Jul 29 04:05:00.240218 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.240198    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27fxl\" (UniqueName: \"kubernetes.io/projected/0e36ed56-ec3e-413f-8cd7-b4955804d557-kube-api-access-27fxl\") pod \"kube-state-metrics-56d9f944b4-2tsrx\" (UID: \"0e36ed56-ec3e-413f-8cd7-b4955804d557\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2tsrx"
Jul 29 04:05:00.240597 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.240573    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lm7tl\" (UniqueName: \"kubernetes.io/projected/9365ba50-d29a-42ed-a00c-d90acac83158-kube-api-access-lm7tl\") pod \"node-exporter-nvlt9\" (UID: \"9365ba50-d29a-42ed-a00c-d90acac83158\") " pod="openshift-monitoring/node-exporter-nvlt9"
Jul 29 04:05:00.241084 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.241063    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrx6l\" (UniqueName: \"kubernetes.io/projected/07f13065-7fae-4b45-b8de-f3a093c67ae7-kube-api-access-vrx6l\") pod \"openshift-state-metrics-b8f49f5c6-mgwlp\" (UID: \"07f13065-7fae-4b45-b8de-f3a093c67ae7\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-mgwlp"
Jul 29 04:05:00.365938 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.365892    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-mgwlp"
Jul 29 04:05:00.373086 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.373053    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2tsrx"
Jul 29 04:05:00.382905 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.382877    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nvlt9"
Jul 29 04:05:00.450931 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.450805    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nvlt9" event={"ID":"9365ba50-d29a-42ed-a00c-d90acac83158","Type":"ContainerStarted","Data":"d87486d5ac332ca265f055cf59775ebc3bcf71433a6bc9a3d38d6a3ad3b21486"}
Jul 29 04:05:00.575464 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.575430    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-glpbr"]
Jul 29 04:05:00.578958 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:05:00.578932    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod790cc9d0_6220_4ad0_bff0_a1ae3fbcaeec.slice/crio-d4aadb1a4b0d0c477ff6022eac4a71099d89494aa3d3275037459a3df09a7330 WatchSource:0}: Error finding container d4aadb1a4b0d0c477ff6022eac4a71099d89494aa3d3275037459a3df09a7330: Status 404 returned error can't find the container with id d4aadb1a4b0d0c477ff6022eac4a71099d89494aa3d3275037459a3df09a7330
Jul 29 04:05:00.624702 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.624606    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-2tsrx"]
Jul 29 04:05:00.628687 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:05:00.628659    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e36ed56_ec3e_413f_8cd7_b4955804d557.slice/crio-0cb81dc9d8e26caba090d4d8626e0724510f24761f9d37083433e3c7f6466e29 WatchSource:0}: Error finding container 0cb81dc9d8e26caba090d4d8626e0724510f24761f9d37083433e3c7f6466e29: Status 404 returned error can't find the container with id 0cb81dc9d8e26caba090d4d8626e0724510f24761f9d37083433e3c7f6466e29
Jul 29 04:05:00.637820 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.637792    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-mgwlp"]
Jul 29 04:05:00.640298 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:05:00.640271    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07f13065_7fae_4b45_b8de_f3a093c67ae7.slice/crio-89d574f6073bafd16ecb6bf43899d4076c7f074e86ddc6758f32c57380ea1b64 WatchSource:0}: Error finding container 89d574f6073bafd16ecb6bf43899d4076c7f074e86ddc6758f32c57380ea1b64: Status 404 returned error can't find the container with id 89d574f6073bafd16ecb6bf43899d4076c7f074e86ddc6758f32c57380ea1b64
Jul 29 04:05:00.800972 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.800937    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ftvjm"]
Jul 29 04:05:00.803820 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:00.803797    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-b2gqf"]
Jul 29 04:05:00.805461 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:05:00.805428    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad8e0e9f_d912_40df_98b5_5e17f77aa631.slice/crio-b029426c5822407fdc2f4a3a93cacebee6bff308c803dba3650a3932617911a9 WatchSource:0}: Error finding container b029426c5822407fdc2f4a3a93cacebee6bff308c803dba3650a3932617911a9: Status 404 returned error can't find the container with id b029426c5822407fdc2f4a3a93cacebee6bff308c803dba3650a3932617911a9
Jul 29 04:05:00.806529 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:05:00.806477    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91c78bb4_6179_4fcf_b449_f18b90e0a4f2.slice/crio-fb9c06fc8cf552d5cf4447f71d824736835fa7d46b13683f3688af598d585405 WatchSource:0}: Error finding container fb9c06fc8cf552d5cf4447f71d824736835fa7d46b13683f3688af598d585405: Status 404 returned error can't find the container with id fb9c06fc8cf552d5cf4447f71d824736835fa7d46b13683f3688af598d585405
Jul 29 04:05:01.112971 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.112938    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 04:05:01.117209 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.117180    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 29 04:05:01.119783 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.119757    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 29 04:05:01.119906 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.119823    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 29 04:05:01.119906 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.119874    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 29 04:05:01.120024 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.119874    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 29 04:05:01.120115 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.120096    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 29 04:05:01.120181 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.120096    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 29 04:05:01.120181 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.120122    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-lrb42\""
Jul 29 04:05:01.120181 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.120156    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 29 04:05:01.120317 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.120106    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 29 04:05:01.120368 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.120335    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 29 04:05:01.133479 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.133448    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 04:05:01.238792 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.238754    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 04:05:01.238989 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.238815    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 04:05:01.238989 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.238842    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 04:05:01.238989 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.238868    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45skw\" (UniqueName: \"kubernetes.io/projected/bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96-kube-api-access-45skw\") pod \"alertmanager-main-0\" (UID: \"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 04:05:01.238989 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.238908    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 04:05:01.238989 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.238957    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 04:05:01.239254 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.239047    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 04:05:01.239254 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.239094    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 04:05:01.239254 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.239125    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96-web-config\") pod \"alertmanager-main-0\" (UID: \"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 04:05:01.239254 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.239176    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 04:05:01.239254 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.239227    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96-config-volume\") pod \"alertmanager-main-0\" (UID: \"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 04:05:01.239455 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.239266    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96-config-out\") pod \"alertmanager-main-0\" (UID: \"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 04:05:01.239455 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.239292    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 04:05:01.341402 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.340243    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96-config-volume\") pod \"alertmanager-main-0\" (UID: \"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 04:05:01.341402 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.340308    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96-config-out\") pod \"alertmanager-main-0\" (UID: \"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 04:05:01.341402 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.340335    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 04:05:01.341402 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.340559    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 04:05:01.341402 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.340608    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 04:05:01.341402 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.340640    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 04:05:01.341402 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.340667    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45skw\" (UniqueName: \"kubernetes.io/projected/bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96-kube-api-access-45skw\") pod \"alertmanager-main-0\" (UID: \"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 04:05:01.341402 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.340720    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 04:05:01.341402 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:05:01.340724    2572 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 29 04:05:01.341402 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.340740    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 04:05:01.341402 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.340773    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 04:05:01.341402 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:05:01.340813    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96-secret-alertmanager-main-tls podName:bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96 nodeName:}" failed. No retries permitted until 2026-07-29 04:05:01.84078783 +0000 UTC m=+68.273825974 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96") : secret "alertmanager-main-tls" not found
Jul 29 04:05:01.341402 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.340812    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 04:05:01.341402 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.340860    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 04:05:01.341402 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.340896    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96-web-config\") pod \"alertmanager-main-0\" (UID: \"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 04:05:01.341402 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.340925    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 04:05:01.342259 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.341694    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 04:05:01.342259 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.342105    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 04:05:01.345333 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.345305    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96-config-out\") pod \"alertmanager-main-0\" (UID: \"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 04:05:01.345333 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.345328    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 04:05:01.345867 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.345827    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 04:05:01.358155 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.358122    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 04:05:01.358319 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.358213    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 04:05:01.358319 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.358235    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96-config-volume\") pod \"alertmanager-main-0\" (UID: \"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 04:05:01.358749 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.358723    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96-web-config\") pod \"alertmanager-main-0\" (UID: \"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 04:05:01.360903 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.360878    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45skw\" (UniqueName: \"kubernetes.io/projected/bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96-kube-api-access-45skw\") pod \"alertmanager-main-0\" (UID: \"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 04:05:01.361929 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.361904    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 04:05:01.468387 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.468148    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-mgwlp" event={"ID":"07f13065-7fae-4b45-b8de-f3a093c67ae7","Type":"ContainerStarted","Data":"318278ce8594f18da8cbe5f39ab3c89acbfd0ab0c125a82aaaf0851438bd6b8e"}
Jul 29 04:05:01.468387 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.468271    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-mgwlp" event={"ID":"07f13065-7fae-4b45-b8de-f3a093c67ae7","Type":"ContainerStarted","Data":"407d3ff2b6bce2810f5c2bc6d3750618d8e250dbc731a167c5bfc6ba64888b79"}
Jul 29 04:05:01.468387 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.468301    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-mgwlp" event={"ID":"07f13065-7fae-4b45-b8de-f3a093c67ae7","Type":"ContainerStarted","Data":"89d574f6073bafd16ecb6bf43899d4076c7f074e86ddc6758f32c57380ea1b64"}
Jul 29 04:05:01.469825 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.469795    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-b2gqf" event={"ID":"91c78bb4-6179-4fcf-b449-f18b90e0a4f2","Type":"ContainerStarted","Data":"fb9c06fc8cf552d5cf4447f71d824736835fa7d46b13683f3688af598d585405"}
Jul 29 04:05:01.473265 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.473230    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2mknl" event={"ID":"30460d33-1c48-4aae-abfd-0573702aa066","Type":"ContainerStarted","Data":"9b68be6a6a3e8377f1d89c3c418da63614fa6f37f6e4077666703acd3dc045d2"}
Jul 29 04:05:01.476381 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.476312    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2tsrx" event={"ID":"0e36ed56-ec3e-413f-8cd7-b4955804d557","Type":"ContainerStarted","Data":"0cb81dc9d8e26caba090d4d8626e0724510f24761f9d37083433e3c7f6466e29"}
Jul 29 04:05:01.479974 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.479942    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ftvjm" event={"ID":"ad8e0e9f-d912-40df-98b5-5e17f77aa631","Type":"ContainerStarted","Data":"b029426c5822407fdc2f4a3a93cacebee6bff308c803dba3650a3932617911a9"}
Jul 29 04:05:01.481170 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.481131    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-glpbr" event={"ID":"790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec","Type":"ContainerStarted","Data":"d4aadb1a4b0d0c477ff6022eac4a71099d89494aa3d3275037459a3df09a7330"}
Jul 29 04:05:01.491532 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.491459    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2mknl" podStartSLOduration=1.751886485 podStartE2EDuration="15.491436293s" totalImagesPullingTime="13.739549808s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 04:04:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:05:01.489835758 +0000 UTC m=+67.922873875" watchObservedRunningTime="2026-07-29 04:05:01.491436293 +0000 UTC m=+67.924474408"
Jul 29 04:05:01.847277 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.847233    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 04:05:01.850704 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:01.850673    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 04:05:02.030374 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:02.030337    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 29 04:05:02.045370 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:02.045318    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7b44b78b75-zgh2w"]
Jul 29 04:05:02.058200 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:02.058015    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7b44b78b75-zgh2w"
Jul 29 04:05:02.059536 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:02.059480    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7b44b78b75-zgh2w"]
Jul 29 04:05:02.062939 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:02.060677    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 29 04:05:02.062939 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:02.060696    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 29 04:05:02.062939 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:02.060991    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 29 04:05:02.062939 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:02.062145    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-4jpsb\""
Jul 29 04:05:02.062939 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:02.062377    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 29 04:05:02.062939 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:02.062702    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 29 04:05:02.062939 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:02.062905    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-69j492von7bvp\""
Jul 29 04:05:02.149555 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:02.149448    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18c3c56e-b5d1-49ba-acca-b28e821f32eb-metrics-client-ca\") pod \"thanos-querier-7b44b78b75-zgh2w\" (UID: \"18c3c56e-b5d1-49ba-acca-b28e821f32eb\") " pod="openshift-monitoring/thanos-querier-7b44b78b75-zgh2w"
Jul 29 04:05:02.149555 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:02.149489    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18c3c56e-b5d1-49ba-acca-b28e821f32eb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b44b78b75-zgh2w\" (UID: \"18c3c56e-b5d1-49ba-acca-b28e821f32eb\") " pod="openshift-monitoring/thanos-querier-7b44b78b75-zgh2w"
Jul 29 04:05:02.149555 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:02.149533    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tshnk\" (UniqueName: \"kubernetes.io/projected/18c3c56e-b5d1-49ba-acca-b28e821f32eb-kube-api-access-tshnk\") pod \"thanos-querier-7b44b78b75-zgh2w\" (UID: \"18c3c56e-b5d1-49ba-acca-b28e821f32eb\") " pod="openshift-monitoring/thanos-querier-7b44b78b75-zgh2w"
Jul 29 04:05:02.150125 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:02.149575    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/18c3c56e-b5d1-49ba-acca-b28e821f32eb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b44b78b75-zgh2w\" (UID: \"18c3c56e-b5d1-49ba-acca-b28e821f32eb\") " pod="openshift-monitoring/thanos-querier-7b44b78b75-zgh2w"
Jul 29 04:05:02.150125 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:02.149602    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/18c3c56e-b5d1-49ba-acca-b28e821f32eb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b44b78b75-zgh2w\" (UID: \"18c3c56e-b5d1-49ba-acca-b28e821f32eb\") " pod="openshift-monitoring/thanos-querier-7b44b78b75-zgh2w"
Jul 29 04:05:02.150125 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:02.149632    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/18c3c56e-b5d1-49ba-acca-b28e821f32eb-secret-thanos-querier-tls\") pod \"thanos-querier-7b44b78b75-zgh2w\" (UID: \"18c3c56e-b5d1-49ba-acca-b28e821f32eb\") " pod="openshift-monitoring/thanos-querier-7b44b78b75-zgh2w"
Jul 29 04:05:02.150125 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:02.149671    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18c3c56e-b5d1-49ba-acca-b28e821f32eb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b44b78b75-zgh2w\" (UID: \"18c3c56e-b5d1-49ba-acca-b28e821f32eb\") " pod="openshift-monitoring/thanos-querier-7b44b78b75-zgh2w"
Jul 29 04:05:02.150125 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:02.149699    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/18c3c56e-b5d1-49ba-acca-b28e821f32eb-secret-grpc-tls\") pod \"thanos-querier-7b44b78b75-zgh2w\" (UID: \"18c3c56e-b5d1-49ba-acca-b28e821f32eb\") " pod="openshift-monitoring/thanos-querier-7b44b78b75-zgh2w"
Jul 29 04:05:02.250899 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:02.250519    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18c3c56e-b5d1-49ba-acca-b28e821f32eb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b44b78b75-zgh2w\" (UID: \"18c3c56e-b5d1-49ba-acca-b28e821f32eb\") " pod="openshift-monitoring/thanos-querier-7b44b78b75-zgh2w"
Jul 29 04:05:02.250899 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:02.250592    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/18c3c56e-b5d1-49ba-acca-b28e821f32eb-secret-grpc-tls\") pod \"thanos-querier-7b44b78b75-zgh2w\" (UID: \"18c3c56e-b5d1-49ba-acca-b28e821f32eb\") " pod="openshift-monitoring/thanos-querier-7b44b78b75-zgh2w"
Jul 29 04:05:02.250899 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:02.250634    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18c3c56e-b5d1-49ba-acca-b28e821f32eb-metrics-client-ca\") pod \"thanos-querier-7b44b78b75-zgh2w\" (UID: \"18c3c56e-b5d1-49ba-acca-b28e821f32eb\") " pod="openshift-monitoring/thanos-querier-7b44b78b75-zgh2w"
Jul 29 04:05:02.250899 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:02.250652    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18c3c56e-b5d1-49ba-acca-b28e821f32eb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b44b78b75-zgh2w\" (UID: \"18c3c56e-b5d1-49ba-acca-b28e821f32eb\") " pod="openshift-monitoring/thanos-querier-7b44b78b75-zgh2w"
Jul 29 04:05:02.250899 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:02.250679    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tshnk\" (UniqueName: \"kubernetes.io/projected/18c3c56e-b5d1-49ba-acca-b28e821f32eb-kube-api-access-tshnk\") pod \"thanos-querier-7b44b78b75-zgh2w\" (UID: \"18c3c56e-b5d1-49ba-acca-b28e821f32eb\") " pod="openshift-monitoring/thanos-querier-7b44b78b75-zgh2w"
Jul 29 04:05:02.250899 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:02.250716    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/18c3c56e-b5d1-49ba-acca-b28e821f32eb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b44b78b75-zgh2w\" (UID: \"18c3c56e-b5d1-49ba-acca-b28e821f32eb\") " pod="openshift-monitoring/thanos-querier-7b44b78b75-zgh2w"
Jul 29 04:05:02.250899 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:02.250742    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/18c3c56e-b5d1-49ba-acca-b28e821f32eb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b44b78b75-zgh2w\" (UID: \"18c3c56e-b5d1-49ba-acca-b28e821f32eb\") " pod="openshift-monitoring/thanos-querier-7b44b78b75-zgh2w"
Jul 29 04:05:02.250899 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:02.250775    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/18c3c56e-b5d1-49ba-acca-b28e821f32eb-secret-thanos-querier-tls\") pod \"thanos-querier-7b44b78b75-zgh2w\" (UID: \"18c3c56e-b5d1-49ba-acca-b28e821f32eb\") " pod="openshift-monitoring/thanos-querier-7b44b78b75-zgh2w"
Jul 29 04:05:02.251928 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:02.251893    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18c3c56e-b5d1-49ba-acca-b28e821f32eb-metrics-client-ca\") pod \"thanos-querier-7b44b78b75-zgh2w\" (UID: \"18c3c56e-b5d1-49ba-acca-b28e821f32eb\") " pod="openshift-monitoring/thanos-querier-7b44b78b75-zgh2w"
Jul 29 04:05:02.254304 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:02.253753    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18c3c56e-b5d1-49ba-acca-b28e821f32eb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b44b78b75-zgh2w\" (UID: \"18c3c56e-b5d1-49ba-acca-b28e821f32eb\") " pod="openshift-monitoring/thanos-querier-7b44b78b75-zgh2w"
Jul 29 04:05:02.254304 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:02.254232    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18c3c56e-b5d1-49ba-acca-b28e821f32eb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b44b78b75-zgh2w\" (UID: \"18c3c56e-b5d1-49ba-acca-b28e821f32eb\") " pod="openshift-monitoring/thanos-querier-7b44b78b75-zgh2w"
Jul 29 04:05:02.254304 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:02.254273    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/18c3c56e-b5d1-49ba-acca-b28e821f32eb-secret-grpc-tls\") pod \"thanos-querier-7b44b78b75-zgh2w\" (UID: \"18c3c56e-b5d1-49ba-acca-b28e821f32eb\") " pod="openshift-monitoring/thanos-querier-7b44b78b75-zgh2w"
Jul 29 04:05:02.254975 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:02.254950    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/18c3c56e-b5d1-49ba-acca-b28e821f32eb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b44b78b75-zgh2w\" (UID: \"18c3c56e-b5d1-49ba-acca-b28e821f32eb\") " pod="openshift-monitoring/thanos-querier-7b44b78b75-zgh2w"
Jul 29 04:05:02.255411 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:02.255383    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/18c3c56e-b5d1-49ba-acca-b28e821f32eb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b44b78b75-zgh2w\" (UID: \"18c3c56e-b5d1-49ba-acca-b28e821f32eb\") " pod="openshift-monitoring/thanos-querier-7b44b78b75-zgh2w"
Jul 29 04:05:02.256221 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:02.256197    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/18c3c56e-b5d1-49ba-acca-b28e821f32eb-secret-thanos-querier-tls\") pod \"thanos-querier-7b44b78b75-zgh2w\" (UID: \"18c3c56e-b5d1-49ba-acca-b28e821f32eb\") " pod="openshift-monitoring/thanos-querier-7b44b78b75-zgh2w"
Jul 29 04:05:02.262735 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:02.262703    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tshnk\" (UniqueName: \"kubernetes.io/projected/18c3c56e-b5d1-49ba-acca-b28e821f32eb-kube-api-access-tshnk\") pod \"thanos-querier-7b44b78b75-zgh2w\" (UID: \"18c3c56e-b5d1-49ba-acca-b28e821f32eb\") " pod="openshift-monitoring/thanos-querier-7b44b78b75-zgh2w"
Jul 29 04:05:02.371633 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:02.371592    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7b44b78b75-zgh2w"
Jul 29 04:05:03.420591 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:03.419639    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-f2tq9"
Jul 29 04:05:03.501446 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:03.501408    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nvlt9" event={"ID":"9365ba50-d29a-42ed-a00c-d90acac83158","Type":"ContainerStarted","Data":"9a9d665db7c57cb3884d7274d6be7adda7a0aac046c8bdb86ba8435804e2fc55"}
Jul 29 04:05:03.530044 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:03.529808    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-mgwlp" event={"ID":"07f13065-7fae-4b45-b8de-f3a093c67ae7","Type":"ContainerStarted","Data":"b81fc4d31f2ac996a5dc38af6f376712dbd6a11ff90c93c779097d3d60d65d41"}
Jul 29 04:05:03.544586 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:03.544558    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2tsrx" event={"ID":"0e36ed56-ec3e-413f-8cd7-b4955804d557","Type":"ContainerStarted","Data":"8e04bc0f74943c0a2069b2c249c76b6b7dddf089e58854f865ecebe2856886b2"}
Jul 29 04:05:03.550928 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:03.549777    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 04:05:03.564977 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:03.564901    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-mgwlp" podStartSLOduration=1.02768323 podStartE2EDuration="3.564877464s" totalImagesPullingTime="2.537194234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:05:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:05:03.563559401 +0000 UTC m=+69.996597519" watchObservedRunningTime="2026-07-29 04:05:03.564877464 +0000 UTC m=+69.997915579"
Jul 29 04:05:03.574516 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:03.571019    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7b44b78b75-zgh2w"]
Jul 29 04:05:04.339458 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.339416    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-78c57778cc-rzf4d"]
Jul 29 04:05:04.343953 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.343926    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-78c57778cc-rzf4d"
Jul 29 04:05:04.347838 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.347813    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 29 04:05:04.347970 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.347875    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 29 04:05:04.348061 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.347820    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-sktrt\""
Jul 29 04:05:04.348157 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.348043    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-594fon3uucepj\""
Jul 29 04:05:04.348296 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.348279    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 29 04:05:04.348473 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.348457    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 29 04:05:04.357817 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.357796    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-78c57778cc-rzf4d"]
Jul 29 04:05:04.480128 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.479766    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f51c5b1-20d1-41ee-9cdd-e91466edba0c-client-ca-bundle\") pod \"metrics-server-78c57778cc-rzf4d\" (UID: \"3f51c5b1-20d1-41ee-9cdd-e91466edba0c\") " pod="openshift-monitoring/metrics-server-78c57778cc-rzf4d"
Jul 29 04:05:04.480128 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.479817    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f51c5b1-20d1-41ee-9cdd-e91466edba0c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78c57778cc-rzf4d\" (UID: \"3f51c5b1-20d1-41ee-9cdd-e91466edba0c\") " pod="openshift-monitoring/metrics-server-78c57778cc-rzf4d"
Jul 29 04:05:04.480128 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.479851    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3f51c5b1-20d1-41ee-9cdd-e91466edba0c-secret-metrics-server-client-certs\") pod \"metrics-server-78c57778cc-rzf4d\" (UID: \"3f51c5b1-20d1-41ee-9cdd-e91466edba0c\") " pod="openshift-monitoring/metrics-server-78c57778cc-rzf4d"
Jul 29 04:05:04.480128 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.479891    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3f51c5b1-20d1-41ee-9cdd-e91466edba0c-secret-metrics-server-tls\") pod \"metrics-server-78c57778cc-rzf4d\" (UID: \"3f51c5b1-20d1-41ee-9cdd-e91466edba0c\") " pod="openshift-monitoring/metrics-server-78c57778cc-rzf4d"
Jul 29 04:05:04.480128 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.479930    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3f51c5b1-20d1-41ee-9cdd-e91466edba0c-audit-log\") pod \"metrics-server-78c57778cc-rzf4d\" (UID: \"3f51c5b1-20d1-41ee-9cdd-e91466edba0c\") " pod="openshift-monitoring/metrics-server-78c57778cc-rzf4d"
Jul 29 04:05:04.480128 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.479986    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3f51c5b1-20d1-41ee-9cdd-e91466edba0c-metrics-server-audit-profiles\") pod \"metrics-server-78c57778cc-rzf4d\" (UID: \"3f51c5b1-20d1-41ee-9cdd-e91466edba0c\") " pod="openshift-monitoring/metrics-server-78c57778cc-rzf4d"
Jul 29 04:05:04.480128 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.480031    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t47t6\" (UniqueName: \"kubernetes.io/projected/3f51c5b1-20d1-41ee-9cdd-e91466edba0c-kube-api-access-t47t6\") pod \"metrics-server-78c57778cc-rzf4d\" (UID: \"3f51c5b1-20d1-41ee-9cdd-e91466edba0c\") " pod="openshift-monitoring/metrics-server-78c57778cc-rzf4d"
Jul 29 04:05:04.553735 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.553379    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2tsrx" event={"ID":"0e36ed56-ec3e-413f-8cd7-b4955804d557","Type":"ContainerStarted","Data":"e0dce01a431847a374833cfc70f18e11fafafcfc9387be40dc5bd052698dd94b"}
Jul 29 04:05:04.553735 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.553456    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2tsrx" event={"ID":"0e36ed56-ec3e-413f-8cd7-b4955804d557","Type":"ContainerStarted","Data":"afd3813465d4b6416b78614141e6043693505c99ceb6a3ed853e0b5072fcfc66"}
Jul 29 04:05:04.555176 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.555140    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b44b78b75-zgh2w" event={"ID":"18c3c56e-b5d1-49ba-acca-b28e821f32eb","Type":"ContainerStarted","Data":"cf63294dcdbecc0be56df2a058239e26ae41a62c614f203dbc7d1ff02acb22d1"}
Jul 29 04:05:04.556579 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.556547    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96","Type":"ContainerStarted","Data":"03451e0c02e93a4592ffeb1f8d4aee5eb189fcc81a105f95727b9e9bf15c0d8e"}
Jul 29 04:05:04.559283 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.559253    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-glpbr" event={"ID":"790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec","Type":"ContainerStarted","Data":"118bf69c087b3c3eef485ab715f609d918781949b900b1e70dcad5f4e71d9769"}
Jul 29 04:05:04.559410 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.559310    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-glpbr" event={"ID":"790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec","Type":"ContainerStarted","Data":"c17dba6f53c4748aaf72b7f587c3647f27dfed560ae01f2d8f66a6863e9b1023"}
Jul 29 04:05:04.560953 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.560925    2572 generic.go:356] "Generic (PLEG): container finished" podID="9365ba50-d29a-42ed-a00c-d90acac83158" containerID="9a9d665db7c57cb3884d7274d6be7adda7a0aac046c8bdb86ba8435804e2fc55" exitCode=0
Jul 29 04:05:04.561066 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.560998    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nvlt9" event={"ID":"9365ba50-d29a-42ed-a00c-d90acac83158","Type":"ContainerDied","Data":"9a9d665db7c57cb3884d7274d6be7adda7a0aac046c8bdb86ba8435804e2fc55"}
Jul 29 04:05:04.572546 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.572353    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-2tsrx" podStartSLOduration=1.917219358 podStartE2EDuration="4.572330796s" totalImagesPullingTime="2.655111438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:05:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:05:04.571799345 +0000 UTC m=+71.004837471" watchObservedRunningTime="2026-07-29 04:05:04.572330796 +0000 UTC m=+71.005368910"
Jul 29 04:05:04.581377 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.581339    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3f51c5b1-20d1-41ee-9cdd-e91466edba0c-audit-log\") pod \"metrics-server-78c57778cc-rzf4d\" (UID: \"3f51c5b1-20d1-41ee-9cdd-e91466edba0c\") " pod="openshift-monitoring/metrics-server-78c57778cc-rzf4d"
Jul 29 04:05:04.581631 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.581451    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3f51c5b1-20d1-41ee-9cdd-e91466edba0c-metrics-server-audit-profiles\") pod \"metrics-server-78c57778cc-rzf4d\" (UID: \"3f51c5b1-20d1-41ee-9cdd-e91466edba0c\") " pod="openshift-monitoring/metrics-server-78c57778cc-rzf4d"
Jul 29 04:05:04.581631 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.581517    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t47t6\" (UniqueName: \"kubernetes.io/projected/3f51c5b1-20d1-41ee-9cdd-e91466edba0c-kube-api-access-t47t6\") pod \"metrics-server-78c57778cc-rzf4d\" (UID: \"3f51c5b1-20d1-41ee-9cdd-e91466edba0c\") " pod="openshift-monitoring/metrics-server-78c57778cc-rzf4d"
Jul 29 04:05:04.581631 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.581557    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f51c5b1-20d1-41ee-9cdd-e91466edba0c-client-ca-bundle\") pod \"metrics-server-78c57778cc-rzf4d\" (UID: \"3f51c5b1-20d1-41ee-9cdd-e91466edba0c\") " pod="openshift-monitoring/metrics-server-78c57778cc-rzf4d"
Jul 29 04:05:04.581631 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.581585    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f51c5b1-20d1-41ee-9cdd-e91466edba0c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78c57778cc-rzf4d\" (UID: \"3f51c5b1-20d1-41ee-9cdd-e91466edba0c\") " pod="openshift-monitoring/metrics-server-78c57778cc-rzf4d"
Jul 29 04:05:04.581631 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.581614    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3f51c5b1-20d1-41ee-9cdd-e91466edba0c-secret-metrics-server-client-certs\") pod \"metrics-server-78c57778cc-rzf4d\" (UID: \"3f51c5b1-20d1-41ee-9cdd-e91466edba0c\") " pod="openshift-monitoring/metrics-server-78c57778cc-rzf4d"
Jul 29 04:05:04.581893 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.581649    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3f51c5b1-20d1-41ee-9cdd-e91466edba0c-secret-metrics-server-tls\") pod \"metrics-server-78c57778cc-rzf4d\" (UID: \"3f51c5b1-20d1-41ee-9cdd-e91466edba0c\") " pod="openshift-monitoring/metrics-server-78c57778cc-rzf4d"
Jul 29 04:05:04.581893 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.581847    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3f51c5b1-20d1-41ee-9cdd-e91466edba0c-audit-log\") pod \"metrics-server-78c57778cc-rzf4d\" (UID: \"3f51c5b1-20d1-41ee-9cdd-e91466edba0c\") " pod="openshift-monitoring/metrics-server-78c57778cc-rzf4d"
Jul 29 04:05:04.582455 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.582427    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f51c5b1-20d1-41ee-9cdd-e91466edba0c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78c57778cc-rzf4d\" (UID: \"3f51c5b1-20d1-41ee-9cdd-e91466edba0c\") " pod="openshift-monitoring/metrics-server-78c57778cc-rzf4d"
Jul 29 04:05:04.583048 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.583022    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3f51c5b1-20d1-41ee-9cdd-e91466edba0c-metrics-server-audit-profiles\") pod \"metrics-server-78c57778cc-rzf4d\" (UID: \"3f51c5b1-20d1-41ee-9cdd-e91466edba0c\") " pod="openshift-monitoring/metrics-server-78c57778cc-rzf4d"
Jul 29 04:05:04.585046 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.585023    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f51c5b1-20d1-41ee-9cdd-e91466edba0c-client-ca-bundle\") pod \"metrics-server-78c57778cc-rzf4d\" (UID: \"3f51c5b1-20d1-41ee-9cdd-e91466edba0c\") " pod="openshift-monitoring/metrics-server-78c57778cc-rzf4d"
Jul 29 04:05:04.585361 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.585337    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3f51c5b1-20d1-41ee-9cdd-e91466edba0c-secret-metrics-server-tls\") pod \"metrics-server-78c57778cc-rzf4d\" (UID: \"3f51c5b1-20d1-41ee-9cdd-e91466edba0c\") " pod="openshift-monitoring/metrics-server-78c57778cc-rzf4d"
Jul 29 04:05:04.585442 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.585425    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3f51c5b1-20d1-41ee-9cdd-e91466edba0c-secret-metrics-server-client-certs\") pod \"metrics-server-78c57778cc-rzf4d\" (UID: \"3f51c5b1-20d1-41ee-9cdd-e91466edba0c\") " pod="openshift-monitoring/metrics-server-78c57778cc-rzf4d"
Jul 29 04:05:04.591005 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.590717    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-glpbr" podStartSLOduration=67.885948489 podStartE2EDuration="1m10.590698565s" totalImagesPullingTime="2.704750076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:03:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:05:04.588526323 +0000 UTC m=+71.021564435" watchObservedRunningTime="2026-07-29 04:05:04.590698565 +0000 UTC m=+71.023736681"
Jul 29 04:05:04.595328 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.595302    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t47t6\" (UniqueName: \"kubernetes.io/projected/3f51c5b1-20d1-41ee-9cdd-e91466edba0c-kube-api-access-t47t6\") pod \"metrics-server-78c57778cc-rzf4d\" (UID: \"3f51c5b1-20d1-41ee-9cdd-e91466edba0c\") " pod="openshift-monitoring/metrics-server-78c57778cc-rzf4d"
Jul 29 04:05:04.658744 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.658698    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-78c57778cc-rzf4d"
Jul 29 04:05:04.828769 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.828682    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d4bd74c68-wz4xf"]
Jul 29 04:05:04.831750 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.831721    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d4bd74c68-wz4xf"
Jul 29 04:05:04.831903 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.831891    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-hs7fd"]
Jul 29 04:05:04.834676 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.834654    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-hs7fd"
Jul 29 04:05:04.836285 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.836259    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 29 04:05:04.836898 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.836539    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-pf6k9\""
Jul 29 04:05:04.836898 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.836571    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 29 04:05:04.836898 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.836686    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 29 04:05:04.836898 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.836767    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 29 04:05:04.837132 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.836906    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 29 04:05:04.837521 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.837387    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 29 04:05:04.845059 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.842416    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-c9p6f\""
Jul 29 04:05:04.845059 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.843767    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 29 04:05:04.845059 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.843984    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 29 04:05:04.845059 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.844604    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-hs7fd"]
Jul 29 04:05:04.847794 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.847769    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 29 04:05:04.849199 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.849166    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d4bd74c68-wz4xf"]
Jul 29 04:05:04.884639 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.884604    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6c51cdf-093b-4e4f-a349-cf5a57286f95-trusted-ca-bundle\") pod \"console-6d4bd74c68-wz4xf\" (UID: \"a6c51cdf-093b-4e4f-a349-cf5a57286f95\") " pod="openshift-console/console-6d4bd74c68-wz4xf"
Jul 29 04:05:04.884878 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.884645    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6c51cdf-093b-4e4f-a349-cf5a57286f95-console-config\") pod \"console-6d4bd74c68-wz4xf\" (UID: \"a6c51cdf-093b-4e4f-a349-cf5a57286f95\") " pod="openshift-console/console-6d4bd74c68-wz4xf"
Jul 29 04:05:04.884878 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.884710    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cab041a4-c65e-4289-b8b9-bf16486fcbdd-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-hs7fd\" (UID: \"cab041a4-c65e-4289-b8b9-bf16486fcbdd\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-hs7fd"
Jul 29 04:05:04.884878 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.884771    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqj78\" (UniqueName: \"kubernetes.io/projected/a6c51cdf-093b-4e4f-a349-cf5a57286f95-kube-api-access-gqj78\") pod \"console-6d4bd74c68-wz4xf\" (UID: \"a6c51cdf-093b-4e4f-a349-cf5a57286f95\") " pod="openshift-console/console-6d4bd74c68-wz4xf"
Jul 29 04:05:04.884878 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.884829    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6c51cdf-093b-4e4f-a349-cf5a57286f95-service-ca\") pod \"console-6d4bd74c68-wz4xf\" (UID: \"a6c51cdf-093b-4e4f-a349-cf5a57286f95\") " pod="openshift-console/console-6d4bd74c68-wz4xf"
Jul 29 04:05:04.885106 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.884889    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6c51cdf-093b-4e4f-a349-cf5a57286f95-console-serving-cert\") pod \"console-6d4bd74c68-wz4xf\" (UID: \"a6c51cdf-093b-4e4f-a349-cf5a57286f95\") " pod="openshift-console/console-6d4bd74c68-wz4xf"
Jul 29 04:05:04.885106 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.884944    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6c51cdf-093b-4e4f-a349-cf5a57286f95-oauth-serving-cert\") pod \"console-6d4bd74c68-wz4xf\" (UID: \"a6c51cdf-093b-4e4f-a349-cf5a57286f95\") " pod="openshift-console/console-6d4bd74c68-wz4xf"
Jul 29 04:05:04.885106 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.885002    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6c51cdf-093b-4e4f-a349-cf5a57286f95-console-oauth-config\") pod \"console-6d4bd74c68-wz4xf\" (UID: \"a6c51cdf-093b-4e4f-a349-cf5a57286f95\") " pod="openshift-console/console-6d4bd74c68-wz4xf"
Jul 29 04:05:04.885106 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.885074    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqwvb\" (UniqueName: \"kubernetes.io/projected/cab041a4-c65e-4289-b8b9-bf16486fcbdd-kube-api-access-fqwvb\") pod \"monitoring-plugin-68b7fc9574-hs7fd\" (UID: \"cab041a4-c65e-4289-b8b9-bf16486fcbdd\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-hs7fd"
Jul 29 04:05:04.986403 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.986362    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6c51cdf-093b-4e4f-a349-cf5a57286f95-console-oauth-config\") pod \"console-6d4bd74c68-wz4xf\" (UID: \"a6c51cdf-093b-4e4f-a349-cf5a57286f95\") " pod="openshift-console/console-6d4bd74c68-wz4xf"
Jul 29 04:05:04.986618 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.986422    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqwvb\" (UniqueName: \"kubernetes.io/projected/cab041a4-c65e-4289-b8b9-bf16486fcbdd-kube-api-access-fqwvb\") pod \"monitoring-plugin-68b7fc9574-hs7fd\" (UID: \"cab041a4-c65e-4289-b8b9-bf16486fcbdd\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-hs7fd"
Jul 29 04:05:04.986618 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.986456    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6c51cdf-093b-4e4f-a349-cf5a57286f95-trusted-ca-bundle\") pod \"console-6d4bd74c68-wz4xf\" (UID: \"a6c51cdf-093b-4e4f-a349-cf5a57286f95\") " pod="openshift-console/console-6d4bd74c68-wz4xf"
Jul 29 04:05:04.986618 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.986483    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6c51cdf-093b-4e4f-a349-cf5a57286f95-console-config\") pod \"console-6d4bd74c68-wz4xf\" (UID: \"a6c51cdf-093b-4e4f-a349-cf5a57286f95\") " pod="openshift-console/console-6d4bd74c68-wz4xf"
Jul 29 04:05:04.986618 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.986534    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cab041a4-c65e-4289-b8b9-bf16486fcbdd-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-hs7fd\" (UID: \"cab041a4-c65e-4289-b8b9-bf16486fcbdd\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-hs7fd"
Jul 29 04:05:04.986828 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:05:04.986629    2572 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 29 04:05:04.986828 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.986645    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqj78\" (UniqueName: \"kubernetes.io/projected/a6c51cdf-093b-4e4f-a349-cf5a57286f95-kube-api-access-gqj78\") pod \"console-6d4bd74c68-wz4xf\" (UID: \"a6c51cdf-093b-4e4f-a349-cf5a57286f95\") " pod="openshift-console/console-6d4bd74c68-wz4xf"
Jul 29 04:05:04.986828 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:05:04.986695    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cab041a4-c65e-4289-b8b9-bf16486fcbdd-monitoring-plugin-cert podName:cab041a4-c65e-4289-b8b9-bf16486fcbdd nodeName:}" failed. No retries permitted until 2026-07-29 04:05:05.486674349 +0000 UTC m=+71.919712442 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/cab041a4-c65e-4289-b8b9-bf16486fcbdd-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-hs7fd" (UID: "cab041a4-c65e-4289-b8b9-bf16486fcbdd") : secret "monitoring-plugin-cert" not found
Jul 29 04:05:04.986828 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.986753    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6c51cdf-093b-4e4f-a349-cf5a57286f95-service-ca\") pod \"console-6d4bd74c68-wz4xf\" (UID: \"a6c51cdf-093b-4e4f-a349-cf5a57286f95\") " pod="openshift-console/console-6d4bd74c68-wz4xf"
Jul 29 04:05:04.986828 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.986784    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6c51cdf-093b-4e4f-a349-cf5a57286f95-console-serving-cert\") pod \"console-6d4bd74c68-wz4xf\" (UID: \"a6c51cdf-093b-4e4f-a349-cf5a57286f95\") " pod="openshift-console/console-6d4bd74c68-wz4xf"
Jul 29 04:05:04.986828 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.986823    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6c51cdf-093b-4e4f-a349-cf5a57286f95-oauth-serving-cert\") pod \"console-6d4bd74c68-wz4xf\" (UID: \"a6c51cdf-093b-4e4f-a349-cf5a57286f95\") " pod="openshift-console/console-6d4bd74c68-wz4xf"
Jul 29 04:05:04.987462 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.987439    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6c51cdf-093b-4e4f-a349-cf5a57286f95-console-config\") pod \"console-6d4bd74c68-wz4xf\" (UID: \"a6c51cdf-093b-4e4f-a349-cf5a57286f95\") " pod="openshift-console/console-6d4bd74c68-wz4xf"
Jul 29 04:05:04.987917 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.987896    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6c51cdf-093b-4e4f-a349-cf5a57286f95-service-ca\") pod \"console-6d4bd74c68-wz4xf\" (UID: \"a6c51cdf-093b-4e4f-a349-cf5a57286f95\") " pod="openshift-console/console-6d4bd74c68-wz4xf"
Jul 29 04:05:04.988080 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.988059    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6c51cdf-093b-4e4f-a349-cf5a57286f95-oauth-serving-cert\") pod \"console-6d4bd74c68-wz4xf\" (UID: \"a6c51cdf-093b-4e4f-a349-cf5a57286f95\") " pod="openshift-console/console-6d4bd74c68-wz4xf"
Jul 29 04:05:04.988291 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.988270    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6c51cdf-093b-4e4f-a349-cf5a57286f95-trusted-ca-bundle\") pod \"console-6d4bd74c68-wz4xf\" (UID: \"a6c51cdf-093b-4e4f-a349-cf5a57286f95\") " pod="openshift-console/console-6d4bd74c68-wz4xf"
Jul 29 04:05:04.989920 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.989895    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6c51cdf-093b-4e4f-a349-cf5a57286f95-console-oauth-config\") pod \"console-6d4bd74c68-wz4xf\" (UID: \"a6c51cdf-093b-4e4f-a349-cf5a57286f95\") " pod="openshift-console/console-6d4bd74c68-wz4xf"
Jul 29 04:05:04.990807 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:04.990783    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6c51cdf-093b-4e4f-a349-cf5a57286f95-console-serving-cert\") pod \"console-6d4bd74c68-wz4xf\" (UID: \"a6c51cdf-093b-4e4f-a349-cf5a57286f95\") " pod="openshift-console/console-6d4bd74c68-wz4xf"
Jul 29 04:05:05.015327 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:05.015300    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqj78\" (UniqueName: \"kubernetes.io/projected/a6c51cdf-093b-4e4f-a349-cf5a57286f95-kube-api-access-gqj78\") pod \"console-6d4bd74c68-wz4xf\" (UID: \"a6c51cdf-093b-4e4f-a349-cf5a57286f95\") " pod="openshift-console/console-6d4bd74c68-wz4xf"
Jul 29 04:05:05.019086 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:05.019052    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqwvb\" (UniqueName: \"kubernetes.io/projected/cab041a4-c65e-4289-b8b9-bf16486fcbdd-kube-api-access-fqwvb\") pod \"monitoring-plugin-68b7fc9574-hs7fd\" (UID: \"cab041a4-c65e-4289-b8b9-bf16486fcbdd\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-hs7fd"
Jul 29 04:05:05.151146 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:05.150898    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d4bd74c68-wz4xf"
Jul 29 04:05:05.492097 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:05.491994    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cab041a4-c65e-4289-b8b9-bf16486fcbdd-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-hs7fd\" (UID: \"cab041a4-c65e-4289-b8b9-bf16486fcbdd\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-hs7fd"
Jul 29 04:05:05.494850 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:05.494818    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cab041a4-c65e-4289-b8b9-bf16486fcbdd-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-hs7fd\" (UID: \"cab041a4-c65e-4289-b8b9-bf16486fcbdd\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-hs7fd"
Jul 29 04:05:05.757900 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:05.757806    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-hs7fd"
Jul 29 04:05:06.250087 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.248066    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 04:05:06.251856 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.251828    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.256396 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.254824    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 29 04:05:06.256396 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.255065    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 29 04:05:06.256396 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.255259    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 29 04:05:06.256396 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.255862    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 29 04:05:06.256396 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.256122    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 29 04:05:06.256829 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.256806    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 29 04:05:06.257042 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.257024    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 29 04:05:06.257532 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.257329    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 29 04:05:06.257884 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.257624    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-npqc7\""
Jul 29 04:05:06.257884 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.257690    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 29 04:05:06.257884 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.257753    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-b5s7r6pvhdg78\""
Jul 29 04:05:06.257884 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.257693    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 29 04:05:06.258139 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.257918    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 29 04:05:06.258139 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.258051    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 29 04:05:06.258221 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.258139    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 29 04:05:06.264100 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.260898    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 29 04:05:06.277901 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.277871    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 04:05:06.299985 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.299907    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.300172 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.299945    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.300172 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.300070    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.300172 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.300093    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.300172 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.300112    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.300172 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.300126    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.300172 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.300150    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.300172 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.300165    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.302899 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.300560    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.302899 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.300599    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-web-config\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.302899 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.300622    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.302899 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.300663    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-config\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.302899 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.300751    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4566z\" (UniqueName: \"kubernetes.io/projected/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-kube-api-access-4566z\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.302899 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.300813    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.302899 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.300852    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.302899 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.300881    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.302899 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.300914    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.302899 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.300938    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-config-out\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.302899 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.300969    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.302899 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.301004    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.402350 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.402302    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.402542 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.402368    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.402542 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.402400    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.402542 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.402439    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.402542 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.402465    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.402542 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.402483    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.402542 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.402531    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.402846 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.402559    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.402846 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.402582    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.402846 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.402609    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.402846 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.402633    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-web-config\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.402846 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.402654    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.402846 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.402698    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-config\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.402846 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.402728    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4566z\" (UniqueName: \"kubernetes.io/projected/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-kube-api-access-4566z\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.402846 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.402761    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.402846 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.402801    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.402846 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.402832    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.403273 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.402862    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.403273 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.402942    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-config-out\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.403273 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.402981    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.403775 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.403745    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.404264 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.404231    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.409563 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.405399    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.409563 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.407170    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.409563 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.407683    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-web-config\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.409563 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.407790    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.410360 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.410326    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.411373 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.411351    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.411759 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.411733    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.412111 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.412067    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.412685 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.412667    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.413432 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.412978    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-config\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.413573 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.413551    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.413647 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.413348    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-config-out\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.413647 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.413373    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.413741 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.413334    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.414048 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.414001    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.415641 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.415595    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.415809 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.415790    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.424528 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.424466    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4566z\" (UniqueName: \"kubernetes.io/projected/4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d-kube-api-access-4566z\") pod \"prometheus-k8s-0\" (UID: \"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:06.569782 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:06.569679    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:08.027101 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:08.026999    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-78c57778cc-rzf4d"]
Jul 29 04:05:08.043987 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:08.043954    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-hs7fd"]
Jul 29 04:05:08.057118 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:08.057084    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d4bd74c68-wz4xf"]
Jul 29 04:05:08.088996 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:08.088970    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 04:05:08.092186 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:05:08.092159    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d77fbb0_0119_4f0f_b7e8_c0d38522ff8d.slice/crio-7c8a227bb888f680643cbe2c399b9d6464b17fcc859aa4529d16a1afd0153cf0 WatchSource:0}: Error finding container 7c8a227bb888f680643cbe2c399b9d6464b17fcc859aa4529d16a1afd0153cf0: Status 404 returned error can't find the container with id 7c8a227bb888f680643cbe2c399b9d6464b17fcc859aa4529d16a1afd0153cf0
Jul 29 04:05:08.582011 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:08.581963    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b44b78b75-zgh2w" event={"ID":"18c3c56e-b5d1-49ba-acca-b28e821f32eb","Type":"ContainerStarted","Data":"dfd623aca1c39f7ea919e3f8a0534323238b7c1e1c60268ff34c45bebe668e09"}
Jul 29 04:05:08.582213 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:08.582094    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b44b78b75-zgh2w" event={"ID":"18c3c56e-b5d1-49ba-acca-b28e821f32eb","Type":"ContainerStarted","Data":"eeca3b54a1681f391dc7e9b81d57eddab34bc6038a6e784f81fb5186b9a6a840"}
Jul 29 04:05:08.582213 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:08.582138    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b44b78b75-zgh2w" event={"ID":"18c3c56e-b5d1-49ba-acca-b28e821f32eb","Type":"ContainerStarted","Data":"a8ce2e6b95aef98969f35c3635ff9805f6ee5fe66d592a7cac19451dbad9d16d"}
Jul 29 04:05:08.583386 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:08.583351    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d4bd74c68-wz4xf" event={"ID":"a6c51cdf-093b-4e4f-a349-cf5a57286f95","Type":"ContainerStarted","Data":"65dea893d9c5f207a5a0abca66633335bb7342f20eb4bca0ad1deb3d353dcda9"}
Jul 29 04:05:08.584761 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:08.584727    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-78c57778cc-rzf4d" event={"ID":"3f51c5b1-20d1-41ee-9cdd-e91466edba0c","Type":"ContainerStarted","Data":"71ac9572d23ef8038d7e62b01b24b01815bcc5188a1d924af8b8f45a2d95e6e4"}
Jul 29 04:05:08.586323 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:08.586292    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ftvjm" event={"ID":"ad8e0e9f-d912-40df-98b5-5e17f77aa631","Type":"ContainerStarted","Data":"e32ea6ee850af801934ee378166c09f034fa50503a5a37eed55e01b27a3f5e3a"}
Jul 29 04:05:08.587947 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:08.587919    2572 generic.go:356] "Generic (PLEG): container finished" podID="bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96" containerID="27efa74165a8d4642a82e1dcb694ece4162e5abd521fa0773e1605e7fee30514" exitCode=0
Jul 29 04:05:08.588070 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:08.587984    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96","Type":"ContainerDied","Data":"27efa74165a8d4642a82e1dcb694ece4162e5abd521fa0773e1605e7fee30514"}
Jul 29 04:05:08.589374 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:08.589349    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-hs7fd" event={"ID":"cab041a4-c65e-4289-b8b9-bf16486fcbdd","Type":"ContainerStarted","Data":"d81cc805bdfb656168f69e94ef1dbaaef76cefe1e16a7045bf9000b3b52d7656"}
Jul 29 04:05:08.591841 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:08.591820    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nvlt9" event={"ID":"9365ba50-d29a-42ed-a00c-d90acac83158","Type":"ContainerStarted","Data":"4fdcdb0ee8ffeb79fc3c87b5b677ce0acbc98e65ac9022dc94426be1d4dad501"}
Jul 29 04:05:08.591928 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:08.591894    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nvlt9" event={"ID":"9365ba50-d29a-42ed-a00c-d90acac83158","Type":"ContainerStarted","Data":"704157d445c3b79c265675c08af2a6620875936666bb6f4b03bdac50428d066c"}
Jul 29 04:05:08.594008 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:08.593981    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-b2gqf" event={"ID":"91c78bb4-6179-4fcf-b449-f18b90e0a4f2","Type":"ContainerStarted","Data":"3621f7e8d77bc6353d582288406710bf52a5b973c52528af93f6f6182b313021"}
Jul 29 04:05:08.594119 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:08.594041    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-b2gqf"
Jul 29 04:05:08.595821 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:08.595799    2572 generic.go:356] "Generic (PLEG): container finished" podID="4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d" containerID="d5001aee03d6cdf4d7bfcaf157bb0c3e2731bf650edf5bfe1937000b5f0548ef" exitCode=0
Jul 29 04:05:08.595915 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:08.595880    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d","Type":"ContainerDied","Data":"d5001aee03d6cdf4d7bfcaf157bb0c3e2731bf650edf5bfe1937000b5f0548ef"}
Jul 29 04:05:08.595983 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:08.595944    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d","Type":"ContainerStarted","Data":"7c8a227bb888f680643cbe2c399b9d6464b17fcc859aa4529d16a1afd0153cf0"}
Jul 29 04:05:08.601284 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:08.601244    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ftvjm" podStartSLOduration=67.609051463 podStartE2EDuration="1m14.601231833s" totalImagesPullingTime="6.99218037s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 04:03:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:05:08.600124795 +0000 UTC m=+75.033162908" watchObservedRunningTime="2026-07-29 04:05:08.601231833 +0000 UTC m=+75.034269924"
Jul 29 04:05:08.640795 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:08.640735    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nvlt9" podStartSLOduration=5.589185422 podStartE2EDuration="8.640713229s" totalImagesPullingTime="2.843556575s" totalInitContainerRuntime="207.971232ms" isStatefulPod=true podCreationTimestamp="2026-07-29 04:05:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:05:08.64005191 +0000 UTC m=+75.073090024" watchObservedRunningTime="2026-07-29 04:05:08.640713229 +0000 UTC m=+75.073751345"
Jul 29 04:05:08.680380 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:08.680318    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-b2gqf" podStartSLOduration=67.707079843 podStartE2EDuration="1m14.680298225s" totalImagesPullingTime="6.973218382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:03:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:05:08.679804571 +0000 UTC m=+75.112842685" watchObservedRunningTime="2026-07-29 04:05:08.680298225 +0000 UTC m=+75.113336341"
Jul 29 04:05:11.617116 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:11.617072    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b44b78b75-zgh2w" event={"ID":"18c3c56e-b5d1-49ba-acca-b28e821f32eb","Type":"ContainerStarted","Data":"b83269b215bbe8345652bfba21e0e5314b18b7e56a57e41cef614bd00da54d6a"}
Jul 29 04:05:11.617587 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:11.617199    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b44b78b75-zgh2w" event={"ID":"18c3c56e-b5d1-49ba-acca-b28e821f32eb","Type":"ContainerStarted","Data":"71b06eee7864c4f76eb7eef85312a5cd069a6531d0b13266d71d27b9014f42de"}
Jul 29 04:05:11.619115 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:11.619086    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-78c57778cc-rzf4d" event={"ID":"3f51c5b1-20d1-41ee-9cdd-e91466edba0c","Type":"ContainerStarted","Data":"4371e770afd9d8044e254d48b3a52724db5489622ea5b824346d31354ed87905"}
Jul 29 04:05:11.621273 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:11.621248    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-hs7fd" event={"ID":"cab041a4-c65e-4289-b8b9-bf16486fcbdd","Type":"ContainerStarted","Data":"6d293fa02eda53e947f7becf351526eb9c0f1ab7a1d13f530364f509d3952a5c"}
Jul 29 04:05:11.621765 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:11.621745    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-hs7fd"
Jul 29 04:05:11.628175 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:11.628154    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-hs7fd"
Jul 29 04:05:11.637871 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:11.637142    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-78c57778cc-rzf4d" podStartSLOduration=5.115630873 podStartE2EDuration="7.637123143s" totalImagesPullingTime="2.52149227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:05:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:05:11.634855165 +0000 UTC m=+78.067893279" watchObservedRunningTime="2026-07-29 04:05:11.637123143 +0000 UTC m=+78.070161259"
Jul 29 04:05:11.653148 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:11.653079    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-hs7fd" podStartSLOduration=5.130679287 podStartE2EDuration="7.653062654s" totalImagesPullingTime="2.522383367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:05:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:05:11.65300647 +0000 UTC m=+78.086044584" watchObservedRunningTime="2026-07-29 04:05:11.653062654 +0000 UTC m=+78.086100763"
Jul 29 04:05:14.641066 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:14.641024    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d","Type":"ContainerStarted","Data":"8b2ccf161ed6c9b18a09051d14df8b58568683176898c9abc8738ee6235e4c10"}
Jul 29 04:05:14.641484 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:14.641109    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d","Type":"ContainerStarted","Data":"6c0637d69a20c025a39ec5ad349739b87eb9c96d6a52d28f61ed36f63f600e20"}
Jul 29 04:05:14.641484 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:14.641148    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d","Type":"ContainerStarted","Data":"bb83c9e8ae69ee07b0d605bb4b55b4927ef7306d1a6be5b30b3a25646828519a"}
Jul 29 04:05:14.641484 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:14.641177    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d","Type":"ContainerStarted","Data":"749333f3a1c05093d9b8d590777148f5940239a8a94f99ab4b808e20051f11b8"}
Jul 29 04:05:14.641484 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:14.641206    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d","Type":"ContainerStarted","Data":"cbe6214315e8326a86e357faab42bfaa1d6a07000b4c4bda4700cfb8e3a460d7"}
Jul 29 04:05:14.641484 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:14.641248    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d","Type":"ContainerStarted","Data":"4a516bf53199dd60cdd7241dbff0147d033861486834e6cb3c5bda4539ee43bd"}
Jul 29 04:05:14.644040 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:14.644014    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b44b78b75-zgh2w" event={"ID":"18c3c56e-b5d1-49ba-acca-b28e821f32eb","Type":"ContainerStarted","Data":"d1125df735afd04b095680181eb291f124848876a38d3474d5ca9d191fb178b2"}
Jul 29 04:05:14.644249 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:14.644232    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7b44b78b75-zgh2w"
Jul 29 04:05:14.645706 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:14.645674    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d4bd74c68-wz4xf" event={"ID":"a6c51cdf-093b-4e4f-a349-cf5a57286f95","Type":"ContainerStarted","Data":"d902b0082dc7682b239c702f4294af0b9d62f9e1ed99b95de8ab12526a21e14d"}
Jul 29 04:05:14.649929 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:14.649902    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96","Type":"ContainerStarted","Data":"09792970ccd1e0e2d819cb3ead5eea230218ef428bb744f2da4ee5367a52e7d7"}
Jul 29 04:05:14.650016 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:14.649972    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96","Type":"ContainerStarted","Data":"98fa3c985f3f10a6241d1af14fe585414b8fcf7d72b4670f3365d09f4bd59b9c"}
Jul 29 04:05:14.650067 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:14.650014    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96","Type":"ContainerStarted","Data":"20b1768d36a46f91bd1267ffd40c7b887481c58ae34b781468a08983335ea180"}
Jul 29 04:05:14.650067 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:14.650049    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96","Type":"ContainerStarted","Data":"6a60805f26953ffc08590db4b1e7db0d18da6718b4ae045bd1985df3a1a3cbe5"}
Jul 29 04:05:14.650140 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:14.650077    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96","Type":"ContainerStarted","Data":"99e1e00bd42c16e332994ece2be5616407759c40650c4ba97d1177c20e7c16a1"}
Jul 29 04:05:14.650140 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:14.650100    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96","Type":"ContainerStarted","Data":"0ce7133fbe1435b615b91a784cf8ca6d402d02a9c33e528dc69e12f9d13602bd"}
Jul 29 04:05:14.650613 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:14.650596    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7b44b78b75-zgh2w"
Jul 29 04:05:14.670239 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:14.670195    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.4727278200000002 podStartE2EDuration="8.67017766s" totalImagesPullingTime="5.173868004s" totalInitContainerRuntime="23.581836ms" isStatefulPod=false podCreationTimestamp="2026-07-29 04:05:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:05:14.667641455 +0000 UTC m=+81.100679574" watchObservedRunningTime="2026-07-29 04:05:14.67017766 +0000 UTC m=+81.103215774"
Jul 29 04:05:14.698353 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:14.698307    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.279338862 podStartE2EDuration="13.698294378s" totalImagesPullingTime="9.381432018s" totalInitContainerRuntime="37.523498ms" isStatefulPod=false podCreationTimestamp="2026-07-29 04:05:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:05:14.69679251 +0000 UTC m=+81.129830625" watchObservedRunningTime="2026-07-29 04:05:14.698294378 +0000 UTC m=+81.131332490"
Jul 29 04:05:14.719908 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:14.719857    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7b44b78b75-zgh2w" podStartSLOduration=6.101826598 podStartE2EDuration="12.719841403s" totalImagesPullingTime="6.618014805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:05:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:05:14.719479467 +0000 UTC m=+81.152517582" watchObservedRunningTime="2026-07-29 04:05:14.719841403 +0000 UTC m=+81.152879559"
Jul 29 04:05:14.740271 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:14.740213    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d4bd74c68-wz4xf" podStartSLOduration=5.042937543 podStartE2EDuration="10.740198289s" totalImagesPullingTime="5.697260746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:05:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:05:14.739442283 +0000 UTC m=+81.172480397" watchObservedRunningTime="2026-07-29 04:05:14.740198289 +0000 UTC m=+81.173236403"
Jul 29 04:05:15.152028 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:15.151986    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d4bd74c68-wz4xf"
Jul 29 04:05:15.152196 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:15.152164    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d4bd74c68-wz4xf"
Jul 29 04:05:15.157234 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:15.157210    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d4bd74c68-wz4xf"
Jul 29 04:05:15.657810 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:15.657782    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d4bd74c68-wz4xf"
Jul 29 04:05:16.570279 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:16.570244    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:05:24.658953 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:24.658924    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-78c57778cc-rzf4d"
Jul 29 04:05:24.659333 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:24.658978    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-78c57778cc-rzf4d"
Jul 29 04:05:31.630526 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:31.630263    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-55jls_19251c81-52a7-4281-872d-3ad2ad32b2e2/serve-healthcheck-canary/0.log"
Jul 29 04:05:39.607327 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:39.607296    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-b2gqf"
Jul 29 04:05:44.667085 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:44.666292    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-78c57778cc-rzf4d"
Jul 29 04:05:44.673050 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:05:44.673016    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-78c57778cc-rzf4d"
Jul 29 04:06:06.571158 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:06:06.571117    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:06:06.591730 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:06:06.591704    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:06:06.886456 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:06:06.886415    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 04:06:40.195193 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:06:40.192448    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d4bd74c68-wz4xf"]
Jul 29 04:07:05.216804 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:07:05.216730    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6d4bd74c68-wz4xf" podUID="a6c51cdf-093b-4e4f-a349-cf5a57286f95" containerName="console" containerID="cri-o://d902b0082dc7682b239c702f4294af0b9d62f9e1ed99b95de8ab12526a21e14d" gracePeriod=15
Jul 29 04:07:05.454513 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:07:05.454477    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d4bd74c68-wz4xf"
Jul 29 04:07:05.465337 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:07:05.465311    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6c51cdf-093b-4e4f-a349-cf5a57286f95-trusted-ca-bundle\") pod \"a6c51cdf-093b-4e4f-a349-cf5a57286f95\" (UID: \"a6c51cdf-093b-4e4f-a349-cf5a57286f95\") "
Jul 29 04:07:05.465474 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:07:05.465351    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6c51cdf-093b-4e4f-a349-cf5a57286f95-console-serving-cert\") pod \"a6c51cdf-093b-4e4f-a349-cf5a57286f95\" (UID: \"a6c51cdf-093b-4e4f-a349-cf5a57286f95\") "
Jul 29 04:07:05.465474 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:07:05.465378    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6c51cdf-093b-4e4f-a349-cf5a57286f95-console-oauth-config\") pod \"a6c51cdf-093b-4e4f-a349-cf5a57286f95\" (UID: \"a6c51cdf-093b-4e4f-a349-cf5a57286f95\") "
Jul 29 04:07:05.465474 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:07:05.465421    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqj78\" (UniqueName: \"kubernetes.io/projected/a6c51cdf-093b-4e4f-a349-cf5a57286f95-kube-api-access-gqj78\") pod \"a6c51cdf-093b-4e4f-a349-cf5a57286f95\" (UID: \"a6c51cdf-093b-4e4f-a349-cf5a57286f95\") "
Jul 29 04:07:05.465474 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:07:05.465438    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6c51cdf-093b-4e4f-a349-cf5a57286f95-service-ca\") pod \"a6c51cdf-093b-4e4f-a349-cf5a57286f95\" (UID: \"a6c51cdf-093b-4e4f-a349-cf5a57286f95\") "
Jul 29 04:07:05.465474 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:07:05.465468    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6c51cdf-093b-4e4f-a349-cf5a57286f95-oauth-serving-cert\") pod \"a6c51cdf-093b-4e4f-a349-cf5a57286f95\" (UID: \"a6c51cdf-093b-4e4f-a349-cf5a57286f95\") "
Jul 29 04:07:05.465758 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:07:05.465521    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6c51cdf-093b-4e4f-a349-cf5a57286f95-console-config\") pod \"a6c51cdf-093b-4e4f-a349-cf5a57286f95\" (UID: \"a6c51cdf-093b-4e4f-a349-cf5a57286f95\") "
Jul 29 04:07:05.465821 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:07:05.465792    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6c51cdf-093b-4e4f-a349-cf5a57286f95-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a6c51cdf-093b-4e4f-a349-cf5a57286f95" (UID: "a6c51cdf-093b-4e4f-a349-cf5a57286f95"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:07:05.465873 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:07:05.465851    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6c51cdf-093b-4e4f-a349-cf5a57286f95-service-ca" (OuterVolumeSpecName: "service-ca") pod "a6c51cdf-093b-4e4f-a349-cf5a57286f95" (UID: "a6c51cdf-093b-4e4f-a349-cf5a57286f95"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:07:05.466075 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:07:05.466026    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6c51cdf-093b-4e4f-a349-cf5a57286f95-console-config" (OuterVolumeSpecName: "console-config") pod "a6c51cdf-093b-4e4f-a349-cf5a57286f95" (UID: "a6c51cdf-093b-4e4f-a349-cf5a57286f95"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:07:05.466289 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:07:05.466184    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6c51cdf-093b-4e4f-a349-cf5a57286f95-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a6c51cdf-093b-4e4f-a349-cf5a57286f95" (UID: "a6c51cdf-093b-4e4f-a349-cf5a57286f95"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:07:05.468041 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:07:05.467970    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6c51cdf-093b-4e4f-a349-cf5a57286f95-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a6c51cdf-093b-4e4f-a349-cf5a57286f95" (UID: "a6c51cdf-093b-4e4f-a349-cf5a57286f95"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 04:07:05.468041 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:07:05.468031    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6c51cdf-093b-4e4f-a349-cf5a57286f95-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a6c51cdf-093b-4e4f-a349-cf5a57286f95" (UID: "a6c51cdf-093b-4e4f-a349-cf5a57286f95"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 04:07:05.468201 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:07:05.468159    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6c51cdf-093b-4e4f-a349-cf5a57286f95-kube-api-access-gqj78" (OuterVolumeSpecName: "kube-api-access-gqj78") pod "a6c51cdf-093b-4e4f-a349-cf5a57286f95" (UID: "a6c51cdf-093b-4e4f-a349-cf5a57286f95"). InnerVolumeSpecName "kube-api-access-gqj78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:07:05.566388 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:07:05.566349    2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6c51cdf-093b-4e4f-a349-cf5a57286f95-trusted-ca-bundle\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 04:07:05.566388 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:07:05.566381    2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6c51cdf-093b-4e4f-a349-cf5a57286f95-console-serving-cert\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 04:07:05.566388 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:07:05.566391    2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6c51cdf-093b-4e4f-a349-cf5a57286f95-console-oauth-config\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 04:07:05.566388 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:07:05.566399    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqj78\" (UniqueName: \"kubernetes.io/projected/a6c51cdf-093b-4e4f-a349-cf5a57286f95-kube-api-access-gqj78\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 04:07:05.566690 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:07:05.566410    2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6c51cdf-093b-4e4f-a349-cf5a57286f95-service-ca\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 04:07:05.566690 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:07:05.566418    2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6c51cdf-093b-4e4f-a349-cf5a57286f95-oauth-serving-cert\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 04:07:05.566690 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:07:05.566426    2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6c51cdf-093b-4e4f-a349-cf5a57286f95-console-config\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 04:07:06.103587 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:07:06.103553    2572 generic.go:356] "Generic (PLEG): container finished" podID="a6c51cdf-093b-4e4f-a349-cf5a57286f95" containerID="d902b0082dc7682b239c702f4294af0b9d62f9e1ed99b95de8ab12526a21e14d" exitCode=0
Jul 29 04:07:06.103752 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:07:06.103596    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d4bd74c68-wz4xf"
Jul 29 04:07:06.103752 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:07:06.103638    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d4bd74c68-wz4xf" event={"ID":"a6c51cdf-093b-4e4f-a349-cf5a57286f95","Type":"ContainerDied","Data":"d902b0082dc7682b239c702f4294af0b9d62f9e1ed99b95de8ab12526a21e14d"}
Jul 29 04:07:06.103752 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:07:06.103682    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d4bd74c68-wz4xf" event={"ID":"a6c51cdf-093b-4e4f-a349-cf5a57286f95","Type":"ContainerDied","Data":"65dea893d9c5f207a5a0abca66633335bb7342f20eb4bca0ad1deb3d353dcda9"}
Jul 29 04:07:06.103752 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:07:06.103703    2572 scope.go:117] "RemoveContainer" containerID="d902b0082dc7682b239c702f4294af0b9d62f9e1ed99b95de8ab12526a21e14d"
Jul 29 04:07:06.112358 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:07:06.112338    2572 scope.go:117] "RemoveContainer" containerID="d902b0082dc7682b239c702f4294af0b9d62f9e1ed99b95de8ab12526a21e14d"
Jul 29 04:07:06.112657 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:07:06.112637    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d902b0082dc7682b239c702f4294af0b9d62f9e1ed99b95de8ab12526a21e14d\": container with ID starting with d902b0082dc7682b239c702f4294af0b9d62f9e1ed99b95de8ab12526a21e14d not found: ID does not exist" containerID="d902b0082dc7682b239c702f4294af0b9d62f9e1ed99b95de8ab12526a21e14d"
Jul 29 04:07:06.112725 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:07:06.112667    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d902b0082dc7682b239c702f4294af0b9d62f9e1ed99b95de8ab12526a21e14d"} err="failed to get container status \"d902b0082dc7682b239c702f4294af0b9d62f9e1ed99b95de8ab12526a21e14d\": rpc error: code = NotFound desc = could not find container \"d902b0082dc7682b239c702f4294af0b9d62f9e1ed99b95de8ab12526a21e14d\": container with ID starting with d902b0082dc7682b239c702f4294af0b9d62f9e1ed99b95de8ab12526a21e14d not found: ID does not exist"
Jul 29 04:07:06.123328 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:07:06.123305    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d4bd74c68-wz4xf"]
Jul 29 04:07:06.126420 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:07:06.126397    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d4bd74c68-wz4xf"]
Jul 29 04:07:06.147179 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:07:06.147157    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6c51cdf-093b-4e4f-a349-cf5a57286f95" path="/var/lib/kubelet/pods/a6c51cdf-093b-4e4f-a349-cf5a57286f95/volumes"
Jul 29 04:08:11.389054 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:11.389015    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xzlwx"]
Jul 29 04:08:11.389528 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:11.389358    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6c51cdf-093b-4e4f-a349-cf5a57286f95" containerName="console"
Jul 29 04:08:11.389528 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:11.389370    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6c51cdf-093b-4e4f-a349-cf5a57286f95" containerName="console"
Jul 29 04:08:11.389528 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:11.389430    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6c51cdf-093b-4e4f-a349-cf5a57286f95" containerName="console"
Jul 29 04:08:11.392355 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:11.392339    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xzlwx"
Jul 29 04:08:11.394812 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:11.394781    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 29 04:08:11.395690 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:11.395670    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 29 04:08:11.395801 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:11.395670    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-tvngz\""
Jul 29 04:08:11.399035 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:11.399015    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xzlwx"]
Jul 29 04:08:11.428618 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:11.428581    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/52223d9f-6e1e-4eca-a0f2-7ddf671cf598-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xzlwx\" (UID: \"52223d9f-6e1e-4eca-a0f2-7ddf671cf598\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xzlwx"
Jul 29 04:08:11.428788 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:11.428700    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8hdw\" (UniqueName: \"kubernetes.io/projected/52223d9f-6e1e-4eca-a0f2-7ddf671cf598-kube-api-access-b8hdw\") pod \"cert-manager-cainjector-559cdd8c87-xzlwx\" (UID: \"52223d9f-6e1e-4eca-a0f2-7ddf671cf598\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xzlwx"
Jul 29 04:08:11.530048 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:11.530010    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8hdw\" (UniqueName: \"kubernetes.io/projected/52223d9f-6e1e-4eca-a0f2-7ddf671cf598-kube-api-access-b8hdw\") pod \"cert-manager-cainjector-559cdd8c87-xzlwx\" (UID: \"52223d9f-6e1e-4eca-a0f2-7ddf671cf598\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xzlwx"
Jul 29 04:08:11.530222 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:11.530058    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/52223d9f-6e1e-4eca-a0f2-7ddf671cf598-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xzlwx\" (UID: \"52223d9f-6e1e-4eca-a0f2-7ddf671cf598\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xzlwx"
Jul 29 04:08:11.538449 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:11.538423    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/52223d9f-6e1e-4eca-a0f2-7ddf671cf598-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xzlwx\" (UID: \"52223d9f-6e1e-4eca-a0f2-7ddf671cf598\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xzlwx"
Jul 29 04:08:11.538619 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:11.538557    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8hdw\" (UniqueName: \"kubernetes.io/projected/52223d9f-6e1e-4eca-a0f2-7ddf671cf598-kube-api-access-b8hdw\") pod \"cert-manager-cainjector-559cdd8c87-xzlwx\" (UID: \"52223d9f-6e1e-4eca-a0f2-7ddf671cf598\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xzlwx"
Jul 29 04:08:11.716115 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:11.716020    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xzlwx"
Jul 29 04:08:11.845791 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:11.845764    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xzlwx"]
Jul 29 04:08:11.848475 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:08:11.848449    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod52223d9f_6e1e_4eca_a0f2_7ddf671cf598.slice/crio-3e5a462cf27ec11e0786b03f190c8a40cf94316ce3184c349159529ca3cdd08c WatchSource:0}: Error finding container 3e5a462cf27ec11e0786b03f190c8a40cf94316ce3184c349159529ca3cdd08c: Status 404 returned error can't find the container with id 3e5a462cf27ec11e0786b03f190c8a40cf94316ce3184c349159529ca3cdd08c
Jul 29 04:08:12.358674 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:12.358638    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xzlwx" event={"ID":"52223d9f-6e1e-4eca-a0f2-7ddf671cf598","Type":"ContainerStarted","Data":"3e5a462cf27ec11e0786b03f190c8a40cf94316ce3184c349159529ca3cdd08c"}
Jul 29 04:08:14.937655 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:14.937616    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-dzsvq"]
Jul 29 04:08:14.940480 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:14.940458    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-dzsvq"]
Jul 29 04:08:14.940613 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:14.940565    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-dzsvq"
Jul 29 04:08:14.942869 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:14.942845    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-rj627\""
Jul 29 04:08:15.067194 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:15.067082    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/620d41c1-068c-4922-8a3e-40b234306e3c-bound-sa-token\") pod \"cert-manager-55b4d954d5-dzsvq\" (UID: \"620d41c1-068c-4922-8a3e-40b234306e3c\") " pod="cert-manager/cert-manager-55b4d954d5-dzsvq"
Jul 29 04:08:15.067356 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:15.067196    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rjnt\" (UniqueName: \"kubernetes.io/projected/620d41c1-068c-4922-8a3e-40b234306e3c-kube-api-access-9rjnt\") pod \"cert-manager-55b4d954d5-dzsvq\" (UID: \"620d41c1-068c-4922-8a3e-40b234306e3c\") " pod="cert-manager/cert-manager-55b4d954d5-dzsvq"
Jul 29 04:08:15.168142 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:15.168098    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rjnt\" (UniqueName: \"kubernetes.io/projected/620d41c1-068c-4922-8a3e-40b234306e3c-kube-api-access-9rjnt\") pod \"cert-manager-55b4d954d5-dzsvq\" (UID: \"620d41c1-068c-4922-8a3e-40b234306e3c\") " pod="cert-manager/cert-manager-55b4d954d5-dzsvq"
Jul 29 04:08:15.168342 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:15.168185    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/620d41c1-068c-4922-8a3e-40b234306e3c-bound-sa-token\") pod \"cert-manager-55b4d954d5-dzsvq\" (UID: \"620d41c1-068c-4922-8a3e-40b234306e3c\") " pod="cert-manager/cert-manager-55b4d954d5-dzsvq"
Jul 29 04:08:15.176771 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:15.176742    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/620d41c1-068c-4922-8a3e-40b234306e3c-bound-sa-token\") pod \"cert-manager-55b4d954d5-dzsvq\" (UID: \"620d41c1-068c-4922-8a3e-40b234306e3c\") " pod="cert-manager/cert-manager-55b4d954d5-dzsvq"
Jul 29 04:08:15.177069 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:15.177048    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rjnt\" (UniqueName: \"kubernetes.io/projected/620d41c1-068c-4922-8a3e-40b234306e3c-kube-api-access-9rjnt\") pod \"cert-manager-55b4d954d5-dzsvq\" (UID: \"620d41c1-068c-4922-8a3e-40b234306e3c\") " pod="cert-manager/cert-manager-55b4d954d5-dzsvq"
Jul 29 04:08:15.250185 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:15.250144    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-dzsvq"
Jul 29 04:08:15.374318 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:15.374284    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xzlwx" event={"ID":"52223d9f-6e1e-4eca-a0f2-7ddf671cf598","Type":"ContainerStarted","Data":"a7267b02570cd4c989fbcc61aa66ec374142b2f29b0f2299bbad9ac65eb1e507"}
Jul 29 04:08:15.382494 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:15.382342    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-dzsvq"]
Jul 29 04:08:15.385340 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:08:15.385318    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod620d41c1_068c_4922_8a3e_40b234306e3c.slice/crio-f85117c66ea053e3581d5fe85774bc944e4e2c906c6731e0410ff7f0a29fccb4 WatchSource:0}: Error finding container f85117c66ea053e3581d5fe85774bc944e4e2c906c6731e0410ff7f0a29fccb4: Status 404 returned error can't find the container with id f85117c66ea053e3581d5fe85774bc944e4e2c906c6731e0410ff7f0a29fccb4
Jul 29 04:08:15.390566 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:15.390527    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xzlwx" podStartSLOduration=1.464097228 podStartE2EDuration="4.390491701s" totalImagesPullingTime="2.926394473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:08:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:08:15.390096606 +0000 UTC m=+261.823134723" watchObservedRunningTime="2026-07-29 04:08:15.390491701 +0000 UTC m=+261.823529813"
Jul 29 04:08:16.379840 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:16.379805    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-dzsvq" event={"ID":"620d41c1-068c-4922-8a3e-40b234306e3c","Type":"ContainerStarted","Data":"5ba45126bcc307167094933a1b7b3299cfb7567da6868f6192c396c0e33e2d73"}
Jul 29 04:08:16.379840 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:16.379852    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-dzsvq" event={"ID":"620d41c1-068c-4922-8a3e-40b234306e3c","Type":"ContainerStarted","Data":"f85117c66ea053e3581d5fe85774bc944e4e2c906c6731e0410ff7f0a29fccb4"}
Jul 29 04:08:16.396529 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:16.396462    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-dzsvq" podStartSLOduration=2.396448327 podStartE2EDuration="2.396448327s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:08:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:08:16.395207947 +0000 UTC m=+262.828246060" watchObservedRunningTime="2026-07-29 04:08:16.396448327 +0000 UTC m=+262.829486440"
Jul 29 04:08:35.312243 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:35.312207    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-75c59548f9-sch5c"]
Jul 29 04:08:35.314631 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:35.314614    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-75c59548f9-sch5c"
Jul 29 04:08:35.319645 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:35.319622    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 29 04:08:35.319645 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:35.319632    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 29 04:08:35.319645 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:35.319643    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 29 04:08:35.319890 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:35.319676    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 29 04:08:35.319890 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:35.319635    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 29 04:08:35.324824 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:35.324808    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-tqhtl\""
Jul 29 04:08:35.394882 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:35.394831    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-75c59548f9-sch5c"]
Jul 29 04:08:35.434764 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:35.434726    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/717e09e6-36c0-4942-9292-1b63569aeaa5-manager-config\") pod \"lws-controller-manager-75c59548f9-sch5c\" (UID: \"717e09e6-36c0-4942-9292-1b63569aeaa5\") " pod="openshift-lws-operator/lws-controller-manager-75c59548f9-sch5c"
Jul 29 04:08:35.434924 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:35.434779    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/717e09e6-36c0-4942-9292-1b63569aeaa5-metrics-cert\") pod \"lws-controller-manager-75c59548f9-sch5c\" (UID: \"717e09e6-36c0-4942-9292-1b63569aeaa5\") " pod="openshift-lws-operator/lws-controller-manager-75c59548f9-sch5c"
Jul 29 04:08:35.434924 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:35.434817    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/717e09e6-36c0-4942-9292-1b63569aeaa5-cert\") pod \"lws-controller-manager-75c59548f9-sch5c\" (UID: \"717e09e6-36c0-4942-9292-1b63569aeaa5\") " pod="openshift-lws-operator/lws-controller-manager-75c59548f9-sch5c"
Jul 29 04:08:35.434924 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:35.434861    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncnb8\" (UniqueName: \"kubernetes.io/projected/717e09e6-36c0-4942-9292-1b63569aeaa5-kube-api-access-ncnb8\") pod \"lws-controller-manager-75c59548f9-sch5c\" (UID: \"717e09e6-36c0-4942-9292-1b63569aeaa5\") " pod="openshift-lws-operator/lws-controller-manager-75c59548f9-sch5c"
Jul 29 04:08:35.535526 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:35.535462    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/717e09e6-36c0-4942-9292-1b63569aeaa5-metrics-cert\") pod \"lws-controller-manager-75c59548f9-sch5c\" (UID: \"717e09e6-36c0-4942-9292-1b63569aeaa5\") " pod="openshift-lws-operator/lws-controller-manager-75c59548f9-sch5c"
Jul 29 04:08:35.535739 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:35.535535    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/717e09e6-36c0-4942-9292-1b63569aeaa5-cert\") pod \"lws-controller-manager-75c59548f9-sch5c\" (UID: \"717e09e6-36c0-4942-9292-1b63569aeaa5\") " pod="openshift-lws-operator/lws-controller-manager-75c59548f9-sch5c"
Jul 29 04:08:35.535739 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:35.535589    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncnb8\" (UniqueName: \"kubernetes.io/projected/717e09e6-36c0-4942-9292-1b63569aeaa5-kube-api-access-ncnb8\") pod \"lws-controller-manager-75c59548f9-sch5c\" (UID: \"717e09e6-36c0-4942-9292-1b63569aeaa5\") " pod="openshift-lws-operator/lws-controller-manager-75c59548f9-sch5c"
Jul 29 04:08:35.535739 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:35.535643    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/717e09e6-36c0-4942-9292-1b63569aeaa5-manager-config\") pod \"lws-controller-manager-75c59548f9-sch5c\" (UID: \"717e09e6-36c0-4942-9292-1b63569aeaa5\") " pod="openshift-lws-operator/lws-controller-manager-75c59548f9-sch5c"
Jul 29 04:08:35.536236 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:35.536215    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/717e09e6-36c0-4942-9292-1b63569aeaa5-manager-config\") pod \"lws-controller-manager-75c59548f9-sch5c\" (UID: \"717e09e6-36c0-4942-9292-1b63569aeaa5\") " pod="openshift-lws-operator/lws-controller-manager-75c59548f9-sch5c"
Jul 29 04:08:35.538261 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:35.538238    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/717e09e6-36c0-4942-9292-1b63569aeaa5-cert\") pod \"lws-controller-manager-75c59548f9-sch5c\" (UID: \"717e09e6-36c0-4942-9292-1b63569aeaa5\") " pod="openshift-lws-operator/lws-controller-manager-75c59548f9-sch5c"
Jul 29 04:08:35.538355 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:35.538334    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/717e09e6-36c0-4942-9292-1b63569aeaa5-metrics-cert\") pod \"lws-controller-manager-75c59548f9-sch5c\" (UID: \"717e09e6-36c0-4942-9292-1b63569aeaa5\") " pod="openshift-lws-operator/lws-controller-manager-75c59548f9-sch5c"
Jul 29 04:08:35.544651 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:35.544626    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncnb8\" (UniqueName: \"kubernetes.io/projected/717e09e6-36c0-4942-9292-1b63569aeaa5-kube-api-access-ncnb8\") pod \"lws-controller-manager-75c59548f9-sch5c\" (UID: \"717e09e6-36c0-4942-9292-1b63569aeaa5\") " pod="openshift-lws-operator/lws-controller-manager-75c59548f9-sch5c"
Jul 29 04:08:35.624236 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:35.624190    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-75c59548f9-sch5c"
Jul 29 04:08:35.759727 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:35.759695    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-75c59548f9-sch5c"]
Jul 29 04:08:35.763005 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:08:35.762977    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod717e09e6_36c0_4942_9292_1b63569aeaa5.slice/crio-af30b1af5736b2f370aeed74aea3e4bb94777af37d87e5fdc9941788dc72b35e WatchSource:0}: Error finding container af30b1af5736b2f370aeed74aea3e4bb94777af37d87e5fdc9941788dc72b35e: Status 404 returned error can't find the container with id af30b1af5736b2f370aeed74aea3e4bb94777af37d87e5fdc9941788dc72b35e
Jul 29 04:08:36.457691 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:36.457649    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-75c59548f9-sch5c" event={"ID":"717e09e6-36c0-4942-9292-1b63569aeaa5","Type":"ContainerStarted","Data":"af30b1af5736b2f370aeed74aea3e4bb94777af37d87e5fdc9941788dc72b35e"}
Jul 29 04:08:38.466939 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:38.466902    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-75c59548f9-sch5c" event={"ID":"717e09e6-36c0-4942-9292-1b63569aeaa5","Type":"ContainerStarted","Data":"61faedf1b1df5ece6a25322938faeffbafd0ee96311e4922dde73aace941378f"}
Jul 29 04:08:38.467350 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:38.467028    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-75c59548f9-sch5c"
Jul 29 04:08:38.485274 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:38.485216    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-75c59548f9-sch5c" podStartSLOduration=0.961723015 podStartE2EDuration="3.485199029s" totalImagesPullingTime="2.523476014s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:08:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:08:38.484188549 +0000 UTC m=+284.917226674" watchObservedRunningTime="2026-07-29 04:08:38.485199029 +0000 UTC m=+284.918237141"
Jul 29 04:08:39.951009 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:39.950963    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64c765c8-tr4vz"]
Jul 29 04:08:39.953417 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:39.953398    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-tr4vz"
Jul 29 04:08:39.956260 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:39.956239    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 29 04:08:39.956942 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:39.956895    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6c7bk\""
Jul 29 04:08:39.957063 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:39.956960    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 29 04:08:39.957063 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:39.956975    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 29 04:08:39.957063 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:39.957011    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 29 04:08:39.966925 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:39.966893    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64c765c8-tr4vz"]
Jul 29 04:08:40.076821 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:40.076782    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bed5eefc-3f59-455f-87d0-c180dc472ae7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64c765c8-tr4vz\" (UID: \"bed5eefc-3f59-455f-87d0-c180dc472ae7\") " pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-tr4vz"
Jul 29 04:08:40.076991 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:40.076833    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bed5eefc-3f59-455f-87d0-c180dc472ae7-tmp\") pod \"opendatahub-operator-controller-manager-64c765c8-tr4vz\" (UID: \"bed5eefc-3f59-455f-87d0-c180dc472ae7\") " pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-tr4vz"
Jul 29 04:08:40.076991 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:40.076896    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bed5eefc-3f59-455f-87d0-c180dc472ae7-webhook-cert\") pod \"opendatahub-operator-controller-manager-64c765c8-tr4vz\" (UID: \"bed5eefc-3f59-455f-87d0-c180dc472ae7\") " pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-tr4vz"
Jul 29 04:08:40.076991 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:40.076968    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld2wv\" (UniqueName: \"kubernetes.io/projected/bed5eefc-3f59-455f-87d0-c180dc472ae7-kube-api-access-ld2wv\") pod \"opendatahub-operator-controller-manager-64c765c8-tr4vz\" (UID: \"bed5eefc-3f59-455f-87d0-c180dc472ae7\") " pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-tr4vz"
Jul 29 04:08:40.077160 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:40.077032    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bed5eefc-3f59-455f-87d0-c180dc472ae7-manifests\") pod \"opendatahub-operator-controller-manager-64c765c8-tr4vz\" (UID: \"bed5eefc-3f59-455f-87d0-c180dc472ae7\") " pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-tr4vz"
Jul 29 04:08:40.178461 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:40.178421    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bed5eefc-3f59-455f-87d0-c180dc472ae7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64c765c8-tr4vz\" (UID: \"bed5eefc-3f59-455f-87d0-c180dc472ae7\") " pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-tr4vz"
Jul 29 04:08:40.178687 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:40.178479    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bed5eefc-3f59-455f-87d0-c180dc472ae7-tmp\") pod \"opendatahub-operator-controller-manager-64c765c8-tr4vz\" (UID: \"bed5eefc-3f59-455f-87d0-c180dc472ae7\") " pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-tr4vz"
Jul 29 04:08:40.178687 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:40.178543    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bed5eefc-3f59-455f-87d0-c180dc472ae7-webhook-cert\") pod \"opendatahub-operator-controller-manager-64c765c8-tr4vz\" (UID: \"bed5eefc-3f59-455f-87d0-c180dc472ae7\") " pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-tr4vz"
Jul 29 04:08:40.178687 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:40.178579    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld2wv\" (UniqueName: \"kubernetes.io/projected/bed5eefc-3f59-455f-87d0-c180dc472ae7-kube-api-access-ld2wv\") pod \"opendatahub-operator-controller-manager-64c765c8-tr4vz\" (UID: \"bed5eefc-3f59-455f-87d0-c180dc472ae7\") " pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-tr4vz"
Jul 29 04:08:40.178687 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:40.178643    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bed5eefc-3f59-455f-87d0-c180dc472ae7-manifests\") pod \"opendatahub-operator-controller-manager-64c765c8-tr4vz\" (UID: \"bed5eefc-3f59-455f-87d0-c180dc472ae7\") " pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-tr4vz"
Jul 29 04:08:40.179070 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:40.179034    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bed5eefc-3f59-455f-87d0-c180dc472ae7-manifests\") pod \"opendatahub-operator-controller-manager-64c765c8-tr4vz\" (UID: \"bed5eefc-3f59-455f-87d0-c180dc472ae7\") " pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-tr4vz"
Jul 29 04:08:40.181114 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:40.181083    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bed5eefc-3f59-455f-87d0-c180dc472ae7-tmp\") pod \"opendatahub-operator-controller-manager-64c765c8-tr4vz\" (UID: \"bed5eefc-3f59-455f-87d0-c180dc472ae7\") " pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-tr4vz"
Jul 29 04:08:40.181237 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:40.181180    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bed5eefc-3f59-455f-87d0-c180dc472ae7-webhook-cert\") pod \"opendatahub-operator-controller-manager-64c765c8-tr4vz\" (UID: \"bed5eefc-3f59-455f-87d0-c180dc472ae7\") " pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-tr4vz"
Jul 29 04:08:40.181237 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:40.181225    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bed5eefc-3f59-455f-87d0-c180dc472ae7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64c765c8-tr4vz\" (UID: \"bed5eefc-3f59-455f-87d0-c180dc472ae7\") " pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-tr4vz"
Jul 29 04:08:40.187765 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:40.187743    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld2wv\" (UniqueName: \"kubernetes.io/projected/bed5eefc-3f59-455f-87d0-c180dc472ae7-kube-api-access-ld2wv\") pod \"opendatahub-operator-controller-manager-64c765c8-tr4vz\" (UID: \"bed5eefc-3f59-455f-87d0-c180dc472ae7\") " pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-tr4vz"
Jul 29 04:08:40.264295 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:40.264185    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-tr4vz"
Jul 29 04:08:40.406030 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:40.405996    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64c765c8-tr4vz"]
Jul 29 04:08:40.411512 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:08:40.411455    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbed5eefc_3f59_455f_87d0_c180dc472ae7.slice/crio-f9ad4b38936352e01c3d8725e179e2dab39255cd48b2cb7c54cae1654b17ba39 WatchSource:0}: Error finding container f9ad4b38936352e01c3d8725e179e2dab39255cd48b2cb7c54cae1654b17ba39: Status 404 returned error can't find the container with id f9ad4b38936352e01c3d8725e179e2dab39255cd48b2cb7c54cae1654b17ba39
Jul 29 04:08:40.476701 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:40.476655    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-tr4vz" event={"ID":"bed5eefc-3f59-455f-87d0-c180dc472ae7","Type":"ContainerStarted","Data":"f9ad4b38936352e01c3d8725e179e2dab39255cd48b2cb7c54cae1654b17ba39"}
Jul 29 04:08:44.497014 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:44.496973    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-tr4vz" event={"ID":"bed5eefc-3f59-455f-87d0-c180dc472ae7","Type":"ContainerStarted","Data":"19cf6135177df3dde912005b79d3572c66169975c64926bd21724560b4ece7dc"}
Jul 29 04:08:45.503588 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:45.503548    2572 generic.go:356] "Generic (PLEG): container finished" podID="bed5eefc-3f59-455f-87d0-c180dc472ae7" containerID="19cf6135177df3dde912005b79d3572c66169975c64926bd21724560b4ece7dc" exitCode=0
Jul 29 04:08:45.503968 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:45.503640    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-tr4vz" event={"ID":"bed5eefc-3f59-455f-87d0-c180dc472ae7","Type":"ContainerDied","Data":"19cf6135177df3dde912005b79d3572c66169975c64926bd21724560b4ece7dc"}
Jul 29 04:08:46.510222 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:46.510180    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-tr4vz" event={"ID":"bed5eefc-3f59-455f-87d0-c180dc472ae7","Type":"ContainerStarted","Data":"08eff9e67f839020b14fc7ecc16f5775edf56cc3576fe5f2d555938e59c0f8a1"}
Jul 29 04:08:46.510668 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:46.510257    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-tr4vz"
Jul 29 04:08:46.533813 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:46.533761    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-tr4vz" podStartSLOduration=2.8706166250000003 podStartE2EDuration="7.533744368s" totalImagesPullingTime="3.618143253s" totalInitContainerRuntime="1.04498449s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:08:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:08:46.531156856 +0000 UTC m=+292.964194976" watchObservedRunningTime="2026-07-29 04:08:46.533744368 +0000 UTC m=+292.966782482"
Jul 29 04:08:49.473043 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:49.473015    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-75c59548f9-sch5c"
Jul 29 04:08:54.029556 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:54.029533    2572 kubelet.go:1648] "Image garbage collection succeeded"
Jul 29 04:08:57.517990 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:57.517958    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-tr4vz"
Jul 29 04:08:59.558329 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:59.558290    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-76ccb86b9-9dqb8"]
Jul 29 04:08:59.561896 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:59.561873    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-76ccb86b9-9dqb8"
Jul 29 04:08:59.564145 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:59.564117    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 29 04:08:59.565219 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:59.565195    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 29 04:08:59.566049 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:59.566027    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-68q26\""
Jul 29 04:08:59.566173 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:59.566057    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 29 04:08:59.569130 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:59.569101    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 29 04:08:59.577636 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:59.577607    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-76ccb86b9-9dqb8"]
Jul 29 04:08:59.653771 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:59.653736    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5c5dc98-bc8f-4b33-97c9-356d4c60ada1-tmp\") pod \"kube-auth-proxy-76ccb86b9-9dqb8\" (UID: \"b5c5dc98-bc8f-4b33-97c9-356d4c60ada1\") " pod="openshift-ingress/kube-auth-proxy-76ccb86b9-9dqb8"
Jul 29 04:08:59.653939 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:59.653791    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6985q\" (UniqueName: \"kubernetes.io/projected/b5c5dc98-bc8f-4b33-97c9-356d4c60ada1-kube-api-access-6985q\") pod \"kube-auth-proxy-76ccb86b9-9dqb8\" (UID: \"b5c5dc98-bc8f-4b33-97c9-356d4c60ada1\") " pod="openshift-ingress/kube-auth-proxy-76ccb86b9-9dqb8"
Jul 29 04:08:59.653939 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:59.653827    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5c5dc98-bc8f-4b33-97c9-356d4c60ada1-tls-certs\") pod \"kube-auth-proxy-76ccb86b9-9dqb8\" (UID: \"b5c5dc98-bc8f-4b33-97c9-356d4c60ada1\") " pod="openshift-ingress/kube-auth-proxy-76ccb86b9-9dqb8"
Jul 29 04:08:59.755075 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:59.755041    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5c5dc98-bc8f-4b33-97c9-356d4c60ada1-tls-certs\") pod \"kube-auth-proxy-76ccb86b9-9dqb8\" (UID: \"b5c5dc98-bc8f-4b33-97c9-356d4c60ada1\") " pod="openshift-ingress/kube-auth-proxy-76ccb86b9-9dqb8"
Jul 29 04:08:59.755229 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:59.755106    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5c5dc98-bc8f-4b33-97c9-356d4c60ada1-tmp\") pod \"kube-auth-proxy-76ccb86b9-9dqb8\" (UID: \"b5c5dc98-bc8f-4b33-97c9-356d4c60ada1\") " pod="openshift-ingress/kube-auth-proxy-76ccb86b9-9dqb8"
Jul 29 04:08:59.755229 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:59.755148    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6985q\" (UniqueName: \"kubernetes.io/projected/b5c5dc98-bc8f-4b33-97c9-356d4c60ada1-kube-api-access-6985q\") pod \"kube-auth-proxy-76ccb86b9-9dqb8\" (UID: \"b5c5dc98-bc8f-4b33-97c9-356d4c60ada1\") " pod="openshift-ingress/kube-auth-proxy-76ccb86b9-9dqb8"
Jul 29 04:08:59.757538 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:59.757491    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5c5dc98-bc8f-4b33-97c9-356d4c60ada1-tmp\") pod \"kube-auth-proxy-76ccb86b9-9dqb8\" (UID: \"b5c5dc98-bc8f-4b33-97c9-356d4c60ada1\") " pod="openshift-ingress/kube-auth-proxy-76ccb86b9-9dqb8"
Jul 29 04:08:59.757726 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:59.757706    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5c5dc98-bc8f-4b33-97c9-356d4c60ada1-tls-certs\") pod \"kube-auth-proxy-76ccb86b9-9dqb8\" (UID: \"b5c5dc98-bc8f-4b33-97c9-356d4c60ada1\") " pod="openshift-ingress/kube-auth-proxy-76ccb86b9-9dqb8"
Jul 29 04:08:59.772348 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:59.772318    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6985q\" (UniqueName: \"kubernetes.io/projected/b5c5dc98-bc8f-4b33-97c9-356d4c60ada1-kube-api-access-6985q\") pod \"kube-auth-proxy-76ccb86b9-9dqb8\" (UID: \"b5c5dc98-bc8f-4b33-97c9-356d4c60ada1\") " pod="openshift-ingress/kube-auth-proxy-76ccb86b9-9dqb8"
Jul 29 04:08:59.871911 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:08:59.871881    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-76ccb86b9-9dqb8"
Jul 29 04:09:00.016195 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:09:00.016158    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-76ccb86b9-9dqb8"]
Jul 29 04:09:00.019163 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:09:00.019136    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5c5dc98_bc8f_4b33_97c9_356d4c60ada1.slice/crio-af3a83beadccd879b8b543e01c079426d626f4c00fca8170f7908f74ff1a7e61 WatchSource:0}: Error finding container af3a83beadccd879b8b543e01c079426d626f4c00fca8170f7908f74ff1a7e61: Status 404 returned error can't find the container with id af3a83beadccd879b8b543e01c079426d626f4c00fca8170f7908f74ff1a7e61
Jul 29 04:09:00.020952 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:09:00.020936    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 04:09:00.577426 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:09:00.577360    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-76ccb86b9-9dqb8" event={"ID":"b5c5dc98-bc8f-4b33-97c9-356d4c60ada1","Type":"ContainerStarted","Data":"af3a83beadccd879b8b543e01c079426d626f4c00fca8170f7908f74ff1a7e61"}
Jul 29 04:09:03.594293 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:09:03.594259    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-76ccb86b9-9dqb8" event={"ID":"b5c5dc98-bc8f-4b33-97c9-356d4c60ada1","Type":"ContainerStarted","Data":"d0dfc39909455847c25c6f3ddd844dd2b5712cbd77f5c75339d39f62ab1e8dca"}
Jul 29 04:09:03.609866 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:09:03.609795    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-76ccb86b9-9dqb8" podStartSLOduration=2.023543582 podStartE2EDuration="4.609769887s" totalImagesPullingTime="2.586226305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:08:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:09:03.609096709 +0000 UTC m=+310.042134823" watchObservedRunningTime="2026-07-29 04:09:03.609769887 +0000 UTC m=+310.042808000"
Jul 29 04:09:09.674788 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:09:09.674749    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-cthxg"]
Jul 29 04:09:09.678683 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:09:09.678663    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cthxg"
Jul 29 04:09:09.681706 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:09:09.681682    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 29 04:09:09.681851 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:09:09.681736    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-wtl94\""
Jul 29 04:09:09.702327 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:09:09.699099    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-cthxg"]
Jul 29 04:09:09.748112 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:09:09.748073    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20443ca3-c07a-4931-946a-5dabf4ee539b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-cthxg\" (UID: \"20443ca3-c07a-4931-946a-5dabf4ee539b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cthxg"
Jul 29 04:09:09.748286 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:09:09.748156    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfc9j\" (UniqueName: \"kubernetes.io/projected/20443ca3-c07a-4931-946a-5dabf4ee539b-kube-api-access-vfc9j\") pod \"llmisvc-controller-manager-777c6bd7d5-cthxg\" (UID: \"20443ca3-c07a-4931-946a-5dabf4ee539b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cthxg"
Jul 29 04:09:09.849249 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:09:09.849211    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfc9j\" (UniqueName: \"kubernetes.io/projected/20443ca3-c07a-4931-946a-5dabf4ee539b-kube-api-access-vfc9j\") pod \"llmisvc-controller-manager-777c6bd7d5-cthxg\" (UID: \"20443ca3-c07a-4931-946a-5dabf4ee539b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cthxg"
Jul 29 04:09:09.849397 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:09:09.849280    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20443ca3-c07a-4931-946a-5dabf4ee539b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-cthxg\" (UID: \"20443ca3-c07a-4931-946a-5dabf4ee539b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cthxg"
Jul 29 04:09:09.851895 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:09:09.851875    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20443ca3-c07a-4931-946a-5dabf4ee539b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-cthxg\" (UID: \"20443ca3-c07a-4931-946a-5dabf4ee539b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cthxg"
Jul 29 04:09:09.858716 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:09:09.858692    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfc9j\" (UniqueName: \"kubernetes.io/projected/20443ca3-c07a-4931-946a-5dabf4ee539b-kube-api-access-vfc9j\") pod \"llmisvc-controller-manager-777c6bd7d5-cthxg\" (UID: \"20443ca3-c07a-4931-946a-5dabf4ee539b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cthxg"
Jul 29 04:09:09.991769 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:09:09.991672    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cthxg"
Jul 29 04:09:10.127978 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:09:10.127893    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-cthxg"]
Jul 29 04:09:10.131846 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:09:10.131820    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod20443ca3_c07a_4931_946a_5dabf4ee539b.slice/crio-cc66445fa6e5aada5289455c70d2561013ab0014d580da53058e06fdfd3a9322 WatchSource:0}: Error finding container cc66445fa6e5aada5289455c70d2561013ab0014d580da53058e06fdfd3a9322: Status 404 returned error can't find the container with id cc66445fa6e5aada5289455c70d2561013ab0014d580da53058e06fdfd3a9322
Jul 29 04:09:10.628816 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:09:10.628780    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cthxg" event={"ID":"20443ca3-c07a-4931-946a-5dabf4ee539b","Type":"ContainerStarted","Data":"cc66445fa6e5aada5289455c70d2561013ab0014d580da53058e06fdfd3a9322"}
Jul 29 04:09:13.643610 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:09:13.643568    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cthxg" event={"ID":"20443ca3-c07a-4931-946a-5dabf4ee539b","Type":"ContainerStarted","Data":"cd81618a6f392f80be17a65364ed139bc9cb5c37f3997f06830b1ff605b03868"}
Jul 29 04:09:13.643965 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:09:13.643713    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cthxg"
Jul 29 04:09:13.660410 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:09:13.660354    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cthxg" podStartSLOduration=1.367123173 podStartE2EDuration="4.660338129s" totalImagesPullingTime="3.293214956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:09:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:09:13.658988632 +0000 UTC m=+320.092026747" watchObservedRunningTime="2026-07-29 04:09:13.660338129 +0000 UTC m=+320.093376242"
Jul 29 04:09:44.650542 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:09:44.650446    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cthxg"
Jul 29 04:11:02.283553 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:02.283524    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fjw5k"]
Jul 29 04:11:02.286703 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:02.286685    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fjw5k"
Jul 29 04:11:02.289514 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:02.289475    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 29 04:11:02.289631 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:02.289619    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 29 04:11:02.289704 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:02.289630    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nkp54\""
Jul 29 04:11:02.303778 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:02.303758    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fjw5k"]
Jul 29 04:11:02.459802 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:02.459762    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctz6j\" (UniqueName: \"kubernetes.io/projected/75948a5b-d25d-4b68-aaa4-dc11e215b6ed-kube-api-access-ctz6j\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-fjw5k\" (UID: \"75948a5b-d25d-4b68-aaa4-dc11e215b6ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fjw5k"
Jul 29 04:11:02.459985 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:02.459816    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/75948a5b-d25d-4b68-aaa4-dc11e215b6ed-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-fjw5k\" (UID: \"75948a5b-d25d-4b68-aaa4-dc11e215b6ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fjw5k"
Jul 29 04:11:02.560435 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:02.560347    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/75948a5b-d25d-4b68-aaa4-dc11e215b6ed-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-fjw5k\" (UID: \"75948a5b-d25d-4b68-aaa4-dc11e215b6ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fjw5k"
Jul 29 04:11:02.560629 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:02.560445    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctz6j\" (UniqueName: \"kubernetes.io/projected/75948a5b-d25d-4b68-aaa4-dc11e215b6ed-kube-api-access-ctz6j\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-fjw5k\" (UID: \"75948a5b-d25d-4b68-aaa4-dc11e215b6ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fjw5k"
Jul 29 04:11:02.560820 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:02.560798    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/75948a5b-d25d-4b68-aaa4-dc11e215b6ed-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-fjw5k\" (UID: \"75948a5b-d25d-4b68-aaa4-dc11e215b6ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fjw5k"
Jul 29 04:11:02.573019 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:02.572989    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctz6j\" (UniqueName: \"kubernetes.io/projected/75948a5b-d25d-4b68-aaa4-dc11e215b6ed-kube-api-access-ctz6j\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-fjw5k\" (UID: \"75948a5b-d25d-4b68-aaa4-dc11e215b6ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fjw5k"
Jul 29 04:11:02.596983 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:02.596955    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fjw5k"
Jul 29 04:11:02.731100 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:02.731075    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fjw5k"]
Jul 29 04:11:02.733411 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:11:02.733371    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75948a5b_d25d_4b68_aaa4_dc11e215b6ed.slice/crio-50437dbd980efd4b6b84f39927c72824b257b951a863f4d0f3a36ab6944ba239 WatchSource:0}: Error finding container 50437dbd980efd4b6b84f39927c72824b257b951a863f4d0f3a36ab6944ba239: Status 404 returned error can't find the container with id 50437dbd980efd4b6b84f39927c72824b257b951a863f4d0f3a36ab6944ba239
Jul 29 04:11:02.925881 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:02.925850    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fjw5k"]
Jul 29 04:11:02.931331 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:02.931303    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fjw5k"]
Jul 29 04:11:02.950796 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:02.950769    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7rqfs"]
Jul 29 04:11:02.954848 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:02.954829    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7rqfs"
Jul 29 04:11:02.968693 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:02.968670    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7rqfs"]
Jul 29 04:11:03.065970 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:03.065934    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f19ecf6c-0c9f-47fa-9654-f0849a8db2e2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7rqfs\" (UID: \"f19ecf6c-0c9f-47fa-9654-f0849a8db2e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7rqfs"
Jul 29 04:11:03.066166 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:03.066001    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52pmp\" (UniqueName: \"kubernetes.io/projected/f19ecf6c-0c9f-47fa-9654-f0849a8db2e2-kube-api-access-52pmp\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7rqfs\" (UID: \"f19ecf6c-0c9f-47fa-9654-f0849a8db2e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7rqfs"
Jul 29 04:11:03.166941 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:03.166904    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52pmp\" (UniqueName: \"kubernetes.io/projected/f19ecf6c-0c9f-47fa-9654-f0849a8db2e2-kube-api-access-52pmp\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7rqfs\" (UID: \"f19ecf6c-0c9f-47fa-9654-f0849a8db2e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7rqfs"
Jul 29 04:11:03.167119 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:03.166980    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f19ecf6c-0c9f-47fa-9654-f0849a8db2e2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7rqfs\" (UID: \"f19ecf6c-0c9f-47fa-9654-f0849a8db2e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7rqfs"
Jul 29 04:11:03.167297 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:03.167281    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f19ecf6c-0c9f-47fa-9654-f0849a8db2e2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7rqfs\" (UID: \"f19ecf6c-0c9f-47fa-9654-f0849a8db2e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7rqfs"
Jul 29 04:11:03.183820 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:03.183749    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52pmp\" (UniqueName: \"kubernetes.io/projected/f19ecf6c-0c9f-47fa-9654-f0849a8db2e2-kube-api-access-52pmp\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7rqfs\" (UID: \"f19ecf6c-0c9f-47fa-9654-f0849a8db2e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7rqfs"
Jul 29 04:11:03.266745 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:03.266704    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7rqfs"
Jul 29 04:11:03.411901 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:03.411812    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7rqfs"]
Jul 29 04:11:03.441452 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:11:03.441366    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf19ecf6c_0c9f_47fa_9654_f0849a8db2e2.slice/crio-6d71878088a14fc1116aa44755bcb8b7696efe23dd6c620f6a82ee33a785b00b WatchSource:0}: Error finding container 6d71878088a14fc1116aa44755bcb8b7696efe23dd6c620f6a82ee33a785b00b: Status 404 returned error can't find the container with id 6d71878088a14fc1116aa44755bcb8b7696efe23dd6c620f6a82ee33a785b00b
Jul 29 04:11:04.156838 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:04.156797    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7rqfs" event={"ID":"f19ecf6c-0c9f-47fa-9654-f0849a8db2e2","Type":"ContainerStarted","Data":"6d71878088a14fc1116aa44755bcb8b7696efe23dd6c620f6a82ee33a785b00b"}
Jul 29 04:11:07.159598 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:07.159482    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fjw5k" podUID="75948a5b-d25d-4b68-aaa4-dc11e215b6ed" containerName="manager" containerID="cri-o://cc754b17de6c8c5930bef9113558818addb1a1e31c128de79abc31d54799df6d" gracePeriod=2
Jul 29 04:11:07.161273 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:07.161226    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7rqfs" event={"ID":"f19ecf6c-0c9f-47fa-9654-f0849a8db2e2","Type":"ContainerStarted","Data":"8f8e8baa1620181fb7bc78feb0014049faf5aafd3b5b0b936adff724e41db373"}
Jul 29 04:11:07.161412 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:07.161304    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7rqfs"
Jul 29 04:11:07.179268 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:07.179221    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7rqfs" podStartSLOduration=1.703174058 podStartE2EDuration="5.179205418s" totalImagesPullingTime="3.47603136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:11:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:11:07.178850075 +0000 UTC m=+433.611888200" watchObservedRunningTime="2026-07-29 04:11:07.179205418 +0000 UTC m=+433.612243512"
Jul 29 04:11:07.399752 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:07.399727    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fjw5k"
Jul 29 04:11:07.401861 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:11:07.401830    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-fjw5k\" is forbidden: User \"system:node:ip-10-0-130-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-4.ec2.internal' and this object" podUID="75948a5b-d25d-4b68-aaa4-dc11e215b6ed" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fjw5k"
Jul 29 04:11:07.512137 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:07.512062    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/75948a5b-d25d-4b68-aaa4-dc11e215b6ed-extensions-socket-volume\") pod \"75948a5b-d25d-4b68-aaa4-dc11e215b6ed\" (UID: \"75948a5b-d25d-4b68-aaa4-dc11e215b6ed\") "
Jul 29 04:11:07.512137 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:07.512121    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctz6j\" (UniqueName: \"kubernetes.io/projected/75948a5b-d25d-4b68-aaa4-dc11e215b6ed-kube-api-access-ctz6j\") pod \"75948a5b-d25d-4b68-aaa4-dc11e215b6ed\" (UID: \"75948a5b-d25d-4b68-aaa4-dc11e215b6ed\") "
Jul 29 04:11:07.512349 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:07.512326    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75948a5b-d25d-4b68-aaa4-dc11e215b6ed-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "75948a5b-d25d-4b68-aaa4-dc11e215b6ed" (UID: "75948a5b-d25d-4b68-aaa4-dc11e215b6ed"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:11:07.514427 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:07.514400    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75948a5b-d25d-4b68-aaa4-dc11e215b6ed-kube-api-access-ctz6j" (OuterVolumeSpecName: "kube-api-access-ctz6j") pod "75948a5b-d25d-4b68-aaa4-dc11e215b6ed" (UID: "75948a5b-d25d-4b68-aaa4-dc11e215b6ed"). InnerVolumeSpecName "kube-api-access-ctz6j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:11:07.613057 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:07.613024    2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/75948a5b-d25d-4b68-aaa4-dc11e215b6ed-extensions-socket-volume\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 04:11:07.613057 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:07.613051    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctz6j\" (UniqueName: \"kubernetes.io/projected/75948a5b-d25d-4b68-aaa4-dc11e215b6ed-kube-api-access-ctz6j\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 04:11:08.147537 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:08.147485    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75948a5b-d25d-4b68-aaa4-dc11e215b6ed" path="/var/lib/kubelet/pods/75948a5b-d25d-4b68-aaa4-dc11e215b6ed/volumes"
Jul 29 04:11:08.166552 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:08.166524    2572 generic.go:356] "Generic (PLEG): container finished" podID="75948a5b-d25d-4b68-aaa4-dc11e215b6ed" containerID="cc754b17de6c8c5930bef9113558818addb1a1e31c128de79abc31d54799df6d" exitCode=2
Jul 29 04:11:08.166951 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:08.166634    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fjw5k"
Jul 29 04:11:08.166951 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:08.166669    2572 scope.go:117] "RemoveContainer" containerID="cc754b17de6c8c5930bef9113558818addb1a1e31c128de79abc31d54799df6d"
Jul 29 04:11:08.171031 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:11:08.171001    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-fjw5k\" is forbidden: User \"system:node:ip-10-0-130-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-4.ec2.internal' and this object" podUID="75948a5b-d25d-4b68-aaa4-dc11e215b6ed" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fjw5k"
Jul 29 04:11:08.176032 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:08.176016    2572 scope.go:117] "RemoveContainer" containerID="cc754b17de6c8c5930bef9113558818addb1a1e31c128de79abc31d54799df6d"
Jul 29 04:11:08.176288 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:11:08.176269    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc754b17de6c8c5930bef9113558818addb1a1e31c128de79abc31d54799df6d\": container with ID starting with cc754b17de6c8c5930bef9113558818addb1a1e31c128de79abc31d54799df6d not found: ID does not exist" containerID="cc754b17de6c8c5930bef9113558818addb1a1e31c128de79abc31d54799df6d"
Jul 29 04:11:08.176350 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:08.176302    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc754b17de6c8c5930bef9113558818addb1a1e31c128de79abc31d54799df6d"} err="failed to get container status \"cc754b17de6c8c5930bef9113558818addb1a1e31c128de79abc31d54799df6d\": rpc error: code = NotFound desc = could not find container \"cc754b17de6c8c5930bef9113558818addb1a1e31c128de79abc31d54799df6d\": container with ID starting with cc754b17de6c8c5930bef9113558818addb1a1e31c128de79abc31d54799df6d not found: ID does not exist"
Jul 29 04:11:18.169927 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:18.169852    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7rqfs"
Jul 29 04:11:35.554324 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:35.554294    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7rqfs"]
Jul 29 04:11:35.554840 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:35.554515    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7rqfs" podUID="f19ecf6c-0c9f-47fa-9654-f0849a8db2e2" containerName="manager" containerID="cri-o://8f8e8baa1620181fb7bc78feb0014049faf5aafd3b5b0b936adff724e41db373" gracePeriod=10
Jul 29 04:11:35.801666 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:35.801633    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7rqfs"
Jul 29 04:11:35.859434 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:35.859405    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52pmp\" (UniqueName: \"kubernetes.io/projected/f19ecf6c-0c9f-47fa-9654-f0849a8db2e2-kube-api-access-52pmp\") pod \"f19ecf6c-0c9f-47fa-9654-f0849a8db2e2\" (UID: \"f19ecf6c-0c9f-47fa-9654-f0849a8db2e2\") "
Jul 29 04:11:35.859600 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:35.859483    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f19ecf6c-0c9f-47fa-9654-f0849a8db2e2-extensions-socket-volume\") pod \"f19ecf6c-0c9f-47fa-9654-f0849a8db2e2\" (UID: \"f19ecf6c-0c9f-47fa-9654-f0849a8db2e2\") "
Jul 29 04:11:35.859964 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:35.859935    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f19ecf6c-0c9f-47fa-9654-f0849a8db2e2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f19ecf6c-0c9f-47fa-9654-f0849a8db2e2" (UID: "f19ecf6c-0c9f-47fa-9654-f0849a8db2e2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:11:35.861719 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:35.861699    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f19ecf6c-0c9f-47fa-9654-f0849a8db2e2-kube-api-access-52pmp" (OuterVolumeSpecName: "kube-api-access-52pmp") pod "f19ecf6c-0c9f-47fa-9654-f0849a8db2e2" (UID: "f19ecf6c-0c9f-47fa-9654-f0849a8db2e2"). InnerVolumeSpecName "kube-api-access-52pmp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:11:35.960723 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:35.960687    2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f19ecf6c-0c9f-47fa-9654-f0849a8db2e2-extensions-socket-volume\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 04:11:35.960723 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:35.960717    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52pmp\" (UniqueName: \"kubernetes.io/projected/f19ecf6c-0c9f-47fa-9654-f0849a8db2e2-kube-api-access-52pmp\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 04:11:36.298831 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:36.298798    2572 generic.go:356] "Generic (PLEG): container finished" podID="f19ecf6c-0c9f-47fa-9654-f0849a8db2e2" containerID="8f8e8baa1620181fb7bc78feb0014049faf5aafd3b5b0b936adff724e41db373" exitCode=0
Jul 29 04:11:36.299029 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:36.298856    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7rqfs"
Jul 29 04:11:36.299029 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:36.298862    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7rqfs" event={"ID":"f19ecf6c-0c9f-47fa-9654-f0849a8db2e2","Type":"ContainerDied","Data":"8f8e8baa1620181fb7bc78feb0014049faf5aafd3b5b0b936adff724e41db373"}
Jul 29 04:11:36.299029 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:36.298979    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7rqfs" event={"ID":"f19ecf6c-0c9f-47fa-9654-f0849a8db2e2","Type":"ContainerDied","Data":"6d71878088a14fc1116aa44755bcb8b7696efe23dd6c620f6a82ee33a785b00b"}
Jul 29 04:11:36.299029 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:36.299007    2572 scope.go:117] "RemoveContainer" containerID="8f8e8baa1620181fb7bc78feb0014049faf5aafd3b5b0b936adff724e41db373"
Jul 29 04:11:36.307670 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:36.307653    2572 scope.go:117] "RemoveContainer" containerID="8f8e8baa1620181fb7bc78feb0014049faf5aafd3b5b0b936adff724e41db373"
Jul 29 04:11:36.307900 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:11:36.307880    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f8e8baa1620181fb7bc78feb0014049faf5aafd3b5b0b936adff724e41db373\": container with ID starting with 8f8e8baa1620181fb7bc78feb0014049faf5aafd3b5b0b936adff724e41db373 not found: ID does not exist" containerID="8f8e8baa1620181fb7bc78feb0014049faf5aafd3b5b0b936adff724e41db373"
Jul 29 04:11:36.308010 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:36.307905    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f8e8baa1620181fb7bc78feb0014049faf5aafd3b5b0b936adff724e41db373"} err="failed to get container status \"8f8e8baa1620181fb7bc78feb0014049faf5aafd3b5b0b936adff724e41db373\": rpc error: code = NotFound desc = could not find container \"8f8e8baa1620181fb7bc78feb0014049faf5aafd3b5b0b936adff724e41db373\": container with ID starting with 8f8e8baa1620181fb7bc78feb0014049faf5aafd3b5b0b936adff724e41db373 not found: ID does not exist"
Jul 29 04:11:36.317005 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:36.316978    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7rqfs"]
Jul 29 04:11:36.322104 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:36.322085    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7rqfs"]
Jul 29 04:11:38.148270 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:38.148227    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f19ecf6c-0c9f-47fa-9654-f0849a8db2e2" path="/var/lib/kubelet/pods/f19ecf6c-0c9f-47fa-9654-f0849a8db2e2/volumes"
Jul 29 04:11:50.765554 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:50.765495    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:11:50.765946 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:50.765852    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f19ecf6c-0c9f-47fa-9654-f0849a8db2e2" containerName="manager"
Jul 29 04:11:50.765946 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:50.765864    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f19ecf6c-0c9f-47fa-9654-f0849a8db2e2" containerName="manager"
Jul 29 04:11:50.765946 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:50.765887    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75948a5b-d25d-4b68-aaa4-dc11e215b6ed" containerName="manager"
Jul 29 04:11:50.765946 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:50.765894    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="75948a5b-d25d-4b68-aaa4-dc11e215b6ed" containerName="manager"
Jul 29 04:11:50.766063 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:50.765955    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f19ecf6c-0c9f-47fa-9654-f0849a8db2e2" containerName="manager"
Jul 29 04:11:50.766063 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:50.765965    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="75948a5b-d25d-4b68-aaa4-dc11e215b6ed" containerName="manager"
Jul 29 04:11:50.768097 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:50.768078    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-jn88m"
Jul 29 04:11:50.770467 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:50.770446    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-g45cf\""
Jul 29 04:11:50.770613 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:50.770448    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 29 04:11:50.771217 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:50.771198    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 29 04:11:50.771334 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:50.771205    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 29 04:11:50.778201 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:50.778176    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:11:50.787840 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:50.787811    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:11:50.895868 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:50.895831    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6f4d7c11-6c60-4c8a-9d9f-972ac0430813-config-file\") pod \"limitador-limitador-54d6d988d5-jn88m\" (UID: \"6f4d7c11-6c60-4c8a-9d9f-972ac0430813\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jn88m"
Jul 29 04:11:50.896058 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:50.895885    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddxzd\" (UniqueName: \"kubernetes.io/projected/6f4d7c11-6c60-4c8a-9d9f-972ac0430813-kube-api-access-ddxzd\") pod \"limitador-limitador-54d6d988d5-jn88m\" (UID: \"6f4d7c11-6c60-4c8a-9d9f-972ac0430813\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jn88m"
Jul 29 04:11:50.997109 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:50.997022    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6f4d7c11-6c60-4c8a-9d9f-972ac0430813-config-file\") pod \"limitador-limitador-54d6d988d5-jn88m\" (UID: \"6f4d7c11-6c60-4c8a-9d9f-972ac0430813\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jn88m"
Jul 29 04:11:50.997109 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:50.997074    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddxzd\" (UniqueName: \"kubernetes.io/projected/6f4d7c11-6c60-4c8a-9d9f-972ac0430813-kube-api-access-ddxzd\") pod \"limitador-limitador-54d6d988d5-jn88m\" (UID: \"6f4d7c11-6c60-4c8a-9d9f-972ac0430813\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jn88m"
Jul 29 04:11:50.997736 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:50.997713    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6f4d7c11-6c60-4c8a-9d9f-972ac0430813-config-file\") pod \"limitador-limitador-54d6d988d5-jn88m\" (UID: \"6f4d7c11-6c60-4c8a-9d9f-972ac0430813\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jn88m"
Jul 29 04:11:51.005025 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:51.005002    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddxzd\" (UniqueName: \"kubernetes.io/projected/6f4d7c11-6c60-4c8a-9d9f-972ac0430813-kube-api-access-ddxzd\") pod \"limitador-limitador-54d6d988d5-jn88m\" (UID: \"6f4d7c11-6c60-4c8a-9d9f-972ac0430813\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jn88m"
Jul 29 04:11:51.080060 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:51.080024    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-jn88m"
Jul 29 04:11:51.213017 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:51.212967    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:11:51.215853 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:11:51.215812    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f4d7c11_6c60_4c8a_9d9f_972ac0430813.slice/crio-8c8d74c7c72fae2ab12a2b186cc3eb5b7f89d19eec511ac2c867449e1aa8f15e WatchSource:0}: Error finding container 8c8d74c7c72fae2ab12a2b186cc3eb5b7f89d19eec511ac2c867449e1aa8f15e: Status 404 returned error can't find the container with id 8c8d74c7c72fae2ab12a2b186cc3eb5b7f89d19eec511ac2c867449e1aa8f15e
Jul 29 04:11:51.367946 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:51.367916    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-jn88m" event={"ID":"6f4d7c11-6c60-4c8a-9d9f-972ac0430813","Type":"ContainerStarted","Data":"8c8d74c7c72fae2ab12a2b186cc3eb5b7f89d19eec511ac2c867449e1aa8f15e"}
Jul 29 04:11:54.385912 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:54.385870    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-jn88m" event={"ID":"6f4d7c11-6c60-4c8a-9d9f-972ac0430813","Type":"ContainerStarted","Data":"a45a16a45ac80bafac64fed2d0fbf3c17ac0053f2c913238ded7b2f807b50c34"}
Jul 29 04:11:54.386371 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:54.386028    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-jn88m"
Jul 29 04:11:54.402932 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:11:54.402879    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-jn88m" podStartSLOduration=1.784585097 podStartE2EDuration="4.402864442s" totalImagesPullingTime="2.618279345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:11:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:11:54.400268707 +0000 UTC m=+480.833306820" watchObservedRunningTime="2026-07-29 04:11:54.402864442 +0000 UTC m=+480.835902555"
Jul 29 04:12:05.392319 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:12:05.392286    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-jn88m"
Jul 29 04:13:04.560431 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:04.560394    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:13:20.481146 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:20.481109    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:13:31.620447 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:31.620413    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-swv4f"]
Jul 29 04:13:31.624105 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:31.624078    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-swv4f"
Jul 29 04:13:31.627832 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:31.627809    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 29 04:13:31.627991 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:31.627883    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hrx5q\""
Jul 29 04:13:31.627991 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:31.627939    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 29 04:13:31.628113 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:31.628071    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 29 04:13:31.633085 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:31.633056    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-swv4f"]
Jul 29 04:13:31.802018 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:31.801973    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/943237de-e0a7-4015-bda2-827a1b164502-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-swv4f\" (UID: \"943237de-e0a7-4015-bda2-827a1b164502\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-swv4f"
Jul 29 04:13:31.802018 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:31.802026    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/943237de-e0a7-4015-bda2-827a1b164502-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-swv4f\" (UID: \"943237de-e0a7-4015-bda2-827a1b164502\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-swv4f"
Jul 29 04:13:31.802249 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:31.802050    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/943237de-e0a7-4015-bda2-827a1b164502-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-swv4f\" (UID: \"943237de-e0a7-4015-bda2-827a1b164502\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-swv4f"
Jul 29 04:13:31.802249 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:31.802091    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/943237de-e0a7-4015-bda2-827a1b164502-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-swv4f\" (UID: \"943237de-e0a7-4015-bda2-827a1b164502\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-swv4f"
Jul 29 04:13:31.802249 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:31.802115    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbpmj\" (UniqueName: \"kubernetes.io/projected/943237de-e0a7-4015-bda2-827a1b164502-kube-api-access-lbpmj\") pod \"e2e-distinct-simulated-kserve-59975d69f9-swv4f\" (UID: \"943237de-e0a7-4015-bda2-827a1b164502\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-swv4f"
Jul 29 04:13:31.802249 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:31.802204    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/943237de-e0a7-4015-bda2-827a1b164502-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-swv4f\" (UID: \"943237de-e0a7-4015-bda2-827a1b164502\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-swv4f"
Jul 29 04:13:31.903103 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:31.903005    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/943237de-e0a7-4015-bda2-827a1b164502-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-swv4f\" (UID: \"943237de-e0a7-4015-bda2-827a1b164502\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-swv4f"
Jul 29 04:13:31.903103 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:31.903061    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/943237de-e0a7-4015-bda2-827a1b164502-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-swv4f\" (UID: \"943237de-e0a7-4015-bda2-827a1b164502\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-swv4f"
Jul 29 04:13:31.903103 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:31.903098    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/943237de-e0a7-4015-bda2-827a1b164502-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-swv4f\" (UID: \"943237de-e0a7-4015-bda2-827a1b164502\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-swv4f"
Jul 29 04:13:31.903367 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:31.903135    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbpmj\" (UniqueName: \"kubernetes.io/projected/943237de-e0a7-4015-bda2-827a1b164502-kube-api-access-lbpmj\") pod \"e2e-distinct-simulated-kserve-59975d69f9-swv4f\" (UID: \"943237de-e0a7-4015-bda2-827a1b164502\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-swv4f"
Jul 29 04:13:31.903367 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:31.903195    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/943237de-e0a7-4015-bda2-827a1b164502-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-swv4f\" (UID: \"943237de-e0a7-4015-bda2-827a1b164502\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-swv4f"
Jul 29 04:13:31.903367 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:31.903254    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/943237de-e0a7-4015-bda2-827a1b164502-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-swv4f\" (UID: \"943237de-e0a7-4015-bda2-827a1b164502\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-swv4f"
Jul 29 04:13:31.903545 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:31.903414    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/943237de-e0a7-4015-bda2-827a1b164502-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-swv4f\" (UID: \"943237de-e0a7-4015-bda2-827a1b164502\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-swv4f"
Jul 29 04:13:31.903545 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:31.903472    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/943237de-e0a7-4015-bda2-827a1b164502-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-swv4f\" (UID: \"943237de-e0a7-4015-bda2-827a1b164502\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-swv4f"
Jul 29 04:13:31.903660 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:31.903596    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/943237de-e0a7-4015-bda2-827a1b164502-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-swv4f\" (UID: \"943237de-e0a7-4015-bda2-827a1b164502\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-swv4f"
Jul 29 04:13:31.905614 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:31.905582    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/943237de-e0a7-4015-bda2-827a1b164502-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-swv4f\" (UID: \"943237de-e0a7-4015-bda2-827a1b164502\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-swv4f"
Jul 29 04:13:31.906002 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:31.905976    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/943237de-e0a7-4015-bda2-827a1b164502-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-swv4f\" (UID: \"943237de-e0a7-4015-bda2-827a1b164502\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-swv4f"
Jul 29 04:13:31.911069 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:31.911047    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbpmj\" (UniqueName: \"kubernetes.io/projected/943237de-e0a7-4015-bda2-827a1b164502-kube-api-access-lbpmj\") pod \"e2e-distinct-simulated-kserve-59975d69f9-swv4f\" (UID: \"943237de-e0a7-4015-bda2-827a1b164502\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-swv4f"
Jul 29 04:13:31.936982 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:31.936956    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-swv4f"
Jul 29 04:13:32.073313 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:32.073146    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-swv4f"]
Jul 29 04:13:32.075513 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:13:32.075464    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod943237de_e0a7_4015_bda2_827a1b164502.slice/crio-f207d25d9fbc6fcb587d70032d86e1293c9d8a08ee1a6761b07aab85fcd74371 WatchSource:0}: Error finding container f207d25d9fbc6fcb587d70032d86e1293c9d8a08ee1a6761b07aab85fcd74371: Status 404 returned error can't find the container with id f207d25d9fbc6fcb587d70032d86e1293c9d8a08ee1a6761b07aab85fcd74371
Jul 29 04:13:32.586370 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:32.586238    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:13:32.833455 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:32.833414    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-swv4f" event={"ID":"943237de-e0a7-4015-bda2-827a1b164502","Type":"ContainerStarted","Data":"f207d25d9fbc6fcb587d70032d86e1293c9d8a08ee1a6761b07aab85fcd74371"}
Jul 29 04:13:33.839458 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:33.839422    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-swv4f" event={"ID":"943237de-e0a7-4015-bda2-827a1b164502","Type":"ContainerStarted","Data":"757ff2600e3a5050afeecd475dd0328851028a5065af70a4ed6205f3e5780c95"}
Jul 29 04:13:33.855698 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:33.855645    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-swv4f" podStartSLOduration=1.87017574 podStartE2EDuration="2.855628542s" totalImagesPullingTime="985.452802ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:13:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:13:33.854733543 +0000 UTC m=+580.287771683" watchObservedRunningTime="2026-07-29 04:13:33.855628542 +0000 UTC m=+580.288666655"
Jul 29 04:13:41.937389 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:41.937352    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-swv4f"
Jul 29 04:13:41.937798 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:41.937450    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-swv4f"
Jul 29 04:13:41.950431 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:41.950403    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-swv4f"
Jul 29 04:13:42.280371 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:42.280276    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:13:42.894193 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:42.894167    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-swv4f"
Jul 29 04:13:46.632533 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:46.632487    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt"]
Jul 29 04:13:46.636297 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:46.636262    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt"
Jul 29 04:13:46.640694 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:46.640662    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 29 04:13:46.645493 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:46.645466    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt"]
Jul 29 04:13:46.741653 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:46.741600    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b2e62d8-052b-43a7-8725-3807e1947115-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt\" (UID: \"9b2e62d8-052b-43a7-8725-3807e1947115\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt"
Jul 29 04:13:46.741653 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:46.741659    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b2e62d8-052b-43a7-8725-3807e1947115-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt\" (UID: \"9b2e62d8-052b-43a7-8725-3807e1947115\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt"
Jul 29 04:13:46.741886 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:46.741753    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b2e62d8-052b-43a7-8725-3807e1947115-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt\" (UID: \"9b2e62d8-052b-43a7-8725-3807e1947115\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt"
Jul 29 04:13:46.741886 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:46.741837    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b2e62d8-052b-43a7-8725-3807e1947115-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt\" (UID: \"9b2e62d8-052b-43a7-8725-3807e1947115\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt"
Jul 29 04:13:46.741886 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:46.741863    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b2e62d8-052b-43a7-8725-3807e1947115-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt\" (UID: \"9b2e62d8-052b-43a7-8725-3807e1947115\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt"
Jul 29 04:13:46.741997 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:46.741912    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sssg5\" (UniqueName: \"kubernetes.io/projected/9b2e62d8-052b-43a7-8725-3807e1947115-kube-api-access-sssg5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt\" (UID: \"9b2e62d8-052b-43a7-8725-3807e1947115\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt"
Jul 29 04:13:46.842688 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:46.842644    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b2e62d8-052b-43a7-8725-3807e1947115-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt\" (UID: \"9b2e62d8-052b-43a7-8725-3807e1947115\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt"
Jul 29 04:13:46.842688 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:46.842690    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b2e62d8-052b-43a7-8725-3807e1947115-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt\" (UID: \"9b2e62d8-052b-43a7-8725-3807e1947115\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt"
Jul 29 04:13:46.842908 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:46.842774    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sssg5\" (UniqueName: \"kubernetes.io/projected/9b2e62d8-052b-43a7-8725-3807e1947115-kube-api-access-sssg5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt\" (UID: \"9b2e62d8-052b-43a7-8725-3807e1947115\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt"
Jul 29 04:13:46.842908 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:46.842809    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b2e62d8-052b-43a7-8725-3807e1947115-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt\" (UID: \"9b2e62d8-052b-43a7-8725-3807e1947115\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt"
Jul 29 04:13:46.842908 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:46.842827    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b2e62d8-052b-43a7-8725-3807e1947115-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt\" (UID: \"9b2e62d8-052b-43a7-8725-3807e1947115\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt"
Jul 29 04:13:46.842908 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:46.842879    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b2e62d8-052b-43a7-8725-3807e1947115-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt\" (UID: \"9b2e62d8-052b-43a7-8725-3807e1947115\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt"
Jul 29 04:13:46.843136 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:46.843118    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b2e62d8-052b-43a7-8725-3807e1947115-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt\" (UID: \"9b2e62d8-052b-43a7-8725-3807e1947115\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt"
Jul 29 04:13:46.843177 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:46.843161    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b2e62d8-052b-43a7-8725-3807e1947115-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt\" (UID: \"9b2e62d8-052b-43a7-8725-3807e1947115\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt"
Jul 29 04:13:46.843212 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:46.843190    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b2e62d8-052b-43a7-8725-3807e1947115-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt\" (UID: \"9b2e62d8-052b-43a7-8725-3807e1947115\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt"
Jul 29 04:13:46.845333 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:46.845305    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b2e62d8-052b-43a7-8725-3807e1947115-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt\" (UID: \"9b2e62d8-052b-43a7-8725-3807e1947115\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt"
Jul 29 04:13:46.845592 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:46.845574    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b2e62d8-052b-43a7-8725-3807e1947115-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt\" (UID: \"9b2e62d8-052b-43a7-8725-3807e1947115\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt"
Jul 29 04:13:46.851491 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:46.851467    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sssg5\" (UniqueName: \"kubernetes.io/projected/9b2e62d8-052b-43a7-8725-3807e1947115-kube-api-access-sssg5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt\" (UID: \"9b2e62d8-052b-43a7-8725-3807e1947115\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt"
Jul 29 04:13:46.951700 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:46.951592    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt"
Jul 29 04:13:47.087034 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:47.086888    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt"]
Jul 29 04:13:47.089345 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:13:47.089300    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b2e62d8_052b_43a7_8725_3807e1947115.slice/crio-a465a0d5ba5625492cb35038521a1ff8d5ea88e47e533ea6696daa65a980c4bd WatchSource:0}: Error finding container a465a0d5ba5625492cb35038521a1ff8d5ea88e47e533ea6696daa65a980c4bd: Status 404 returned error can't find the container with id a465a0d5ba5625492cb35038521a1ff8d5ea88e47e533ea6696daa65a980c4bd
Jul 29 04:13:47.907558 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:47.907490    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt" event={"ID":"9b2e62d8-052b-43a7-8725-3807e1947115","Type":"ContainerStarted","Data":"fc54959eed4d9c84decad2f34622c888577fe5b62ec7a942886c879cd2020248"}
Jul 29 04:13:47.907991 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:47.907581    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt" event={"ID":"9b2e62d8-052b-43a7-8725-3807e1947115","Type":"ContainerStarted","Data":"a465a0d5ba5625492cb35038521a1ff8d5ea88e47e533ea6696daa65a980c4bd"}
Jul 29 04:13:47.926221 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:47.925741    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt" podStartSLOduration=1.748581229 podStartE2EDuration="1.925721025s" totalImagesPullingTime="177.139796ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:13:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:13:47.924122665 +0000 UTC m=+594.357160779" watchObservedRunningTime="2026-07-29 04:13:47.925721025 +0000 UTC m=+594.358759138"
Jul 29 04:13:47.977089 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:47.977054    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:13:54.380721 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:54.380667    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:13:56.952738 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:56.952705    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt"
Jul 29 04:13:56.953106 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:56.952770    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt"
Jul 29 04:13:56.965192 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:56.965167    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt"
Jul 29 04:13:57.965395 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:13:57.965358    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt"
Jul 29 04:14:09.503858 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:14:09.503819    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-gflm5"]
Jul 29 04:14:09.508424 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:14:09.508399    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gflm5"
Jul 29 04:14:09.510807 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:14:09.510784    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 29 04:14:09.515194 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:14:09.515165    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-gflm5"]
Jul 29 04:14:09.657336 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:14:09.657301    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f24j\" (UniqueName: \"kubernetes.io/projected/51cff2f2-45dc-4442-9c4f-0540142ff6e8-kube-api-access-6f24j\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gflm5\" (UID: \"51cff2f2-45dc-4442-9c4f-0540142ff6e8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gflm5"
Jul 29 04:14:09.657544 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:14:09.657361    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51cff2f2-45dc-4442-9c4f-0540142ff6e8-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gflm5\" (UID: \"51cff2f2-45dc-4442-9c4f-0540142ff6e8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gflm5"
Jul 29 04:14:09.657544 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:14:09.657431    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51cff2f2-45dc-4442-9c4f-0540142ff6e8-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gflm5\" (UID: \"51cff2f2-45dc-4442-9c4f-0540142ff6e8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gflm5"
Jul 29 04:14:09.657544 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:14:09.657538    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51cff2f2-45dc-4442-9c4f-0540142ff6e8-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gflm5\" (UID: \"51cff2f2-45dc-4442-9c4f-0540142ff6e8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gflm5"
Jul 29 04:14:09.657690 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:14:09.657564    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51cff2f2-45dc-4442-9c4f-0540142ff6e8-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gflm5\" (UID: \"51cff2f2-45dc-4442-9c4f-0540142ff6e8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gflm5"
Jul 29 04:14:09.657690 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:14:09.657582    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51cff2f2-45dc-4442-9c4f-0540142ff6e8-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gflm5\" (UID: \"51cff2f2-45dc-4442-9c4f-0540142ff6e8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gflm5"
Jul 29 04:14:09.758259 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:14:09.758167    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51cff2f2-45dc-4442-9c4f-0540142ff6e8-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gflm5\" (UID: \"51cff2f2-45dc-4442-9c4f-0540142ff6e8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gflm5"
Jul 29 04:14:09.758259 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:14:09.758212    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51cff2f2-45dc-4442-9c4f-0540142ff6e8-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gflm5\" (UID: \"51cff2f2-45dc-4442-9c4f-0540142ff6e8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gflm5"
Jul 29 04:14:09.758259 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:14:09.758237    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51cff2f2-45dc-4442-9c4f-0540142ff6e8-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gflm5\" (UID: \"51cff2f2-45dc-4442-9c4f-0540142ff6e8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gflm5"
Jul 29 04:14:09.758478 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:14:09.758297    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f24j\" (UniqueName: \"kubernetes.io/projected/51cff2f2-45dc-4442-9c4f-0540142ff6e8-kube-api-access-6f24j\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gflm5\" (UID: \"51cff2f2-45dc-4442-9c4f-0540142ff6e8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gflm5"
Jul 29 04:14:09.758478 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:14:09.758348    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51cff2f2-45dc-4442-9c4f-0540142ff6e8-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gflm5\" (UID: \"51cff2f2-45dc-4442-9c4f-0540142ff6e8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gflm5"
Jul 29 04:14:09.758478 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:14:09.758385    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51cff2f2-45dc-4442-9c4f-0540142ff6e8-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gflm5\" (UID: \"51cff2f2-45dc-4442-9c4f-0540142ff6e8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gflm5"
Jul 29 04:14:09.758734 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:14:09.758703    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51cff2f2-45dc-4442-9c4f-0540142ff6e8-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gflm5\" (UID: \"51cff2f2-45dc-4442-9c4f-0540142ff6e8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gflm5"
Jul 29 04:14:09.758870 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:14:09.758779    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51cff2f2-45dc-4442-9c4f-0540142ff6e8-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gflm5\" (UID: \"51cff2f2-45dc-4442-9c4f-0540142ff6e8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gflm5"
Jul 29 04:14:09.758870 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:14:09.758789    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51cff2f2-45dc-4442-9c4f-0540142ff6e8-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gflm5\" (UID: \"51cff2f2-45dc-4442-9c4f-0540142ff6e8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gflm5"
Jul 29 04:14:09.760661 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:14:09.760641    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51cff2f2-45dc-4442-9c4f-0540142ff6e8-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gflm5\" (UID: \"51cff2f2-45dc-4442-9c4f-0540142ff6e8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gflm5"
Jul 29 04:14:09.760917 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:14:09.760900    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51cff2f2-45dc-4442-9c4f-0540142ff6e8-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gflm5\" (UID: \"51cff2f2-45dc-4442-9c4f-0540142ff6e8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gflm5"
Jul 29 04:14:09.766379 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:14:09.766357    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f24j\" (UniqueName: \"kubernetes.io/projected/51cff2f2-45dc-4442-9c4f-0540142ff6e8-kube-api-access-6f24j\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gflm5\" (UID: \"51cff2f2-45dc-4442-9c4f-0540142ff6e8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gflm5"
Jul 29 04:14:09.819606 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:14:09.819556    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gflm5"
Jul 29 04:14:09.952897 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:14:09.952870    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-gflm5"]
Jul 29 04:14:09.955177 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:14:09.955149    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod51cff2f2_45dc_4442_9c4f_0540142ff6e8.slice/crio-4493c02b9cb98e69ce8dd3ab1d581baa4723e5109709ba86f35f87b72b5ede71 WatchSource:0}: Error finding container 4493c02b9cb98e69ce8dd3ab1d581baa4723e5109709ba86f35f87b72b5ede71: Status 404 returned error can't find the container with id 4493c02b9cb98e69ce8dd3ab1d581baa4723e5109709ba86f35f87b72b5ede71
Jul 29 04:14:09.956907 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:14:09.956889    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 04:14:10.011730 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:14:10.011649    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gflm5" event={"ID":"51cff2f2-45dc-4442-9c4f-0540142ff6e8","Type":"ContainerStarted","Data":"4493c02b9cb98e69ce8dd3ab1d581baa4723e5109709ba86f35f87b72b5ede71"}
Jul 29 04:14:11.017307 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:14:11.017271    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gflm5" event={"ID":"51cff2f2-45dc-4442-9c4f-0540142ff6e8","Type":"ContainerStarted","Data":"5019b79db3fee0385fa659b23b24f8ff427d75c91fb90c8de8ba60fcd530d7aa"}
Jul 29 04:14:11.033196 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:14:11.033146    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gflm5" podStartSLOduration=1.8859874730000001 podStartE2EDuration="2.033131152s" totalImagesPullingTime="147.143679ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:14:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:14:11.032861771 +0000 UTC m=+617.465899885" watchObservedRunningTime="2026-07-29 04:14:11.033131152 +0000 UTC m=+617.466169263"
Jul 29 04:14:12.874365 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:14:12.874330    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:14:19.820191 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:14:19.820080    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gflm5"
Jul 29 04:14:19.820191 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:14:19.820167    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gflm5"
Jul 29 04:14:19.832839 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:14:19.832818    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gflm5"
Jul 29 04:14:20.074432 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:14:20.074354    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gflm5"
Jul 29 04:15:26.988912 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:15:26.988876    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:15:37.681918 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:15:37.681883    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:15:48.384855 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:15:48.384778    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:17:27.587938 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:17:27.587860    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:18:41.115931 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:18:41.115897    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:18:48.594779 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:18:48.594691    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:19:03.380840 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:19:03.380798    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:19:12.383894 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:19:12.383860    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:19:21.686243 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:19:21.686206    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:19:36.781800 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:19:36.781761    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:19:43.187395 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:19:43.187349    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:19:53.087294 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:19:53.087250    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:20:14.584485 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:20:14.584400    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:20:25.684535 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:20:25.684482    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:20:48.085516 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:20:48.085464    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:21:00.675384 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:21:00.675348    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:21:14.286858 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:21:14.286818    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:21:24.179062 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:21:24.179025    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:21:39.284423 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:21:39.284387    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:21:48.083844 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:21:48.083764    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:21:59.478420 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:21:59.478380    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:22:08.581121 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:22:08.581072    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:22:17.892754 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:22:17.892717    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:22:27.075691 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:22:27.075657    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:22:38.871250 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:22:38.871213    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:22:46.585298 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:22:46.585263    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:26:10.383894 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:26:10.383862    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:26:20.381723 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:26:20.381639    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:26:32.084619 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:26:32.084581    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:26:40.484616 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:26:40.484579    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:26:50.180613 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:26:50.180577    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:27:01.083389 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:27:01.083350    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:27:10.781848 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:27:10.781811    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:27:20.179166 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:27:20.179129    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:27:33.477128 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:27:33.477089    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:27:42.581312 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:27:42.581276    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:28:02.888187 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:28:02.888110    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:28:11.582206 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:28:11.582161    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:28:19.720014 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:28:19.719974    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j"]
Jul 29 04:28:19.722404 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:28:19.722387    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j"
Jul 29 04:28:19.724705 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:28:19.724682    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-c3af2471-kserve-self-signed-certs\""
Jul 29 04:28:19.731438 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:28:19.731416    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j"]
Jul 29 04:28:19.842574 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:28:19.842534    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49baef98-f153-4500-9304-5c6302d00759-home\") pod \"e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j\" (UID: \"49baef98-f153-4500-9304-5c6302d00759\") " pod="llm/e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j"
Jul 29 04:28:19.842574 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:28:19.842570    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49baef98-f153-4500-9304-5c6302d00759-tmp-dir\") pod \"e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j\" (UID: \"49baef98-f153-4500-9304-5c6302d00759\") " pod="llm/e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j"
Jul 29 04:28:19.842808 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:28:19.842633    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49baef98-f153-4500-9304-5c6302d00759-model-cache\") pod \"e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j\" (UID: \"49baef98-f153-4500-9304-5c6302d00759\") " pod="llm/e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j"
Jul 29 04:28:19.842808 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:28:19.842701    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49baef98-f153-4500-9304-5c6302d00759-tls-certs\") pod \"e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j\" (UID: \"49baef98-f153-4500-9304-5c6302d00759\") " pod="llm/e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j"
Jul 29 04:28:19.842808 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:28:19.842731    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49baef98-f153-4500-9304-5c6302d00759-dshm\") pod \"e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j\" (UID: \"49baef98-f153-4500-9304-5c6302d00759\") " pod="llm/e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j"
Jul 29 04:28:19.842808 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:28:19.842770    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb5k7\" (UniqueName: \"kubernetes.io/projected/49baef98-f153-4500-9304-5c6302d00759-kube-api-access-bb5k7\") pod \"e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j\" (UID: \"49baef98-f153-4500-9304-5c6302d00759\") " pod="llm/e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j"
Jul 29 04:28:19.943374 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:28:19.943338    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49baef98-f153-4500-9304-5c6302d00759-model-cache\") pod \"e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j\" (UID: \"49baef98-f153-4500-9304-5c6302d00759\") " pod="llm/e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j"
Jul 29 04:28:19.943598 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:28:19.943392    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49baef98-f153-4500-9304-5c6302d00759-tls-certs\") pod \"e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j\" (UID: \"49baef98-f153-4500-9304-5c6302d00759\") " pod="llm/e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j"
Jul 29 04:28:19.943598 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:28:19.943441    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49baef98-f153-4500-9304-5c6302d00759-dshm\") pod \"e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j\" (UID: \"49baef98-f153-4500-9304-5c6302d00759\") " pod="llm/e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j"
Jul 29 04:28:19.943598 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:28:19.943524    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb5k7\" (UniqueName: \"kubernetes.io/projected/49baef98-f153-4500-9304-5c6302d00759-kube-api-access-bb5k7\") pod \"e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j\" (UID: \"49baef98-f153-4500-9304-5c6302d00759\") " pod="llm/e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j"
Jul 29 04:28:19.943598 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:28:19.943579    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49baef98-f153-4500-9304-5c6302d00759-home\") pod \"e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j\" (UID: \"49baef98-f153-4500-9304-5c6302d00759\") " pod="llm/e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j"
Jul 29 04:28:19.943598 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:28:19.943596    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49baef98-f153-4500-9304-5c6302d00759-tmp-dir\") pod \"e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j\" (UID: \"49baef98-f153-4500-9304-5c6302d00759\") " pod="llm/e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j"
Jul 29 04:28:19.943943 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:28:19.943921    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49baef98-f153-4500-9304-5c6302d00759-model-cache\") pod \"e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j\" (UID: \"49baef98-f153-4500-9304-5c6302d00759\") " pod="llm/e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j"
Jul 29 04:28:19.943997 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:28:19.943983    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49baef98-f153-4500-9304-5c6302d00759-tmp-dir\") pod \"e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j\" (UID: \"49baef98-f153-4500-9304-5c6302d00759\") " pod="llm/e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j"
Jul 29 04:28:19.944037 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:28:19.944005    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49baef98-f153-4500-9304-5c6302d00759-home\") pod \"e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j\" (UID: \"49baef98-f153-4500-9304-5c6302d00759\") " pod="llm/e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j"
Jul 29 04:28:19.945965 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:28:19.945944    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49baef98-f153-4500-9304-5c6302d00759-dshm\") pod \"e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j\" (UID: \"49baef98-f153-4500-9304-5c6302d00759\") " pod="llm/e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j"
Jul 29 04:28:19.946155 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:28:19.946138    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49baef98-f153-4500-9304-5c6302d00759-tls-certs\") pod \"e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j\" (UID: \"49baef98-f153-4500-9304-5c6302d00759\") " pod="llm/e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j"
Jul 29 04:28:19.951289 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:28:19.951266    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb5k7\" (UniqueName: \"kubernetes.io/projected/49baef98-f153-4500-9304-5c6302d00759-kube-api-access-bb5k7\") pod \"e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j\" (UID: \"49baef98-f153-4500-9304-5c6302d00759\") " pod="llm/e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j"
Jul 29 04:28:20.032589 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:28:20.032461    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j"
Jul 29 04:28:20.171445 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:28:20.171371    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j"]
Jul 29 04:28:20.174254 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:28:20.174226    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod49baef98_f153_4500_9304_5c6302d00759.slice/crio-28ab3ad94085c176a2662ca9df576adfdd091b07b65552d4c72053a9934bc85e WatchSource:0}: Error finding container 28ab3ad94085c176a2662ca9df576adfdd091b07b65552d4c72053a9934bc85e: Status 404 returned error can't find the container with id 28ab3ad94085c176a2662ca9df576adfdd091b07b65552d4c72053a9934bc85e
Jul 29 04:28:21.020285 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:28:21.020246    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j" event={"ID":"49baef98-f153-4500-9304-5c6302d00759","Type":"ContainerStarted","Data":"f8fd1e27bc25f27119a157e9ba3f53ce7889316b13c11cb2e32db4dac5a565f6"}
Jul 29 04:28:21.020285 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:28:21.020292    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j" event={"ID":"49baef98-f153-4500-9304-5c6302d00759","Type":"ContainerStarted","Data":"28ab3ad94085c176a2662ca9df576adfdd091b07b65552d4c72053a9934bc85e"}
Jul 29 04:28:21.035345 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:28:21.035289    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j" podStartSLOduration=2.035268781 podStartE2EDuration="2.035268781s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:28:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:28:21.034403307 +0000 UTC m=+1467.467441421" watchObservedRunningTime="2026-07-29 04:28:21.035268781 +0000 UTC m=+1467.468306875"
Jul 29 04:28:30.033327 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:28:30.033288    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j"
Jul 29 04:28:30.033730 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:28:30.033374    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j"
Jul 29 04:28:30.045652 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:28:30.045627    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j"
Jul 29 04:28:30.073533 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:28:30.073490    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j"
Jul 29 04:28:31.382012 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:28:31.381978    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:28:45.946753 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:28:45.946709    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j"]
Jul 29 04:28:48.676723 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:28:48.676684    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:29:00.967455 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:29:00.967391    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j" podUID="49baef98-f153-4500-9304-5c6302d00759" containerName="main" containerID="cri-o://f8fd1e27bc25f27119a157e9ba3f53ce7889316b13c11cb2e32db4dac5a565f6" gracePeriod=45
Jul 29 04:29:01.213944 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:29:01.213803    2572 generic.go:356] "Generic (PLEG): container finished" podID="49baef98-f153-4500-9304-5c6302d00759" containerID="f8fd1e27bc25f27119a157e9ba3f53ce7889316b13c11cb2e32db4dac5a565f6" exitCode=0
Jul 29 04:29:01.214092 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:29:01.213940    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j" event={"ID":"49baef98-f153-4500-9304-5c6302d00759","Type":"ContainerDied","Data":"f8fd1e27bc25f27119a157e9ba3f53ce7889316b13c11cb2e32db4dac5a565f6"}
Jul 29 04:29:01.234756 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:29:01.234687    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j"
Jul 29 04:29:01.353752 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:29:01.353718    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49baef98-f153-4500-9304-5c6302d00759-home\") pod \"49baef98-f153-4500-9304-5c6302d00759\" (UID: \"49baef98-f153-4500-9304-5c6302d00759\") "
Jul 29 04:29:01.353947 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:29:01.353766    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49baef98-f153-4500-9304-5c6302d00759-tls-certs\") pod \"49baef98-f153-4500-9304-5c6302d00759\" (UID: \"49baef98-f153-4500-9304-5c6302d00759\") "
Jul 29 04:29:01.353947 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:29:01.353809    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49baef98-f153-4500-9304-5c6302d00759-model-cache\") pod \"49baef98-f153-4500-9304-5c6302d00759\" (UID: \"49baef98-f153-4500-9304-5c6302d00759\") "
Jul 29 04:29:01.353947 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:29:01.353832    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bb5k7\" (UniqueName: \"kubernetes.io/projected/49baef98-f153-4500-9304-5c6302d00759-kube-api-access-bb5k7\") pod \"49baef98-f153-4500-9304-5c6302d00759\" (UID: \"49baef98-f153-4500-9304-5c6302d00759\") "
Jul 29 04:29:01.353947 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:29:01.353864    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49baef98-f153-4500-9304-5c6302d00759-tmp-dir\") pod \"49baef98-f153-4500-9304-5c6302d00759\" (UID: \"49baef98-f153-4500-9304-5c6302d00759\") "
Jul 29 04:29:01.354154 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:29:01.354091    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49baef98-f153-4500-9304-5c6302d00759-dshm\") pod \"49baef98-f153-4500-9304-5c6302d00759\" (UID: \"49baef98-f153-4500-9304-5c6302d00759\") "
Jul 29 04:29:01.354253 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:29:01.354059    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49baef98-f153-4500-9304-5c6302d00759-home" (OuterVolumeSpecName: "home") pod "49baef98-f153-4500-9304-5c6302d00759" (UID: "49baef98-f153-4500-9304-5c6302d00759"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:29:01.354308 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:29:01.354124    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49baef98-f153-4500-9304-5c6302d00759-model-cache" (OuterVolumeSpecName: "model-cache") pod "49baef98-f153-4500-9304-5c6302d00759" (UID: "49baef98-f153-4500-9304-5c6302d00759"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:29:01.354308 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:29:01.354143    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49baef98-f153-4500-9304-5c6302d00759-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "49baef98-f153-4500-9304-5c6302d00759" (UID: "49baef98-f153-4500-9304-5c6302d00759"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:29:01.354451 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:29:01.354433    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49baef98-f153-4500-9304-5c6302d00759-tmp-dir\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 04:29:01.354523 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:29:01.354454    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49baef98-f153-4500-9304-5c6302d00759-home\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 04:29:01.354523 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:29:01.354463    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49baef98-f153-4500-9304-5c6302d00759-model-cache\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 04:29:01.356359 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:29:01.356332    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49baef98-f153-4500-9304-5c6302d00759-dshm" (OuterVolumeSpecName: "dshm") pod "49baef98-f153-4500-9304-5c6302d00759" (UID: "49baef98-f153-4500-9304-5c6302d00759"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:29:01.356472 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:29:01.356355    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49baef98-f153-4500-9304-5c6302d00759-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "49baef98-f153-4500-9304-5c6302d00759" (UID: "49baef98-f153-4500-9304-5c6302d00759"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 04:29:01.356472 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:29:01.356397    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49baef98-f153-4500-9304-5c6302d00759-kube-api-access-bb5k7" (OuterVolumeSpecName: "kube-api-access-bb5k7") pod "49baef98-f153-4500-9304-5c6302d00759" (UID: "49baef98-f153-4500-9304-5c6302d00759"). InnerVolumeSpecName "kube-api-access-bb5k7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:29:01.455887 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:29:01.455835    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49baef98-f153-4500-9304-5c6302d00759-dshm\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 04:29:01.455887 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:29:01.455883    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49baef98-f153-4500-9304-5c6302d00759-tls-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 04:29:01.455887 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:29:01.455895    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bb5k7\" (UniqueName: \"kubernetes.io/projected/49baef98-f153-4500-9304-5c6302d00759-kube-api-access-bb5k7\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 04:29:02.219960 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:29:02.219925    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j" event={"ID":"49baef98-f153-4500-9304-5c6302d00759","Type":"ContainerDied","Data":"28ab3ad94085c176a2662ca9df576adfdd091b07b65552d4c72053a9934bc85e"}
Jul 29 04:29:02.219960 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:29:02.219953    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j"
Jul 29 04:29:02.220419 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:29:02.219972    2572 scope.go:117] "RemoveContainer" containerID="f8fd1e27bc25f27119a157e9ba3f53ce7889316b13c11cb2e32db4dac5a565f6"
Jul 29 04:29:02.235358 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:29:02.235307    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j"]
Jul 29 04:29:02.237749 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:29:02.237725    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-c3af2471-kserve-5598d9bc9-5b86j"]
Jul 29 04:29:02.687901 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:29:02.687862    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:29:04.148437 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:29:04.148406    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49baef98-f153-4500-9304-5c6302d00759" path="/var/lib/kubelet/pods/49baef98-f153-4500-9304-5c6302d00759/volumes"
Jul 29 04:29:09.288305 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:29:09.288264    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:29:20.875196 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:29:20.875158    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:29:35.587061 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:29:35.587024    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:29:55.984687 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:29:55.984649    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:30:05.379264 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:30:05.379220    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:30:15.495460 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:30:15.495422    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:30:25.109141 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:30:25.109102    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:30:35.101609 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:30:35.101569    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:30:45.192132 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:30:45.192057    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:30:56.989609 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:30:56.989579    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:31:06.795183 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:31:06.795145    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:31:19.690914 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:31:19.690876    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:31:30.978713 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:31:30.978674    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:31:39.086773 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:31:39.086726    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:31:53.182904 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:31:53.182871    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:32:04.580967 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:32:04.580930    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:32:18.674196 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:32:18.674113    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:32:33.884430 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:32:33.884391    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:32:43.384825 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:32:43.384785    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:32:52.180475 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:32:52.180435    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:33:10.783772 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:33:10.783736    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:33:21.176100 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:33:21.176066    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:33:31.588145 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:33:31.588110    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:33:39.486143 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:33:39.486107    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:34:10.433790 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:34:10.433754    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:34:20.680182 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:34:20.680146    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:34:44.480378 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:34:44.480336    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:34:54.480634 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:34:54.480595    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:35:18.482997 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:35:18.482900    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:35:27.876207 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:35:27.876167    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:35:54.278936 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:35:54.278900    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:36:15.875143 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:36:15.875107    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:37:45.677699 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:37:45.677661    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:39:48.986139 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:39:48.986054    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:39:58.086866 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:39:58.086827    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:40:40.384771 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:40:40.384732    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:41:19.280893 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:41:19.280852    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:43:12.714244 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:43:12.714210    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:43:22.793926 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:43:22.793885    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:43:57.030581 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:43:57.030544    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-994302ee/e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x"]
Jul 29 04:43:57.031174 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:43:57.031152    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49baef98-f153-4500-9304-5c6302d00759" containerName="main"
Jul 29 04:43:57.031217 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:43:57.031179    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="49baef98-f153-4500-9304-5c6302d00759" containerName="main"
Jul 29 04:43:57.031310 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:43:57.031290    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="49baef98-f153-4500-9304-5c6302d00759" containerName="main"
Jul 29 04:43:57.034724 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:43:57.034702    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-994302ee/e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x"
Jul 29 04:43:57.038031 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:43:57.038011    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-994302ee\"/\"kube-root-ca.crt\""
Jul 29 04:43:57.038138 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:43:57.038020    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-994302ee\"/\"default-dockercfg-v986b\""
Jul 29 04:43:57.038138 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:43:57.038011    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-994302ee\"/\"openshift-service-ca.crt\""
Jul 29 04:43:57.038138 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:43:57.038011    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-994302ee\"/\"e2e-lifecycle-model-994302ee-kserve-self-signed-certs\""
Jul 29 04:43:57.041807 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:43:57.041789    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-994302ee/e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x"]
Jul 29 04:43:57.107884 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:43:57.107846    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b566b8d2-50f8-4ad4-a92d-3c7031f314f9-model-cache\") pod \"e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x\" (UID: \"b566b8d2-50f8-4ad4-a92d-3c7031f314f9\") " pod="ai-tenant-e2e-mt-994302ee/e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x"
Jul 29 04:43:57.107884 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:43:57.107883    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b566b8d2-50f8-4ad4-a92d-3c7031f314f9-tls-certs\") pod \"e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x\" (UID: \"b566b8d2-50f8-4ad4-a92d-3c7031f314f9\") " pod="ai-tenant-e2e-mt-994302ee/e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x"
Jul 29 04:43:57.108082 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:43:57.107914    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b566b8d2-50f8-4ad4-a92d-3c7031f314f9-tmp-dir\") pod \"e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x\" (UID: \"b566b8d2-50f8-4ad4-a92d-3c7031f314f9\") " pod="ai-tenant-e2e-mt-994302ee/e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x"
Jul 29 04:43:57.108082 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:43:57.107950    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b566b8d2-50f8-4ad4-a92d-3c7031f314f9-dshm\") pod \"e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x\" (UID: \"b566b8d2-50f8-4ad4-a92d-3c7031f314f9\") " pod="ai-tenant-e2e-mt-994302ee/e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x"
Jul 29 04:43:57.108082 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:43:57.107982    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wd6l\" (UniqueName: \"kubernetes.io/projected/b566b8d2-50f8-4ad4-a92d-3c7031f314f9-kube-api-access-4wd6l\") pod \"e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x\" (UID: \"b566b8d2-50f8-4ad4-a92d-3c7031f314f9\") " pod="ai-tenant-e2e-mt-994302ee/e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x"
Jul 29 04:43:57.108082 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:43:57.108027    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b566b8d2-50f8-4ad4-a92d-3c7031f314f9-home\") pod \"e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x\" (UID: \"b566b8d2-50f8-4ad4-a92d-3c7031f314f9\") " pod="ai-tenant-e2e-mt-994302ee/e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x"
Jul 29 04:43:57.208605 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:43:57.208565    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b566b8d2-50f8-4ad4-a92d-3c7031f314f9-model-cache\") pod \"e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x\" (UID: \"b566b8d2-50f8-4ad4-a92d-3c7031f314f9\") " pod="ai-tenant-e2e-mt-994302ee/e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x"
Jul 29 04:43:57.208605 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:43:57.208608    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b566b8d2-50f8-4ad4-a92d-3c7031f314f9-tls-certs\") pod \"e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x\" (UID: \"b566b8d2-50f8-4ad4-a92d-3c7031f314f9\") " pod="ai-tenant-e2e-mt-994302ee/e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x"
Jul 29 04:43:57.208869 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:43:57.208654    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b566b8d2-50f8-4ad4-a92d-3c7031f314f9-tmp-dir\") pod \"e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x\" (UID: \"b566b8d2-50f8-4ad4-a92d-3c7031f314f9\") " pod="ai-tenant-e2e-mt-994302ee/e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x"
Jul 29 04:43:57.208869 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:43:57.208682    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b566b8d2-50f8-4ad4-a92d-3c7031f314f9-dshm\") pod \"e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x\" (UID: \"b566b8d2-50f8-4ad4-a92d-3c7031f314f9\") " pod="ai-tenant-e2e-mt-994302ee/e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x"
Jul 29 04:43:57.208869 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:43:57.208733    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wd6l\" (UniqueName: \"kubernetes.io/projected/b566b8d2-50f8-4ad4-a92d-3c7031f314f9-kube-api-access-4wd6l\") pod \"e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x\" (UID: \"b566b8d2-50f8-4ad4-a92d-3c7031f314f9\") " pod="ai-tenant-e2e-mt-994302ee/e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x"
Jul 29 04:43:57.208869 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:43:57.208760    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b566b8d2-50f8-4ad4-a92d-3c7031f314f9-home\") pod \"e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x\" (UID: \"b566b8d2-50f8-4ad4-a92d-3c7031f314f9\") " pod="ai-tenant-e2e-mt-994302ee/e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x"
Jul 29 04:43:57.209142 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:43:57.209019    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b566b8d2-50f8-4ad4-a92d-3c7031f314f9-model-cache\") pod \"e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x\" (UID: \"b566b8d2-50f8-4ad4-a92d-3c7031f314f9\") " pod="ai-tenant-e2e-mt-994302ee/e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x"
Jul 29 04:43:57.209142 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:43:57.209067    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b566b8d2-50f8-4ad4-a92d-3c7031f314f9-tmp-dir\") pod \"e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x\" (UID: \"b566b8d2-50f8-4ad4-a92d-3c7031f314f9\") " pod="ai-tenant-e2e-mt-994302ee/e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x"
Jul 29 04:43:57.209238 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:43:57.209220    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b566b8d2-50f8-4ad4-a92d-3c7031f314f9-home\") pod \"e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x\" (UID: \"b566b8d2-50f8-4ad4-a92d-3c7031f314f9\") " pod="ai-tenant-e2e-mt-994302ee/e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x"
Jul 29 04:43:57.211095 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:43:57.211077    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b566b8d2-50f8-4ad4-a92d-3c7031f314f9-dshm\") pod \"e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x\" (UID: \"b566b8d2-50f8-4ad4-a92d-3c7031f314f9\") " pod="ai-tenant-e2e-mt-994302ee/e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x"
Jul 29 04:43:57.211379 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:43:57.211362    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b566b8d2-50f8-4ad4-a92d-3c7031f314f9-tls-certs\") pod \"e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x\" (UID: \"b566b8d2-50f8-4ad4-a92d-3c7031f314f9\") " pod="ai-tenant-e2e-mt-994302ee/e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x"
Jul 29 04:43:57.216411 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:43:57.216387    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wd6l\" (UniqueName: \"kubernetes.io/projected/b566b8d2-50f8-4ad4-a92d-3c7031f314f9-kube-api-access-4wd6l\") pod \"e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x\" (UID: \"b566b8d2-50f8-4ad4-a92d-3c7031f314f9\") " pod="ai-tenant-e2e-mt-994302ee/e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x"
Jul 29 04:43:57.347013 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:43:57.346699    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-994302ee/e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x"
Jul 29 04:43:57.487046 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:43:57.487012    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-994302ee/e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x"]
Jul 29 04:43:57.489412 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:43:57.489383    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb566b8d2_50f8_4ad4_a92d_3c7031f314f9.slice/crio-2dadb0a12b9930ee6cc4d6b2674ed9db4b5ef8429e511ad374cff1e093297c6e WatchSource:0}: Error finding container 2dadb0a12b9930ee6cc4d6b2674ed9db4b5ef8429e511ad374cff1e093297c6e: Status 404 returned error can't find the container with id 2dadb0a12b9930ee6cc4d6b2674ed9db4b5ef8429e511ad374cff1e093297c6e
Jul 29 04:43:58.476619 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:43:58.476587    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-994302ee/e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x" event={"ID":"b566b8d2-50f8-4ad4-a92d-3c7031f314f9","Type":"ContainerStarted","Data":"5188291dc663a94ca61dd5d9ab3782bcd299925dec09e894ac44cfa87c22d11e"}
Jul 29 04:43:58.476619 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:43:58.476634    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-994302ee/e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x" event={"ID":"b566b8d2-50f8-4ad4-a92d-3c7031f314f9","Type":"ContainerStarted","Data":"2dadb0a12b9930ee6cc4d6b2674ed9db4b5ef8429e511ad374cff1e093297c6e"}
Jul 29 04:43:58.495081 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:43:58.495030    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-994302ee/e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x" podStartSLOduration=1.4950144 podStartE2EDuration="1.4950144s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:43:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:43:58.492666716 +0000 UTC m=+2404.925704826" watchObservedRunningTime="2026-07-29 04:43:58.4950144 +0000 UTC m=+2404.928052512"
Jul 29 04:44:00.177606 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:44:00.177569    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:44:07.349687 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:44:07.349645    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-994302ee/e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x"
Jul 29 04:44:07.350145 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:44:07.349702    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-994302ee/e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x"
Jul 29 04:44:07.362450 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:44:07.362419    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-994302ee/e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x"
Jul 29 04:44:07.529781 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:44:07.529754    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-994302ee/e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x"
Jul 29 04:44:12.181158 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:44:12.181120    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:44:35.876206 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:44:35.876127    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:44:43.875003 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:44:43.874965    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:44:45.517981 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:44:45.517938    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-994302ee/e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x"]
Jul 29 04:45:00.538634 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:45:00.538557    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-994302ee/e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x" podUID="b566b8d2-50f8-4ad4-a92d-3c7031f314f9" containerName="main" containerID="cri-o://5188291dc663a94ca61dd5d9ab3782bcd299925dec09e894ac44cfa87c22d11e" gracePeriod=45
Jul 29 04:45:00.772274 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:45:00.772246    2572 generic.go:356] "Generic (PLEG): container finished" podID="b566b8d2-50f8-4ad4-a92d-3c7031f314f9" containerID="5188291dc663a94ca61dd5d9ab3782bcd299925dec09e894ac44cfa87c22d11e" exitCode=0
Jul 29 04:45:00.772382 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:45:00.772325    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-994302ee/e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x" event={"ID":"b566b8d2-50f8-4ad4-a92d-3c7031f314f9","Type":"ContainerDied","Data":"5188291dc663a94ca61dd5d9ab3782bcd299925dec09e894ac44cfa87c22d11e"}
Jul 29 04:45:00.789565 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:45:00.789481    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-994302ee/e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x"
Jul 29 04:45:00.909610 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:45:00.909572    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b566b8d2-50f8-4ad4-a92d-3c7031f314f9-home\") pod \"b566b8d2-50f8-4ad4-a92d-3c7031f314f9\" (UID: \"b566b8d2-50f8-4ad4-a92d-3c7031f314f9\") "
Jul 29 04:45:00.909785 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:45:00.909632    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b566b8d2-50f8-4ad4-a92d-3c7031f314f9-tls-certs\") pod \"b566b8d2-50f8-4ad4-a92d-3c7031f314f9\" (UID: \"b566b8d2-50f8-4ad4-a92d-3c7031f314f9\") "
Jul 29 04:45:00.909785 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:45:00.909662    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wd6l\" (UniqueName: \"kubernetes.io/projected/b566b8d2-50f8-4ad4-a92d-3c7031f314f9-kube-api-access-4wd6l\") pod \"b566b8d2-50f8-4ad4-a92d-3c7031f314f9\" (UID: \"b566b8d2-50f8-4ad4-a92d-3c7031f314f9\") "
Jul 29 04:45:00.909785 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:45:00.909716    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b566b8d2-50f8-4ad4-a92d-3c7031f314f9-dshm\") pod \"b566b8d2-50f8-4ad4-a92d-3c7031f314f9\" (UID: \"b566b8d2-50f8-4ad4-a92d-3c7031f314f9\") "
Jul 29 04:45:00.909785 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:45:00.909745    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b566b8d2-50f8-4ad4-a92d-3c7031f314f9-model-cache\") pod \"b566b8d2-50f8-4ad4-a92d-3c7031f314f9\" (UID: \"b566b8d2-50f8-4ad4-a92d-3c7031f314f9\") "
Jul 29 04:45:00.909996 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:45:00.909794    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b566b8d2-50f8-4ad4-a92d-3c7031f314f9-tmp-dir\") pod \"b566b8d2-50f8-4ad4-a92d-3c7031f314f9\" (UID: \"b566b8d2-50f8-4ad4-a92d-3c7031f314f9\") "
Jul 29 04:45:00.909996 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:45:00.909953    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b566b8d2-50f8-4ad4-a92d-3c7031f314f9-home" (OuterVolumeSpecName: "home") pod "b566b8d2-50f8-4ad4-a92d-3c7031f314f9" (UID: "b566b8d2-50f8-4ad4-a92d-3c7031f314f9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:45:00.910108 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:45:00.910045    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b566b8d2-50f8-4ad4-a92d-3c7031f314f9-model-cache" (OuterVolumeSpecName: "model-cache") pod "b566b8d2-50f8-4ad4-a92d-3c7031f314f9" (UID: "b566b8d2-50f8-4ad4-a92d-3c7031f314f9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:45:00.910167 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:45:00.910126    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b566b8d2-50f8-4ad4-a92d-3c7031f314f9-home\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 04:45:00.910167 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:45:00.910125    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b566b8d2-50f8-4ad4-a92d-3c7031f314f9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b566b8d2-50f8-4ad4-a92d-3c7031f314f9" (UID: "b566b8d2-50f8-4ad4-a92d-3c7031f314f9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:45:00.912130 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:45:00.912107    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b566b8d2-50f8-4ad4-a92d-3c7031f314f9-dshm" (OuterVolumeSpecName: "dshm") pod "b566b8d2-50f8-4ad4-a92d-3c7031f314f9" (UID: "b566b8d2-50f8-4ad4-a92d-3c7031f314f9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:45:00.912130 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:45:00.912107    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b566b8d2-50f8-4ad4-a92d-3c7031f314f9-kube-api-access-4wd6l" (OuterVolumeSpecName: "kube-api-access-4wd6l") pod "b566b8d2-50f8-4ad4-a92d-3c7031f314f9" (UID: "b566b8d2-50f8-4ad4-a92d-3c7031f314f9"). InnerVolumeSpecName "kube-api-access-4wd6l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:45:00.912261 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:45:00.912196    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b566b8d2-50f8-4ad4-a92d-3c7031f314f9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b566b8d2-50f8-4ad4-a92d-3c7031f314f9" (UID: "b566b8d2-50f8-4ad4-a92d-3c7031f314f9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 04:45:01.010685 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:45:01.010644    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b566b8d2-50f8-4ad4-a92d-3c7031f314f9-dshm\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 04:45:01.010685 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:45:01.010676    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b566b8d2-50f8-4ad4-a92d-3c7031f314f9-model-cache\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 04:45:01.010685 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:45:01.010688    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b566b8d2-50f8-4ad4-a92d-3c7031f314f9-tmp-dir\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 04:45:01.010685 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:45:01.010698    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b566b8d2-50f8-4ad4-a92d-3c7031f314f9-tls-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 04:45:01.010964 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:45:01.010707    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wd6l\" (UniqueName: \"kubernetes.io/projected/b566b8d2-50f8-4ad4-a92d-3c7031f314f9-kube-api-access-4wd6l\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 04:45:01.778355 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:45:01.778319    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-994302ee/e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x" event={"ID":"b566b8d2-50f8-4ad4-a92d-3c7031f314f9","Type":"ContainerDied","Data":"2dadb0a12b9930ee6cc4d6b2674ed9db4b5ef8429e511ad374cff1e093297c6e"}
Jul 29 04:45:01.778355 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:45:01.778347    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-994302ee/e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x"
Jul 29 04:45:01.778968 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:45:01.778378    2572 scope.go:117] "RemoveContainer" containerID="5188291dc663a94ca61dd5d9ab3782bcd299925dec09e894ac44cfa87c22d11e"
Jul 29 04:45:01.798610 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:45:01.798581    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-994302ee/e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x"]
Jul 29 04:45:01.801603 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:45:01.801580    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-994302ee/e2e-lifecycle-model-994302ee-kserve-8457ddc7b7-fkv7x"]
Jul 29 04:45:02.148668 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:45:02.148624    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b566b8d2-50f8-4ad4-a92d-3c7031f314f9" path="/var/lib/kubelet/pods/b566b8d2-50f8-4ad4-a92d-3c7031f314f9/volumes"
Jul 29 04:45:30.988891 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:45:30.988849    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:45:41.786013 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:45:41.785976    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:45:54.185077 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:45:54.184981    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:46:03.976780 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:46:03.976741    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:47:03.181393 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:47:03.181357    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:47:29.775987 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:47:29.775895    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:48:04.826347 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:48:04.826309    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-e021d8/test-model-e021d8-kserve-5bf69d76df-xbstc"]
Jul 29 04:48:04.826836 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:48:04.826793    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b566b8d2-50f8-4ad4-a92d-3c7031f314f9" containerName="main"
Jul 29 04:48:04.826836 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:48:04.826810    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b566b8d2-50f8-4ad4-a92d-3c7031f314f9" containerName="main"
Jul 29 04:48:04.826907 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:48:04.826879    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b566b8d2-50f8-4ad4-a92d-3c7031f314f9" containerName="main"
Jul 29 04:48:04.829744 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:48:04.829724    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e021d8/test-model-e021d8-kserve-5bf69d76df-xbstc"
Jul 29 04:48:04.833074 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:48:04.833048    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-e021d8\"/\"test-model-e021d8-kserve-self-signed-certs\""
Jul 29 04:48:04.833220 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:48:04.833087    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-e021d8\"/\"default-dockercfg-6j455\""
Jul 29 04:48:04.833220 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:48:04.833048    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-e021d8\"/\"openshift-service-ca.crt\""
Jul 29 04:48:04.833220 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:48:04.833140    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-e021d8\"/\"kube-root-ca.crt\""
Jul 29 04:48:04.838435 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:48:04.838411    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-e021d8/test-model-e021d8-kserve-5bf69d76df-xbstc"]
Jul 29 04:48:04.924765 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:48:04.924728    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f873c98-af7d-48dc-ae9a-6f994bf05654-home\") pod \"test-model-e021d8-kserve-5bf69d76df-xbstc\" (UID: \"6f873c98-af7d-48dc-ae9a-6f994bf05654\") " pod="ai-tenant-e2e-inf-a-e021d8/test-model-e021d8-kserve-5bf69d76df-xbstc"
Jul 29 04:48:04.924958 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:48:04.924773    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f873c98-af7d-48dc-ae9a-6f994bf05654-dshm\") pod \"test-model-e021d8-kserve-5bf69d76df-xbstc\" (UID: \"6f873c98-af7d-48dc-ae9a-6f994bf05654\") " pod="ai-tenant-e2e-inf-a-e021d8/test-model-e021d8-kserve-5bf69d76df-xbstc"
Jul 29 04:48:04.924958 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:48:04.924803    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f873c98-af7d-48dc-ae9a-6f994bf05654-tls-certs\") pod \"test-model-e021d8-kserve-5bf69d76df-xbstc\" (UID: \"6f873c98-af7d-48dc-ae9a-6f994bf05654\") " pod="ai-tenant-e2e-inf-a-e021d8/test-model-e021d8-kserve-5bf69d76df-xbstc"
Jul 29 04:48:04.924958 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:48:04.924943    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f873c98-af7d-48dc-ae9a-6f994bf05654-model-cache\") pod \"test-model-e021d8-kserve-5bf69d76df-xbstc\" (UID: \"6f873c98-af7d-48dc-ae9a-6f994bf05654\") " pod="ai-tenant-e2e-inf-a-e021d8/test-model-e021d8-kserve-5bf69d76df-xbstc"
Jul 29 04:48:04.925097 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:48:04.924970    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f873c98-af7d-48dc-ae9a-6f994bf05654-tmp-dir\") pod \"test-model-e021d8-kserve-5bf69d76df-xbstc\" (UID: \"6f873c98-af7d-48dc-ae9a-6f994bf05654\") " pod="ai-tenant-e2e-inf-a-e021d8/test-model-e021d8-kserve-5bf69d76df-xbstc"
Jul 29 04:48:04.925097 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:48:04.924988    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr2fn\" (UniqueName: \"kubernetes.io/projected/6f873c98-af7d-48dc-ae9a-6f994bf05654-kube-api-access-gr2fn\") pod \"test-model-e021d8-kserve-5bf69d76df-xbstc\" (UID: \"6f873c98-af7d-48dc-ae9a-6f994bf05654\") " pod="ai-tenant-e2e-inf-a-e021d8/test-model-e021d8-kserve-5bf69d76df-xbstc"
Jul 29 04:48:05.026491 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:48:05.026455    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f873c98-af7d-48dc-ae9a-6f994bf05654-home\") pod \"test-model-e021d8-kserve-5bf69d76df-xbstc\" (UID: \"6f873c98-af7d-48dc-ae9a-6f994bf05654\") " pod="ai-tenant-e2e-inf-a-e021d8/test-model-e021d8-kserve-5bf69d76df-xbstc"
Jul 29 04:48:05.026491 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:48:05.026515    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f873c98-af7d-48dc-ae9a-6f994bf05654-dshm\") pod \"test-model-e021d8-kserve-5bf69d76df-xbstc\" (UID: \"6f873c98-af7d-48dc-ae9a-6f994bf05654\") " pod="ai-tenant-e2e-inf-a-e021d8/test-model-e021d8-kserve-5bf69d76df-xbstc"
Jul 29 04:48:05.026491 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:48:05.026542    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f873c98-af7d-48dc-ae9a-6f994bf05654-tls-certs\") pod \"test-model-e021d8-kserve-5bf69d76df-xbstc\" (UID: \"6f873c98-af7d-48dc-ae9a-6f994bf05654\") " pod="ai-tenant-e2e-inf-a-e021d8/test-model-e021d8-kserve-5bf69d76df-xbstc"
Jul 29 04:48:05.026815 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:48:05.026595    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f873c98-af7d-48dc-ae9a-6f994bf05654-model-cache\") pod \"test-model-e021d8-kserve-5bf69d76df-xbstc\" (UID: \"6f873c98-af7d-48dc-ae9a-6f994bf05654\") " pod="ai-tenant-e2e-inf-a-e021d8/test-model-e021d8-kserve-5bf69d76df-xbstc"
Jul 29 04:48:05.026815 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:48:05.026611    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f873c98-af7d-48dc-ae9a-6f994bf05654-tmp-dir\") pod \"test-model-e021d8-kserve-5bf69d76df-xbstc\" (UID: \"6f873c98-af7d-48dc-ae9a-6f994bf05654\") " pod="ai-tenant-e2e-inf-a-e021d8/test-model-e021d8-kserve-5bf69d76df-xbstc"
Jul 29 04:48:05.026815 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:48:05.026626    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr2fn\" (UniqueName: \"kubernetes.io/projected/6f873c98-af7d-48dc-ae9a-6f994bf05654-kube-api-access-gr2fn\") pod \"test-model-e021d8-kserve-5bf69d76df-xbstc\" (UID: \"6f873c98-af7d-48dc-ae9a-6f994bf05654\") " pod="ai-tenant-e2e-inf-a-e021d8/test-model-e021d8-kserve-5bf69d76df-xbstc"
Jul 29 04:48:05.026971 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:48:05.026923    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f873c98-af7d-48dc-ae9a-6f994bf05654-home\") pod \"test-model-e021d8-kserve-5bf69d76df-xbstc\" (UID: \"6f873c98-af7d-48dc-ae9a-6f994bf05654\") " pod="ai-tenant-e2e-inf-a-e021d8/test-model-e021d8-kserve-5bf69d76df-xbstc"
Jul 29 04:48:05.027031 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:48:05.026966    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f873c98-af7d-48dc-ae9a-6f994bf05654-model-cache\") pod \"test-model-e021d8-kserve-5bf69d76df-xbstc\" (UID: \"6f873c98-af7d-48dc-ae9a-6f994bf05654\") " pod="ai-tenant-e2e-inf-a-e021d8/test-model-e021d8-kserve-5bf69d76df-xbstc"
Jul 29 04:48:05.027089 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:48:05.027042    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f873c98-af7d-48dc-ae9a-6f994bf05654-tmp-dir\") pod \"test-model-e021d8-kserve-5bf69d76df-xbstc\" (UID: \"6f873c98-af7d-48dc-ae9a-6f994bf05654\") " pod="ai-tenant-e2e-inf-a-e021d8/test-model-e021d8-kserve-5bf69d76df-xbstc"
Jul 29 04:48:05.028945 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:48:05.028919    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f873c98-af7d-48dc-ae9a-6f994bf05654-dshm\") pod \"test-model-e021d8-kserve-5bf69d76df-xbstc\" (UID: \"6f873c98-af7d-48dc-ae9a-6f994bf05654\") " pod="ai-tenant-e2e-inf-a-e021d8/test-model-e021d8-kserve-5bf69d76df-xbstc"
Jul 29 04:48:05.029190 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:48:05.029173    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f873c98-af7d-48dc-ae9a-6f994bf05654-tls-certs\") pod \"test-model-e021d8-kserve-5bf69d76df-xbstc\" (UID: \"6f873c98-af7d-48dc-ae9a-6f994bf05654\") " pod="ai-tenant-e2e-inf-a-e021d8/test-model-e021d8-kserve-5bf69d76df-xbstc"
Jul 29 04:48:05.035301 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:48:05.035275    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr2fn\" (UniqueName: \"kubernetes.io/projected/6f873c98-af7d-48dc-ae9a-6f994bf05654-kube-api-access-gr2fn\") pod \"test-model-e021d8-kserve-5bf69d76df-xbstc\" (UID: \"6f873c98-af7d-48dc-ae9a-6f994bf05654\") " pod="ai-tenant-e2e-inf-a-e021d8/test-model-e021d8-kserve-5bf69d76df-xbstc"
Jul 29 04:48:05.140659 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:48:05.140610    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e021d8/test-model-e021d8-kserve-5bf69d76df-xbstc"
Jul 29 04:48:05.272553 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:48:05.272528    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-e021d8/test-model-e021d8-kserve-5bf69d76df-xbstc"]
Jul 29 04:48:05.274700 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:48:05.274669    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f873c98_af7d_48dc_ae9a_6f994bf05654.slice/crio-220349638ae422a75709b54a56b1561eeaef584065bf5e231746397db5c6f19f WatchSource:0}: Error finding container 220349638ae422a75709b54a56b1561eeaef584065bf5e231746397db5c6f19f: Status 404 returned error can't find the container with id 220349638ae422a75709b54a56b1561eeaef584065bf5e231746397db5c6f19f
Jul 29 04:48:05.645677 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:48:05.645641    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e021d8/test-model-e021d8-kserve-5bf69d76df-xbstc" event={"ID":"6f873c98-af7d-48dc-ae9a-6f994bf05654","Type":"ContainerStarted","Data":"429f557bc22114808fc0ee99de97604d44f5a374f206b0f556af7bf472ce4b51"}
Jul 29 04:48:05.645859 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:48:05.645686    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e021d8/test-model-e021d8-kserve-5bf69d76df-xbstc" event={"ID":"6f873c98-af7d-48dc-ae9a-6f994bf05654","Type":"ContainerStarted","Data":"220349638ae422a75709b54a56b1561eeaef584065bf5e231746397db5c6f19f"}
Jul 29 04:48:05.662824 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:48:05.662773    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-e021d8/test-model-e021d8-kserve-5bf69d76df-xbstc" podStartSLOduration=1.662757426 podStartE2EDuration="1.662757426s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:48:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:48:05.660924671 +0000 UTC m=+2652.093962786" watchObservedRunningTime="2026-07-29 04:48:05.662757426 +0000 UTC m=+2652.095795538"
Jul 29 04:48:07.585228 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:48:07.585194    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:48:15.141236 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:48:15.141176    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-e021d8/test-model-e021d8-kserve-5bf69d76df-xbstc"
Jul 29 04:48:15.141776 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:48:15.141267    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-e021d8/test-model-e021d8-kserve-5bf69d76df-xbstc"
Jul 29 04:48:15.153836 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:48:15.153810    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-e021d8/test-model-e021d8-kserve-5bf69d76df-xbstc"
Jul 29 04:48:15.704029 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:48:15.704001    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-e021d8/test-model-e021d8-kserve-5bf69d76df-xbstc"
Jul 29 04:48:37.182258 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:48:37.182218    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:48:50.881257 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:48:50.881173    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:49:14.246909 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:49:14.246863    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-e021d8/test-model-e021d8-kserve-5bf69d76df-xbstc"]
Jul 29 04:49:19.783250 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:49:19.783200    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:49:29.268280 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:49:29.268237    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-e021d8/test-model-e021d8-kserve-5bf69d76df-xbstc" podUID="6f873c98-af7d-48dc-ae9a-6f994bf05654" containerName="main" containerID="cri-o://429f557bc22114808fc0ee99de97604d44f5a374f206b0f556af7bf472ce4b51" gracePeriod=45
Jul 29 04:49:29.528433 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:49:29.528378    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e021d8/test-model-e021d8-kserve-5bf69d76df-xbstc"
Jul 29 04:49:29.645322 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:49:29.645286    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gr2fn\" (UniqueName: \"kubernetes.io/projected/6f873c98-af7d-48dc-ae9a-6f994bf05654-kube-api-access-gr2fn\") pod \"6f873c98-af7d-48dc-ae9a-6f994bf05654\" (UID: \"6f873c98-af7d-48dc-ae9a-6f994bf05654\") "
Jul 29 04:49:29.645552 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:49:29.645334    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f873c98-af7d-48dc-ae9a-6f994bf05654-dshm\") pod \"6f873c98-af7d-48dc-ae9a-6f994bf05654\" (UID: \"6f873c98-af7d-48dc-ae9a-6f994bf05654\") "
Jul 29 04:49:29.645552 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:49:29.645367    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f873c98-af7d-48dc-ae9a-6f994bf05654-tls-certs\") pod \"6f873c98-af7d-48dc-ae9a-6f994bf05654\" (UID: \"6f873c98-af7d-48dc-ae9a-6f994bf05654\") "
Jul 29 04:49:29.645552 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:49:29.645435    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f873c98-af7d-48dc-ae9a-6f994bf05654-home\") pod \"6f873c98-af7d-48dc-ae9a-6f994bf05654\" (UID: \"6f873c98-af7d-48dc-ae9a-6f994bf05654\") "
Jul 29 04:49:29.645552 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:49:29.645463    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f873c98-af7d-48dc-ae9a-6f994bf05654-model-cache\") pod \"6f873c98-af7d-48dc-ae9a-6f994bf05654\" (UID: \"6f873c98-af7d-48dc-ae9a-6f994bf05654\") "
Jul 29 04:49:29.645744 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:49:29.645729    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f873c98-af7d-48dc-ae9a-6f994bf05654-model-cache" (OuterVolumeSpecName: "model-cache") pod "6f873c98-af7d-48dc-ae9a-6f994bf05654" (UID: "6f873c98-af7d-48dc-ae9a-6f994bf05654"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:49:29.645791 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:49:29.645749    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f873c98-af7d-48dc-ae9a-6f994bf05654-home" (OuterVolumeSpecName: "home") pod "6f873c98-af7d-48dc-ae9a-6f994bf05654" (UID: "6f873c98-af7d-48dc-ae9a-6f994bf05654"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:49:29.645907 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:49:29.645890    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f873c98-af7d-48dc-ae9a-6f994bf05654-tmp-dir\") pod \"6f873c98-af7d-48dc-ae9a-6f994bf05654\" (UID: \"6f873c98-af7d-48dc-ae9a-6f994bf05654\") "
Jul 29 04:49:29.646147 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:49:29.646125    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f873c98-af7d-48dc-ae9a-6f994bf05654-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6f873c98-af7d-48dc-ae9a-6f994bf05654" (UID: "6f873c98-af7d-48dc-ae9a-6f994bf05654"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:49:29.646310 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:49:29.646286    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f873c98-af7d-48dc-ae9a-6f994bf05654-home\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 04:49:29.646363 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:49:29.646314    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f873c98-af7d-48dc-ae9a-6f994bf05654-model-cache\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 04:49:29.646363 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:49:29.646325    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f873c98-af7d-48dc-ae9a-6f994bf05654-tmp-dir\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 04:49:29.647985 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:49:29.647952    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f873c98-af7d-48dc-ae9a-6f994bf05654-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6f873c98-af7d-48dc-ae9a-6f994bf05654" (UID: "6f873c98-af7d-48dc-ae9a-6f994bf05654"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 04:49:29.648279 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:49:29.648251    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f873c98-af7d-48dc-ae9a-6f994bf05654-kube-api-access-gr2fn" (OuterVolumeSpecName: "kube-api-access-gr2fn") pod "6f873c98-af7d-48dc-ae9a-6f994bf05654" (UID: "6f873c98-af7d-48dc-ae9a-6f994bf05654"). InnerVolumeSpecName "kube-api-access-gr2fn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:49:29.648373 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:49:29.648274    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f873c98-af7d-48dc-ae9a-6f994bf05654-dshm" (OuterVolumeSpecName: "dshm") pod "6f873c98-af7d-48dc-ae9a-6f994bf05654" (UID: "6f873c98-af7d-48dc-ae9a-6f994bf05654"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:49:29.746858 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:49:29.746823    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gr2fn\" (UniqueName: \"kubernetes.io/projected/6f873c98-af7d-48dc-ae9a-6f994bf05654-kube-api-access-gr2fn\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 04:49:29.746858 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:49:29.746851    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f873c98-af7d-48dc-ae9a-6f994bf05654-dshm\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 04:49:29.746858 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:49:29.746861    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f873c98-af7d-48dc-ae9a-6f994bf05654-tls-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 04:49:30.041943 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:49:30.041907    2572 generic.go:356] "Generic (PLEG): container finished" podID="6f873c98-af7d-48dc-ae9a-6f994bf05654" containerID="429f557bc22114808fc0ee99de97604d44f5a374f206b0f556af7bf472ce4b51" exitCode=0
Jul 29 04:49:30.042129 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:49:30.041969    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e021d8/test-model-e021d8-kserve-5bf69d76df-xbstc" event={"ID":"6f873c98-af7d-48dc-ae9a-6f994bf05654","Type":"ContainerDied","Data":"429f557bc22114808fc0ee99de97604d44f5a374f206b0f556af7bf472ce4b51"}
Jul 29 04:49:30.042129 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:49:30.042005    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e021d8/test-model-e021d8-kserve-5bf69d76df-xbstc"
Jul 29 04:49:30.042129 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:49:30.042013    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e021d8/test-model-e021d8-kserve-5bf69d76df-xbstc" event={"ID":"6f873c98-af7d-48dc-ae9a-6f994bf05654","Type":"ContainerDied","Data":"220349638ae422a75709b54a56b1561eeaef584065bf5e231746397db5c6f19f"}
Jul 29 04:49:30.042129 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:49:30.042037    2572 scope.go:117] "RemoveContainer" containerID="429f557bc22114808fc0ee99de97604d44f5a374f206b0f556af7bf472ce4b51"
Jul 29 04:49:30.051406 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:49:30.051388    2572 scope.go:117] "RemoveContainer" containerID="429f557bc22114808fc0ee99de97604d44f5a374f206b0f556af7bf472ce4b51"
Jul 29 04:49:30.051669 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:49:30.051648    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"429f557bc22114808fc0ee99de97604d44f5a374f206b0f556af7bf472ce4b51\": container with ID starting with 429f557bc22114808fc0ee99de97604d44f5a374f206b0f556af7bf472ce4b51 not found: ID does not exist" containerID="429f557bc22114808fc0ee99de97604d44f5a374f206b0f556af7bf472ce4b51"
Jul 29 04:49:30.051732 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:49:30.051678    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"429f557bc22114808fc0ee99de97604d44f5a374f206b0f556af7bf472ce4b51"} err="failed to get container status \"429f557bc22114808fc0ee99de97604d44f5a374f206b0f556af7bf472ce4b51\": rpc error: code = NotFound desc = could not find container \"429f557bc22114808fc0ee99de97604d44f5a374f206b0f556af7bf472ce4b51\": container with ID starting with 429f557bc22114808fc0ee99de97604d44f5a374f206b0f556af7bf472ce4b51 not found: ID does not exist"
Jul 29 04:49:30.062356 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:49:30.062329    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-e021d8/test-model-e021d8-kserve-5bf69d76df-xbstc"]
Jul 29 04:49:30.066341 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:49:30.066313    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-e021d8/test-model-e021d8-kserve-5bf69d76df-xbstc"]
Jul 29 04:49:30.148330 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:49:30.148296    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f873c98-af7d-48dc-ae9a-6f994bf05654" path="/var/lib/kubelet/pods/6f873c98-af7d-48dc-ae9a-6f994bf05654/volumes"
Jul 29 04:49:34.781522 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:49:34.781466    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:49:46.278666 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:49:46.278617    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:49:58.580907 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:49:58.580869    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:50:30.283487 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:50:30.283402    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:50:49.532838 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:50:49.532805    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-09567c-plbv9"]
Jul 29 04:50:49.533245 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:50:49.533196    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f873c98-af7d-48dc-ae9a-6f994bf05654" containerName="main"
Jul 29 04:50:49.533245 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:50:49.533207    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f873c98-af7d-48dc-ae9a-6f994bf05654" containerName="main"
Jul 29 04:50:49.533318 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:50:49.533259    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f873c98-af7d-48dc-ae9a-6f994bf05654" containerName="main"
Jul 29 04:50:49.536541 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:50:49.536524    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-09567c-plbv9"
Jul 29 04:50:49.539051 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:50:49.539029    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mxv5w\""
Jul 29 04:50:49.539197 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:50:49.539073    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 04:50:49.544612 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:50:49.544582    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-09567c-plbv9"]
Jul 29 04:50:49.674514 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:50:49.674470    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbe829c4-5631-4d50-a5c7-04eeee604f9b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-09567c-plbv9\" (UID: \"cbe829c4-5631-4d50-a5c7-04eeee604f9b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-09567c-plbv9"
Jul 29 04:50:49.775536 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:50:49.775481    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbe829c4-5631-4d50-a5c7-04eeee604f9b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-09567c-plbv9\" (UID: \"cbe829c4-5631-4d50-a5c7-04eeee604f9b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-09567c-plbv9"
Jul 29 04:50:49.776132 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:50:49.776111    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbe829c4-5631-4d50-a5c7-04eeee604f9b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-09567c-plbv9\" (UID: \"cbe829c4-5631-4d50-a5c7-04eeee604f9b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-09567c-plbv9"
Jul 29 04:50:49.848414 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:50:49.848378    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-09567c-plbv9"
Jul 29 04:50:49.984628 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:50:49.984603    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-09567c-plbv9"]
Jul 29 04:50:49.986706 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:50:49.986677    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbe829c4_5631_4d50_a5c7_04eeee604f9b.slice/crio-6610fe6488a988b243ec26847030484a0ef59ccb1c4e39b3c82bd8ddf6e1f8c6 WatchSource:0}: Error finding container 6610fe6488a988b243ec26847030484a0ef59ccb1c4e39b3c82bd8ddf6e1f8c6: Status 404 returned error can't find the container with id 6610fe6488a988b243ec26847030484a0ef59ccb1c4e39b3c82bd8ddf6e1f8c6
Jul 29 04:50:49.988636 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:50:49.988618    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 04:50:50.436121 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:50:50.436083    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-09567c-plbv9" event={"ID":"cbe829c4-5631-4d50-a5c7-04eeee604f9b","Type":"ContainerStarted","Data":"6610fe6488a988b243ec26847030484a0ef59ccb1c4e39b3c82bd8ddf6e1f8c6"}
Jul 29 04:50:52.449817 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:50:52.449713    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-09567c-plbv9" event={"ID":"cbe829c4-5631-4d50-a5c7-04eeee604f9b","Type":"ContainerStarted","Data":"77c71ecd6555d07923b144d67aeccf3887b3fd6f010e20695a1b95ea29e27830"}
Jul 29 04:50:52.485237 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:50:52.482432    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-09567c-plbv9" podStartSLOduration=1.305061581 podStartE2EDuration="3.482409172s" totalImagesPullingTime="2.177347591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:50:52.480061827 +0000 UTC m=+2818.913099940" watchObservedRunningTime="2026-07-29 04:50:52.482409172 +0000 UTC m=+2818.915447286"
Jul 29 04:50:53.456565 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:50:53.456519    2572 generic.go:356] "Generic (PLEG): container finished" podID="cbe829c4-5631-4d50-a5c7-04eeee604f9b" containerID="77c71ecd6555d07923b144d67aeccf3887b3fd6f010e20695a1b95ea29e27830" exitCode=0
Jul 29 04:50:53.456962 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:50:53.456590    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-09567c-plbv9" event={"ID":"cbe829c4-5631-4d50-a5c7-04eeee604f9b","Type":"ContainerDied","Data":"77c71ecd6555d07923b144d67aeccf3887b3fd6f010e20695a1b95ea29e27830"}
Jul 29 04:50:54.593619 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:50:54.593591    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-09567c-plbv9"
Jul 29 04:50:54.723172 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:50:54.723067    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbe829c4-5631-4d50-a5c7-04eeee604f9b-maas-api-service-ca\") pod \"cbe829c4-5631-4d50-a5c7-04eeee604f9b\" (UID: \"cbe829c4-5631-4d50-a5c7-04eeee604f9b\") "
Jul 29 04:50:54.723519 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:50:54.723468    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbe829c4-5631-4d50-a5c7-04eeee604f9b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cbe829c4-5631-4d50-a5c7-04eeee604f9b" (UID: "cbe829c4-5631-4d50-a5c7-04eeee604f9b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:50:54.824622 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:50:54.824586    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbe829c4-5631-4d50-a5c7-04eeee604f9b-maas-api-service-ca\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 04:50:55.466360 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:50:55.466332    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-09567c-plbv9"
Jul 29 04:50:55.466569 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:50:55.466368    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-09567c-plbv9" event={"ID":"cbe829c4-5631-4d50-a5c7-04eeee604f9b","Type":"ContainerDied","Data":"6610fe6488a988b243ec26847030484a0ef59ccb1c4e39b3c82bd8ddf6e1f8c6"}
Jul 29 04:50:55.466569 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:50:55.466417    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6610fe6488a988b243ec26847030484a0ef59ccb1c4e39b3c82bd8ddf6e1f8c6"
Jul 29 04:51:05.081483 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:51:05.081442    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-09567c-plbv9"]
Jul 29 04:51:05.086412 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:51:05.086379    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-09567c-plbv9"]
Jul 29 04:51:06.147870 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:51:06.147839    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbe829c4-5631-4d50-a5c7-04eeee604f9b" path="/var/lib/kubelet/pods/cbe829c4-5631-4d50-a5c7-04eeee604f9b/volumes"
Jul 29 04:51:07.381635 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:51:07.381597    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:51:11.743710 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:51:11.743675    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c3ff84-bjztv"]
Jul 29 04:51:11.744137 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:51:11.744120    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbe829c4-5631-4d50-a5c7-04eeee604f9b" containerName="revoke-keys"
Jul 29 04:51:11.744181 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:51:11.744144    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbe829c4-5631-4d50-a5c7-04eeee604f9b" containerName="revoke-keys"
Jul 29 04:51:11.744247 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:51:11.744236    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbe829c4-5631-4d50-a5c7-04eeee604f9b" containerName="revoke-keys"
Jul 29 04:51:11.747413 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:51:11.747397    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c3ff84-bjztv"
Jul 29 04:51:11.749700 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:51:11.749680    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mxv5w\""
Jul 29 04:51:11.749815 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:51:11.749751    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 04:51:11.757045 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:51:11.755465    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c3ff84-bjztv"]
Jul 29 04:51:11.776701 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:51:11.776667    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1a2aa0a-5f62-456d-b0f1-fb7184e6c4f1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-c3ff84-bjztv\" (UID: \"a1a2aa0a-5f62-456d-b0f1-fb7184e6c4f1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c3ff84-bjztv"
Jul 29 04:51:11.878201 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:51:11.878154    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1a2aa0a-5f62-456d-b0f1-fb7184e6c4f1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-c3ff84-bjztv\" (UID: \"a1a2aa0a-5f62-456d-b0f1-fb7184e6c4f1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c3ff84-bjztv"
Jul 29 04:51:11.878814 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:51:11.878790    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1a2aa0a-5f62-456d-b0f1-fb7184e6c4f1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-c3ff84-bjztv\" (UID: \"a1a2aa0a-5f62-456d-b0f1-fb7184e6c4f1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c3ff84-bjztv"
Jul 29 04:51:12.068257 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:51:12.068166    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c3ff84-bjztv"
Jul 29 04:51:12.207538 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:51:12.207484    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c3ff84-bjztv"]
Jul 29 04:51:12.211048 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:51:12.211015    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1a2aa0a_5f62_456d_b0f1_fb7184e6c4f1.slice/crio-e695ab93e73bc8bd29b855b200ba7470d0c8652df24bd604303dedfb7905c351 WatchSource:0}: Error finding container e695ab93e73bc8bd29b855b200ba7470d0c8652df24bd604303dedfb7905c351: Status 404 returned error can't find the container with id e695ab93e73bc8bd29b855b200ba7470d0c8652df24bd604303dedfb7905c351
Jul 29 04:51:12.546048 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:51:12.546014    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c3ff84-bjztv" event={"ID":"a1a2aa0a-5f62-456d-b0f1-fb7184e6c4f1","Type":"ContainerStarted","Data":"c4eddf38f943ab9a0b48034304d00d83a56e49a20665c576320c6d3f181addc2"}
Jul 29 04:51:12.546224 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:51:12.546070    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c3ff84-bjztv" event={"ID":"a1a2aa0a-5f62-456d-b0f1-fb7184e6c4f1","Type":"ContainerStarted","Data":"e695ab93e73bc8bd29b855b200ba7470d0c8652df24bd604303dedfb7905c351"}
Jul 29 04:51:12.559955 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:51:12.559904    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c3ff84-bjztv" podStartSLOduration=1.5598888629999998 podStartE2EDuration="1.559888863s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:51:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:51:12.558761987 +0000 UTC m=+2838.991800100" watchObservedRunningTime="2026-07-29 04:51:12.559888863 +0000 UTC m=+2838.992926973"
Jul 29 04:51:13.552247 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:51:13.552197    2572 generic.go:356] "Generic (PLEG): container finished" podID="a1a2aa0a-5f62-456d-b0f1-fb7184e6c4f1" containerID="c4eddf38f943ab9a0b48034304d00d83a56e49a20665c576320c6d3f181addc2" exitCode=0
Jul 29 04:51:13.552687 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:51:13.552286    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c3ff84-bjztv" event={"ID":"a1a2aa0a-5f62-456d-b0f1-fb7184e6c4f1","Type":"ContainerDied","Data":"c4eddf38f943ab9a0b48034304d00d83a56e49a20665c576320c6d3f181addc2"}
Jul 29 04:51:14.690078 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:51:14.690045    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c3ff84-bjztv"
Jul 29 04:51:14.805529 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:51:14.805459    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1a2aa0a-5f62-456d-b0f1-fb7184e6c4f1-maas-api-service-ca\") pod \"a1a2aa0a-5f62-456d-b0f1-fb7184e6c4f1\" (UID: \"a1a2aa0a-5f62-456d-b0f1-fb7184e6c4f1\") "
Jul 29 04:51:14.805817 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:51:14.805792    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1a2aa0a-5f62-456d-b0f1-fb7184e6c4f1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a1a2aa0a-5f62-456d-b0f1-fb7184e6c4f1" (UID: "a1a2aa0a-5f62-456d-b0f1-fb7184e6c4f1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:51:14.906463 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:51:14.906430    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1a2aa0a-5f62-456d-b0f1-fb7184e6c4f1-maas-api-service-ca\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 04:51:15.563666 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:51:15.563634    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c3ff84-bjztv"
Jul 29 04:51:15.563666 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:51:15.563663    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c3ff84-bjztv" event={"ID":"a1a2aa0a-5f62-456d-b0f1-fb7184e6c4f1","Type":"ContainerDied","Data":"e695ab93e73bc8bd29b855b200ba7470d0c8652df24bd604303dedfb7905c351"}
Jul 29 04:51:15.563899 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:51:15.563708    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e695ab93e73bc8bd29b855b200ba7470d0c8652df24bd604303dedfb7905c351"
Jul 29 04:51:27.449797 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:51:27.449758    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c3ff84-bjztv"]
Jul 29 04:51:27.452094 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:51:27.452066    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c3ff84-bjztv"]
Jul 29 04:51:28.147743 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:51:28.147709    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1a2aa0a-5f62-456d-b0f1-fb7184e6c4f1" path="/var/lib/kubelet/pods/a1a2aa0a-5f62-456d-b0f1-fb7184e6c4f1/volumes"
Jul 29 04:51:32.083570 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:51:32.083525    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:51:43.780959 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:51:43.780870    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:52:14.281806 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:52:14.281764    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:53:06.440351 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:06.440318    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-6eef04/auth-test-model-6eef04-kserve-75858c4d75-h6862"]
Jul 29 04:53:06.440866 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:06.440756    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1a2aa0a-5f62-456d-b0f1-fb7184e6c4f1" containerName="revoke-keys"
Jul 29 04:53:06.440866 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:06.440769    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1a2aa0a-5f62-456d-b0f1-fb7184e6c4f1" containerName="revoke-keys"
Jul 29 04:53:06.440866 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:06.440837    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1a2aa0a-5f62-456d-b0f1-fb7184e6c4f1" containerName="revoke-keys"
Jul 29 04:53:06.443870 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:06.443852    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6eef04/auth-test-model-6eef04-kserve-75858c4d75-h6862"
Jul 29 04:53:06.446233 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:06.446212    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-6eef04\"/\"openshift-service-ca.crt\""
Jul 29 04:53:06.447193 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:06.447176    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6eef04\"/\"auth-test-model-6eef04-kserve-self-signed-certs\""
Jul 29 04:53:06.447288 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:06.447270    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6eef04\"/\"default-dockercfg-w4mtl\""
Jul 29 04:53:06.447344 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:06.447330    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-6eef04\"/\"kube-root-ca.crt\""
Jul 29 04:53:06.455518 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:06.454033    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6eef04/auth-test-model-6eef04-kserve-75858c4d75-h6862"]
Jul 29 04:53:06.544614 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:06.544572    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d7d2afd-162b-409f-94cd-d8faba690b2c-tmp-dir\") pod \"auth-test-model-6eef04-kserve-75858c4d75-h6862\" (UID: \"7d7d2afd-162b-409f-94cd-d8faba690b2c\") " pod="ai-tenant-e2e-shared-a-6eef04/auth-test-model-6eef04-kserve-75858c4d75-h6862"
Jul 29 04:53:06.544819 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:06.544633    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d7d2afd-162b-409f-94cd-d8faba690b2c-home\") pod \"auth-test-model-6eef04-kserve-75858c4d75-h6862\" (UID: \"7d7d2afd-162b-409f-94cd-d8faba690b2c\") " pod="ai-tenant-e2e-shared-a-6eef04/auth-test-model-6eef04-kserve-75858c4d75-h6862"
Jul 29 04:53:06.544819 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:06.544660    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d7d2afd-162b-409f-94cd-d8faba690b2c-model-cache\") pod \"auth-test-model-6eef04-kserve-75858c4d75-h6862\" (UID: \"7d7d2afd-162b-409f-94cd-d8faba690b2c\") " pod="ai-tenant-e2e-shared-a-6eef04/auth-test-model-6eef04-kserve-75858c4d75-h6862"
Jul 29 04:53:06.544819 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:06.544725    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d7d2afd-162b-409f-94cd-d8faba690b2c-tls-certs\") pod \"auth-test-model-6eef04-kserve-75858c4d75-h6862\" (UID: \"7d7d2afd-162b-409f-94cd-d8faba690b2c\") " pod="ai-tenant-e2e-shared-a-6eef04/auth-test-model-6eef04-kserve-75858c4d75-h6862"
Jul 29 04:53:06.544819 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:06.544765    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d7d2afd-162b-409f-94cd-d8faba690b2c-dshm\") pod \"auth-test-model-6eef04-kserve-75858c4d75-h6862\" (UID: \"7d7d2afd-162b-409f-94cd-d8faba690b2c\") " pod="ai-tenant-e2e-shared-a-6eef04/auth-test-model-6eef04-kserve-75858c4d75-h6862"
Jul 29 04:53:06.544994 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:06.544825    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jzqv\" (UniqueName: \"kubernetes.io/projected/7d7d2afd-162b-409f-94cd-d8faba690b2c-kube-api-access-7jzqv\") pod \"auth-test-model-6eef04-kserve-75858c4d75-h6862\" (UID: \"7d7d2afd-162b-409f-94cd-d8faba690b2c\") " pod="ai-tenant-e2e-shared-a-6eef04/auth-test-model-6eef04-kserve-75858c4d75-h6862"
Jul 29 04:53:06.646291 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:06.646252    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jzqv\" (UniqueName: \"kubernetes.io/projected/7d7d2afd-162b-409f-94cd-d8faba690b2c-kube-api-access-7jzqv\") pod \"auth-test-model-6eef04-kserve-75858c4d75-h6862\" (UID: \"7d7d2afd-162b-409f-94cd-d8faba690b2c\") " pod="ai-tenant-e2e-shared-a-6eef04/auth-test-model-6eef04-kserve-75858c4d75-h6862"
Jul 29 04:53:06.646470 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:06.646332    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d7d2afd-162b-409f-94cd-d8faba690b2c-tmp-dir\") pod \"auth-test-model-6eef04-kserve-75858c4d75-h6862\" (UID: \"7d7d2afd-162b-409f-94cd-d8faba690b2c\") " pod="ai-tenant-e2e-shared-a-6eef04/auth-test-model-6eef04-kserve-75858c4d75-h6862"
Jul 29 04:53:06.646470 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:06.646361    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d7d2afd-162b-409f-94cd-d8faba690b2c-home\") pod \"auth-test-model-6eef04-kserve-75858c4d75-h6862\" (UID: \"7d7d2afd-162b-409f-94cd-d8faba690b2c\") " pod="ai-tenant-e2e-shared-a-6eef04/auth-test-model-6eef04-kserve-75858c4d75-h6862"
Jul 29 04:53:06.646470 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:06.646377    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d7d2afd-162b-409f-94cd-d8faba690b2c-model-cache\") pod \"auth-test-model-6eef04-kserve-75858c4d75-h6862\" (UID: \"7d7d2afd-162b-409f-94cd-d8faba690b2c\") " pod="ai-tenant-e2e-shared-a-6eef04/auth-test-model-6eef04-kserve-75858c4d75-h6862"
Jul 29 04:53:06.646470 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:06.646411    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d7d2afd-162b-409f-94cd-d8faba690b2c-tls-certs\") pod \"auth-test-model-6eef04-kserve-75858c4d75-h6862\" (UID: \"7d7d2afd-162b-409f-94cd-d8faba690b2c\") " pod="ai-tenant-e2e-shared-a-6eef04/auth-test-model-6eef04-kserve-75858c4d75-h6862"
Jul 29 04:53:06.646470 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:06.646449    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d7d2afd-162b-409f-94cd-d8faba690b2c-dshm\") pod \"auth-test-model-6eef04-kserve-75858c4d75-h6862\" (UID: \"7d7d2afd-162b-409f-94cd-d8faba690b2c\") " pod="ai-tenant-e2e-shared-a-6eef04/auth-test-model-6eef04-kserve-75858c4d75-h6862"
Jul 29 04:53:06.646848 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:06.646827    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d7d2afd-162b-409f-94cd-d8faba690b2c-tmp-dir\") pod \"auth-test-model-6eef04-kserve-75858c4d75-h6862\" (UID: \"7d7d2afd-162b-409f-94cd-d8faba690b2c\") " pod="ai-tenant-e2e-shared-a-6eef04/auth-test-model-6eef04-kserve-75858c4d75-h6862"
Jul 29 04:53:06.646913 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:06.646865    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d7d2afd-162b-409f-94cd-d8faba690b2c-model-cache\") pod \"auth-test-model-6eef04-kserve-75858c4d75-h6862\" (UID: \"7d7d2afd-162b-409f-94cd-d8faba690b2c\") " pod="ai-tenant-e2e-shared-a-6eef04/auth-test-model-6eef04-kserve-75858c4d75-h6862"
Jul 29 04:53:06.646913 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:06.646903    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d7d2afd-162b-409f-94cd-d8faba690b2c-home\") pod \"auth-test-model-6eef04-kserve-75858c4d75-h6862\" (UID: \"7d7d2afd-162b-409f-94cd-d8faba690b2c\") " pod="ai-tenant-e2e-shared-a-6eef04/auth-test-model-6eef04-kserve-75858c4d75-h6862"
Jul 29 04:53:06.648785 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:06.648770    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d7d2afd-162b-409f-94cd-d8faba690b2c-dshm\") pod \"auth-test-model-6eef04-kserve-75858c4d75-h6862\" (UID: \"7d7d2afd-162b-409f-94cd-d8faba690b2c\") " pod="ai-tenant-e2e-shared-a-6eef04/auth-test-model-6eef04-kserve-75858c4d75-h6862"
Jul 29 04:53:06.649046 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:06.649030    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d7d2afd-162b-409f-94cd-d8faba690b2c-tls-certs\") pod \"auth-test-model-6eef04-kserve-75858c4d75-h6862\" (UID: \"7d7d2afd-162b-409f-94cd-d8faba690b2c\") " pod="ai-tenant-e2e-shared-a-6eef04/auth-test-model-6eef04-kserve-75858c4d75-h6862"
Jul 29 04:53:06.655252 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:06.655232    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jzqv\" (UniqueName: \"kubernetes.io/projected/7d7d2afd-162b-409f-94cd-d8faba690b2c-kube-api-access-7jzqv\") pod \"auth-test-model-6eef04-kserve-75858c4d75-h6862\" (UID: \"7d7d2afd-162b-409f-94cd-d8faba690b2c\") " pod="ai-tenant-e2e-shared-a-6eef04/auth-test-model-6eef04-kserve-75858c4d75-h6862"
Jul 29 04:53:06.761218 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:06.761124    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6eef04/auth-test-model-6eef04-kserve-75858c4d75-h6862"
Jul 29 04:53:06.898037 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:06.897979    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6eef04/auth-test-model-6eef04-kserve-75858c4d75-h6862"]
Jul 29 04:53:06.900482 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:53:06.900449    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d7d2afd_162b_409f_94cd_d8faba690b2c.slice/crio-3259afdefa1427432149a3ca838ec7f0c3ecbaf36d98f24b94d217936ce1bcd4 WatchSource:0}: Error finding container 3259afdefa1427432149a3ca838ec7f0c3ecbaf36d98f24b94d217936ce1bcd4: Status 404 returned error can't find the container with id 3259afdefa1427432149a3ca838ec7f0c3ecbaf36d98f24b94d217936ce1bcd4
Jul 29 04:53:07.109642 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:07.109608    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6eef04/auth-test-model-6eef04-kserve-75858c4d75-h6862" event={"ID":"7d7d2afd-162b-409f-94cd-d8faba690b2c","Type":"ContainerStarted","Data":"1d751e1ca9dc5f1ea7762af63066e552688982b7f9455ba8289793ac4c9ac342"}
Jul 29 04:53:07.109807 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:07.109656    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6eef04/auth-test-model-6eef04-kserve-75858c4d75-h6862" event={"ID":"7d7d2afd-162b-409f-94cd-d8faba690b2c","Type":"ContainerStarted","Data":"3259afdefa1427432149a3ca838ec7f0c3ecbaf36d98f24b94d217936ce1bcd4"}
Jul 29 04:53:07.126703 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:07.126651    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-6eef04/auth-test-model-6eef04-kserve-75858c4d75-h6862" podStartSLOduration=1.126636959 podStartE2EDuration="1.126636959s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:53:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:53:07.125003288 +0000 UTC m=+2953.558041404" watchObservedRunningTime="2026-07-29 04:53:07.126636959 +0000 UTC m=+2953.559675113"
Jul 29 04:53:10.382448 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:10.382413    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:53:16.761563 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:16.761471    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-6eef04/auth-test-model-6eef04-kserve-75858c4d75-h6862"
Jul 29 04:53:16.761563 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:16.761554    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-6eef04/auth-test-model-6eef04-kserve-75858c4d75-h6862"
Jul 29 04:53:16.774001 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:16.773973    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-6eef04/auth-test-model-6eef04-kserve-75858c4d75-h6862"
Jul 29 04:53:17.172410 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:17.172380    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-6eef04/auth-test-model-6eef04-kserve-75858c4d75-h6862"
Jul 29 04:53:25.005364 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:25.005329    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-be8bc5/auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx"]
Jul 29 04:53:25.009143 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:25.009122    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-be8bc5/auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx"
Jul 29 04:53:25.012779 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:25.012749    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-be8bc5\"/\"openshift-service-ca.crt\""
Jul 29 04:53:25.012907 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:25.012804    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-be8bc5\"/\"auth-test-model-be8bc5-kserve-self-signed-certs\""
Jul 29 04:53:25.012973 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:25.012909    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-be8bc5\"/\"default-dockercfg-ddrn9\""
Jul 29 04:53:25.013023 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:25.012971    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-be8bc5\"/\"kube-root-ca.crt\""
Jul 29 04:53:25.018548 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:25.018525    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-be8bc5/auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx"]
Jul 29 04:53:25.114406 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:25.114366    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca8c3713-fc2d-42e5-b669-af9ebf6bc53d-home\") pod \"auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx\" (UID: \"ca8c3713-fc2d-42e5-b669-af9ebf6bc53d\") " pod="ai-tenant-e2e-shared-b-be8bc5/auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx"
Jul 29 04:53:25.114616 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:25.114409    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca8c3713-fc2d-42e5-b669-af9ebf6bc53d-dshm\") pod \"auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx\" (UID: \"ca8c3713-fc2d-42e5-b669-af9ebf6bc53d\") " pod="ai-tenant-e2e-shared-b-be8bc5/auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx"
Jul 29 04:53:25.114616 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:25.114444    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca8c3713-fc2d-42e5-b669-af9ebf6bc53d-tls-certs\") pod \"auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx\" (UID: \"ca8c3713-fc2d-42e5-b669-af9ebf6bc53d\") " pod="ai-tenant-e2e-shared-b-be8bc5/auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx"
Jul 29 04:53:25.114616 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:25.114569    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca8c3713-fc2d-42e5-b669-af9ebf6bc53d-model-cache\") pod \"auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx\" (UID: \"ca8c3713-fc2d-42e5-b669-af9ebf6bc53d\") " pod="ai-tenant-e2e-shared-b-be8bc5/auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx"
Jul 29 04:53:25.114767 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:25.114616    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca8c3713-fc2d-42e5-b669-af9ebf6bc53d-tmp-dir\") pod \"auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx\" (UID: \"ca8c3713-fc2d-42e5-b669-af9ebf6bc53d\") " pod="ai-tenant-e2e-shared-b-be8bc5/auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx"
Jul 29 04:53:25.114767 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:25.114740    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bs4p\" (UniqueName: \"kubernetes.io/projected/ca8c3713-fc2d-42e5-b669-af9ebf6bc53d-kube-api-access-7bs4p\") pod \"auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx\" (UID: \"ca8c3713-fc2d-42e5-b669-af9ebf6bc53d\") " pod="ai-tenant-e2e-shared-b-be8bc5/auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx"
Jul 29 04:53:25.215775 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:25.215740    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca8c3713-fc2d-42e5-b669-af9ebf6bc53d-home\") pod \"auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx\" (UID: \"ca8c3713-fc2d-42e5-b669-af9ebf6bc53d\") " pod="ai-tenant-e2e-shared-b-be8bc5/auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx"
Jul 29 04:53:25.215775 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:25.215767    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca8c3713-fc2d-42e5-b669-af9ebf6bc53d-dshm\") pod \"auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx\" (UID: \"ca8c3713-fc2d-42e5-b669-af9ebf6bc53d\") " pod="ai-tenant-e2e-shared-b-be8bc5/auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx"
Jul 29 04:53:25.216026 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:25.215897    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca8c3713-fc2d-42e5-b669-af9ebf6bc53d-tls-certs\") pod \"auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx\" (UID: \"ca8c3713-fc2d-42e5-b669-af9ebf6bc53d\") " pod="ai-tenant-e2e-shared-b-be8bc5/auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx"
Jul 29 04:53:25.216026 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:25.215969    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca8c3713-fc2d-42e5-b669-af9ebf6bc53d-model-cache\") pod \"auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx\" (UID: \"ca8c3713-fc2d-42e5-b669-af9ebf6bc53d\") " pod="ai-tenant-e2e-shared-b-be8bc5/auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx"
Jul 29 04:53:25.216137 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:25.216026    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca8c3713-fc2d-42e5-b669-af9ebf6bc53d-tmp-dir\") pod \"auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx\" (UID: \"ca8c3713-fc2d-42e5-b669-af9ebf6bc53d\") " pod="ai-tenant-e2e-shared-b-be8bc5/auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx"
Jul 29 04:53:25.216137 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:25.216063    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bs4p\" (UniqueName: \"kubernetes.io/projected/ca8c3713-fc2d-42e5-b669-af9ebf6bc53d-kube-api-access-7bs4p\") pod \"auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx\" (UID: \"ca8c3713-fc2d-42e5-b669-af9ebf6bc53d\") " pod="ai-tenant-e2e-shared-b-be8bc5/auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx"
Jul 29 04:53:25.216137 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:25.216077    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca8c3713-fc2d-42e5-b669-af9ebf6bc53d-home\") pod \"auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx\" (UID: \"ca8c3713-fc2d-42e5-b669-af9ebf6bc53d\") " pod="ai-tenant-e2e-shared-b-be8bc5/auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx"
Jul 29 04:53:25.216273 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:25.216252    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca8c3713-fc2d-42e5-b669-af9ebf6bc53d-model-cache\") pod \"auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx\" (UID: \"ca8c3713-fc2d-42e5-b669-af9ebf6bc53d\") " pod="ai-tenant-e2e-shared-b-be8bc5/auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx"
Jul 29 04:53:25.216376 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:25.216349    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca8c3713-fc2d-42e5-b669-af9ebf6bc53d-tmp-dir\") pod \"auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx\" (UID: \"ca8c3713-fc2d-42e5-b669-af9ebf6bc53d\") " pod="ai-tenant-e2e-shared-b-be8bc5/auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx"
Jul 29 04:53:25.218408 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:25.218388    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca8c3713-fc2d-42e5-b669-af9ebf6bc53d-dshm\") pod \"auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx\" (UID: \"ca8c3713-fc2d-42e5-b669-af9ebf6bc53d\") " pod="ai-tenant-e2e-shared-b-be8bc5/auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx"
Jul 29 04:53:25.218565 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:25.218547    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca8c3713-fc2d-42e5-b669-af9ebf6bc53d-tls-certs\") pod \"auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx\" (UID: \"ca8c3713-fc2d-42e5-b669-af9ebf6bc53d\") " pod="ai-tenant-e2e-shared-b-be8bc5/auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx"
Jul 29 04:53:25.223956 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:25.223927    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bs4p\" (UniqueName: \"kubernetes.io/projected/ca8c3713-fc2d-42e5-b669-af9ebf6bc53d-kube-api-access-7bs4p\") pod \"auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx\" (UID: \"ca8c3713-fc2d-42e5-b669-af9ebf6bc53d\") " pod="ai-tenant-e2e-shared-b-be8bc5/auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx"
Jul 29 04:53:25.321402 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:25.321320    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-be8bc5/auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx"
Jul 29 04:53:25.456427 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:25.456395    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-be8bc5/auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx"]
Jul 29 04:53:25.459577 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:53:25.459552    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podca8c3713_fc2d_42e5_b669_af9ebf6bc53d.slice/crio-8cf9aa832a72036f2e09f2ff0bcfeec8ebef7786aabadc1413d3c5eebea10d0f WatchSource:0}: Error finding container 8cf9aa832a72036f2e09f2ff0bcfeec8ebef7786aabadc1413d3c5eebea10d0f: Status 404 returned error can't find the container with id 8cf9aa832a72036f2e09f2ff0bcfeec8ebef7786aabadc1413d3c5eebea10d0f
Jul 29 04:53:26.207615 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:26.207581    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-be8bc5/auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx" event={"ID":"ca8c3713-fc2d-42e5-b669-af9ebf6bc53d","Type":"ContainerStarted","Data":"4f7072199e2f42aa61fc2fb25b81f067025582f6ab00ab39b323010c32e04105"}
Jul 29 04:53:26.207615 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:26.207624    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-be8bc5/auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx" event={"ID":"ca8c3713-fc2d-42e5-b669-af9ebf6bc53d","Type":"ContainerStarted","Data":"8cf9aa832a72036f2e09f2ff0bcfeec8ebef7786aabadc1413d3c5eebea10d0f"}
Jul 29 04:53:26.228563 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:26.225521    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-be8bc5/auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx" podStartSLOduration=2.225479719 podStartE2EDuration="2.225479719s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:53:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:53:26.223081805 +0000 UTC m=+2972.656119918" watchObservedRunningTime="2026-07-29 04:53:26.225479719 +0000 UTC m=+2972.658517837"
Jul 29 04:53:28.879134 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:28.879087    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:53:35.321425 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:35.321382    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-be8bc5/auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx"
Jul 29 04:53:35.321891 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:35.321437    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-be8bc5/auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx"
Jul 29 04:53:35.334048 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:35.334020    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-be8bc5/auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx"
Jul 29 04:53:36.270426 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:36.270397    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-be8bc5/auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx"
Jul 29 04:53:52.888327 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:53:52.888286    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:54:18.783359 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:54:18.783319    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:54:31.685443 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:54:31.685405    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:54:43.396944 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:54:43.396910    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:55:02.484171 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:55:02.484129    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:55:17.484452 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:55:17.484413    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:55:30.884637 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:55:30.884590    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:55:52.588548 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:55:52.588495    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:56:09.383945 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:56:09.383908    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:56:34.982122 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:56:34.982049    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:56:54.176431 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:56:54.176393    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:56:54.379855 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:56:54.379820    2572 scope.go:117] "RemoveContainer" containerID="77c71ecd6555d07923b144d67aeccf3887b3fd6f010e20695a1b95ea29e27830"
Jul 29 04:57:20.479417 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:57:20.479381    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:57:33.541695 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:57:33.541654    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:57:46.387096 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:57:46.387009    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:57:54.400002 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:57:54.399971    2572 scope.go:117] "RemoveContainer" containerID="c4eddf38f943ab9a0b48034304d00d83a56e49a20665c576320c6d3f181addc2"
Jul 29 04:58:08.277363 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:08.277326    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:58:11.639539 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:11.639488    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6eef04/auth-test-model-6eef04-kserve-75858c4d75-h6862"]
Jul 29 04:58:12.543013 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:12.542976    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-be8bc5/auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx"]
Jul 29 04:58:23.481938 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:23.481905    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:58:26.659021 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:26.658945    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-6eef04/auth-test-model-6eef04-kserve-75858c4d75-h6862" podUID="7d7d2afd-162b-409f-94cd-d8faba690b2c" containerName="main" containerID="cri-o://1d751e1ca9dc5f1ea7762af63066e552688982b7f9455ba8289793ac4c9ac342" gracePeriod=45
Jul 29 04:58:26.915713 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:26.915653    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6eef04/auth-test-model-6eef04-kserve-75858c4d75-h6862"
Jul 29 04:58:27.001614 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:27.001583    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d7d2afd-162b-409f-94cd-d8faba690b2c-model-cache\") pod \"7d7d2afd-162b-409f-94cd-d8faba690b2c\" (UID: \"7d7d2afd-162b-409f-94cd-d8faba690b2c\") "
Jul 29 04:58:27.001764 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:27.001647    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d7d2afd-162b-409f-94cd-d8faba690b2c-tmp-dir\") pod \"7d7d2afd-162b-409f-94cd-d8faba690b2c\" (UID: \"7d7d2afd-162b-409f-94cd-d8faba690b2c\") "
Jul 29 04:58:27.001764 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:27.001668    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d7d2afd-162b-409f-94cd-d8faba690b2c-home\") pod \"7d7d2afd-162b-409f-94cd-d8faba690b2c\" (UID: \"7d7d2afd-162b-409f-94cd-d8faba690b2c\") "
Jul 29 04:58:27.001764 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:27.001704    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d7d2afd-162b-409f-94cd-d8faba690b2c-tls-certs\") pod \"7d7d2afd-162b-409f-94cd-d8faba690b2c\" (UID: \"7d7d2afd-162b-409f-94cd-d8faba690b2c\") "
Jul 29 04:58:27.001764 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:27.001744    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d7d2afd-162b-409f-94cd-d8faba690b2c-dshm\") pod \"7d7d2afd-162b-409f-94cd-d8faba690b2c\" (UID: \"7d7d2afd-162b-409f-94cd-d8faba690b2c\") "
Jul 29 04:58:27.001764 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:27.001762    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jzqv\" (UniqueName: \"kubernetes.io/projected/7d7d2afd-162b-409f-94cd-d8faba690b2c-kube-api-access-7jzqv\") pod \"7d7d2afd-162b-409f-94cd-d8faba690b2c\" (UID: \"7d7d2afd-162b-409f-94cd-d8faba690b2c\") "
Jul 29 04:58:27.002040 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:27.001858    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d7d2afd-162b-409f-94cd-d8faba690b2c-model-cache" (OuterVolumeSpecName: "model-cache") pod "7d7d2afd-162b-409f-94cd-d8faba690b2c" (UID: "7d7d2afd-162b-409f-94cd-d8faba690b2c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:58:27.002040 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:27.001933    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d7d2afd-162b-409f-94cd-d8faba690b2c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7d7d2afd-162b-409f-94cd-d8faba690b2c" (UID: "7d7d2afd-162b-409f-94cd-d8faba690b2c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:58:27.002040 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:27.001994    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d7d2afd-162b-409f-94cd-d8faba690b2c-home" (OuterVolumeSpecName: "home") pod "7d7d2afd-162b-409f-94cd-d8faba690b2c" (UID: "7d7d2afd-162b-409f-94cd-d8faba690b2c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:58:27.002176 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:27.002089    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d7d2afd-162b-409f-94cd-d8faba690b2c-home\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 04:58:27.002176 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:27.002106    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d7d2afd-162b-409f-94cd-d8faba690b2c-model-cache\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 04:58:27.002176 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:27.002122    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d7d2afd-162b-409f-94cd-d8faba690b2c-tmp-dir\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 04:58:27.004111 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:27.004086    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d7d2afd-162b-409f-94cd-d8faba690b2c-dshm" (OuterVolumeSpecName: "dshm") pod "7d7d2afd-162b-409f-94cd-d8faba690b2c" (UID: "7d7d2afd-162b-409f-94cd-d8faba690b2c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:58:27.004241 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:27.004133    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d7d2afd-162b-409f-94cd-d8faba690b2c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7d7d2afd-162b-409f-94cd-d8faba690b2c" (UID: "7d7d2afd-162b-409f-94cd-d8faba690b2c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 04:58:27.004241 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:27.004170    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d7d2afd-162b-409f-94cd-d8faba690b2c-kube-api-access-7jzqv" (OuterVolumeSpecName: "kube-api-access-7jzqv") pod "7d7d2afd-162b-409f-94cd-d8faba690b2c" (UID: "7d7d2afd-162b-409f-94cd-d8faba690b2c"). InnerVolumeSpecName "kube-api-access-7jzqv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:58:27.102923 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:27.102878    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d7d2afd-162b-409f-94cd-d8faba690b2c-tls-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 04:58:27.102923 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:27.102912    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d7d2afd-162b-409f-94cd-d8faba690b2c-dshm\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 04:58:27.102923 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:27.102921    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jzqv\" (UniqueName: \"kubernetes.io/projected/7d7d2afd-162b-409f-94cd-d8faba690b2c-kube-api-access-7jzqv\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 04:58:27.562822 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:27.562775    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-be8bc5/auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx" podUID="ca8c3713-fc2d-42e5-b669-af9ebf6bc53d" containerName="main" containerID="cri-o://4f7072199e2f42aa61fc2fb25b81f067025582f6ab00ab39b323010c32e04105" gracePeriod=45
Jul 29 04:58:27.672174 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:27.672121    2572 generic.go:356] "Generic (PLEG): container finished" podID="7d7d2afd-162b-409f-94cd-d8faba690b2c" containerID="1d751e1ca9dc5f1ea7762af63066e552688982b7f9455ba8289793ac4c9ac342" exitCode=0
Jul 29 04:58:27.672602 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:27.672216    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6eef04/auth-test-model-6eef04-kserve-75858c4d75-h6862" event={"ID":"7d7d2afd-162b-409f-94cd-d8faba690b2c","Type":"ContainerDied","Data":"1d751e1ca9dc5f1ea7762af63066e552688982b7f9455ba8289793ac4c9ac342"}
Jul 29 04:58:27.672602 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:27.672241    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6eef04/auth-test-model-6eef04-kserve-75858c4d75-h6862"
Jul 29 04:58:27.672602 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:27.672258    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6eef04/auth-test-model-6eef04-kserve-75858c4d75-h6862" event={"ID":"7d7d2afd-162b-409f-94cd-d8faba690b2c","Type":"ContainerDied","Data":"3259afdefa1427432149a3ca838ec7f0c3ecbaf36d98f24b94d217936ce1bcd4"}
Jul 29 04:58:27.672602 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:27.672280    2572 scope.go:117] "RemoveContainer" containerID="1d751e1ca9dc5f1ea7762af63066e552688982b7f9455ba8289793ac4c9ac342"
Jul 29 04:58:27.681725 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:27.681709    2572 scope.go:117] "RemoveContainer" containerID="1d751e1ca9dc5f1ea7762af63066e552688982b7f9455ba8289793ac4c9ac342"
Jul 29 04:58:27.681975 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:58:27.681954    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d751e1ca9dc5f1ea7762af63066e552688982b7f9455ba8289793ac4c9ac342\": container with ID starting with 1d751e1ca9dc5f1ea7762af63066e552688982b7f9455ba8289793ac4c9ac342 not found: ID does not exist" containerID="1d751e1ca9dc5f1ea7762af63066e552688982b7f9455ba8289793ac4c9ac342"
Jul 29 04:58:27.682019 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:27.681986    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d751e1ca9dc5f1ea7762af63066e552688982b7f9455ba8289793ac4c9ac342"} err="failed to get container status \"1d751e1ca9dc5f1ea7762af63066e552688982b7f9455ba8289793ac4c9ac342\": rpc error: code = NotFound desc = could not find container \"1d751e1ca9dc5f1ea7762af63066e552688982b7f9455ba8289793ac4c9ac342\": container with ID starting with 1d751e1ca9dc5f1ea7762af63066e552688982b7f9455ba8289793ac4c9ac342 not found: ID does not exist"
Jul 29 04:58:27.694493 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:27.694463    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6eef04/auth-test-model-6eef04-kserve-75858c4d75-h6862"]
Jul 29 04:58:27.698194 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:27.698166    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-6eef04/auth-test-model-6eef04-kserve-75858c4d75-h6862"]
Jul 29 04:58:27.823198 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:27.823140    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-be8bc5/auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx"
Jul 29 04:58:27.911192 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:27.911158    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bs4p\" (UniqueName: \"kubernetes.io/projected/ca8c3713-fc2d-42e5-b669-af9ebf6bc53d-kube-api-access-7bs4p\") pod \"ca8c3713-fc2d-42e5-b669-af9ebf6bc53d\" (UID: \"ca8c3713-fc2d-42e5-b669-af9ebf6bc53d\") "
Jul 29 04:58:27.911364 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:27.911203    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca8c3713-fc2d-42e5-b669-af9ebf6bc53d-tmp-dir\") pod \"ca8c3713-fc2d-42e5-b669-af9ebf6bc53d\" (UID: \"ca8c3713-fc2d-42e5-b669-af9ebf6bc53d\") "
Jul 29 04:58:27.911364 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:27.911251    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca8c3713-fc2d-42e5-b669-af9ebf6bc53d-tls-certs\") pod \"ca8c3713-fc2d-42e5-b669-af9ebf6bc53d\" (UID: \"ca8c3713-fc2d-42e5-b669-af9ebf6bc53d\") "
Jul 29 04:58:27.911364 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:27.911269    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca8c3713-fc2d-42e5-b669-af9ebf6bc53d-home\") pod \"ca8c3713-fc2d-42e5-b669-af9ebf6bc53d\" (UID: \"ca8c3713-fc2d-42e5-b669-af9ebf6bc53d\") "
Jul 29 04:58:27.911364 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:27.911286    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca8c3713-fc2d-42e5-b669-af9ebf6bc53d-dshm\") pod \"ca8c3713-fc2d-42e5-b669-af9ebf6bc53d\" (UID: \"ca8c3713-fc2d-42e5-b669-af9ebf6bc53d\") "
Jul 29 04:58:27.911364 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:27.911308    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca8c3713-fc2d-42e5-b669-af9ebf6bc53d-model-cache\") pod \"ca8c3713-fc2d-42e5-b669-af9ebf6bc53d\" (UID: \"ca8c3713-fc2d-42e5-b669-af9ebf6bc53d\") "
Jul 29 04:58:27.911658 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:27.911610    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca8c3713-fc2d-42e5-b669-af9ebf6bc53d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ca8c3713-fc2d-42e5-b669-af9ebf6bc53d" (UID: "ca8c3713-fc2d-42e5-b669-af9ebf6bc53d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:58:27.911712 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:27.911626    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca8c3713-fc2d-42e5-b669-af9ebf6bc53d-home" (OuterVolumeSpecName: "home") pod "ca8c3713-fc2d-42e5-b669-af9ebf6bc53d" (UID: "ca8c3713-fc2d-42e5-b669-af9ebf6bc53d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:58:27.911772 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:27.911748    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca8c3713-fc2d-42e5-b669-af9ebf6bc53d-model-cache" (OuterVolumeSpecName: "model-cache") pod "ca8c3713-fc2d-42e5-b669-af9ebf6bc53d" (UID: "ca8c3713-fc2d-42e5-b669-af9ebf6bc53d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:58:27.913745 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:27.913713    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca8c3713-fc2d-42e5-b669-af9ebf6bc53d-dshm" (OuterVolumeSpecName: "dshm") pod "ca8c3713-fc2d-42e5-b669-af9ebf6bc53d" (UID: "ca8c3713-fc2d-42e5-b669-af9ebf6bc53d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:58:27.913858 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:27.913766    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca8c3713-fc2d-42e5-b669-af9ebf6bc53d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ca8c3713-fc2d-42e5-b669-af9ebf6bc53d" (UID: "ca8c3713-fc2d-42e5-b669-af9ebf6bc53d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 04:58:27.913858 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:27.913780    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca8c3713-fc2d-42e5-b669-af9ebf6bc53d-kube-api-access-7bs4p" (OuterVolumeSpecName: "kube-api-access-7bs4p") pod "ca8c3713-fc2d-42e5-b669-af9ebf6bc53d" (UID: "ca8c3713-fc2d-42e5-b669-af9ebf6bc53d"). InnerVolumeSpecName "kube-api-access-7bs4p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:58:28.013002 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:28.012957    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca8c3713-fc2d-42e5-b669-af9ebf6bc53d-tls-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 04:58:28.013002 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:28.012994    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca8c3713-fc2d-42e5-b669-af9ebf6bc53d-home\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 04:58:28.013002 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:28.013003    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca8c3713-fc2d-42e5-b669-af9ebf6bc53d-dshm\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 04:58:28.013002 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:28.013011    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca8c3713-fc2d-42e5-b669-af9ebf6bc53d-model-cache\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 04:58:28.013276 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:28.013023    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bs4p\" (UniqueName: \"kubernetes.io/projected/ca8c3713-fc2d-42e5-b669-af9ebf6bc53d-kube-api-access-7bs4p\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 04:58:28.013276 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:28.013032    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca8c3713-fc2d-42e5-b669-af9ebf6bc53d-tmp-dir\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 04:58:28.148810 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:28.148775    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d7d2afd-162b-409f-94cd-d8faba690b2c" path="/var/lib/kubelet/pods/7d7d2afd-162b-409f-94cd-d8faba690b2c/volumes"
Jul 29 04:58:28.679920 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:28.679880    2572 generic.go:356] "Generic (PLEG): container finished" podID="ca8c3713-fc2d-42e5-b669-af9ebf6bc53d" containerID="4f7072199e2f42aa61fc2fb25b81f067025582f6ab00ab39b323010c32e04105" exitCode=0
Jul 29 04:58:28.679920 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:28.679921    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-be8bc5/auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx"
Jul 29 04:58:28.680416 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:28.679920    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-be8bc5/auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx" event={"ID":"ca8c3713-fc2d-42e5-b669-af9ebf6bc53d","Type":"ContainerDied","Data":"4f7072199e2f42aa61fc2fb25b81f067025582f6ab00ab39b323010c32e04105"}
Jul 29 04:58:28.680416 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:28.680042    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-be8bc5/auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx" event={"ID":"ca8c3713-fc2d-42e5-b669-af9ebf6bc53d","Type":"ContainerDied","Data":"8cf9aa832a72036f2e09f2ff0bcfeec8ebef7786aabadc1413d3c5eebea10d0f"}
Jul 29 04:58:28.680416 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:28.680066    2572 scope.go:117] "RemoveContainer" containerID="4f7072199e2f42aa61fc2fb25b81f067025582f6ab00ab39b323010c32e04105"
Jul 29 04:58:28.688831 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:28.688814    2572 scope.go:117] "RemoveContainer" containerID="4f7072199e2f42aa61fc2fb25b81f067025582f6ab00ab39b323010c32e04105"
Jul 29 04:58:28.689070 ip-10-0-130-4 kubenswrapper[2572]: E0729 04:58:28.689052    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f7072199e2f42aa61fc2fb25b81f067025582f6ab00ab39b323010c32e04105\": container with ID starting with 4f7072199e2f42aa61fc2fb25b81f067025582f6ab00ab39b323010c32e04105 not found: ID does not exist" containerID="4f7072199e2f42aa61fc2fb25b81f067025582f6ab00ab39b323010c32e04105"
Jul 29 04:58:28.689111 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:28.689079    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f7072199e2f42aa61fc2fb25b81f067025582f6ab00ab39b323010c32e04105"} err="failed to get container status \"4f7072199e2f42aa61fc2fb25b81f067025582f6ab00ab39b323010c32e04105\": rpc error: code = NotFound desc = could not find container \"4f7072199e2f42aa61fc2fb25b81f067025582f6ab00ab39b323010c32e04105\": container with ID starting with 4f7072199e2f42aa61fc2fb25b81f067025582f6ab00ab39b323010c32e04105 not found: ID does not exist"
Jul 29 04:58:28.695108 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:28.695032    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-be8bc5/auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx"]
Jul 29 04:58:28.697315 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:28.697293    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-be8bc5/auth-test-model-be8bc5-kserve-79c45b98cf-b2mfx"]
Jul 29 04:58:30.148231 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:30.148194    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca8c3713-fc2d-42e5-b669-af9ebf6bc53d" path="/var/lib/kubelet/pods/ca8c3713-fc2d-42e5-b669-af9ebf6bc53d/volumes"
Jul 29 04:58:32.783536 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:32.783488    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:58:39.223935 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:39.223897    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-be8bc5/sub-test-model-be8bc5-kserve-787cc68df7-qn22h"]
Jul 29 04:58:39.224450 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:39.224431    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d7d2afd-162b-409f-94cd-d8faba690b2c" containerName="main"
Jul 29 04:58:39.224559 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:39.224454    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d7d2afd-162b-409f-94cd-d8faba690b2c" containerName="main"
Jul 29 04:58:39.224559 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:39.224472    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca8c3713-fc2d-42e5-b669-af9ebf6bc53d" containerName="main"
Jul 29 04:58:39.224559 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:39.224480    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca8c3713-fc2d-42e5-b669-af9ebf6bc53d" containerName="main"
Jul 29 04:58:39.224723 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:39.224600    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d7d2afd-162b-409f-94cd-d8faba690b2c" containerName="main"
Jul 29 04:58:39.224723 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:39.224613    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca8c3713-fc2d-42e5-b669-af9ebf6bc53d" containerName="main"
Jul 29 04:58:39.227698 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:39.227676    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-be8bc5/sub-test-model-be8bc5-kserve-787cc68df7-qn22h"
Jul 29 04:58:39.230294 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:39.230276    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-be8bc5\"/\"kube-root-ca.crt\""
Jul 29 04:58:39.231369 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:39.231350    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-be8bc5\"/\"default-dockercfg-ddrn9\""
Jul 29 04:58:39.231468 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:39.231370    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-be8bc5\"/\"openshift-service-ca.crt\""
Jul 29 04:58:39.231468 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:39.231380    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-be8bc5\"/\"sub-test-model-be8bc5-kserve-self-signed-certs\""
Jul 29 04:58:39.239255 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:39.239234    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-be8bc5/sub-test-model-be8bc5-kserve-787cc68df7-qn22h"]
Jul 29 04:58:39.322536 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:39.322468    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35b83029-018c-442d-b87e-c976584fa634-model-cache\") pod \"sub-test-model-be8bc5-kserve-787cc68df7-qn22h\" (UID: \"35b83029-018c-442d-b87e-c976584fa634\") " pod="ai-tenant-e2e-shared-b-be8bc5/sub-test-model-be8bc5-kserve-787cc68df7-qn22h"
Jul 29 04:58:39.322536 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:39.322531    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvqzr\" (UniqueName: \"kubernetes.io/projected/35b83029-018c-442d-b87e-c976584fa634-kube-api-access-cvqzr\") pod \"sub-test-model-be8bc5-kserve-787cc68df7-qn22h\" (UID: \"35b83029-018c-442d-b87e-c976584fa634\") " pod="ai-tenant-e2e-shared-b-be8bc5/sub-test-model-be8bc5-kserve-787cc68df7-qn22h"
Jul 29 04:58:39.322768 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:39.322612    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35b83029-018c-442d-b87e-c976584fa634-tmp-dir\") pod \"sub-test-model-be8bc5-kserve-787cc68df7-qn22h\" (UID: \"35b83029-018c-442d-b87e-c976584fa634\") " pod="ai-tenant-e2e-shared-b-be8bc5/sub-test-model-be8bc5-kserve-787cc68df7-qn22h"
Jul 29 04:58:39.322768 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:39.322660    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35b83029-018c-442d-b87e-c976584fa634-tls-certs\") pod \"sub-test-model-be8bc5-kserve-787cc68df7-qn22h\" (UID: \"35b83029-018c-442d-b87e-c976584fa634\") " pod="ai-tenant-e2e-shared-b-be8bc5/sub-test-model-be8bc5-kserve-787cc68df7-qn22h"
Jul 29 04:58:39.322768 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:39.322695    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35b83029-018c-442d-b87e-c976584fa634-home\") pod \"sub-test-model-be8bc5-kserve-787cc68df7-qn22h\" (UID: \"35b83029-018c-442d-b87e-c976584fa634\") " pod="ai-tenant-e2e-shared-b-be8bc5/sub-test-model-be8bc5-kserve-787cc68df7-qn22h"
Jul 29 04:58:39.322768 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:39.322734    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35b83029-018c-442d-b87e-c976584fa634-dshm\") pod \"sub-test-model-be8bc5-kserve-787cc68df7-qn22h\" (UID: \"35b83029-018c-442d-b87e-c976584fa634\") " pod="ai-tenant-e2e-shared-b-be8bc5/sub-test-model-be8bc5-kserve-787cc68df7-qn22h"
Jul 29 04:58:39.423947 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:39.423888    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35b83029-018c-442d-b87e-c976584fa634-tmp-dir\") pod \"sub-test-model-be8bc5-kserve-787cc68df7-qn22h\" (UID: \"35b83029-018c-442d-b87e-c976584fa634\") " pod="ai-tenant-e2e-shared-b-be8bc5/sub-test-model-be8bc5-kserve-787cc68df7-qn22h"
Jul 29 04:58:39.424150 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:39.423963    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35b83029-018c-442d-b87e-c976584fa634-tls-certs\") pod \"sub-test-model-be8bc5-kserve-787cc68df7-qn22h\" (UID: \"35b83029-018c-442d-b87e-c976584fa634\") " pod="ai-tenant-e2e-shared-b-be8bc5/sub-test-model-be8bc5-kserve-787cc68df7-qn22h"
Jul 29 04:58:39.424150 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:39.424000    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35b83029-018c-442d-b87e-c976584fa634-home\") pod \"sub-test-model-be8bc5-kserve-787cc68df7-qn22h\" (UID: \"35b83029-018c-442d-b87e-c976584fa634\") " pod="ai-tenant-e2e-shared-b-be8bc5/sub-test-model-be8bc5-kserve-787cc68df7-qn22h"
Jul 29 04:58:39.424150 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:39.424052    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35b83029-018c-442d-b87e-c976584fa634-dshm\") pod \"sub-test-model-be8bc5-kserve-787cc68df7-qn22h\" (UID: \"35b83029-018c-442d-b87e-c976584fa634\") " pod="ai-tenant-e2e-shared-b-be8bc5/sub-test-model-be8bc5-kserve-787cc68df7-qn22h"
Jul 29 04:58:39.424150 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:39.424121    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35b83029-018c-442d-b87e-c976584fa634-model-cache\") pod \"sub-test-model-be8bc5-kserve-787cc68df7-qn22h\" (UID: \"35b83029-018c-442d-b87e-c976584fa634\") " pod="ai-tenant-e2e-shared-b-be8bc5/sub-test-model-be8bc5-kserve-787cc68df7-qn22h"
Jul 29 04:58:39.424150 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:39.424144    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvqzr\" (UniqueName: \"kubernetes.io/projected/35b83029-018c-442d-b87e-c976584fa634-kube-api-access-cvqzr\") pod \"sub-test-model-be8bc5-kserve-787cc68df7-qn22h\" (UID: \"35b83029-018c-442d-b87e-c976584fa634\") " pod="ai-tenant-e2e-shared-b-be8bc5/sub-test-model-be8bc5-kserve-787cc68df7-qn22h"
Jul 29 04:58:39.424397 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:39.424354    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35b83029-018c-442d-b87e-c976584fa634-tmp-dir\") pod \"sub-test-model-be8bc5-kserve-787cc68df7-qn22h\" (UID: \"35b83029-018c-442d-b87e-c976584fa634\") " pod="ai-tenant-e2e-shared-b-be8bc5/sub-test-model-be8bc5-kserve-787cc68df7-qn22h"
Jul 29 04:58:39.424397 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:39.424363    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35b83029-018c-442d-b87e-c976584fa634-home\") pod \"sub-test-model-be8bc5-kserve-787cc68df7-qn22h\" (UID: \"35b83029-018c-442d-b87e-c976584fa634\") " pod="ai-tenant-e2e-shared-b-be8bc5/sub-test-model-be8bc5-kserve-787cc68df7-qn22h"
Jul 29 04:58:39.424493 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:39.424459    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35b83029-018c-442d-b87e-c976584fa634-model-cache\") pod \"sub-test-model-be8bc5-kserve-787cc68df7-qn22h\" (UID: \"35b83029-018c-442d-b87e-c976584fa634\") " pod="ai-tenant-e2e-shared-b-be8bc5/sub-test-model-be8bc5-kserve-787cc68df7-qn22h"
Jul 29 04:58:39.426492 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:39.426470    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35b83029-018c-442d-b87e-c976584fa634-dshm\") pod \"sub-test-model-be8bc5-kserve-787cc68df7-qn22h\" (UID: \"35b83029-018c-442d-b87e-c976584fa634\") " pod="ai-tenant-e2e-shared-b-be8bc5/sub-test-model-be8bc5-kserve-787cc68df7-qn22h"
Jul 29 04:58:39.426709 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:39.426690    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35b83029-018c-442d-b87e-c976584fa634-tls-certs\") pod \"sub-test-model-be8bc5-kserve-787cc68df7-qn22h\" (UID: \"35b83029-018c-442d-b87e-c976584fa634\") " pod="ai-tenant-e2e-shared-b-be8bc5/sub-test-model-be8bc5-kserve-787cc68df7-qn22h"
Jul 29 04:58:39.431781 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:39.431758    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvqzr\" (UniqueName: \"kubernetes.io/projected/35b83029-018c-442d-b87e-c976584fa634-kube-api-access-cvqzr\") pod \"sub-test-model-be8bc5-kserve-787cc68df7-qn22h\" (UID: \"35b83029-018c-442d-b87e-c976584fa634\") " pod="ai-tenant-e2e-shared-b-be8bc5/sub-test-model-be8bc5-kserve-787cc68df7-qn22h"
Jul 29 04:58:39.537655 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:39.537567    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-be8bc5/sub-test-model-be8bc5-kserve-787cc68df7-qn22h"
Jul 29 04:58:39.673401 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:39.673372    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-be8bc5/sub-test-model-be8bc5-kserve-787cc68df7-qn22h"]
Jul 29 04:58:39.675465 ip-10-0-130-4 kubenswrapper[2572]: W0729 04:58:39.675432    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod35b83029_018c_442d_b87e_c976584fa634.slice/crio-d91503b00049268bac979d8ffe9567f93720f01fd38040f1f376568354c65ec5 WatchSource:0}: Error finding container d91503b00049268bac979d8ffe9567f93720f01fd38040f1f376568354c65ec5: Status 404 returned error can't find the container with id d91503b00049268bac979d8ffe9567f93720f01fd38040f1f376568354c65ec5
Jul 29 04:58:39.735420 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:39.735387    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-be8bc5/sub-test-model-be8bc5-kserve-787cc68df7-qn22h" event={"ID":"35b83029-018c-442d-b87e-c976584fa634","Type":"ContainerStarted","Data":"d91503b00049268bac979d8ffe9567f93720f01fd38040f1f376568354c65ec5"}
Jul 29 04:58:40.742199 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:40.742157    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-be8bc5/sub-test-model-be8bc5-kserve-787cc68df7-qn22h" event={"ID":"35b83029-018c-442d-b87e-c976584fa634","Type":"ContainerStarted","Data":"afdaf8cda2c8042946490d2cf23967491633f8d16322e14f2534036a76c0abd6"}
Jul 29 04:58:40.757398 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:40.757346    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-be8bc5/sub-test-model-be8bc5-kserve-787cc68df7-qn22h" podStartSLOduration=1.7573294069999998 podStartE2EDuration="1.757329407s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:58:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:58:40.756718018 +0000 UTC m=+3287.189756132" watchObservedRunningTime="2026-07-29 04:58:40.757329407 +0000 UTC m=+3287.190367520"
Jul 29 04:58:43.875981 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:43.875938    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:58:49.538482 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:49.538438    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-be8bc5/sub-test-model-be8bc5-kserve-787cc68df7-qn22h"
Jul 29 04:58:49.538896 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:49.538519    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-be8bc5/sub-test-model-be8bc5-kserve-787cc68df7-qn22h"
Jul 29 04:58:49.551127 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:49.551097    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-be8bc5/sub-test-model-be8bc5-kserve-787cc68df7-qn22h"
Jul 29 04:58:49.796740 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:58:49.796654    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-be8bc5/sub-test-model-be8bc5-kserve-787cc68df7-qn22h"
Jul 29 04:59:31.079821 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:59:31.079781    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 04:59:50.584945 ip-10-0-130-4 kubenswrapper[2572]: I0729 04:59:50.584908    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 05:00:00.149069 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:00.149031    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-6eef04-29755020-wtwpj"]
Jul 29 05:00:00.152634 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:00.152617    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755020-mhr49"]
Jul 29 05:00:00.152774 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:00.152754    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-6eef04-29755020-wtwpj"
Jul 29 05:00:00.155105 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:00.155086    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mxv5w\""
Jul 29 05:00:00.155913 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:00.155880    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-be8bc5-29755020-wll28"]
Jul 29 05:00:00.156029 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:00.156003    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755020-mhr49"
Jul 29 05:00:00.159327 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:00.159304    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-6eef04-29755020-wtwpj"]
Jul 29 05:00:00.159451 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:00.159435    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-be8bc5-29755020-wll28"
Jul 29 05:00:00.162760 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:00.162351    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-be8bc5-29755020-wll28"]
Jul 29 05:00:00.165225 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:00.165199    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755020-mhr49"]
Jul 29 05:00:00.166892 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:00.166872    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-6eef04-29755020-wtwpj"
Jul 29 05:00:00.175872 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:00.175852    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755020-mhr49"
Jul 29 05:00:00.217764 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:00.217737    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-be8bc5-29755020-wll28"
Jul 29 05:00:00.330811 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:00.330716    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-6eef04-29755020-wtwpj"]
Jul 29 05:00:00.332872 ip-10-0-130-4 kubenswrapper[2572]: W0729 05:00:00.332829    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd6b088f_3fa5_49e1_b277_d436673d05fd.slice/crio-2126abcd1cb35239c7ad88859fed269551d634d87ca2eeba0b6fdc0385b8ae50 WatchSource:0}: Error finding container 2126abcd1cb35239c7ad88859fed269551d634d87ca2eeba0b6fdc0385b8ae50: Status 404 returned error can't find the container with id 2126abcd1cb35239c7ad88859fed269551d634d87ca2eeba0b6fdc0385b8ae50
Jul 29 05:00:00.359478 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:00.359432    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755020-mhr49"]
Jul 29 05:00:00.361568 ip-10-0-130-4 kubenswrapper[2572]: W0729 05:00:00.361536    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5b0e6b7_84b4_46a5_b305_799f6fbe37c1.slice/crio-d8cfd00d17c2fd749816f493b0c2dd93c1fb60b241c0e4c70cb92798011e7479 WatchSource:0}: Error finding container d8cfd00d17c2fd749816f493b0c2dd93c1fb60b241c0e4c70cb92798011e7479: Status 404 returned error can't find the container with id d8cfd00d17c2fd749816f493b0c2dd93c1fb60b241c0e4c70cb92798011e7479
Jul 29 05:00:00.384604 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:00.384577    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-be8bc5-29755020-wll28"]
Jul 29 05:00:00.392631 ip-10-0-130-4 kubenswrapper[2572]: W0729 05:00:00.392603    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7f939d6_a940_4f00_8f77_3970b406985b.slice/crio-6fa20e02b179d19487a18dd619440d8052eb29e02ca83ac9fe222d9296cfe50c WatchSource:0}: Error finding container 6fa20e02b179d19487a18dd619440d8052eb29e02ca83ac9fe222d9296cfe50c: Status 404 returned error can't find the container with id 6fa20e02b179d19487a18dd619440d8052eb29e02ca83ac9fe222d9296cfe50c
Jul 29 05:00:01.115727 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:01.115696    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755020-mhr49" event={"ID":"a5b0e6b7-84b4-46a5-b305-799f6fbe37c1","Type":"ContainerStarted","Data":"67602871aecc74f515f616fe08e9ba805b8494577a16a87f57698109ff3b721d"}
Jul 29 05:00:01.115904 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:01.115748    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755020-mhr49" event={"ID":"a5b0e6b7-84b4-46a5-b305-799f6fbe37c1","Type":"ContainerStarted","Data":"d8cfd00d17c2fd749816f493b0c2dd93c1fb60b241c0e4c70cb92798011e7479"}
Jul 29 05:00:01.117258 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:01.117221    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-be8bc5-29755020-wll28" event={"ID":"c7f939d6-a940-4f00-8f77-3970b406985b","Type":"ContainerStarted","Data":"67eae26a6916ad5e21446acbbd3222d0a8c733ed8d40bbcb8d3756bb0f6f7089"}
Jul 29 05:00:01.117391 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:01.117269    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-be8bc5-29755020-wll28" event={"ID":"c7f939d6-a940-4f00-8f77-3970b406985b","Type":"ContainerStarted","Data":"6fa20e02b179d19487a18dd619440d8052eb29e02ca83ac9fe222d9296cfe50c"}
Jul 29 05:00:01.118702 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:01.118675    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-6eef04-29755020-wtwpj" event={"ID":"cd6b088f-3fa5-49e1-b277-d436673d05fd","Type":"ContainerStarted","Data":"e04a0829d7a7ad42dbbd32035ad3e8913c2f9f46c6e1f75299a327a457137218"}
Jul 29 05:00:01.118822 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:01.118716    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-6eef04-29755020-wtwpj" event={"ID":"cd6b088f-3fa5-49e1-b277-d436673d05fd","Type":"ContainerStarted","Data":"2126abcd1cb35239c7ad88859fed269551d634d87ca2eeba0b6fdc0385b8ae50"}
Jul 29 05:00:01.131330 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:01.131285    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755020-mhr49" podStartSLOduration=1.131268499 podStartE2EDuration="1.131268499s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 05:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 05:00:01.130603276 +0000 UTC m=+3367.563641389" watchObservedRunningTime="2026-07-29 05:00:01.131268499 +0000 UTC m=+3367.564306613"
Jul 29 05:00:01.145015 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:01.144971    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-6eef04-29755020-wtwpj" podStartSLOduration=1.144958886 podStartE2EDuration="1.144958886s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 05:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 05:00:01.144688139 +0000 UTC m=+3367.577726252" watchObservedRunningTime="2026-07-29 05:00:01.144958886 +0000 UTC m=+3367.577996998"
Jul 29 05:00:01.160021 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:01.159979    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-be8bc5-29755020-wll28" podStartSLOduration=1.159967628 podStartE2EDuration="1.159967628s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 05:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 05:00:01.159318069 +0000 UTC m=+3367.592356183" watchObservedRunningTime="2026-07-29 05:00:01.159967628 +0000 UTC m=+3367.593005741"
Jul 29 05:00:02.125616 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:02.125578    2572 generic.go:356] "Generic (PLEG): container finished" podID="a5b0e6b7-84b4-46a5-b305-799f6fbe37c1" containerID="67602871aecc74f515f616fe08e9ba805b8494577a16a87f57698109ff3b721d" exitCode=0
Jul 29 05:00:02.125786 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:02.125665    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755020-mhr49" event={"ID":"a5b0e6b7-84b4-46a5-b305-799f6fbe37c1","Type":"ContainerDied","Data":"67602871aecc74f515f616fe08e9ba805b8494577a16a87f57698109ff3b721d"}
Jul 29 05:00:02.127279 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:02.127253    2572 generic.go:356] "Generic (PLEG): container finished" podID="c7f939d6-a940-4f00-8f77-3970b406985b" containerID="67eae26a6916ad5e21446acbbd3222d0a8c733ed8d40bbcb8d3756bb0f6f7089" exitCode=0
Jul 29 05:00:02.127410 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:02.127335    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-be8bc5-29755020-wll28" event={"ID":"c7f939d6-a940-4f00-8f77-3970b406985b","Type":"ContainerDied","Data":"67eae26a6916ad5e21446acbbd3222d0a8c733ed8d40bbcb8d3756bb0f6f7089"}
Jul 29 05:00:02.128703 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:02.128681    2572 generic.go:356] "Generic (PLEG): container finished" podID="cd6b088f-3fa5-49e1-b277-d436673d05fd" containerID="e04a0829d7a7ad42dbbd32035ad3e8913c2f9f46c6e1f75299a327a457137218" exitCode=0
Jul 29 05:00:02.128823 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:02.128714    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-6eef04-29755020-wtwpj" event={"ID":"cd6b088f-3fa5-49e1-b277-d436673d05fd","Type":"ContainerDied","Data":"e04a0829d7a7ad42dbbd32035ad3e8913c2f9f46c6e1f75299a327a457137218"}
Jul 29 05:00:03.284223 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:03.284199    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-6eef04-29755020-wtwpj"
Jul 29 05:00:03.330637 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:03.330614    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755020-mhr49"
Jul 29 05:00:03.333823 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:03.333803    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-be8bc5-29755020-wll28"
Jul 29 05:00:04.139808 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:04.139783    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755020-mhr49"
Jul 29 05:00:04.139808 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:04.139790    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755020-mhr49" event={"ID":"a5b0e6b7-84b4-46a5-b305-799f6fbe37c1","Type":"ContainerDied","Data":"d8cfd00d17c2fd749816f493b0c2dd93c1fb60b241c0e4c70cb92798011e7479"}
Jul 29 05:00:04.140073 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:04.139831    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d8cfd00d17c2fd749816f493b0c2dd93c1fb60b241c0e4c70cb92798011e7479"
Jul 29 05:00:04.141133 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:04.141110    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-be8bc5-29755020-wll28"
Jul 29 05:00:04.141253 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:04.141114    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-be8bc5-29755020-wll28" event={"ID":"c7f939d6-a940-4f00-8f77-3970b406985b","Type":"ContainerDied","Data":"6fa20e02b179d19487a18dd619440d8052eb29e02ca83ac9fe222d9296cfe50c"}
Jul 29 05:00:04.141253 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:04.141222    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6fa20e02b179d19487a18dd619440d8052eb29e02ca83ac9fe222d9296cfe50c"
Jul 29 05:00:04.144225 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:04.144192    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-6eef04-29755020-wtwpj"
Jul 29 05:00:04.148475 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:04.148441    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-6eef04-29755020-wtwpj" event={"ID":"cd6b088f-3fa5-49e1-b277-d436673d05fd","Type":"ContainerDied","Data":"2126abcd1cb35239c7ad88859fed269551d634d87ca2eeba0b6fdc0385b8ae50"}
Jul 29 05:00:04.148611 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:04.148487    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2126abcd1cb35239c7ad88859fed269551d634d87ca2eeba0b6fdc0385b8ae50"
Jul 29 05:00:13.480309 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:13.480263    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 05:00:20.536057 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:20.536017    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-be8bc5/sub-test-model-be8bc5-kserve-787cc68df7-qn22h"]
Jul 29 05:00:24.638663 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:24.638623    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-6eef04/rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm"]
Jul 29 05:00:24.639047 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:24.639001    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5b0e6b7-84b4-46a5-b305-799f6fbe37c1" containerName="cleanup"
Jul 29 05:00:24.639047 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:24.639012    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5b0e6b7-84b4-46a5-b305-799f6fbe37c1" containerName="cleanup"
Jul 29 05:00:24.639047 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:24.639022    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7f939d6-a940-4f00-8f77-3970b406985b" containerName="cleanup"
Jul 29 05:00:24.639047 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:24.639028    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7f939d6-a940-4f00-8f77-3970b406985b" containerName="cleanup"
Jul 29 05:00:24.639047 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:24.639046    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd6b088f-3fa5-49e1-b277-d436673d05fd" containerName="cleanup"
Jul 29 05:00:24.639047 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:24.639051    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd6b088f-3fa5-49e1-b277-d436673d05fd" containerName="cleanup"
Jul 29 05:00:24.639247 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:24.639112    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7f939d6-a940-4f00-8f77-3970b406985b" containerName="cleanup"
Jul 29 05:00:24.639247 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:24.639121    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd6b088f-3fa5-49e1-b277-d436673d05fd" containerName="cleanup"
Jul 29 05:00:24.639247 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:24.639128    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5b0e6b7-84b4-46a5-b305-799f6fbe37c1" containerName="cleanup"
Jul 29 05:00:24.642417 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:24.642400    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6eef04/rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm"
Jul 29 05:00:24.645953 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:24.645929    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-6eef04\"/\"kube-root-ca.crt\""
Jul 29 05:00:24.646967 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:24.646942    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6eef04\"/\"default-dockercfg-w4mtl\""
Jul 29 05:00:24.647069 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:24.647049    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-6eef04\"/\"openshift-service-ca.crt\""
Jul 29 05:00:24.647184 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:24.647157    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6eef04\"/\"rate-test-model-6eef04-kserve-self-signed-certs\""
Jul 29 05:00:24.647837 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:24.647817    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b862e450-99e3-49af-a8e6-64e8ca694bbf-tmp-dir\") pod \"rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm\" (UID: \"b862e450-99e3-49af-a8e6-64e8ca694bbf\") " pod="ai-tenant-e2e-shared-a-6eef04/rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm"
Jul 29 05:00:24.647904 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:24.647859    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b862e450-99e3-49af-a8e6-64e8ca694bbf-model-cache\") pod \"rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm\" (UID: \"b862e450-99e3-49af-a8e6-64e8ca694bbf\") " pod="ai-tenant-e2e-shared-a-6eef04/rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm"
Jul 29 05:00:24.648083 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:24.648061    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b862e450-99e3-49af-a8e6-64e8ca694bbf-tls-certs\") pod \"rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm\" (UID: \"b862e450-99e3-49af-a8e6-64e8ca694bbf\") " pod="ai-tenant-e2e-shared-a-6eef04/rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm"
Jul 29 05:00:24.648158 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:24.648116    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwtlx\" (UniqueName: \"kubernetes.io/projected/b862e450-99e3-49af-a8e6-64e8ca694bbf-kube-api-access-jwtlx\") pod \"rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm\" (UID: \"b862e450-99e3-49af-a8e6-64e8ca694bbf\") " pod="ai-tenant-e2e-shared-a-6eef04/rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm"
Jul 29 05:00:24.648158 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:24.648148    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b862e450-99e3-49af-a8e6-64e8ca694bbf-dshm\") pod \"rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm\" (UID: \"b862e450-99e3-49af-a8e6-64e8ca694bbf\") " pod="ai-tenant-e2e-shared-a-6eef04/rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm"
Jul 29 05:00:24.648548 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:24.648180    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b862e450-99e3-49af-a8e6-64e8ca694bbf-home\") pod \"rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm\" (UID: \"b862e450-99e3-49af-a8e6-64e8ca694bbf\") " pod="ai-tenant-e2e-shared-a-6eef04/rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm"
Jul 29 05:00:24.655945 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:24.655918    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6eef04/rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm"]
Jul 29 05:00:24.749011 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:24.748976    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwtlx\" (UniqueName: \"kubernetes.io/projected/b862e450-99e3-49af-a8e6-64e8ca694bbf-kube-api-access-jwtlx\") pod \"rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm\" (UID: \"b862e450-99e3-49af-a8e6-64e8ca694bbf\") " pod="ai-tenant-e2e-shared-a-6eef04/rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm"
Jul 29 05:00:24.749011 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:24.749012    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b862e450-99e3-49af-a8e6-64e8ca694bbf-dshm\") pod \"rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm\" (UID: \"b862e450-99e3-49af-a8e6-64e8ca694bbf\") " pod="ai-tenant-e2e-shared-a-6eef04/rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm"
Jul 29 05:00:24.749191 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:24.749034    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b862e450-99e3-49af-a8e6-64e8ca694bbf-home\") pod \"rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm\" (UID: \"b862e450-99e3-49af-a8e6-64e8ca694bbf\") " pod="ai-tenant-e2e-shared-a-6eef04/rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm"
Jul 29 05:00:24.749191 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:24.749168    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b862e450-99e3-49af-a8e6-64e8ca694bbf-tmp-dir\") pod \"rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm\" (UID: \"b862e450-99e3-49af-a8e6-64e8ca694bbf\") " pod="ai-tenant-e2e-shared-a-6eef04/rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm"
Jul 29 05:00:24.749287 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:24.749213    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b862e450-99e3-49af-a8e6-64e8ca694bbf-model-cache\") pod \"rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm\" (UID: \"b862e450-99e3-49af-a8e6-64e8ca694bbf\") " pod="ai-tenant-e2e-shared-a-6eef04/rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm"
Jul 29 05:00:24.749374 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:24.749354    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b862e450-99e3-49af-a8e6-64e8ca694bbf-tls-certs\") pod \"rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm\" (UID: \"b862e450-99e3-49af-a8e6-64e8ca694bbf\") " pod="ai-tenant-e2e-shared-a-6eef04/rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm"
Jul 29 05:00:24.749438 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:24.749410    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b862e450-99e3-49af-a8e6-64e8ca694bbf-home\") pod \"rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm\" (UID: \"b862e450-99e3-49af-a8e6-64e8ca694bbf\") " pod="ai-tenant-e2e-shared-a-6eef04/rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm"
Jul 29 05:00:24.749546 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:24.749495    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b862e450-99e3-49af-a8e6-64e8ca694bbf-tmp-dir\") pod \"rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm\" (UID: \"b862e450-99e3-49af-a8e6-64e8ca694bbf\") " pod="ai-tenant-e2e-shared-a-6eef04/rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm"
Jul 29 05:00:24.749649 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:24.749629    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b862e450-99e3-49af-a8e6-64e8ca694bbf-model-cache\") pod \"rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm\" (UID: \"b862e450-99e3-49af-a8e6-64e8ca694bbf\") " pod="ai-tenant-e2e-shared-a-6eef04/rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm"
Jul 29 05:00:24.751608 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:24.751591    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b862e450-99e3-49af-a8e6-64e8ca694bbf-dshm\") pod \"rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm\" (UID: \"b862e450-99e3-49af-a8e6-64e8ca694bbf\") " pod="ai-tenant-e2e-shared-a-6eef04/rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm"
Jul 29 05:00:24.751759 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:24.751743    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b862e450-99e3-49af-a8e6-64e8ca694bbf-tls-certs\") pod \"rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm\" (UID: \"b862e450-99e3-49af-a8e6-64e8ca694bbf\") " pod="ai-tenant-e2e-shared-a-6eef04/rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm"
Jul 29 05:00:24.770285 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:24.770259    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwtlx\" (UniqueName: \"kubernetes.io/projected/b862e450-99e3-49af-a8e6-64e8ca694bbf-kube-api-access-jwtlx\") pod \"rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm\" (UID: \"b862e450-99e3-49af-a8e6-64e8ca694bbf\") " pod="ai-tenant-e2e-shared-a-6eef04/rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm"
Jul 29 05:00:24.952152 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:24.952057    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6eef04/rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm"
Jul 29 05:00:25.094978 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:25.094950    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6eef04/rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm"]
Jul 29 05:00:25.096649 ip-10-0-130-4 kubenswrapper[2572]: W0729 05:00:25.096622    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb862e450_99e3_49af_a8e6_64e8ca694bbf.slice/crio-7b29b7d61059eec6e586bf82284075e520cf0bb6afa9d5fa34ce915b9edb2dbd WatchSource:0}: Error finding container 7b29b7d61059eec6e586bf82284075e520cf0bb6afa9d5fa34ce915b9edb2dbd: Status 404 returned error can't find the container with id 7b29b7d61059eec6e586bf82284075e520cf0bb6afa9d5fa34ce915b9edb2dbd
Jul 29 05:00:25.255547 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:25.255440    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6eef04/rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm" event={"ID":"b862e450-99e3-49af-a8e6-64e8ca694bbf","Type":"ContainerStarted","Data":"486371babca431a862340c9b6374735231a0fad1d7c0b0072244cf61dc44b617"}
Jul 29 05:00:25.255547 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:25.255482    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6eef04/rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm" event={"ID":"b862e450-99e3-49af-a8e6-64e8ca694bbf","Type":"ContainerStarted","Data":"7b29b7d61059eec6e586bf82284075e520cf0bb6afa9d5fa34ce915b9edb2dbd"}
Jul 29 05:00:25.280549 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:25.280469    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-6eef04/rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm" podStartSLOduration=1.280452197 podStartE2EDuration="1.280452197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 05:00:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 05:00:25.278647829 +0000 UTC m=+3391.711685943" watchObservedRunningTime="2026-07-29 05:00:25.280452197 +0000 UTC m=+3391.713490341"
Jul 29 05:00:29.092104 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:29.092062    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 05:00:34.952810 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:34.952766    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-6eef04/rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm"
Jul 29 05:00:34.952810 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:34.952818    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-6eef04/rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm"
Jul 29 05:00:34.965876 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:34.965842    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-6eef04/rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm"
Jul 29 05:00:35.318712 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:35.318612    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-6eef04/rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm"
Jul 29 05:00:35.556519 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:35.556443    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-be8bc5/sub-test-model-be8bc5-kserve-787cc68df7-qn22h" podUID="35b83029-018c-442d-b87e-c976584fa634" containerName="main" containerID="cri-o://afdaf8cda2c8042946490d2cf23967491633f8d16322e14f2534036a76c0abd6" gracePeriod=45
Jul 29 05:00:35.816938 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:35.816915    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-be8bc5/sub-test-model-be8bc5-kserve-787cc68df7-qn22h"
Jul 29 05:00:35.857386 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:35.857351    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35b83029-018c-442d-b87e-c976584fa634-tmp-dir\") pod \"35b83029-018c-442d-b87e-c976584fa634\" (UID: \"35b83029-018c-442d-b87e-c976584fa634\") "
Jul 29 05:00:35.857586 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:35.857437    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35b83029-018c-442d-b87e-c976584fa634-dshm\") pod \"35b83029-018c-442d-b87e-c976584fa634\" (UID: \"35b83029-018c-442d-b87e-c976584fa634\") "
Jul 29 05:00:35.857586 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:35.857466    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35b83029-018c-442d-b87e-c976584fa634-model-cache\") pod \"35b83029-018c-442d-b87e-c976584fa634\" (UID: \"35b83029-018c-442d-b87e-c976584fa634\") "
Jul 29 05:00:35.857586 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:35.857493    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvqzr\" (UniqueName: \"kubernetes.io/projected/35b83029-018c-442d-b87e-c976584fa634-kube-api-access-cvqzr\") pod \"35b83029-018c-442d-b87e-c976584fa634\" (UID: \"35b83029-018c-442d-b87e-c976584fa634\") "
Jul 29 05:00:35.857779 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:35.857592    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35b83029-018c-442d-b87e-c976584fa634-tls-certs\") pod \"35b83029-018c-442d-b87e-c976584fa634\" (UID: \"35b83029-018c-442d-b87e-c976584fa634\") "
Jul 29 05:00:35.857779 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:35.857621    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35b83029-018c-442d-b87e-c976584fa634-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "35b83029-018c-442d-b87e-c976584fa634" (UID: "35b83029-018c-442d-b87e-c976584fa634"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:00:35.857779 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:35.857632    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35b83029-018c-442d-b87e-c976584fa634-home\") pod \"35b83029-018c-442d-b87e-c976584fa634\" (UID: \"35b83029-018c-442d-b87e-c976584fa634\") "
Jul 29 05:00:35.857779 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:35.857764    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35b83029-018c-442d-b87e-c976584fa634-model-cache" (OuterVolumeSpecName: "model-cache") pod "35b83029-018c-442d-b87e-c976584fa634" (UID: "35b83029-018c-442d-b87e-c976584fa634"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:00:35.858033 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:35.857869    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35b83029-018c-442d-b87e-c976584fa634-home" (OuterVolumeSpecName: "home") pod "35b83029-018c-442d-b87e-c976584fa634" (UID: "35b83029-018c-442d-b87e-c976584fa634"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:00:35.858126 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:35.858105    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35b83029-018c-442d-b87e-c976584fa634-home\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 05:00:35.858186 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:35.858131    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35b83029-018c-442d-b87e-c976584fa634-tmp-dir\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 05:00:35.858186 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:35.858145    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35b83029-018c-442d-b87e-c976584fa634-model-cache\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 05:00:35.859852 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:35.859819    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35b83029-018c-442d-b87e-c976584fa634-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "35b83029-018c-442d-b87e-c976584fa634" (UID: "35b83029-018c-442d-b87e-c976584fa634"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 05:00:35.859852 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:35.859840    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35b83029-018c-442d-b87e-c976584fa634-dshm" (OuterVolumeSpecName: "dshm") pod "35b83029-018c-442d-b87e-c976584fa634" (UID: "35b83029-018c-442d-b87e-c976584fa634"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:00:35.859999 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:35.859913    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35b83029-018c-442d-b87e-c976584fa634-kube-api-access-cvqzr" (OuterVolumeSpecName: "kube-api-access-cvqzr") pod "35b83029-018c-442d-b87e-c976584fa634" (UID: "35b83029-018c-442d-b87e-c976584fa634"). InnerVolumeSpecName "kube-api-access-cvqzr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 05:00:35.958773 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:35.958730    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35b83029-018c-442d-b87e-c976584fa634-dshm\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 05:00:35.958773 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:35.958767    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvqzr\" (UniqueName: \"kubernetes.io/projected/35b83029-018c-442d-b87e-c976584fa634-kube-api-access-cvqzr\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 05:00:35.958773 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:35.958780    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35b83029-018c-442d-b87e-c976584fa634-tls-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 05:00:36.312696 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:36.312654    2572 generic.go:356] "Generic (PLEG): container finished" podID="35b83029-018c-442d-b87e-c976584fa634" containerID="afdaf8cda2c8042946490d2cf23967491633f8d16322e14f2534036a76c0abd6" exitCode=0
Jul 29 05:00:36.312867 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:36.312711    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-be8bc5/sub-test-model-be8bc5-kserve-787cc68df7-qn22h"
Jul 29 05:00:36.312867 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:36.312745    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-be8bc5/sub-test-model-be8bc5-kserve-787cc68df7-qn22h" event={"ID":"35b83029-018c-442d-b87e-c976584fa634","Type":"ContainerDied","Data":"afdaf8cda2c8042946490d2cf23967491633f8d16322e14f2534036a76c0abd6"}
Jul 29 05:00:36.312867 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:36.312792    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-be8bc5/sub-test-model-be8bc5-kserve-787cc68df7-qn22h" event={"ID":"35b83029-018c-442d-b87e-c976584fa634","Type":"ContainerDied","Data":"d91503b00049268bac979d8ffe9567f93720f01fd38040f1f376568354c65ec5"}
Jul 29 05:00:36.312867 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:36.312810    2572 scope.go:117] "RemoveContainer" containerID="afdaf8cda2c8042946490d2cf23967491633f8d16322e14f2534036a76c0abd6"
Jul 29 05:00:36.321667 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:36.321648    2572 scope.go:117] "RemoveContainer" containerID="afdaf8cda2c8042946490d2cf23967491633f8d16322e14f2534036a76c0abd6"
Jul 29 05:00:36.321924 ip-10-0-130-4 kubenswrapper[2572]: E0729 05:00:36.321905    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afdaf8cda2c8042946490d2cf23967491633f8d16322e14f2534036a76c0abd6\": container with ID starting with afdaf8cda2c8042946490d2cf23967491633f8d16322e14f2534036a76c0abd6 not found: ID does not exist" containerID="afdaf8cda2c8042946490d2cf23967491633f8d16322e14f2534036a76c0abd6"
Jul 29 05:00:36.321974 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:36.321937    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afdaf8cda2c8042946490d2cf23967491633f8d16322e14f2534036a76c0abd6"} err="failed to get container status \"afdaf8cda2c8042946490d2cf23967491633f8d16322e14f2534036a76c0abd6\": rpc error: code = NotFound desc = could not find container \"afdaf8cda2c8042946490d2cf23967491633f8d16322e14f2534036a76c0abd6\": container with ID starting with afdaf8cda2c8042946490d2cf23967491633f8d16322e14f2534036a76c0abd6 not found: ID does not exist"
Jul 29 05:00:36.331682 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:36.331657    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-be8bc5/sub-test-model-be8bc5-kserve-787cc68df7-qn22h"]
Jul 29 05:00:36.338734 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:36.338714    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-be8bc5/sub-test-model-be8bc5-kserve-787cc68df7-qn22h"]
Jul 29 05:00:38.147829 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:38.147794    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35b83029-018c-442d-b87e-c976584fa634" path="/var/lib/kubelet/pods/35b83029-018c-442d-b87e-c976584fa634/volumes"
Jul 29 05:00:51.167943 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:51.167849    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-be8bc5/rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2"]
Jul 29 05:00:51.168300 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:51.168272    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35b83029-018c-442d-b87e-c976584fa634" containerName="main"
Jul 29 05:00:51.168353 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:51.168287    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="35b83029-018c-442d-b87e-c976584fa634" containerName="main"
Jul 29 05:00:51.168410 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:51.168397    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="35b83029-018c-442d-b87e-c976584fa634" containerName="main"
Jul 29 05:00:51.172929 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:51.172912    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-be8bc5/rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2"
Jul 29 05:00:51.177734 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:51.177714    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-be8bc5\"/\"rate-test-model-be8bc5-kserve-self-signed-certs\""
Jul 29 05:00:51.180731 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:51.180715    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-be8bc5\"/\"openshift-service-ca.crt\""
Jul 29 05:00:51.180984 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:51.180968    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-be8bc5\"/\"default-dockercfg-ddrn9\""
Jul 29 05:00:51.182231 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:51.182216    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-be8bc5\"/\"kube-root-ca.crt\""
Jul 29 05:00:51.195972 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:51.195945    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-be8bc5/rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2"]
Jul 29 05:00:51.303131 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:51.303088    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb94aeb6-0976-42b4-86ee-073d7ac1d8ac-tmp-dir\") pod \"rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2\" (UID: \"eb94aeb6-0976-42b4-86ee-073d7ac1d8ac\") " pod="ai-tenant-e2e-shared-b-be8bc5/rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2"
Jul 29 05:00:51.303131 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:51.303130    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb94aeb6-0976-42b4-86ee-073d7ac1d8ac-tls-certs\") pod \"rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2\" (UID: \"eb94aeb6-0976-42b4-86ee-073d7ac1d8ac\") " pod="ai-tenant-e2e-shared-b-be8bc5/rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2"
Jul 29 05:00:51.303384 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:51.303197    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lqbc\" (UniqueName: \"kubernetes.io/projected/eb94aeb6-0976-42b4-86ee-073d7ac1d8ac-kube-api-access-8lqbc\") pod \"rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2\" (UID: \"eb94aeb6-0976-42b4-86ee-073d7ac1d8ac\") " pod="ai-tenant-e2e-shared-b-be8bc5/rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2"
Jul 29 05:00:51.303384 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:51.303263    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb94aeb6-0976-42b4-86ee-073d7ac1d8ac-home\") pod \"rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2\" (UID: \"eb94aeb6-0976-42b4-86ee-073d7ac1d8ac\") " pod="ai-tenant-e2e-shared-b-be8bc5/rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2"
Jul 29 05:00:51.303384 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:51.303304    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb94aeb6-0976-42b4-86ee-073d7ac1d8ac-model-cache\") pod \"rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2\" (UID: \"eb94aeb6-0976-42b4-86ee-073d7ac1d8ac\") " pod="ai-tenant-e2e-shared-b-be8bc5/rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2"
Jul 29 05:00:51.303579 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:51.303437    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb94aeb6-0976-42b4-86ee-073d7ac1d8ac-dshm\") pod \"rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2\" (UID: \"eb94aeb6-0976-42b4-86ee-073d7ac1d8ac\") " pod="ai-tenant-e2e-shared-b-be8bc5/rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2"
Jul 29 05:00:51.404159 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:51.404126    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb94aeb6-0976-42b4-86ee-073d7ac1d8ac-tmp-dir\") pod \"rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2\" (UID: \"eb94aeb6-0976-42b4-86ee-073d7ac1d8ac\") " pod="ai-tenant-e2e-shared-b-be8bc5/rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2"
Jul 29 05:00:51.404159 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:51.404159    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb94aeb6-0976-42b4-86ee-073d7ac1d8ac-tls-certs\") pod \"rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2\" (UID: \"eb94aeb6-0976-42b4-86ee-073d7ac1d8ac\") " pod="ai-tenant-e2e-shared-b-be8bc5/rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2"
Jul 29 05:00:51.404382 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:51.404188    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lqbc\" (UniqueName: \"kubernetes.io/projected/eb94aeb6-0976-42b4-86ee-073d7ac1d8ac-kube-api-access-8lqbc\") pod \"rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2\" (UID: \"eb94aeb6-0976-42b4-86ee-073d7ac1d8ac\") " pod="ai-tenant-e2e-shared-b-be8bc5/rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2"
Jul 29 05:00:51.404382 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:51.404213    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb94aeb6-0976-42b4-86ee-073d7ac1d8ac-home\") pod \"rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2\" (UID: \"eb94aeb6-0976-42b4-86ee-073d7ac1d8ac\") " pod="ai-tenant-e2e-shared-b-be8bc5/rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2"
Jul 29 05:00:51.404382 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:51.404258    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb94aeb6-0976-42b4-86ee-073d7ac1d8ac-model-cache\") pod \"rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2\" (UID: \"eb94aeb6-0976-42b4-86ee-073d7ac1d8ac\") " pod="ai-tenant-e2e-shared-b-be8bc5/rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2"
Jul 29 05:00:51.404554 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:51.404422    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb94aeb6-0976-42b4-86ee-073d7ac1d8ac-dshm\") pod \"rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2\" (UID: \"eb94aeb6-0976-42b4-86ee-073d7ac1d8ac\") " pod="ai-tenant-e2e-shared-b-be8bc5/rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2"
Jul 29 05:00:51.404598 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:51.404587    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb94aeb6-0976-42b4-86ee-073d7ac1d8ac-tmp-dir\") pod \"rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2\" (UID: \"eb94aeb6-0976-42b4-86ee-073d7ac1d8ac\") " pod="ai-tenant-e2e-shared-b-be8bc5/rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2"
Jul 29 05:00:51.404644 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:51.404631    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb94aeb6-0976-42b4-86ee-073d7ac1d8ac-home\") pod \"rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2\" (UID: \"eb94aeb6-0976-42b4-86ee-073d7ac1d8ac\") " pod="ai-tenant-e2e-shared-b-be8bc5/rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2"
Jul 29 05:00:51.404704 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:51.404677    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb94aeb6-0976-42b4-86ee-073d7ac1d8ac-model-cache\") pod \"rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2\" (UID: \"eb94aeb6-0976-42b4-86ee-073d7ac1d8ac\") " pod="ai-tenant-e2e-shared-b-be8bc5/rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2"
Jul 29 05:00:51.406808 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:51.406782    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb94aeb6-0976-42b4-86ee-073d7ac1d8ac-dshm\") pod \"rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2\" (UID: \"eb94aeb6-0976-42b4-86ee-073d7ac1d8ac\") " pod="ai-tenant-e2e-shared-b-be8bc5/rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2"
Jul 29 05:00:51.406972 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:51.406955    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb94aeb6-0976-42b4-86ee-073d7ac1d8ac-tls-certs\") pod \"rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2\" (UID: \"eb94aeb6-0976-42b4-86ee-073d7ac1d8ac\") " pod="ai-tenant-e2e-shared-b-be8bc5/rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2"
Jul 29 05:00:51.413835 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:51.413809    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lqbc\" (UniqueName: \"kubernetes.io/projected/eb94aeb6-0976-42b4-86ee-073d7ac1d8ac-kube-api-access-8lqbc\") pod \"rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2\" (UID: \"eb94aeb6-0976-42b4-86ee-073d7ac1d8ac\") " pod="ai-tenant-e2e-shared-b-be8bc5/rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2"
Jul 29 05:00:51.481758 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:51.481665    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-be8bc5/rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2"
Jul 29 05:00:51.624801 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:51.624776    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-be8bc5/rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2"]
Jul 29 05:00:51.627154 ip-10-0-130-4 kubenswrapper[2572]: W0729 05:00:51.627119    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeb94aeb6_0976_42b4_86ee_073d7ac1d8ac.slice/crio-a2e29599a5902b3a1e53d9aea39ec3831041c3ef14305ee28839e066410899ca WatchSource:0}: Error finding container a2e29599a5902b3a1e53d9aea39ec3831041c3ef14305ee28839e066410899ca: Status 404 returned error can't find the container with id a2e29599a5902b3a1e53d9aea39ec3831041c3ef14305ee28839e066410899ca
Jul 29 05:00:52.397096 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:52.397055    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-be8bc5/rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2" event={"ID":"eb94aeb6-0976-42b4-86ee-073d7ac1d8ac","Type":"ContainerStarted","Data":"5e15a1b7c974925ae183737c5546676dcd3c85ad94207bf290d132de99f5c084"}
Jul 29 05:00:52.397096 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:52.397101    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-be8bc5/rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2" event={"ID":"eb94aeb6-0976-42b4-86ee-073d7ac1d8ac","Type":"ContainerStarted","Data":"a2e29599a5902b3a1e53d9aea39ec3831041c3ef14305ee28839e066410899ca"}
Jul 29 05:00:52.437094 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:52.437035    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-be8bc5/rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2" podStartSLOduration=1.437020559 podStartE2EDuration="1.437020559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 05:00:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 05:00:52.435579437 +0000 UTC m=+3418.868617550" watchObservedRunningTime="2026-07-29 05:00:52.437020559 +0000 UTC m=+3418.870058706"
Jul 29 05:00:54.995069 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:00:54.995031    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 05:01:01.482055 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:01:01.482012    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-be8bc5/rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2"
Jul 29 05:01:01.482427 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:01:01.482074    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-be8bc5/rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2"
Jul 29 05:01:01.494842 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:01:01.494815    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-be8bc5/rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2"
Jul 29 05:01:02.456860 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:01:02.456830    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-be8bc5/rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2"
Jul 29 05:01:39.382286 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:01:39.382244    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 05:01:53.685021 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:01:53.684983    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 05:02:20.981352 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:20.981316    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 05:02:27.437790 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:27.437756    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6eef04/rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm"]
Jul 29 05:02:28.302942 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:28.302902    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-be8bc5/rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2"]
Jul 29 05:02:29.227484 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:29.227448    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7546-139922289503024"]
Jul 29 05:02:29.230904 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:29.230885    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139922289503024"
Jul 29 05:02:29.233300 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:29.233278    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-djt7j\""
Jul 29 05:02:29.237192 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:29.237166    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7546-139922289503024"]
Jul 29 05:02:29.315094 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:29.315058    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h79dr\" (UniqueName: \"kubernetes.io/projected/9538d61e-275f-430d-b836-750fe7de3a38-kube-api-access-h79dr\") pod \"test-curl-7546-139922289503024\" (UID: \"9538d61e-275f-430d-b836-750fe7de3a38\") " pod="opendatahub/test-curl-7546-139922289503024"
Jul 29 05:02:29.416126 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:29.416095    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h79dr\" (UniqueName: \"kubernetes.io/projected/9538d61e-275f-430d-b836-750fe7de3a38-kube-api-access-h79dr\") pod \"test-curl-7546-139922289503024\" (UID: \"9538d61e-275f-430d-b836-750fe7de3a38\") " pod="opendatahub/test-curl-7546-139922289503024"
Jul 29 05:02:29.423553 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:29.423531    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h79dr\" (UniqueName: \"kubernetes.io/projected/9538d61e-275f-430d-b836-750fe7de3a38-kube-api-access-h79dr\") pod \"test-curl-7546-139922289503024\" (UID: \"9538d61e-275f-430d-b836-750fe7de3a38\") " pod="opendatahub/test-curl-7546-139922289503024"
Jul 29 05:02:29.542105 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:29.542015    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139922289503024"
Jul 29 05:02:29.674791 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:29.674765    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7546-139922289503024"]
Jul 29 05:02:29.677146 ip-10-0-130-4 kubenswrapper[2572]: W0729 05:02:29.677120    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9538d61e_275f_430d_b836_750fe7de3a38.slice/crio-5c78977ba142e3ae8bca30845e0e6ac4c256666de0d8828467eb5fe32f37bb6d WatchSource:0}: Error finding container 5c78977ba142e3ae8bca30845e0e6ac4c256666de0d8828467eb5fe32f37bb6d: Status 404 returned error can't find the container with id 5c78977ba142e3ae8bca30845e0e6ac4c256666de0d8828467eb5fe32f37bb6d
Jul 29 05:02:29.678465 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:29.678448    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 05:02:29.888679 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:29.888639    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7546-139922289503024" event={"ID":"9538d61e-275f-430d-b836-750fe7de3a38","Type":"ContainerStarted","Data":"5c78977ba142e3ae8bca30845e0e6ac4c256666de0d8828467eb5fe32f37bb6d"}
Jul 29 05:02:30.897305 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:30.897273    2572 generic.go:356] "Generic (PLEG): container finished" podID="9538d61e-275f-430d-b836-750fe7de3a38" containerID="6bdbc425fb12589a44f646167ffc7d4f7238d623ae3e2e2231eb05b94b425963" exitCode=0
Jul 29 05:02:30.897708 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:30.897354    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7546-139922289503024" event={"ID":"9538d61e-275f-430d-b836-750fe7de3a38","Type":"ContainerDied","Data":"6bdbc425fb12589a44f646167ffc7d4f7238d623ae3e2e2231eb05b94b425963"}
Jul 29 05:02:32.038414 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:32.038382    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139922289503024"
Jul 29 05:02:32.071097 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:32.071072    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7546-139922289503024_9538d61e-275f-430d-b836-750fe7de3a38/test-curl-7546-139922289503024/0.log"
Jul 29 05:02:32.091839 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:32.091807    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7546-139922289503024"]
Jul 29 05:02:32.095720 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:32.095694    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7546-139922289503024"]
Jul 29 05:02:32.140890 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:32.140868    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h79dr\" (UniqueName: \"kubernetes.io/projected/9538d61e-275f-430d-b836-750fe7de3a38-kube-api-access-h79dr\") pod \"9538d61e-275f-430d-b836-750fe7de3a38\" (UID: \"9538d61e-275f-430d-b836-750fe7de3a38\") "
Jul 29 05:02:32.143166 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:32.143133    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9538d61e-275f-430d-b836-750fe7de3a38-kube-api-access-h79dr" (OuterVolumeSpecName: "kube-api-access-h79dr") pod "9538d61e-275f-430d-b836-750fe7de3a38" (UID: "9538d61e-275f-430d-b836-750fe7de3a38"). InnerVolumeSpecName "kube-api-access-h79dr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 05:02:32.148469 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:32.148446    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9538d61e-275f-430d-b836-750fe7de3a38" path="/var/lib/kubelet/pods/9538d61e-275f-430d-b836-750fe7de3a38/volumes"
Jul 29 05:02:32.216522 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:32.216486    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7546-139922289455536"]
Jul 29 05:02:32.216883 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:32.216870    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9538d61e-275f-430d-b836-750fe7de3a38" containerName="test-curl-7546-139922289503024"
Jul 29 05:02:32.216934 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:32.216884    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9538d61e-275f-430d-b836-750fe7de3a38" containerName="test-curl-7546-139922289503024"
Jul 29 05:02:32.216975 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:32.216953    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="9538d61e-275f-430d-b836-750fe7de3a38" containerName="test-curl-7546-139922289503024"
Jul 29 05:02:32.220116 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:32.220100    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139922289455536"
Jul 29 05:02:32.224248 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:32.224226    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7546-139922289455536"]
Jul 29 05:02:32.241907 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:32.241886    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpl5m\" (UniqueName: \"kubernetes.io/projected/d5328858-8433-477f-aa81-5433ab53c3fc-kube-api-access-wpl5m\") pod \"test-curl-7546-139922289455536\" (UID: \"d5328858-8433-477f-aa81-5433ab53c3fc\") " pod="opendatahub/test-curl-7546-139922289455536"
Jul 29 05:02:32.242012 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:32.241937    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h79dr\" (UniqueName: \"kubernetes.io/projected/9538d61e-275f-430d-b836-750fe7de3a38-kube-api-access-h79dr\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 05:02:32.343181 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:32.343152    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpl5m\" (UniqueName: \"kubernetes.io/projected/d5328858-8433-477f-aa81-5433ab53c3fc-kube-api-access-wpl5m\") pod \"test-curl-7546-139922289455536\" (UID: \"d5328858-8433-477f-aa81-5433ab53c3fc\") " pod="opendatahub/test-curl-7546-139922289455536"
Jul 29 05:02:32.350588 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:32.350557    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpl5m\" (UniqueName: \"kubernetes.io/projected/d5328858-8433-477f-aa81-5433ab53c3fc-kube-api-access-wpl5m\") pod \"test-curl-7546-139922289455536\" (UID: \"d5328858-8433-477f-aa81-5433ab53c3fc\") " pod="opendatahub/test-curl-7546-139922289455536"
Jul 29 05:02:32.530371 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:32.530292    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139922289455536"
Jul 29 05:02:32.662023 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:32.661978    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7546-139922289455536"]
Jul 29 05:02:32.664809 ip-10-0-130-4 kubenswrapper[2572]: W0729 05:02:32.664781    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd5328858_8433_477f_aa81_5433ab53c3fc.slice/crio-35ad09d5ad7728a6a3d2ad2be1dd002118943dfc5a85a1db9a28e97317e2bb39 WatchSource:0}: Error finding container 35ad09d5ad7728a6a3d2ad2be1dd002118943dfc5a85a1db9a28e97317e2bb39: Status 404 returned error can't find the container with id 35ad09d5ad7728a6a3d2ad2be1dd002118943dfc5a85a1db9a28e97317e2bb39
Jul 29 05:02:32.908668 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:32.908627    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139922289503024"
Jul 29 05:02:32.908858 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:32.908628    2572 scope.go:117] "RemoveContainer" containerID="6bdbc425fb12589a44f646167ffc7d4f7238d623ae3e2e2231eb05b94b425963"
Jul 29 05:02:32.910110 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:32.909914    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7546-139922289455536" event={"ID":"d5328858-8433-477f-aa81-5433ab53c3fc","Type":"ContainerStarted","Data":"35ad09d5ad7728a6a3d2ad2be1dd002118943dfc5a85a1db9a28e97317e2bb39"}
Jul 29 05:02:33.917521 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:33.917469    2572 generic.go:356] "Generic (PLEG): container finished" podID="d5328858-8433-477f-aa81-5433ab53c3fc" containerID="e7d9be083e0ae537738f9e542f6025028b709e977661b0e1fbb1282d5e974dae" exitCode=0
Jul 29 05:02:33.917911 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:33.917557    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7546-139922289455536" event={"ID":"d5328858-8433-477f-aa81-5433ab53c3fc","Type":"ContainerDied","Data":"e7d9be083e0ae537738f9e542f6025028b709e977661b0e1fbb1282d5e974dae"}
Jul 29 05:02:35.062716 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:35.062692    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139922289455536"
Jul 29 05:02:35.081964 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:35.081944    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7546-139922289455536_d5328858-8433-477f-aa81-5433ab53c3fc/test-curl-7546-139922289455536/0.log"
Jul 29 05:02:35.106163 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:35.106135    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7546-139922289455536"]
Jul 29 05:02:35.109623 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:35.109602    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7546-139922289455536"]
Jul 29 05:02:35.167600 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:35.167573    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpl5m\" (UniqueName: \"kubernetes.io/projected/d5328858-8433-477f-aa81-5433ab53c3fc-kube-api-access-wpl5m\") pod \"d5328858-8433-477f-aa81-5433ab53c3fc\" (UID: \"d5328858-8433-477f-aa81-5433ab53c3fc\") "
Jul 29 05:02:35.169995 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:35.169962    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5328858-8433-477f-aa81-5433ab53c3fc-kube-api-access-wpl5m" (OuterVolumeSpecName: "kube-api-access-wpl5m") pod "d5328858-8433-477f-aa81-5433ab53c3fc" (UID: "d5328858-8433-477f-aa81-5433ab53c3fc"). InnerVolumeSpecName "kube-api-access-wpl5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 05:02:35.176208 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:35.176186    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 05:02:35.269356 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:35.269337    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpl5m\" (UniqueName: \"kubernetes.io/projected/d5328858-8433-477f-aa81-5433ab53c3fc-kube-api-access-wpl5m\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 05:02:35.929035 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:35.929006    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139922289455536"
Jul 29 05:02:35.929035 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:35.929028    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="35ad09d5ad7728a6a3d2ad2be1dd002118943dfc5a85a1db9a28e97317e2bb39"
Jul 29 05:02:35.938555 ip-10-0-130-4 kubenswrapper[2572]: E0729 05:02:35.938528    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7546-139922289455536\" is forbidden: User \"system:node:ip-10-0-130-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-4.ec2.internal' and this object" podUID="d5328858-8433-477f-aa81-5433ab53c3fc" pod="opendatahub/test-curl-7546-139922289455536"
Jul 29 05:02:36.147788 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:36.147756    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5328858-8433-477f-aa81-5433ab53c3fc" path="/var/lib/kubelet/pods/d5328858-8433-477f-aa81-5433ab53c3fc/volumes"
Jul 29 05:02:38.258601 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:38.258566    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7546-139922289587376"]
Jul 29 05:02:38.259034 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:38.258969    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5328858-8433-477f-aa81-5433ab53c3fc" containerName="test-curl-7546-139922289455536"
Jul 29 05:02:38.259034 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:38.258985    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5328858-8433-477f-aa81-5433ab53c3fc" containerName="test-curl-7546-139922289455536"
Jul 29 05:02:38.259166 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:38.259078    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5328858-8433-477f-aa81-5433ab53c3fc" containerName="test-curl-7546-139922289455536"
Jul 29 05:02:38.262234 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:38.262218    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139922289587376"
Jul 29 05:02:38.265012 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:38.264979    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-djt7j\""
Jul 29 05:02:38.276535 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:38.276495    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7546-139922289587376"]
Jul 29 05:02:38.296947 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:38.296916    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlc4k\" (UniqueName: \"kubernetes.io/projected/d9258f0e-3260-437c-9846-f9c651fdf200-kube-api-access-dlc4k\") pod \"test-curl-7546-139922289587376\" (UID: \"d9258f0e-3260-437c-9846-f9c651fdf200\") " pod="opendatahub/test-curl-7546-139922289587376"
Jul 29 05:02:38.398275 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:38.398246    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlc4k\" (UniqueName: \"kubernetes.io/projected/d9258f0e-3260-437c-9846-f9c651fdf200-kube-api-access-dlc4k\") pod \"test-curl-7546-139922289587376\" (UID: \"d9258f0e-3260-437c-9846-f9c651fdf200\") " pod="opendatahub/test-curl-7546-139922289587376"
Jul 29 05:02:38.406295 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:38.406267    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlc4k\" (UniqueName: \"kubernetes.io/projected/d9258f0e-3260-437c-9846-f9c651fdf200-kube-api-access-dlc4k\") pod \"test-curl-7546-139922289587376\" (UID: \"d9258f0e-3260-437c-9846-f9c651fdf200\") " pod="opendatahub/test-curl-7546-139922289587376"
Jul 29 05:02:38.571005 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:38.570939    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139922289587376"
Jul 29 05:02:38.703230 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:38.703155    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7546-139922289587376"]
Jul 29 05:02:38.705597 ip-10-0-130-4 kubenswrapper[2572]: W0729 05:02:38.705570    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd9258f0e_3260_437c_9846_f9c651fdf200.slice/crio-a7f13dff54c2b9deaa4a5047533a9e2e0b27c2211c794eb2672713d58a825d3a WatchSource:0}: Error finding container a7f13dff54c2b9deaa4a5047533a9e2e0b27c2211c794eb2672713d58a825d3a: Status 404 returned error can't find the container with id a7f13dff54c2b9deaa4a5047533a9e2e0b27c2211c794eb2672713d58a825d3a
Jul 29 05:02:38.944879 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:38.944846    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7546-139922289587376" event={"ID":"d9258f0e-3260-437c-9846-f9c651fdf200","Type":"ContainerStarted","Data":"a7f13dff54c2b9deaa4a5047533a9e2e0b27c2211c794eb2672713d58a825d3a"}
Jul 29 05:02:39.951029 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:39.950990    2572 generic.go:356] "Generic (PLEG): container finished" podID="d9258f0e-3260-437c-9846-f9c651fdf200" containerID="ac3a749789bfd185a1a9813d2de2f369ce095ee16256e7f78cf99ef1b448815e" exitCode=0
Jul 29 05:02:39.951408 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:39.951066    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7546-139922289587376" event={"ID":"d9258f0e-3260-437c-9846-f9c651fdf200","Type":"ContainerDied","Data":"ac3a749789bfd185a1a9813d2de2f369ce095ee16256e7f78cf99ef1b448815e"}
Jul 29 05:02:41.090121 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:41.090099    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139922289587376"
Jul 29 05:02:41.108237 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:41.108211    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7546-139922289587376_d9258f0e-3260-437c-9846-f9c651fdf200/test-curl-7546-139922289587376/0.log"
Jul 29 05:02:41.123457 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:41.123429    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlc4k\" (UniqueName: \"kubernetes.io/projected/d9258f0e-3260-437c-9846-f9c651fdf200-kube-api-access-dlc4k\") pod \"d9258f0e-3260-437c-9846-f9c651fdf200\" (UID: \"d9258f0e-3260-437c-9846-f9c651fdf200\") "
Jul 29 05:02:41.125572 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:41.125545    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9258f0e-3260-437c-9846-f9c651fdf200-kube-api-access-dlc4k" (OuterVolumeSpecName: "kube-api-access-dlc4k") pod "d9258f0e-3260-437c-9846-f9c651fdf200" (UID: "d9258f0e-3260-437c-9846-f9c651fdf200"). InnerVolumeSpecName "kube-api-access-dlc4k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 05:02:41.130180 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:41.130155    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7546-139922289587376"]
Jul 29 05:02:41.133185 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:41.133160    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7546-139922289587376"]
Jul 29 05:02:41.228288 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:41.225386    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlc4k\" (UniqueName: \"kubernetes.io/projected/d9258f0e-3260-437c-9846-f9c651fdf200-kube-api-access-dlc4k\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 05:02:41.247536 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:41.247489    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7546-139922289588384"]
Jul 29 05:02:41.247931 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:41.247913    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9258f0e-3260-437c-9846-f9c651fdf200" containerName="test-curl-7546-139922289587376"
Jul 29 05:02:41.248015 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:41.247934    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9258f0e-3260-437c-9846-f9c651fdf200" containerName="test-curl-7546-139922289587376"
Jul 29 05:02:41.248073 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:41.248060    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9258f0e-3260-437c-9846-f9c651fdf200" containerName="test-curl-7546-139922289587376"
Jul 29 05:02:41.250994 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:41.250977    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139922289588384"
Jul 29 05:02:41.256336 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:41.256316    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7546-139922289588384"]
Jul 29 05:02:41.325858 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:41.325814    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n6tk\" (UniqueName: \"kubernetes.io/projected/5244efa1-0038-4725-8821-872f0bbfecc5-kube-api-access-7n6tk\") pod \"test-curl-7546-139922289588384\" (UID: \"5244efa1-0038-4725-8821-872f0bbfecc5\") " pod="opendatahub/test-curl-7546-139922289588384"
Jul 29 05:02:41.426861 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:41.426831    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n6tk\" (UniqueName: \"kubernetes.io/projected/5244efa1-0038-4725-8821-872f0bbfecc5-kube-api-access-7n6tk\") pod \"test-curl-7546-139922289588384\" (UID: \"5244efa1-0038-4725-8821-872f0bbfecc5\") " pod="opendatahub/test-curl-7546-139922289588384"
Jul 29 05:02:41.435027 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:41.434995    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n6tk\" (UniqueName: \"kubernetes.io/projected/5244efa1-0038-4725-8821-872f0bbfecc5-kube-api-access-7n6tk\") pod \"test-curl-7546-139922289588384\" (UID: \"5244efa1-0038-4725-8821-872f0bbfecc5\") " pod="opendatahub/test-curl-7546-139922289588384"
Jul 29 05:02:41.560870 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:41.560796    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139922289588384"
Jul 29 05:02:41.689869 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:41.689838    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7546-139922289588384"]
Jul 29 05:02:41.692979 ip-10-0-130-4 kubenswrapper[2572]: W0729 05:02:41.692947    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5244efa1_0038_4725_8821_872f0bbfecc5.slice/crio-57a4a1e6b9ce15e00d4cd620d0adb442f48e3f05628d7410e919e978d40d98e7 WatchSource:0}: Error finding container 57a4a1e6b9ce15e00d4cd620d0adb442f48e3f05628d7410e919e978d40d98e7: Status 404 returned error can't find the container with id 57a4a1e6b9ce15e00d4cd620d0adb442f48e3f05628d7410e919e978d40d98e7
Jul 29 05:02:41.962005 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:41.961966    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7546-139922289588384" event={"ID":"5244efa1-0038-4725-8821-872f0bbfecc5","Type":"ContainerStarted","Data":"57a4a1e6b9ce15e00d4cd620d0adb442f48e3f05628d7410e919e978d40d98e7"}
Jul 29 05:02:41.963265 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:41.963236    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a7f13dff54c2b9deaa4a5047533a9e2e0b27c2211c794eb2672713d58a825d3a"
Jul 29 05:02:41.963377 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:41.963283    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139922289587376"
Jul 29 05:02:41.974396 ip-10-0-130-4 kubenswrapper[2572]: E0729 05:02:41.974370    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7546-139922289587376\" is forbidden: User \"system:node:ip-10-0-130-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-4.ec2.internal' and this object" podUID="d9258f0e-3260-437c-9846-f9c651fdf200" pod="opendatahub/test-curl-7546-139922289587376"
Jul 29 05:02:42.148319 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:42.148293    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9258f0e-3260-437c-9846-f9c651fdf200" path="/var/lib/kubelet/pods/d9258f0e-3260-437c-9846-f9c651fdf200/volumes"
Jul 29 05:02:42.456955 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:42.456917    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-6eef04/rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm" podUID="b862e450-99e3-49af-a8e6-64e8ca694bbf" containerName="main" containerID="cri-o://486371babca431a862340c9b6374735231a0fad1d7c0b0072244cf61dc44b617" gracePeriod=45
Jul 29 05:02:42.705691 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:42.705662    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6eef04/rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm"
Jul 29 05:02:42.739962 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:42.739902    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b862e450-99e3-49af-a8e6-64e8ca694bbf-dshm\") pod \"b862e450-99e3-49af-a8e6-64e8ca694bbf\" (UID: \"b862e450-99e3-49af-a8e6-64e8ca694bbf\") "
Jul 29 05:02:42.740077 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:42.739980    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwtlx\" (UniqueName: \"kubernetes.io/projected/b862e450-99e3-49af-a8e6-64e8ca694bbf-kube-api-access-jwtlx\") pod \"b862e450-99e3-49af-a8e6-64e8ca694bbf\" (UID: \"b862e450-99e3-49af-a8e6-64e8ca694bbf\") "
Jul 29 05:02:42.740077 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:42.740022    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b862e450-99e3-49af-a8e6-64e8ca694bbf-model-cache\") pod \"b862e450-99e3-49af-a8e6-64e8ca694bbf\" (UID: \"b862e450-99e3-49af-a8e6-64e8ca694bbf\") "
Jul 29 05:02:42.740185 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:42.740099    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b862e450-99e3-49af-a8e6-64e8ca694bbf-tls-certs\") pod \"b862e450-99e3-49af-a8e6-64e8ca694bbf\" (UID: \"b862e450-99e3-49af-a8e6-64e8ca694bbf\") "
Jul 29 05:02:42.740185 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:42.740123    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b862e450-99e3-49af-a8e6-64e8ca694bbf-tmp-dir\") pod \"b862e450-99e3-49af-a8e6-64e8ca694bbf\" (UID: \"b862e450-99e3-49af-a8e6-64e8ca694bbf\") "
Jul 29 05:02:42.740284 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:42.740221    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b862e450-99e3-49af-a8e6-64e8ca694bbf-home\") pod \"b862e450-99e3-49af-a8e6-64e8ca694bbf\" (UID: \"b862e450-99e3-49af-a8e6-64e8ca694bbf\") "
Jul 29 05:02:42.740378 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:42.740350    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b862e450-99e3-49af-a8e6-64e8ca694bbf-model-cache" (OuterVolumeSpecName: "model-cache") pod "b862e450-99e3-49af-a8e6-64e8ca694bbf" (UID: "b862e450-99e3-49af-a8e6-64e8ca694bbf"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:02:42.740378 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:42.740365    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b862e450-99e3-49af-a8e6-64e8ca694bbf-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b862e450-99e3-49af-a8e6-64e8ca694bbf" (UID: "b862e450-99e3-49af-a8e6-64e8ca694bbf"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:02:42.740609 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:42.740575    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b862e450-99e3-49af-a8e6-64e8ca694bbf-home" (OuterVolumeSpecName: "home") pod "b862e450-99e3-49af-a8e6-64e8ca694bbf" (UID: "b862e450-99e3-49af-a8e6-64e8ca694bbf"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:02:42.740895 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:42.740662    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b862e450-99e3-49af-a8e6-64e8ca694bbf-model-cache\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 05:02:42.740895 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:42.740683    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b862e450-99e3-49af-a8e6-64e8ca694bbf-tmp-dir\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 05:02:42.742183 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:42.742165    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b862e450-99e3-49af-a8e6-64e8ca694bbf-dshm" (OuterVolumeSpecName: "dshm") pod "b862e450-99e3-49af-a8e6-64e8ca694bbf" (UID: "b862e450-99e3-49af-a8e6-64e8ca694bbf"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:02:42.742278 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:42.742254    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b862e450-99e3-49af-a8e6-64e8ca694bbf-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b862e450-99e3-49af-a8e6-64e8ca694bbf" (UID: "b862e450-99e3-49af-a8e6-64e8ca694bbf"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 05:02:42.742618 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:42.742602    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b862e450-99e3-49af-a8e6-64e8ca694bbf-kube-api-access-jwtlx" (OuterVolumeSpecName: "kube-api-access-jwtlx") pod "b862e450-99e3-49af-a8e6-64e8ca694bbf" (UID: "b862e450-99e3-49af-a8e6-64e8ca694bbf"). InnerVolumeSpecName "kube-api-access-jwtlx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 05:02:42.841916 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:42.841880    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwtlx\" (UniqueName: \"kubernetes.io/projected/b862e450-99e3-49af-a8e6-64e8ca694bbf-kube-api-access-jwtlx\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 05:02:42.841916 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:42.841913    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b862e450-99e3-49af-a8e6-64e8ca694bbf-tls-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 05:02:42.841916 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:42.841924    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b862e450-99e3-49af-a8e6-64e8ca694bbf-home\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 05:02:42.842137 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:42.841931    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b862e450-99e3-49af-a8e6-64e8ca694bbf-dshm\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 05:02:42.969794 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:42.969763    2572 generic.go:356] "Generic (PLEG): container finished" podID="b862e450-99e3-49af-a8e6-64e8ca694bbf" containerID="486371babca431a862340c9b6374735231a0fad1d7c0b0072244cf61dc44b617" exitCode=0
Jul 29 05:02:42.969958 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:42.969808    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6eef04/rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm"
Jul 29 05:02:42.969958 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:42.969856    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6eef04/rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm" event={"ID":"b862e450-99e3-49af-a8e6-64e8ca694bbf","Type":"ContainerDied","Data":"486371babca431a862340c9b6374735231a0fad1d7c0b0072244cf61dc44b617"}
Jul 29 05:02:42.969958 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:42.969903    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6eef04/rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm" event={"ID":"b862e450-99e3-49af-a8e6-64e8ca694bbf","Type":"ContainerDied","Data":"7b29b7d61059eec6e586bf82284075e520cf0bb6afa9d5fa34ce915b9edb2dbd"}
Jul 29 05:02:42.969958 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:42.969926    2572 scope.go:117] "RemoveContainer" containerID="486371babca431a862340c9b6374735231a0fad1d7c0b0072244cf61dc44b617"
Jul 29 05:02:42.971473 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:42.971442    2572 generic.go:356] "Generic (PLEG): container finished" podID="5244efa1-0038-4725-8821-872f0bbfecc5" containerID="f4d32df5deb50e6816a65d1605fc43db32218ec4df54f7e4ccdc4ec6c49f4708" exitCode=0
Jul 29 05:02:42.971620 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:42.971536    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7546-139922289588384" event={"ID":"5244efa1-0038-4725-8821-872f0bbfecc5","Type":"ContainerDied","Data":"f4d32df5deb50e6816a65d1605fc43db32218ec4df54f7e4ccdc4ec6c49f4708"}
Jul 29 05:02:42.979396 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:42.979377    2572 scope.go:117] "RemoveContainer" containerID="486371babca431a862340c9b6374735231a0fad1d7c0b0072244cf61dc44b617"
Jul 29 05:02:42.979655 ip-10-0-130-4 kubenswrapper[2572]: E0729 05:02:42.979638    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"486371babca431a862340c9b6374735231a0fad1d7c0b0072244cf61dc44b617\": container with ID starting with 486371babca431a862340c9b6374735231a0fad1d7c0b0072244cf61dc44b617 not found: ID does not exist" containerID="486371babca431a862340c9b6374735231a0fad1d7c0b0072244cf61dc44b617"
Jul 29 05:02:42.979715 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:42.979677    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"486371babca431a862340c9b6374735231a0fad1d7c0b0072244cf61dc44b617"} err="failed to get container status \"486371babca431a862340c9b6374735231a0fad1d7c0b0072244cf61dc44b617\": rpc error: code = NotFound desc = could not find container \"486371babca431a862340c9b6374735231a0fad1d7c0b0072244cf61dc44b617\": container with ID starting with 486371babca431a862340c9b6374735231a0fad1d7c0b0072244cf61dc44b617 not found: ID does not exist"
Jul 29 05:02:42.997463 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:42.997407    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6eef04/rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm"]
Jul 29 05:02:43.000675 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:43.000655    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-6eef04/rate-test-model-6eef04-kserve-7ddd4c4ff5-phrbm"]
Jul 29 05:02:43.322905 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:43.322804    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-be8bc5/rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2" podUID="eb94aeb6-0976-42b4-86ee-073d7ac1d8ac" containerName="main" containerID="cri-o://5e15a1b7c974925ae183737c5546676dcd3c85ad94207bf290d132de99f5c084" gracePeriod=45
Jul 29 05:02:43.568992 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:43.568970    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-be8bc5/rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2"
Jul 29 05:02:43.649520 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:43.649471    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8lqbc\" (UniqueName: \"kubernetes.io/projected/eb94aeb6-0976-42b4-86ee-073d7ac1d8ac-kube-api-access-8lqbc\") pod \"eb94aeb6-0976-42b4-86ee-073d7ac1d8ac\" (UID: \"eb94aeb6-0976-42b4-86ee-073d7ac1d8ac\") "
Jul 29 05:02:43.649668 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:43.649539    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb94aeb6-0976-42b4-86ee-073d7ac1d8ac-home\") pod \"eb94aeb6-0976-42b4-86ee-073d7ac1d8ac\" (UID: \"eb94aeb6-0976-42b4-86ee-073d7ac1d8ac\") "
Jul 29 05:02:43.649668 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:43.649586    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb94aeb6-0976-42b4-86ee-073d7ac1d8ac-tmp-dir\") pod \"eb94aeb6-0976-42b4-86ee-073d7ac1d8ac\" (UID: \"eb94aeb6-0976-42b4-86ee-073d7ac1d8ac\") "
Jul 29 05:02:43.649668 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:43.649657    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb94aeb6-0976-42b4-86ee-073d7ac1d8ac-model-cache\") pod \"eb94aeb6-0976-42b4-86ee-073d7ac1d8ac\" (UID: \"eb94aeb6-0976-42b4-86ee-073d7ac1d8ac\") "
Jul 29 05:02:43.649879 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:43.649727    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb94aeb6-0976-42b4-86ee-073d7ac1d8ac-dshm\") pod \"eb94aeb6-0976-42b4-86ee-073d7ac1d8ac\" (UID: \"eb94aeb6-0976-42b4-86ee-073d7ac1d8ac\") "
Jul 29 05:02:43.649879 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:43.649787    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb94aeb6-0976-42b4-86ee-073d7ac1d8ac-tls-certs\") pod \"eb94aeb6-0976-42b4-86ee-073d7ac1d8ac\" (UID: \"eb94aeb6-0976-42b4-86ee-073d7ac1d8ac\") "
Jul 29 05:02:43.649879 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:43.649767    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb94aeb6-0976-42b4-86ee-073d7ac1d8ac-home" (OuterVolumeSpecName: "home") pod "eb94aeb6-0976-42b4-86ee-073d7ac1d8ac" (UID: "eb94aeb6-0976-42b4-86ee-073d7ac1d8ac"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:02:43.650042 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:43.649832    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb94aeb6-0976-42b4-86ee-073d7ac1d8ac-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "eb94aeb6-0976-42b4-86ee-073d7ac1d8ac" (UID: "eb94aeb6-0976-42b4-86ee-073d7ac1d8ac"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:02:43.650042 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:43.649849    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb94aeb6-0976-42b4-86ee-073d7ac1d8ac-model-cache" (OuterVolumeSpecName: "model-cache") pod "eb94aeb6-0976-42b4-86ee-073d7ac1d8ac" (UID: "eb94aeb6-0976-42b4-86ee-073d7ac1d8ac"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:02:43.650119 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:43.650091    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb94aeb6-0976-42b4-86ee-073d7ac1d8ac-home\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 05:02:43.650119 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:43.650103    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb94aeb6-0976-42b4-86ee-073d7ac1d8ac-tmp-dir\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 05:02:43.650119 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:43.650113    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb94aeb6-0976-42b4-86ee-073d7ac1d8ac-model-cache\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 05:02:43.651780 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:43.651750    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb94aeb6-0976-42b4-86ee-073d7ac1d8ac-dshm" (OuterVolumeSpecName: "dshm") pod "eb94aeb6-0976-42b4-86ee-073d7ac1d8ac" (UID: "eb94aeb6-0976-42b4-86ee-073d7ac1d8ac"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:02:43.651780 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:43.651770    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb94aeb6-0976-42b4-86ee-073d7ac1d8ac-kube-api-access-8lqbc" (OuterVolumeSpecName: "kube-api-access-8lqbc") pod "eb94aeb6-0976-42b4-86ee-073d7ac1d8ac" (UID: "eb94aeb6-0976-42b4-86ee-073d7ac1d8ac"). InnerVolumeSpecName "kube-api-access-8lqbc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 05:02:43.651962 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:43.651890    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb94aeb6-0976-42b4-86ee-073d7ac1d8ac-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "eb94aeb6-0976-42b4-86ee-073d7ac1d8ac" (UID: "eb94aeb6-0976-42b4-86ee-073d7ac1d8ac"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 05:02:43.751581 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:43.751551    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb94aeb6-0976-42b4-86ee-073d7ac1d8ac-tls-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 05:02:43.751581 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:43.751575    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8lqbc\" (UniqueName: \"kubernetes.io/projected/eb94aeb6-0976-42b4-86ee-073d7ac1d8ac-kube-api-access-8lqbc\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 05:02:43.751581 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:43.751586    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb94aeb6-0976-42b4-86ee-073d7ac1d8ac-dshm\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 05:02:43.978630 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:43.978536    2572 generic.go:356] "Generic (PLEG): container finished" podID="eb94aeb6-0976-42b4-86ee-073d7ac1d8ac" containerID="5e15a1b7c974925ae183737c5546676dcd3c85ad94207bf290d132de99f5c084" exitCode=0
Jul 29 05:02:43.978630 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:43.978578    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-be8bc5/rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2"
Jul 29 05:02:43.978856 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:43.978632    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-be8bc5/rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2" event={"ID":"eb94aeb6-0976-42b4-86ee-073d7ac1d8ac","Type":"ContainerDied","Data":"5e15a1b7c974925ae183737c5546676dcd3c85ad94207bf290d132de99f5c084"}
Jul 29 05:02:43.978856 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:43.978678    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-be8bc5/rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2" event={"ID":"eb94aeb6-0976-42b4-86ee-073d7ac1d8ac","Type":"ContainerDied","Data":"a2e29599a5902b3a1e53d9aea39ec3831041c3ef14305ee28839e066410899ca"}
Jul 29 05:02:43.978856 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:43.978704    2572 scope.go:117] "RemoveContainer" containerID="5e15a1b7c974925ae183737c5546676dcd3c85ad94207bf290d132de99f5c084"
Jul 29 05:02:43.988659 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:43.988632    2572 scope.go:117] "RemoveContainer" containerID="5e15a1b7c974925ae183737c5546676dcd3c85ad94207bf290d132de99f5c084"
Jul 29 05:02:43.988937 ip-10-0-130-4 kubenswrapper[2572]: E0729 05:02:43.988919    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e15a1b7c974925ae183737c5546676dcd3c85ad94207bf290d132de99f5c084\": container with ID starting with 5e15a1b7c974925ae183737c5546676dcd3c85ad94207bf290d132de99f5c084 not found: ID does not exist" containerID="5e15a1b7c974925ae183737c5546676dcd3c85ad94207bf290d132de99f5c084"
Jul 29 05:02:43.988995 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:43.988944    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e15a1b7c974925ae183737c5546676dcd3c85ad94207bf290d132de99f5c084"} err="failed to get container status \"5e15a1b7c974925ae183737c5546676dcd3c85ad94207bf290d132de99f5c084\": rpc error: code = NotFound desc = could not find container \"5e15a1b7c974925ae183737c5546676dcd3c85ad94207bf290d132de99f5c084\": container with ID starting with 5e15a1b7c974925ae183737c5546676dcd3c85ad94207bf290d132de99f5c084 not found: ID does not exist"
Jul 29 05:02:44.000657 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:44.000626    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-be8bc5/rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2"]
Jul 29 05:02:44.003623 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:44.003603    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-be8bc5/rate-test-model-be8bc5-kserve-56c67f76f5-q6dp2"]
Jul 29 05:02:44.122646 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:44.122620    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139922289588384"
Jul 29 05:02:44.141726 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:44.141699    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7546-139922289588384_5244efa1-0038-4725-8821-872f0bbfecc5/test-curl-7546-139922289588384/0.log"
Jul 29 05:02:44.154669 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:44.154636    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b862e450-99e3-49af-a8e6-64e8ca694bbf" path="/var/lib/kubelet/pods/b862e450-99e3-49af-a8e6-64e8ca694bbf/volumes"
Jul 29 05:02:44.155229 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:44.155200    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb94aeb6-0976-42b4-86ee-073d7ac1d8ac" path="/var/lib/kubelet/pods/eb94aeb6-0976-42b4-86ee-073d7ac1d8ac/volumes"
Jul 29 05:02:44.155892 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:44.155872    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7n6tk\" (UniqueName: \"kubernetes.io/projected/5244efa1-0038-4725-8821-872f0bbfecc5-kube-api-access-7n6tk\") pod \"5244efa1-0038-4725-8821-872f0bbfecc5\" (UID: \"5244efa1-0038-4725-8821-872f0bbfecc5\") "
Jul 29 05:02:44.158106 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:44.158076    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5244efa1-0038-4725-8821-872f0bbfecc5-kube-api-access-7n6tk" (OuterVolumeSpecName: "kube-api-access-7n6tk") pod "5244efa1-0038-4725-8821-872f0bbfecc5" (UID: "5244efa1-0038-4725-8821-872f0bbfecc5"). InnerVolumeSpecName "kube-api-access-7n6tk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 05:02:44.165272 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:44.164910    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7546-139922289588384"]
Jul 29 05:02:44.167002 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:44.166983    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7546-139922289588384"]
Jul 29 05:02:44.257019 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:44.256950    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7n6tk\" (UniqueName: \"kubernetes.io/projected/5244efa1-0038-4725-8821-872f0bbfecc5-kube-api-access-7n6tk\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 05:02:44.285249 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:44.285219    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7546-139922289588384"]
Jul 29 05:02:44.285611 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:44.285597    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb94aeb6-0976-42b4-86ee-073d7ac1d8ac" containerName="main"
Jul 29 05:02:44.285652 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:44.285614    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb94aeb6-0976-42b4-86ee-073d7ac1d8ac" containerName="main"
Jul 29 05:02:44.285652 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:44.285642    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b862e450-99e3-49af-a8e6-64e8ca694bbf" containerName="main"
Jul 29 05:02:44.285652 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:44.285647    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b862e450-99e3-49af-a8e6-64e8ca694bbf" containerName="main"
Jul 29 05:02:44.285747 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:44.285657    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5244efa1-0038-4725-8821-872f0bbfecc5" containerName="test-curl-7546-139922289588384"
Jul 29 05:02:44.285747 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:44.285663    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5244efa1-0038-4725-8821-872f0bbfecc5" containerName="test-curl-7546-139922289588384"
Jul 29 05:02:44.285747 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:44.285718    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b862e450-99e3-49af-a8e6-64e8ca694bbf" containerName="main"
Jul 29 05:02:44.285747 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:44.285724    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb94aeb6-0976-42b4-86ee-073d7ac1d8ac" containerName="main"
Jul 29 05:02:44.285747 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:44.285732    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="5244efa1-0038-4725-8821-872f0bbfecc5" containerName="test-curl-7546-139922289588384"
Jul 29 05:02:44.288960 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:44.288945    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139922289588384"
Jul 29 05:02:44.293895 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:44.293872    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7546-139922289588384"]
Jul 29 05:02:44.358349 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:44.358299    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzs6d\" (UniqueName: \"kubernetes.io/projected/5a60255a-5aa1-4a89-9534-b74ff48374c5-kube-api-access-tzs6d\") pod \"test-curl-7546-139922289588384\" (UID: \"5a60255a-5aa1-4a89-9534-b74ff48374c5\") " pod="opendatahub/test-curl-7546-139922289588384"
Jul 29 05:02:44.459425 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:44.459398    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzs6d\" (UniqueName: \"kubernetes.io/projected/5a60255a-5aa1-4a89-9534-b74ff48374c5-kube-api-access-tzs6d\") pod \"test-curl-7546-139922289588384\" (UID: \"5a60255a-5aa1-4a89-9534-b74ff48374c5\") " pod="opendatahub/test-curl-7546-139922289588384"
Jul 29 05:02:44.467532 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:44.467491    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzs6d\" (UniqueName: \"kubernetes.io/projected/5a60255a-5aa1-4a89-9534-b74ff48374c5-kube-api-access-tzs6d\") pod \"test-curl-7546-139922289588384\" (UID: \"5a60255a-5aa1-4a89-9534-b74ff48374c5\") " pod="opendatahub/test-curl-7546-139922289588384"
Jul 29 05:02:44.599289 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:44.599262    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139922289588384"
Jul 29 05:02:44.732774 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:44.732746    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7546-139922289588384"]
Jul 29 05:02:44.734244 ip-10-0-130-4 kubenswrapper[2572]: W0729 05:02:44.734217    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a60255a_5aa1_4a89_9534_b74ff48374c5.slice/crio-3f71676877938c7c5019d5971ed88aa16d96518908634598506c4ba79ebe736f WatchSource:0}: Error finding container 3f71676877938c7c5019d5971ed88aa16d96518908634598506c4ba79ebe736f: Status 404 returned error can't find the container with id 3f71676877938c7c5019d5971ed88aa16d96518908634598506c4ba79ebe736f
Jul 29 05:02:44.987171 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:44.987073    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7546-139922289588384" event={"ID":"5a60255a-5aa1-4a89-9534-b74ff48374c5","Type":"ContainerStarted","Data":"3f71676877938c7c5019d5971ed88aa16d96518908634598506c4ba79ebe736f"}
Jul 29 05:02:44.988256 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:44.988231    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139922289588384"
Jul 29 05:02:44.988390 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:44.988260    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="57a4a1e6b9ce15e00d4cd620d0adb442f48e3f05628d7410e919e978d40d98e7"
Jul 29 05:02:44.999353 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:44.999324    2572 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7546-139922289588384" oldPodUID="5244efa1-0038-4725-8821-872f0bbfecc5" podUID="5a60255a-5aa1-4a89-9534-b74ff48374c5"
Jul 29 05:02:45.995291 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:45.995254    2572 generic.go:356] "Generic (PLEG): container finished" podID="5a60255a-5aa1-4a89-9534-b74ff48374c5" containerID="66d985c48ef5b650c830852914846e2726160eedd8c89f1d295375a150f52755" exitCode=0
Jul 29 05:02:45.995692 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:45.995331    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7546-139922289588384" event={"ID":"5a60255a-5aa1-4a89-9534-b74ff48374c5","Type":"ContainerDied","Data":"66d985c48ef5b650c830852914846e2726160eedd8c89f1d295375a150f52755"}
Jul 29 05:02:46.147861 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:46.147826    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5244efa1-0038-4725-8821-872f0bbfecc5" path="/var/lib/kubelet/pods/5244efa1-0038-4725-8821-872f0bbfecc5/volumes"
Jul 29 05:02:47.137444 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:47.137422    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139922289588384"
Jul 29 05:02:47.156448 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:47.156423    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7546-139922289588384_5a60255a-5aa1-4a89-9534-b74ff48374c5/test-curl-7546-139922289588384/0.log"
Jul 29 05:02:47.180262 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:47.180236    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7546-139922289588384"]
Jul 29 05:02:47.183302 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:47.183281    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7546-139922289588384"]
Jul 29 05:02:47.185785 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:47.185767    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzs6d\" (UniqueName: \"kubernetes.io/projected/5a60255a-5aa1-4a89-9534-b74ff48374c5-kube-api-access-tzs6d\") pod \"5a60255a-5aa1-4a89-9534-b74ff48374c5\" (UID: \"5a60255a-5aa1-4a89-9534-b74ff48374c5\") "
Jul 29 05:02:47.187875 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:47.187852    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a60255a-5aa1-4a89-9534-b74ff48374c5-kube-api-access-tzs6d" (OuterVolumeSpecName: "kube-api-access-tzs6d") pod "5a60255a-5aa1-4a89-9534-b74ff48374c5" (UID: "5a60255a-5aa1-4a89-9534-b74ff48374c5"). InnerVolumeSpecName "kube-api-access-tzs6d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 05:02:47.287447 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:47.287370    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzs6d\" (UniqueName: \"kubernetes.io/projected/5a60255a-5aa1-4a89-9534-b74ff48374c5-kube-api-access-tzs6d\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 05:02:48.005637 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:48.005604    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139922289588384"
Jul 29 05:02:48.005802 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:48.005617    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3f71676877938c7c5019d5971ed88aa16d96518908634598506c4ba79ebe736f"
Jul 29 05:02:48.014878 ip-10-0-130-4 kubenswrapper[2572]: E0729 05:02:48.014849    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7546-139922289588384\" is forbidden: User \"system:node:ip-10-0-130-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-4.ec2.internal' and this object" podUID="5a60255a-5aa1-4a89-9534-b74ff48374c5" pod="opendatahub/test-curl-7546-139922289588384"
Jul 29 05:02:48.147448 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:02:48.147413    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a60255a-5aa1-4a89-9534-b74ff48374c5" path="/var/lib/kubelet/pods/5a60255a-5aa1-4a89-9534-b74ff48374c5/volumes"
Jul 29 05:03:00.179620 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:03:00.179583    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 05:03:21.076915 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:03:21.076871    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4-rlngf"]
Jul 29 05:03:21.077492 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:03:21.077465    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a60255a-5aa1-4a89-9534-b74ff48374c5" containerName="test-curl-7546-139922289588384"
Jul 29 05:03:21.077492 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:03:21.077490    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a60255a-5aa1-4a89-9534-b74ff48374c5" containerName="test-curl-7546-139922289588384"
Jul 29 05:03:21.077727 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:03:21.077625    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a60255a-5aa1-4a89-9534-b74ff48374c5" containerName="test-curl-7546-139922289588384"
Jul 29 05:03:21.080863 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:03:21.080844    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4-rlngf"
Jul 29 05:03:21.085210 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:03:21.085193    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-b1dab2\""
Jul 29 05:03:21.085304 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:03:21.085197    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-b1dab2-dockercfg-wbdf2\""
Jul 29 05:03:21.099216 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:03:21.099194    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4-rlngf"]
Jul 29 05:03:21.187850 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:03:21.187817    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4dd410e2-30e5-4921-9a47-09d78b659cfa-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4-rlngf\" (UID: \"4dd410e2-30e5-4921-9a47-09d78b659cfa\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4-rlngf"
Jul 29 05:03:21.188030 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:03:21.187866    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cq4f\" (UniqueName: \"kubernetes.io/projected/4dd410e2-30e5-4921-9a47-09d78b659cfa-kube-api-access-7cq4f\") pod \"payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4-rlngf\" (UID: \"4dd410e2-30e5-4921-9a47-09d78b659cfa\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4-rlngf"
Jul 29 05:03:21.288706 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:03:21.288667    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4dd410e2-30e5-4921-9a47-09d78b659cfa-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4-rlngf\" (UID: \"4dd410e2-30e5-4921-9a47-09d78b659cfa\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4-rlngf"
Jul 29 05:03:21.288877 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:03:21.288722    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cq4f\" (UniqueName: \"kubernetes.io/projected/4dd410e2-30e5-4921-9a47-09d78b659cfa-kube-api-access-7cq4f\") pod \"payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4-rlngf\" (UID: \"4dd410e2-30e5-4921-9a47-09d78b659cfa\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4-rlngf"
Jul 29 05:03:21.289564 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:03:21.289536    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4dd410e2-30e5-4921-9a47-09d78b659cfa-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4-rlngf\" (UID: \"4dd410e2-30e5-4921-9a47-09d78b659cfa\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4-rlngf"
Jul 29 05:03:21.296923 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:03:21.296893    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cq4f\" (UniqueName: \"kubernetes.io/projected/4dd410e2-30e5-4921-9a47-09d78b659cfa-kube-api-access-7cq4f\") pod \"payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4-rlngf\" (UID: \"4dd410e2-30e5-4921-9a47-09d78b659cfa\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4-rlngf"
Jul 29 05:03:21.390638 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:03:21.390593    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4-rlngf"
Jul 29 05:03:21.546366 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:03:21.546339    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4-rlngf"]
Jul 29 05:03:21.548088 ip-10-0-130-4 kubenswrapper[2572]: W0729 05:03:21.548058    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dd410e2_30e5_4921_9a47_09d78b659cfa.slice/crio-a851d2caf31e04952583b8b852c33cec89474f5d47ed0a8207a729e4eaa4ff1a WatchSource:0}: Error finding container a851d2caf31e04952583b8b852c33cec89474f5d47ed0a8207a729e4eaa4ff1a: Status 404 returned error can't find the container with id a851d2caf31e04952583b8b852c33cec89474f5d47ed0a8207a729e4eaa4ff1a
Jul 29 05:03:22.174393 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:03:22.174352    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4-rlngf" event={"ID":"4dd410e2-30e5-4921-9a47-09d78b659cfa","Type":"ContainerStarted","Data":"a851d2caf31e04952583b8b852c33cec89474f5d47ed0a8207a729e4eaa4ff1a"}
Jul 29 05:03:24.185067 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:03:24.185029    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4-rlngf" event={"ID":"4dd410e2-30e5-4921-9a47-09d78b659cfa","Type":"ContainerStarted","Data":"24788856078be1ae35c0e73829b393862701c1a89b3e47da2df296339b6fa5bf"}
Jul 29 05:03:24.185452 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:03:24.185103    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4-rlngf"
Jul 29 05:03:24.203798 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:03:24.203753    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4-rlngf" podStartSLOduration=1.565616245 podStartE2EDuration="3.2037379s" totalImagesPullingTime="1.638121655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 05:03:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 05:03:24.203380787 +0000 UTC m=+3570.636418905" watchObservedRunningTime="2026-07-29 05:03:24.2037379 +0000 UTC m=+3570.636776012"
Jul 29 05:03:29.485148 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:03:29.485114    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 05:03:35.192689 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:03:35.192660    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4-rlngf"
Jul 29 05:03:51.995710 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:03:51.995681    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4-rlngf_4dd410e2-30e5-4921-9a47-09d78b659cfa/payload-processing/0.log"
Jul 29 05:04:00.833527 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:00.833471    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-c210b8/ipp-route-c210b8-kserve-7b559c89b7-w5v8r"]
Jul 29 05:04:00.838335 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:00.838316    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-c210b8/ipp-route-c210b8-kserve-7b559c89b7-w5v8r"
Jul 29 05:04:00.840940 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:00.840918    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-c210b8\"/\"kube-root-ca.crt\""
Jul 29 05:04:00.841894 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:00.841879    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-c210b8\"/\"openshift-service-ca.crt\""
Jul 29 05:04:00.842173 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:00.842150    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-c210b8\"/\"ipp-route-c210b8-kserve-self-signed-certs\""
Jul 29 05:04:00.842275 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:00.842189    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-c210b8\"/\"default-dockercfg-tk5ft\""
Jul 29 05:04:00.847711 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:00.847689    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-c210b8/ipp-route-c210b8-kserve-7b559c89b7-w5v8r"]
Jul 29 05:04:00.958614 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:00.958579    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ch6h\" (UniqueName: \"kubernetes.io/projected/942df93b-b196-492a-ae91-4bac436c380a-kube-api-access-8ch6h\") pod \"ipp-route-c210b8-kserve-7b559c89b7-w5v8r\" (UID: \"942df93b-b196-492a-ae91-4bac436c380a\") " pod="ai-tenant-e2e-ipp-a-c210b8/ipp-route-c210b8-kserve-7b559c89b7-w5v8r"
Jul 29 05:04:00.958769 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:00.958631    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/942df93b-b196-492a-ae91-4bac436c380a-model-cache\") pod \"ipp-route-c210b8-kserve-7b559c89b7-w5v8r\" (UID: \"942df93b-b196-492a-ae91-4bac436c380a\") " pod="ai-tenant-e2e-ipp-a-c210b8/ipp-route-c210b8-kserve-7b559c89b7-w5v8r"
Jul 29 05:04:00.958769 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:00.958701    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/942df93b-b196-492a-ae91-4bac436c380a-tmp-dir\") pod \"ipp-route-c210b8-kserve-7b559c89b7-w5v8r\" (UID: \"942df93b-b196-492a-ae91-4bac436c380a\") " pod="ai-tenant-e2e-ipp-a-c210b8/ipp-route-c210b8-kserve-7b559c89b7-w5v8r"
Jul 29 05:04:00.958769 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:00.958756    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/942df93b-b196-492a-ae91-4bac436c380a-dshm\") pod \"ipp-route-c210b8-kserve-7b559c89b7-w5v8r\" (UID: \"942df93b-b196-492a-ae91-4bac436c380a\") " pod="ai-tenant-e2e-ipp-a-c210b8/ipp-route-c210b8-kserve-7b559c89b7-w5v8r"
Jul 29 05:04:00.958899 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:00.958778    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/942df93b-b196-492a-ae91-4bac436c380a-home\") pod \"ipp-route-c210b8-kserve-7b559c89b7-w5v8r\" (UID: \"942df93b-b196-492a-ae91-4bac436c380a\") " pod="ai-tenant-e2e-ipp-a-c210b8/ipp-route-c210b8-kserve-7b559c89b7-w5v8r"
Jul 29 05:04:00.958899 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:00.958841    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/942df93b-b196-492a-ae91-4bac436c380a-tls-certs\") pod \"ipp-route-c210b8-kserve-7b559c89b7-w5v8r\" (UID: \"942df93b-b196-492a-ae91-4bac436c380a\") " pod="ai-tenant-e2e-ipp-a-c210b8/ipp-route-c210b8-kserve-7b559c89b7-w5v8r"
Jul 29 05:04:01.059582 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:01.059549    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ch6h\" (UniqueName: \"kubernetes.io/projected/942df93b-b196-492a-ae91-4bac436c380a-kube-api-access-8ch6h\") pod \"ipp-route-c210b8-kserve-7b559c89b7-w5v8r\" (UID: \"942df93b-b196-492a-ae91-4bac436c380a\") " pod="ai-tenant-e2e-ipp-a-c210b8/ipp-route-c210b8-kserve-7b559c89b7-w5v8r"
Jul 29 05:04:01.059774 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:01.059599    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/942df93b-b196-492a-ae91-4bac436c380a-model-cache\") pod \"ipp-route-c210b8-kserve-7b559c89b7-w5v8r\" (UID: \"942df93b-b196-492a-ae91-4bac436c380a\") " pod="ai-tenant-e2e-ipp-a-c210b8/ipp-route-c210b8-kserve-7b559c89b7-w5v8r"
Jul 29 05:04:01.059774 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:01.059636    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/942df93b-b196-492a-ae91-4bac436c380a-tmp-dir\") pod \"ipp-route-c210b8-kserve-7b559c89b7-w5v8r\" (UID: \"942df93b-b196-492a-ae91-4bac436c380a\") " pod="ai-tenant-e2e-ipp-a-c210b8/ipp-route-c210b8-kserve-7b559c89b7-w5v8r"
Jul 29 05:04:01.059774 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:01.059688    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/942df93b-b196-492a-ae91-4bac436c380a-dshm\") pod \"ipp-route-c210b8-kserve-7b559c89b7-w5v8r\" (UID: \"942df93b-b196-492a-ae91-4bac436c380a\") " pod="ai-tenant-e2e-ipp-a-c210b8/ipp-route-c210b8-kserve-7b559c89b7-w5v8r"
Jul 29 05:04:01.059774 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:01.059716    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/942df93b-b196-492a-ae91-4bac436c380a-home\") pod \"ipp-route-c210b8-kserve-7b559c89b7-w5v8r\" (UID: \"942df93b-b196-492a-ae91-4bac436c380a\") " pod="ai-tenant-e2e-ipp-a-c210b8/ipp-route-c210b8-kserve-7b559c89b7-w5v8r"
Jul 29 05:04:01.059774 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:01.059753    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/942df93b-b196-492a-ae91-4bac436c380a-tls-certs\") pod \"ipp-route-c210b8-kserve-7b559c89b7-w5v8r\" (UID: \"942df93b-b196-492a-ae91-4bac436c380a\") " pod="ai-tenant-e2e-ipp-a-c210b8/ipp-route-c210b8-kserve-7b559c89b7-w5v8r"
Jul 29 05:04:01.060043 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:01.060020    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/942df93b-b196-492a-ae91-4bac436c380a-tmp-dir\") pod \"ipp-route-c210b8-kserve-7b559c89b7-w5v8r\" (UID: \"942df93b-b196-492a-ae91-4bac436c380a\") " pod="ai-tenant-e2e-ipp-a-c210b8/ipp-route-c210b8-kserve-7b559c89b7-w5v8r"
Jul 29 05:04:01.060164 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:01.060145    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/942df93b-b196-492a-ae91-4bac436c380a-model-cache\") pod \"ipp-route-c210b8-kserve-7b559c89b7-w5v8r\" (UID: \"942df93b-b196-492a-ae91-4bac436c380a\") " pod="ai-tenant-e2e-ipp-a-c210b8/ipp-route-c210b8-kserve-7b559c89b7-w5v8r"
Jul 29 05:04:01.060217 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:01.060165    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/942df93b-b196-492a-ae91-4bac436c380a-home\") pod \"ipp-route-c210b8-kserve-7b559c89b7-w5v8r\" (UID: \"942df93b-b196-492a-ae91-4bac436c380a\") " pod="ai-tenant-e2e-ipp-a-c210b8/ipp-route-c210b8-kserve-7b559c89b7-w5v8r"
Jul 29 05:04:01.062170 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:01.062148    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/942df93b-b196-492a-ae91-4bac436c380a-dshm\") pod \"ipp-route-c210b8-kserve-7b559c89b7-w5v8r\" (UID: \"942df93b-b196-492a-ae91-4bac436c380a\") " pod="ai-tenant-e2e-ipp-a-c210b8/ipp-route-c210b8-kserve-7b559c89b7-w5v8r"
Jul 29 05:04:01.062328 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:01.062312    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/942df93b-b196-492a-ae91-4bac436c380a-tls-certs\") pod \"ipp-route-c210b8-kserve-7b559c89b7-w5v8r\" (UID: \"942df93b-b196-492a-ae91-4bac436c380a\") " pod="ai-tenant-e2e-ipp-a-c210b8/ipp-route-c210b8-kserve-7b559c89b7-w5v8r"
Jul 29 05:04:01.070186 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:01.070162    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ch6h\" (UniqueName: \"kubernetes.io/projected/942df93b-b196-492a-ae91-4bac436c380a-kube-api-access-8ch6h\") pod \"ipp-route-c210b8-kserve-7b559c89b7-w5v8r\" (UID: \"942df93b-b196-492a-ae91-4bac436c380a\") " pod="ai-tenant-e2e-ipp-a-c210b8/ipp-route-c210b8-kserve-7b559c89b7-w5v8r"
Jul 29 05:04:01.148102 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:01.148074    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-c210b8/ipp-route-c210b8-kserve-7b559c89b7-w5v8r"
Jul 29 05:04:01.289068 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:01.289042    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-c210b8/ipp-route-c210b8-kserve-7b559c89b7-w5v8r"]
Jul 29 05:04:01.291179 ip-10-0-130-4 kubenswrapper[2572]: W0729 05:04:01.291143    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod942df93b_b196_492a_ae91_4bac436c380a.slice/crio-8c741366680a074ec3db421020ad76b99a5ea8b727c8f14d80781b6e6e34fdd3 WatchSource:0}: Error finding container 8c741366680a074ec3db421020ad76b99a5ea8b727c8f14d80781b6e6e34fdd3: Status 404 returned error can't find the container with id 8c741366680a074ec3db421020ad76b99a5ea8b727c8f14d80781b6e6e34fdd3
Jul 29 05:04:01.369622 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:01.369581    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-c210b8/ipp-route-c210b8-kserve-7b559c89b7-w5v8r" event={"ID":"942df93b-b196-492a-ae91-4bac436c380a","Type":"ContainerStarted","Data":"09a12c1b54dbd06c1b1501b352e65b86612f05649e31ecb3688c51e0f73eb74c"}
Jul 29 05:04:01.369785 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:01.369633    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-c210b8/ipp-route-c210b8-kserve-7b559c89b7-w5v8r" event={"ID":"942df93b-b196-492a-ae91-4bac436c380a","Type":"ContainerStarted","Data":"8c741366680a074ec3db421020ad76b99a5ea8b727c8f14d80781b6e6e34fdd3"}
Jul 29 05:04:01.396522 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:01.396449    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-c210b8/ipp-route-c210b8-kserve-7b559c89b7-w5v8r" podStartSLOduration=1.396434381 podStartE2EDuration="1.396434381s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 05:04:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 05:04:01.394742341 +0000 UTC m=+3607.827780454" watchObservedRunningTime="2026-07-29 05:04:01.396434381 +0000 UTC m=+3607.829472494"
Jul 29 05:04:04.591186 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:04.591145    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 05:04:11.149017 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:11.148977    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-c210b8/ipp-route-c210b8-kserve-7b559c89b7-w5v8r"
Jul 29 05:04:11.149645 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:11.149040    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-c210b8/ipp-route-c210b8-kserve-7b559c89b7-w5v8r"
Jul 29 05:04:11.161348 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:11.161322    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-c210b8/ipp-route-c210b8-kserve-7b559c89b7-w5v8r"
Jul 29 05:04:11.433523 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:11.433420    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-c210b8/ipp-route-c210b8-kserve-7b559c89b7-w5v8r"
Jul 29 05:04:36.716165 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:36.716130    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 05:04:49.421931 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:49.421903    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4-rlngf_4dd410e2-30e5-4921-9a47-09d78b659cfa/payload-processing/0.log"
Jul 29 05:04:54.026272 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:54.026238    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-aa798b-7d65548f8d-kg8sj"]
Jul 29 05:04:54.029830 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:54.029813    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-aa798b-7d65548f8d-kg8sj"
Jul 29 05:04:54.034027 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:54.034004    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-aa798b-dockercfg-x48j9\""
Jul 29 05:04:54.034159 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:54.034043    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-aa798b\""
Jul 29 05:04:54.061245 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:54.061201    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-aa798b-7d65548f8d-kg8sj"]
Jul 29 05:04:54.077432 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:54.077405    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-aa798b-6756d9bbb8-vh5r7"]
Jul 29 05:04:54.080875 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:54.080859    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-aa798b-6756d9bbb8-vh5r7"
Jul 29 05:04:54.132112 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:54.132071    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-aa798b-6756d9bbb8-vh5r7"]
Jul 29 05:04:54.148169 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:54.148143    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6cf5cf8a-6f3f-4ce8-ae95-6dab68965a7a-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-aa798b-6756d9bbb8-vh5r7\" (UID: \"6cf5cf8a-6f3f-4ce8-ae95-6dab68965a7a\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-aa798b-6756d9bbb8-vh5r7"
Jul 29 05:04:54.148315 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:54.148190    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pqwb\" (UniqueName: \"kubernetes.io/projected/6cf5cf8a-6f3f-4ce8-ae95-6dab68965a7a-kube-api-access-7pqwb\") pod \"payload-processing-e2e-ipp-cleanup-aa798b-6756d9bbb8-vh5r7\" (UID: \"6cf5cf8a-6f3f-4ce8-ae95-6dab68965a7a\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-aa798b-6756d9bbb8-vh5r7"
Jul 29 05:04:54.148315 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:54.148226    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1dc8801f-e45b-4d2e-b3a0-27f91894be3e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-aa798b-7d65548f8d-kg8sj\" (UID: \"1dc8801f-e45b-4d2e-b3a0-27f91894be3e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-aa798b-7d65548f8d-kg8sj"
Jul 29 05:04:54.148421 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:54.148314    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbmsj\" (UniqueName: \"kubernetes.io/projected/1dc8801f-e45b-4d2e-b3a0-27f91894be3e-kube-api-access-xbmsj\") pod \"payload-pre-processing-e2e-ipp-cleanup-aa798b-7d65548f8d-kg8sj\" (UID: \"1dc8801f-e45b-4d2e-b3a0-27f91894be3e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-aa798b-7d65548f8d-kg8sj"
Jul 29 05:04:54.249254 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:54.249213    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6cf5cf8a-6f3f-4ce8-ae95-6dab68965a7a-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-aa798b-6756d9bbb8-vh5r7\" (UID: \"6cf5cf8a-6f3f-4ce8-ae95-6dab68965a7a\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-aa798b-6756d9bbb8-vh5r7"
Jul 29 05:04:54.249418 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:54.249286    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pqwb\" (UniqueName: \"kubernetes.io/projected/6cf5cf8a-6f3f-4ce8-ae95-6dab68965a7a-kube-api-access-7pqwb\") pod \"payload-processing-e2e-ipp-cleanup-aa798b-6756d9bbb8-vh5r7\" (UID: \"6cf5cf8a-6f3f-4ce8-ae95-6dab68965a7a\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-aa798b-6756d9bbb8-vh5r7"
Jul 29 05:04:54.249418 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:54.249331    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1dc8801f-e45b-4d2e-b3a0-27f91894be3e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-aa798b-7d65548f8d-kg8sj\" (UID: \"1dc8801f-e45b-4d2e-b3a0-27f91894be3e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-aa798b-7d65548f8d-kg8sj"
Jul 29 05:04:54.249418 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:54.249373    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbmsj\" (UniqueName: \"kubernetes.io/projected/1dc8801f-e45b-4d2e-b3a0-27f91894be3e-kube-api-access-xbmsj\") pod \"payload-pre-processing-e2e-ipp-cleanup-aa798b-7d65548f8d-kg8sj\" (UID: \"1dc8801f-e45b-4d2e-b3a0-27f91894be3e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-aa798b-7d65548f8d-kg8sj"
Jul 29 05:04:54.250388 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:54.250363    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1dc8801f-e45b-4d2e-b3a0-27f91894be3e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-aa798b-7d65548f8d-kg8sj\" (UID: \"1dc8801f-e45b-4d2e-b3a0-27f91894be3e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-aa798b-7d65548f8d-kg8sj"
Jul 29 05:04:54.250473 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:54.250388    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6cf5cf8a-6f3f-4ce8-ae95-6dab68965a7a-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-aa798b-6756d9bbb8-vh5r7\" (UID: \"6cf5cf8a-6f3f-4ce8-ae95-6dab68965a7a\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-aa798b-6756d9bbb8-vh5r7"
Jul 29 05:04:54.264222 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:54.264193    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pqwb\" (UniqueName: \"kubernetes.io/projected/6cf5cf8a-6f3f-4ce8-ae95-6dab68965a7a-kube-api-access-7pqwb\") pod \"payload-processing-e2e-ipp-cleanup-aa798b-6756d9bbb8-vh5r7\" (UID: \"6cf5cf8a-6f3f-4ce8-ae95-6dab68965a7a\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-aa798b-6756d9bbb8-vh5r7"
Jul 29 05:04:54.265276 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:54.265259    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbmsj\" (UniqueName: \"kubernetes.io/projected/1dc8801f-e45b-4d2e-b3a0-27f91894be3e-kube-api-access-xbmsj\") pod \"payload-pre-processing-e2e-ipp-cleanup-aa798b-7d65548f8d-kg8sj\" (UID: \"1dc8801f-e45b-4d2e-b3a0-27f91894be3e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-aa798b-7d65548f8d-kg8sj"
Jul 29 05:04:54.340699 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:54.340620    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-aa798b-7d65548f8d-kg8sj"
Jul 29 05:04:54.391222 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:54.391183    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-aa798b-6756d9bbb8-vh5r7"
Jul 29 05:04:54.505619 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:54.505585    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-aa798b-7d65548f8d-kg8sj"]
Jul 29 05:04:54.507389 ip-10-0-130-4 kubenswrapper[2572]: W0729 05:04:54.507365    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dc8801f_e45b_4d2e_b3a0_27f91894be3e.slice/crio-79f9db2edd12e33d9162bff4dfc3247b4ba8f63c3fa80edfe217e583838e4dd0 WatchSource:0}: Error finding container 79f9db2edd12e33d9162bff4dfc3247b4ba8f63c3fa80edfe217e583838e4dd0: Status 404 returned error can't find the container with id 79f9db2edd12e33d9162bff4dfc3247b4ba8f63c3fa80edfe217e583838e4dd0
Jul 29 05:04:54.568134 ip-10-0-130-4 kubenswrapper[2572]: W0729 05:04:54.568106    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cf5cf8a_6f3f_4ce8_ae95_6dab68965a7a.slice/crio-cc7b5313193f3f7f93b3b6e043298731709ffe7e67b1ab718bbc50fd8f7c92b1 WatchSource:0}: Error finding container cc7b5313193f3f7f93b3b6e043298731709ffe7e67b1ab718bbc50fd8f7c92b1: Status 404 returned error can't find the container with id cc7b5313193f3f7f93b3b6e043298731709ffe7e67b1ab718bbc50fd8f7c92b1
Jul 29 05:04:54.569755 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:54.569736    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-aa798b-6756d9bbb8-vh5r7"]
Jul 29 05:04:54.648545 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:54.648480    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-aa798b-6756d9bbb8-vh5r7" event={"ID":"6cf5cf8a-6f3f-4ce8-ae95-6dab68965a7a","Type":"ContainerStarted","Data":"df4136f8acb29b312ac54018467767fe82129fe208c83bd261d2d60999cc92b8"}
Jul 29 05:04:54.648686 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:54.648612    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-aa798b-6756d9bbb8-vh5r7" event={"ID":"6cf5cf8a-6f3f-4ce8-ae95-6dab68965a7a","Type":"ContainerStarted","Data":"cc7b5313193f3f7f93b3b6e043298731709ffe7e67b1ab718bbc50fd8f7c92b1"}
Jul 29 05:04:54.648929 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:54.648839    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-aa798b-6756d9bbb8-vh5r7"
Jul 29 05:04:54.650639 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:54.650616    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-aa798b-7d65548f8d-kg8sj" event={"ID":"1dc8801f-e45b-4d2e-b3a0-27f91894be3e","Type":"ContainerStarted","Data":"7f3dd04acb71da8c488acadbebc9ff1c8a8e387dd5864c9859187b420331d3aa"}
Jul 29 05:04:54.650729 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:54.650656    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-aa798b-7d65548f8d-kg8sj" event={"ID":"1dc8801f-e45b-4d2e-b3a0-27f91894be3e","Type":"ContainerStarted","Data":"79f9db2edd12e33d9162bff4dfc3247b4ba8f63c3fa80edfe217e583838e4dd0"}
Jul 29 05:04:54.650729 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:54.650685    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-aa798b-7d65548f8d-kg8sj"
Jul 29 05:04:54.689687 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:54.689627    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-aa798b-6756d9bbb8-vh5r7" podStartSLOduration=0.689609663 podStartE2EDuration="689.609663ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 05:04:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 05:04:54.687683651 +0000 UTC m=+3661.120721765" watchObservedRunningTime="2026-07-29 05:04:54.689609663 +0000 UTC m=+3661.122647775"
Jul 29 05:04:54.719307 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:04:54.719249    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-aa798b-7d65548f8d-kg8sj" podStartSLOduration=1.71923404 podStartE2EDuration="1.71923404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 05:04:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 05:04:54.718041688 +0000 UTC m=+3661.151079793" watchObservedRunningTime="2026-07-29 05:04:54.71923404 +0000 UTC m=+3661.152272152"
Jul 29 05:05:03.201749 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:03.201704    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 05:05:05.658396 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:05.658360    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-aa798b-6756d9bbb8-vh5r7"
Jul 29 05:05:05.658818 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:05.658440    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-aa798b-7d65548f8d-kg8sj"
Jul 29 05:05:18.540259 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:18.540180    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-aa798b-z2p9q"]
Jul 29 05:05:18.543710 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:18.543694    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-aa798b-z2p9q"
Jul 29 05:05:18.547698 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:18.547678    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mxv5w\""
Jul 29 05:05:18.548003 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:18.547987    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 05:05:18.567926 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:18.567900    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-aa798b-z2p9q"]
Jul 29 05:05:18.575570 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:18.575542    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/75a44608-b7d2-4ed3-9006-8e6a80f93fde-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-aa798b-z2p9q\" (UID: \"75a44608-b7d2-4ed3-9006-8e6a80f93fde\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-aa798b-z2p9q"
Jul 29 05:05:18.676421 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:18.676389    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/75a44608-b7d2-4ed3-9006-8e6a80f93fde-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-aa798b-z2p9q\" (UID: \"75a44608-b7d2-4ed3-9006-8e6a80f93fde\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-aa798b-z2p9q"
Jul 29 05:05:18.676967 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:18.676949    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/75a44608-b7d2-4ed3-9006-8e6a80f93fde-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-aa798b-z2p9q\" (UID: \"75a44608-b7d2-4ed3-9006-8e6a80f93fde\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-aa798b-z2p9q"
Jul 29 05:05:18.854058 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:18.854025    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-aa798b-z2p9q"
Jul 29 05:05:19.019223 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:19.019192    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-aa798b-z2p9q"]
Jul 29 05:05:19.020297 ip-10-0-130-4 kubenswrapper[2572]: W0729 05:05:19.020270    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75a44608_b7d2_4ed3_9006_8e6a80f93fde.slice/crio-6231cc233423d927e3a8d67905ae044e0ce1b12076b2a57e8f3af9fd608a9334 WatchSource:0}: Error finding container 6231cc233423d927e3a8d67905ae044e0ce1b12076b2a57e8f3af9fd608a9334: Status 404 returned error can't find the container with id 6231cc233423d927e3a8d67905ae044e0ce1b12076b2a57e8f3af9fd608a9334
Jul 29 05:05:19.788984 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:19.788956    2572 generic.go:356] "Generic (PLEG): container finished" podID="75a44608-b7d2-4ed3-9006-8e6a80f93fde" containerID="884ddae5f0d23cb557a440b0b49f6e3876db9aa3323b54ddbdbe25c2217a23d3" exitCode=0
Jul 29 05:05:19.789309 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:19.789003    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-aa798b-z2p9q" event={"ID":"75a44608-b7d2-4ed3-9006-8e6a80f93fde","Type":"ContainerDied","Data":"884ddae5f0d23cb557a440b0b49f6e3876db9aa3323b54ddbdbe25c2217a23d3"}
Jul 29 05:05:19.789309 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:19.789059    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-aa798b-z2p9q" event={"ID":"75a44608-b7d2-4ed3-9006-8e6a80f93fde","Type":"ContainerStarted","Data":"6231cc233423d927e3a8d67905ae044e0ce1b12076b2a57e8f3af9fd608a9334"}
Jul 29 05:05:20.924708 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:20.924681    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-aa798b-z2p9q"
Jul 29 05:05:20.998798 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:20.998773    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/75a44608-b7d2-4ed3-9006-8e6a80f93fde-maas-api-service-ca\") pod \"75a44608-b7d2-4ed3-9006-8e6a80f93fde\" (UID: \"75a44608-b7d2-4ed3-9006-8e6a80f93fde\") "
Jul 29 05:05:20.999150 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:20.999126    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75a44608-b7d2-4ed3-9006-8e6a80f93fde-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "75a44608-b7d2-4ed3-9006-8e6a80f93fde" (UID: "75a44608-b7d2-4ed3-9006-8e6a80f93fde"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 05:05:21.100404 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:21.100379    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/75a44608-b7d2-4ed3-9006-8e6a80f93fde-maas-api-service-ca\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 05:05:21.800635 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:21.800593    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-aa798b-z2p9q"
Jul 29 05:05:21.800809 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:21.800652    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-aa798b-z2p9q" event={"ID":"75a44608-b7d2-4ed3-9006-8e6a80f93fde","Type":"ContainerDied","Data":"6231cc233423d927e3a8d67905ae044e0ce1b12076b2a57e8f3af9fd608a9334"}
Jul 29 05:05:21.800809 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:21.800735    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6231cc233423d927e3a8d67905ae044e0ce1b12076b2a57e8f3af9fd608a9334"
Jul 29 05:05:24.127675 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:24.127634    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-aa798b-6756d9bbb8-vh5r7"]
Jul 29 05:05:24.128142 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:24.127895    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-aa798b-6756d9bbb8-vh5r7" podUID="6cf5cf8a-6f3f-4ce8-ae95-6dab68965a7a" containerName="payload-processing" containerID="cri-o://df4136f8acb29b312ac54018467767fe82129fe208c83bd261d2d60999cc92b8" gracePeriod=30
Jul 29 05:05:24.129699 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:24.129679    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-aa798b-7d65548f8d-kg8sj"]
Jul 29 05:05:24.129850 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:24.129830    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-aa798b-7d65548f8d-kg8sj" podUID="1dc8801f-e45b-4d2e-b3a0-27f91894be3e" containerName="payload-pre-processing" containerID="cri-o://7f3dd04acb71da8c488acadbebc9ff1c8a8e387dd5864c9859187b420331d3aa" gracePeriod=30
Jul 29 05:05:24.418459 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:24.418423    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-aa798b-7d65548f8d-kg8sj"
Jul 29 05:05:24.421914 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:24.421893    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-aa798b-6756d9bbb8-vh5r7"
Jul 29 05:05:24.527964 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:24.527928    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1dc8801f-e45b-4d2e-b3a0-27f91894be3e-plugins-config-volume\") pod \"1dc8801f-e45b-4d2e-b3a0-27f91894be3e\" (UID: \"1dc8801f-e45b-4d2e-b3a0-27f91894be3e\") "
Jul 29 05:05:24.528166 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:24.527998    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7pqwb\" (UniqueName: \"kubernetes.io/projected/6cf5cf8a-6f3f-4ce8-ae95-6dab68965a7a-kube-api-access-7pqwb\") pod \"6cf5cf8a-6f3f-4ce8-ae95-6dab68965a7a\" (UID: \"6cf5cf8a-6f3f-4ce8-ae95-6dab68965a7a\") "
Jul 29 05:05:24.528166 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:24.528071    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6cf5cf8a-6f3f-4ce8-ae95-6dab68965a7a-plugins-config-volume\") pod \"6cf5cf8a-6f3f-4ce8-ae95-6dab68965a7a\" (UID: \"6cf5cf8a-6f3f-4ce8-ae95-6dab68965a7a\") "
Jul 29 05:05:24.528166 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:24.528123    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbmsj\" (UniqueName: \"kubernetes.io/projected/1dc8801f-e45b-4d2e-b3a0-27f91894be3e-kube-api-access-xbmsj\") pod \"1dc8801f-e45b-4d2e-b3a0-27f91894be3e\" (UID: \"1dc8801f-e45b-4d2e-b3a0-27f91894be3e\") "
Jul 29 05:05:24.528321 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:24.528297    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dc8801f-e45b-4d2e-b3a0-27f91894be3e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1dc8801f-e45b-4d2e-b3a0-27f91894be3e" (UID: "1dc8801f-e45b-4d2e-b3a0-27f91894be3e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 05:05:24.528418 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:24.528394    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cf5cf8a-6f3f-4ce8-ae95-6dab68965a7a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6cf5cf8a-6f3f-4ce8-ae95-6dab68965a7a" (UID: "6cf5cf8a-6f3f-4ce8-ae95-6dab68965a7a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 05:05:24.528478 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:24.528454    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1dc8801f-e45b-4d2e-b3a0-27f91894be3e-plugins-config-volume\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 05:05:24.530467 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:24.530439    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dc8801f-e45b-4d2e-b3a0-27f91894be3e-kube-api-access-xbmsj" (OuterVolumeSpecName: "kube-api-access-xbmsj") pod "1dc8801f-e45b-4d2e-b3a0-27f91894be3e" (UID: "1dc8801f-e45b-4d2e-b3a0-27f91894be3e"). InnerVolumeSpecName "kube-api-access-xbmsj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 05:05:24.530467 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:24.530463    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cf5cf8a-6f3f-4ce8-ae95-6dab68965a7a-kube-api-access-7pqwb" (OuterVolumeSpecName: "kube-api-access-7pqwb") pod "6cf5cf8a-6f3f-4ce8-ae95-6dab68965a7a" (UID: "6cf5cf8a-6f3f-4ce8-ae95-6dab68965a7a"). InnerVolumeSpecName "kube-api-access-7pqwb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 05:05:24.563008 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:24.562983    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-aa798b-z2p9q"]
Jul 29 05:05:24.571090 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:24.571065    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-aa798b-z2p9q"]
Jul 29 05:05:24.629530 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:24.629477    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6cf5cf8a-6f3f-4ce8-ae95-6dab68965a7a-plugins-config-volume\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 05:05:24.629530 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:24.629527    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbmsj\" (UniqueName: \"kubernetes.io/projected/1dc8801f-e45b-4d2e-b3a0-27f91894be3e-kube-api-access-xbmsj\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 05:05:24.629702 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:24.629544    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7pqwb\" (UniqueName: \"kubernetes.io/projected/6cf5cf8a-6f3f-4ce8-ae95-6dab68965a7a-kube-api-access-7pqwb\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 05:05:24.817885 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:24.817799    2572 generic.go:356] "Generic (PLEG): container finished" podID="6cf5cf8a-6f3f-4ce8-ae95-6dab68965a7a" containerID="df4136f8acb29b312ac54018467767fe82129fe208c83bd261d2d60999cc92b8" exitCode=0
Jul 29 05:05:24.817885 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:24.817845    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-aa798b-6756d9bbb8-vh5r7"
Jul 29 05:05:24.818097 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:24.817884    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-aa798b-6756d9bbb8-vh5r7" event={"ID":"6cf5cf8a-6f3f-4ce8-ae95-6dab68965a7a","Type":"ContainerDied","Data":"df4136f8acb29b312ac54018467767fe82129fe208c83bd261d2d60999cc92b8"}
Jul 29 05:05:24.818097 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:24.817943    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-aa798b-6756d9bbb8-vh5r7" event={"ID":"6cf5cf8a-6f3f-4ce8-ae95-6dab68965a7a","Type":"ContainerDied","Data":"cc7b5313193f3f7f93b3b6e043298731709ffe7e67b1ab718bbc50fd8f7c92b1"}
Jul 29 05:05:24.818097 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:24.817972    2572 scope.go:117] "RemoveContainer" containerID="df4136f8acb29b312ac54018467767fe82129fe208c83bd261d2d60999cc92b8"
Jul 29 05:05:24.819236 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:24.819214    2572 generic.go:356] "Generic (PLEG): container finished" podID="1dc8801f-e45b-4d2e-b3a0-27f91894be3e" containerID="7f3dd04acb71da8c488acadbebc9ff1c8a8e387dd5864c9859187b420331d3aa" exitCode=0
Jul 29 05:05:24.819378 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:24.819246    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-aa798b-7d65548f8d-kg8sj" event={"ID":"1dc8801f-e45b-4d2e-b3a0-27f91894be3e","Type":"ContainerDied","Data":"7f3dd04acb71da8c488acadbebc9ff1c8a8e387dd5864c9859187b420331d3aa"}
Jul 29 05:05:24.819378 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:24.819270    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-aa798b-7d65548f8d-kg8sj"
Jul 29 05:05:24.819378 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:24.819293    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-aa798b-7d65548f8d-kg8sj" event={"ID":"1dc8801f-e45b-4d2e-b3a0-27f91894be3e","Type":"ContainerDied","Data":"79f9db2edd12e33d9162bff4dfc3247b4ba8f63c3fa80edfe217e583838e4dd0"}
Jul 29 05:05:24.828385 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:24.828367    2572 scope.go:117] "RemoveContainer" containerID="df4136f8acb29b312ac54018467767fe82129fe208c83bd261d2d60999cc92b8"
Jul 29 05:05:24.828723 ip-10-0-130-4 kubenswrapper[2572]: E0729 05:05:24.828701    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df4136f8acb29b312ac54018467767fe82129fe208c83bd261d2d60999cc92b8\": container with ID starting with df4136f8acb29b312ac54018467767fe82129fe208c83bd261d2d60999cc92b8 not found: ID does not exist" containerID="df4136f8acb29b312ac54018467767fe82129fe208c83bd261d2d60999cc92b8"
Jul 29 05:05:24.828788 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:24.828730    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df4136f8acb29b312ac54018467767fe82129fe208c83bd261d2d60999cc92b8"} err="failed to get container status \"df4136f8acb29b312ac54018467767fe82129fe208c83bd261d2d60999cc92b8\": rpc error: code = NotFound desc = could not find container \"df4136f8acb29b312ac54018467767fe82129fe208c83bd261d2d60999cc92b8\": container with ID starting with df4136f8acb29b312ac54018467767fe82129fe208c83bd261d2d60999cc92b8 not found: ID does not exist"
Jul 29 05:05:24.828788 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:24.828748    2572 scope.go:117] "RemoveContainer" containerID="7f3dd04acb71da8c488acadbebc9ff1c8a8e387dd5864c9859187b420331d3aa"
Jul 29 05:05:24.838049 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:24.838034    2572 scope.go:117] "RemoveContainer" containerID="7f3dd04acb71da8c488acadbebc9ff1c8a8e387dd5864c9859187b420331d3aa"
Jul 29 05:05:24.838320 ip-10-0-130-4 kubenswrapper[2572]: E0729 05:05:24.838303    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f3dd04acb71da8c488acadbebc9ff1c8a8e387dd5864c9859187b420331d3aa\": container with ID starting with 7f3dd04acb71da8c488acadbebc9ff1c8a8e387dd5864c9859187b420331d3aa not found: ID does not exist" containerID="7f3dd04acb71da8c488acadbebc9ff1c8a8e387dd5864c9859187b420331d3aa"
Jul 29 05:05:24.838377 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:24.838329    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f3dd04acb71da8c488acadbebc9ff1c8a8e387dd5864c9859187b420331d3aa"} err="failed to get container status \"7f3dd04acb71da8c488acadbebc9ff1c8a8e387dd5864c9859187b420331d3aa\": rpc error: code = NotFound desc = could not find container \"7f3dd04acb71da8c488acadbebc9ff1c8a8e387dd5864c9859187b420331d3aa\": container with ID starting with 7f3dd04acb71da8c488acadbebc9ff1c8a8e387dd5864c9859187b420331d3aa not found: ID does not exist"
Jul 29 05:05:24.859430 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:24.859403    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-aa798b-6756d9bbb8-vh5r7"]
Jul 29 05:05:24.874155 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:24.874119    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-aa798b-6756d9bbb8-vh5r7"]
Jul 29 05:05:24.891158 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:24.891134    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-aa798b-7d65548f8d-kg8sj"]
Jul 29 05:05:24.896311 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:24.896288    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-aa798b-7d65548f8d-kg8sj"]
Jul 29 05:05:26.148235 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:26.148198    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1dc8801f-e45b-4d2e-b3a0-27f91894be3e" path="/var/lib/kubelet/pods/1dc8801f-e45b-4d2e-b3a0-27f91894be3e/volumes"
Jul 29 05:05:26.148619 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:26.148565    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cf5cf8a-6f3f-4ce8-ae95-6dab68965a7a" path="/var/lib/kubelet/pods/6cf5cf8a-6f3f-4ce8-ae95-6dab68965a7a/volumes"
Jul 29 05:05:26.148861 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:26.148848    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75a44608-b7d2-4ed3-9006-8e6a80f93fde" path="/var/lib/kubelet/pods/75a44608-b7d2-4ed3-9006-8e6a80f93fde/volumes"
Jul 29 05:05:28.089811 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:28.089774    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 05:05:35.566269 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:35.566231    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c210b8-ssb6n"]
Jul 29 05:05:35.566732 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:35.566674    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dc8801f-e45b-4d2e-b3a0-27f91894be3e" containerName="payload-pre-processing"
Jul 29 05:05:35.566732 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:35.566690    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dc8801f-e45b-4d2e-b3a0-27f91894be3e" containerName="payload-pre-processing"
Jul 29 05:05:35.566732 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:35.566711    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75a44608-b7d2-4ed3-9006-8e6a80f93fde" containerName="revoke-keys"
Jul 29 05:05:35.566732 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:35.566716    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="75a44608-b7d2-4ed3-9006-8e6a80f93fde" containerName="revoke-keys"
Jul 29 05:05:35.566732 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:35.566732    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cf5cf8a-6f3f-4ce8-ae95-6dab68965a7a" containerName="payload-processing"
Jul 29 05:05:35.566899 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:35.566738    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cf5cf8a-6f3f-4ce8-ae95-6dab68965a7a" containerName="payload-processing"
Jul 29 05:05:35.566899 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:35.566797    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cf5cf8a-6f3f-4ce8-ae95-6dab68965a7a" containerName="payload-processing"
Jul 29 05:05:35.566899 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:35.566807    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="75a44608-b7d2-4ed3-9006-8e6a80f93fde" containerName="revoke-keys"
Jul 29 05:05:35.566899 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:35.566813    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1dc8801f-e45b-4d2e-b3a0-27f91894be3e" containerName="payload-pre-processing"
Jul 29 05:05:35.571166 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:35.571150    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c210b8-ssb6n"
Jul 29 05:05:35.573765 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:35.573741    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mxv5w\""
Jul 29 05:05:35.573892 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:35.573784    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 05:05:35.581196 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:35.581137    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c210b8-ssb6n"]
Jul 29 05:05:35.629692 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:35.629651    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/51d69d71-70da-4efc-8718-2710c42d40f1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-c210b8-ssb6n\" (UID: \"51d69d71-70da-4efc-8718-2710c42d40f1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c210b8-ssb6n"
Jul 29 05:05:35.730518 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:35.730466    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/51d69d71-70da-4efc-8718-2710c42d40f1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-c210b8-ssb6n\" (UID: \"51d69d71-70da-4efc-8718-2710c42d40f1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c210b8-ssb6n"
Jul 29 05:05:35.731068 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:35.731048    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/51d69d71-70da-4efc-8718-2710c42d40f1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-c210b8-ssb6n\" (UID: \"51d69d71-70da-4efc-8718-2710c42d40f1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c210b8-ssb6n"
Jul 29 05:05:35.882732 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:35.882703    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c210b8-ssb6n"
Jul 29 05:05:36.228323 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:36.228296    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c210b8-ssb6n"]
Jul 29 05:05:36.230532 ip-10-0-130-4 kubenswrapper[2572]: W0729 05:05:36.230481    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51d69d71_70da_4efc_8718_2710c42d40f1.slice/crio-62ddfa47046a70487882df3cfd3e8fee24bf249a82f6f235234b540f45b6ac94 WatchSource:0}: Error finding container 62ddfa47046a70487882df3cfd3e8fee24bf249a82f6f235234b540f45b6ac94: Status 404 returned error can't find the container with id 62ddfa47046a70487882df3cfd3e8fee24bf249a82f6f235234b540f45b6ac94
Jul 29 05:05:36.884901 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:36.884862    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c210b8-ssb6n" event={"ID":"51d69d71-70da-4efc-8718-2710c42d40f1","Type":"ContainerStarted","Data":"3baec9d722053820b9f35e60f48dc2849741036fff320ab8038ec28d2a4ec821"}
Jul 29 05:05:36.885289 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:36.884959    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c210b8-ssb6n" event={"ID":"51d69d71-70da-4efc-8718-2710c42d40f1","Type":"ContainerStarted","Data":"62ddfa47046a70487882df3cfd3e8fee24bf249a82f6f235234b540f45b6ac94"}
Jul 29 05:05:36.902861 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:36.902796    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c210b8-ssb6n" podStartSLOduration=1.902777357 podStartE2EDuration="1.902777357s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 05:05:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 05:05:36.902040565 +0000 UTC m=+3703.335078680" watchObservedRunningTime="2026-07-29 05:05:36.902777357 +0000 UTC m=+3703.335815462"
Jul 29 05:05:37.891021 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:37.890941    2572 generic.go:356] "Generic (PLEG): container finished" podID="51d69d71-70da-4efc-8718-2710c42d40f1" containerID="3baec9d722053820b9f35e60f48dc2849741036fff320ab8038ec28d2a4ec821" exitCode=0
Jul 29 05:05:37.891394 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:37.891029    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c210b8-ssb6n" event={"ID":"51d69d71-70da-4efc-8718-2710c42d40f1","Type":"ContainerDied","Data":"3baec9d722053820b9f35e60f48dc2849741036fff320ab8038ec28d2a4ec821"}
Jul 29 05:05:39.033288 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:39.033265    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c210b8-ssb6n"
Jul 29 05:05:39.165843 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:39.165749    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/51d69d71-70da-4efc-8718-2710c42d40f1-maas-api-service-ca\") pod \"51d69d71-70da-4efc-8718-2710c42d40f1\" (UID: \"51d69d71-70da-4efc-8718-2710c42d40f1\") "
Jul 29 05:05:39.166118 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:39.166094    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51d69d71-70da-4efc-8718-2710c42d40f1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "51d69d71-70da-4efc-8718-2710c42d40f1" (UID: "51d69d71-70da-4efc-8718-2710c42d40f1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 05:05:39.267478 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:39.267439    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/51d69d71-70da-4efc-8718-2710c42d40f1-maas-api-service-ca\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 05:05:39.902835 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:39.902807    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c210b8-ssb6n"
Jul 29 05:05:39.903031 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:39.902806    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c210b8-ssb6n" event={"ID":"51d69d71-70da-4efc-8718-2710c42d40f1","Type":"ContainerDied","Data":"62ddfa47046a70487882df3cfd3e8fee24bf249a82f6f235234b540f45b6ac94"}
Jul 29 05:05:39.903031 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:39.902932    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="62ddfa47046a70487882df3cfd3e8fee24bf249a82f6f235234b540f45b6ac94"
Jul 29 05:05:51.309573 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:51.309536    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c210b8-ssb6n"]
Jul 29 05:05:51.317282 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:51.317240    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c210b8-ssb6n"]
Jul 29 05:05:52.148707 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:52.148672    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51d69d71-70da-4efc-8718-2710c42d40f1" path="/var/lib/kubelet/pods/51d69d71-70da-4efc-8718-2710c42d40f1/volumes"
Jul 29 05:05:52.498993 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:52.498907    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 05:05:56.662185 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:05:56.662152    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-c210b8/ipp-route-c210b8-kserve-7b559c89b7-w5v8r"]
Jul 29 05:06:02.783589 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:02.783560    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 05:06:11.681490 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:11.681431    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-c210b8/ipp-route-c210b8-kserve-7b559c89b7-w5v8r" podUID="942df93b-b196-492a-ae91-4bac436c380a" containerName="main" containerID="cri-o://09a12c1b54dbd06c1b1501b352e65b86612f05649e31ecb3688c51e0f73eb74c" gracePeriod=45
Jul 29 05:06:11.934199 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:11.934140    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-c210b8/ipp-route-c210b8-kserve-7b559c89b7-w5v8r"
Jul 29 05:06:12.073784 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:12.073747    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ch6h\" (UniqueName: \"kubernetes.io/projected/942df93b-b196-492a-ae91-4bac436c380a-kube-api-access-8ch6h\") pod \"942df93b-b196-492a-ae91-4bac436c380a\" (UID: \"942df93b-b196-492a-ae91-4bac436c380a\") "
Jul 29 05:06:12.073784 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:12.073790    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/942df93b-b196-492a-ae91-4bac436c380a-tmp-dir\") pod \"942df93b-b196-492a-ae91-4bac436c380a\" (UID: \"942df93b-b196-492a-ae91-4bac436c380a\") "
Jul 29 05:06:12.074010 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:12.073827    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/942df93b-b196-492a-ae91-4bac436c380a-tls-certs\") pod \"942df93b-b196-492a-ae91-4bac436c380a\" (UID: \"942df93b-b196-492a-ae91-4bac436c380a\") "
Jul 29 05:06:12.074010 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:12.073954    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/942df93b-b196-492a-ae91-4bac436c380a-dshm\") pod \"942df93b-b196-492a-ae91-4bac436c380a\" (UID: \"942df93b-b196-492a-ae91-4bac436c380a\") "
Jul 29 05:06:12.074094 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:12.074053    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/942df93b-b196-492a-ae91-4bac436c380a-model-cache\") pod \"942df93b-b196-492a-ae91-4bac436c380a\" (UID: \"942df93b-b196-492a-ae91-4bac436c380a\") "
Jul 29 05:06:12.074094 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:12.074067    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/942df93b-b196-492a-ae91-4bac436c380a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "942df93b-b196-492a-ae91-4bac436c380a" (UID: "942df93b-b196-492a-ae91-4bac436c380a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:06:12.074200 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:12.074128    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/942df93b-b196-492a-ae91-4bac436c380a-home\") pod \"942df93b-b196-492a-ae91-4bac436c380a\" (UID: \"942df93b-b196-492a-ae91-4bac436c380a\") "
Jul 29 05:06:12.074364 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:12.074338    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/942df93b-b196-492a-ae91-4bac436c380a-model-cache" (OuterVolumeSpecName: "model-cache") pod "942df93b-b196-492a-ae91-4bac436c380a" (UID: "942df93b-b196-492a-ae91-4bac436c380a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:06:12.074687 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:12.074665    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/942df93b-b196-492a-ae91-4bac436c380a-model-cache\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 05:06:12.074687 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:12.074690    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/942df93b-b196-492a-ae91-4bac436c380a-tmp-dir\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 05:06:12.074886 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:12.074686    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/942df93b-b196-492a-ae91-4bac436c380a-home" (OuterVolumeSpecName: "home") pod "942df93b-b196-492a-ae91-4bac436c380a" (UID: "942df93b-b196-492a-ae91-4bac436c380a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:06:12.076194 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:12.076166    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/942df93b-b196-492a-ae91-4bac436c380a-dshm" (OuterVolumeSpecName: "dshm") pod "942df93b-b196-492a-ae91-4bac436c380a" (UID: "942df93b-b196-492a-ae91-4bac436c380a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:06:12.076291 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:12.076244    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/942df93b-b196-492a-ae91-4bac436c380a-kube-api-access-8ch6h" (OuterVolumeSpecName: "kube-api-access-8ch6h") pod "942df93b-b196-492a-ae91-4bac436c380a" (UID: "942df93b-b196-492a-ae91-4bac436c380a"). InnerVolumeSpecName "kube-api-access-8ch6h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 05:06:12.076332 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:12.076312    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/942df93b-b196-492a-ae91-4bac436c380a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "942df93b-b196-492a-ae91-4bac436c380a" (UID: "942df93b-b196-492a-ae91-4bac436c380a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 05:06:12.080319 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:12.080294    2572 generic.go:356] "Generic (PLEG): container finished" podID="942df93b-b196-492a-ae91-4bac436c380a" containerID="09a12c1b54dbd06c1b1501b352e65b86612f05649e31ecb3688c51e0f73eb74c" exitCode=0
Jul 29 05:06:12.080425 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:12.080333    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-c210b8/ipp-route-c210b8-kserve-7b559c89b7-w5v8r"
Jul 29 05:06:12.080425 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:12.080375    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-c210b8/ipp-route-c210b8-kserve-7b559c89b7-w5v8r" event={"ID":"942df93b-b196-492a-ae91-4bac436c380a","Type":"ContainerDied","Data":"09a12c1b54dbd06c1b1501b352e65b86612f05649e31ecb3688c51e0f73eb74c"}
Jul 29 05:06:12.080425 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:12.080421    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-c210b8/ipp-route-c210b8-kserve-7b559c89b7-w5v8r" event={"ID":"942df93b-b196-492a-ae91-4bac436c380a","Type":"ContainerDied","Data":"8c741366680a074ec3db421020ad76b99a5ea8b727c8f14d80781b6e6e34fdd3"}
Jul 29 05:06:12.080581 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:12.080442    2572 scope.go:117] "RemoveContainer" containerID="09a12c1b54dbd06c1b1501b352e65b86612f05649e31ecb3688c51e0f73eb74c"
Jul 29 05:06:12.095188 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:12.095170    2572 scope.go:117] "RemoveContainer" containerID="09a12c1b54dbd06c1b1501b352e65b86612f05649e31ecb3688c51e0f73eb74c"
Jul 29 05:06:12.095445 ip-10-0-130-4 kubenswrapper[2572]: E0729 05:06:12.095427    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09a12c1b54dbd06c1b1501b352e65b86612f05649e31ecb3688c51e0f73eb74c\": container with ID starting with 09a12c1b54dbd06c1b1501b352e65b86612f05649e31ecb3688c51e0f73eb74c not found: ID does not exist" containerID="09a12c1b54dbd06c1b1501b352e65b86612f05649e31ecb3688c51e0f73eb74c"
Jul 29 05:06:12.095492 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:12.095455    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09a12c1b54dbd06c1b1501b352e65b86612f05649e31ecb3688c51e0f73eb74c"} err="failed to get container status \"09a12c1b54dbd06c1b1501b352e65b86612f05649e31ecb3688c51e0f73eb74c\": rpc error: code = NotFound desc = could not find container \"09a12c1b54dbd06c1b1501b352e65b86612f05649e31ecb3688c51e0f73eb74c\": container with ID starting with 09a12c1b54dbd06c1b1501b352e65b86612f05649e31ecb3688c51e0f73eb74c not found: ID does not exist"
Jul 29 05:06:12.106167 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:12.106145    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-c210b8/ipp-route-c210b8-kserve-7b559c89b7-w5v8r"]
Jul 29 05:06:12.111994 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:12.111976    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-c210b8/ipp-route-c210b8-kserve-7b559c89b7-w5v8r"]
Jul 29 05:06:12.148081 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:12.148057    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="942df93b-b196-492a-ae91-4bac436c380a" path="/var/lib/kubelet/pods/942df93b-b196-492a-ae91-4bac436c380a/volumes"
Jul 29 05:06:12.175434 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:12.175415    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/942df93b-b196-492a-ae91-4bac436c380a-home\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 05:06:12.175525 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:12.175433    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ch6h\" (UniqueName: \"kubernetes.io/projected/942df93b-b196-492a-ae91-4bac436c380a-kube-api-access-8ch6h\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 05:06:12.175525 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:12.175445    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/942df93b-b196-492a-ae91-4bac436c380a-tls-certs\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 05:06:12.175525 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:12.175455    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/942df93b-b196-492a-ae91-4bac436c380a-dshm\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 05:06:46.021766 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:46.021685    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b1dab2-x2whd"]
Jul 29 05:06:46.022188 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:46.022057    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="942df93b-b196-492a-ae91-4bac436c380a" containerName="main"
Jul 29 05:06:46.022188 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:46.022067    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="942df93b-b196-492a-ae91-4bac436c380a" containerName="main"
Jul 29 05:06:46.022188 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:46.022092    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51d69d71-70da-4efc-8718-2710c42d40f1" containerName="revoke-keys"
Jul 29 05:06:46.022188 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:46.022098    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="51d69d71-70da-4efc-8718-2710c42d40f1" containerName="revoke-keys"
Jul 29 05:06:46.022188 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:46.022156    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="51d69d71-70da-4efc-8718-2710c42d40f1" containerName="revoke-keys"
Jul 29 05:06:46.022188 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:46.022167    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="942df93b-b196-492a-ae91-4bac436c380a" containerName="main"
Jul 29 05:06:46.025238 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:46.025222    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b1dab2-x2whd"
Jul 29 05:06:46.027934 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:46.027912    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mxv5w\""
Jul 29 05:06:46.027934 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:46.027928    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 05:06:46.032203 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:46.032066    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b1dab2-x2whd"]
Jul 29 05:06:46.091221 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:46.091185    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26fd1eb9-5e23-4412-aafc-06329674f5ce-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-b1dab2-x2whd\" (UID: \"26fd1eb9-5e23-4412-aafc-06329674f5ce\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b1dab2-x2whd"
Jul 29 05:06:46.192695 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:46.192660    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26fd1eb9-5e23-4412-aafc-06329674f5ce-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-b1dab2-x2whd\" (UID: \"26fd1eb9-5e23-4412-aafc-06329674f5ce\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b1dab2-x2whd"
Jul 29 05:06:46.193235 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:46.193217    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26fd1eb9-5e23-4412-aafc-06329674f5ce-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-b1dab2-x2whd\" (UID: \"26fd1eb9-5e23-4412-aafc-06329674f5ce\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b1dab2-x2whd"
Jul 29 05:06:46.336346 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:46.336270    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b1dab2-x2whd"
Jul 29 05:06:46.682937 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:46.682905    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b1dab2-x2whd"]
Jul 29 05:06:46.685443 ip-10-0-130-4 kubenswrapper[2572]: W0729 05:06:46.685415    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26fd1eb9_5e23_4412_aafc_06329674f5ce.slice/crio-b9e800e4328bdcd9b89a27439c105e672bc35a7bb73d9159ea7adaa2df37bb6b WatchSource:0}: Error finding container b9e800e4328bdcd9b89a27439c105e672bc35a7bb73d9159ea7adaa2df37bb6b: Status 404 returned error can't find the container with id b9e800e4328bdcd9b89a27439c105e672bc35a7bb73d9159ea7adaa2df37bb6b
Jul 29 05:06:47.255550 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:47.255438    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b1dab2-x2whd" event={"ID":"26fd1eb9-5e23-4412-aafc-06329674f5ce","Type":"ContainerStarted","Data":"81200aee882bda9249fdedcc684fe5aa5bee3a6aa09669db998eb51dc1c806c1"}
Jul 29 05:06:47.255550 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:47.255495    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b1dab2-x2whd" event={"ID":"26fd1eb9-5e23-4412-aafc-06329674f5ce","Type":"ContainerStarted","Data":"b9e800e4328bdcd9b89a27439c105e672bc35a7bb73d9159ea7adaa2df37bb6b"}
Jul 29 05:06:47.274402 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:47.274354    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b1dab2-x2whd" podStartSLOduration=1.2743394270000001 podStartE2EDuration="1.274339427s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 05:06:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 05:06:47.273016074 +0000 UTC m=+3773.706054188" watchObservedRunningTime="2026-07-29 05:06:47.274339427 +0000 UTC m=+3773.707377540"
Jul 29 05:06:48.261566 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:48.261536    2572 generic.go:356] "Generic (PLEG): container finished" podID="26fd1eb9-5e23-4412-aafc-06329674f5ce" containerID="81200aee882bda9249fdedcc684fe5aa5bee3a6aa09669db998eb51dc1c806c1" exitCode=0
Jul 29 05:06:48.261942 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:48.261626    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b1dab2-x2whd" event={"ID":"26fd1eb9-5e23-4412-aafc-06329674f5ce","Type":"ContainerDied","Data":"81200aee882bda9249fdedcc684fe5aa5bee3a6aa09669db998eb51dc1c806c1"}
Jul 29 05:06:49.399987 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:49.399961    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b1dab2-x2whd"
Jul 29 05:06:49.523977 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:49.523897    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26fd1eb9-5e23-4412-aafc-06329674f5ce-maas-api-service-ca\") pod \"26fd1eb9-5e23-4412-aafc-06329674f5ce\" (UID: \"26fd1eb9-5e23-4412-aafc-06329674f5ce\") "
Jul 29 05:06:49.526590 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:49.524419    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26fd1eb9-5e23-4412-aafc-06329674f5ce-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "26fd1eb9-5e23-4412-aafc-06329674f5ce" (UID: "26fd1eb9-5e23-4412-aafc-06329674f5ce"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 05:06:49.526590 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:49.524676    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26fd1eb9-5e23-4412-aafc-06329674f5ce-maas-api-service-ca\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 05:06:50.272705 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:50.272675    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b1dab2-x2whd"
Jul 29 05:06:50.272874 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:50.272675    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b1dab2-x2whd" event={"ID":"26fd1eb9-5e23-4412-aafc-06329674f5ce","Type":"ContainerDied","Data":"b9e800e4328bdcd9b89a27439c105e672bc35a7bb73d9159ea7adaa2df37bb6b"}
Jul 29 05:06:50.272874 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:50.272803    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b9e800e4328bdcd9b89a27439c105e672bc35a7bb73d9159ea7adaa2df37bb6b"
Jul 29 05:06:56.567008 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:56.566973    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4-rlngf"]
Jul 29 05:06:56.567524 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:56.567252    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4-rlngf" podUID="4dd410e2-30e5-4921-9a47-09d78b659cfa" containerName="payload-processing" containerID="cri-o://24788856078be1ae35c0e73829b393862701c1a89b3e47da2df296339b6fa5bf" gracePeriod=30
Jul 29 05:06:56.715909 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:56.715875    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b1dab2-x2whd"]
Jul 29 05:06:56.718640 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:56.718611    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b1dab2-x2whd"]
Jul 29 05:06:56.825811 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:56.825754    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4-rlngf"
Jul 29 05:06:56.891753 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:56.891724    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7cq4f\" (UniqueName: \"kubernetes.io/projected/4dd410e2-30e5-4921-9a47-09d78b659cfa-kube-api-access-7cq4f\") pod \"4dd410e2-30e5-4921-9a47-09d78b659cfa\" (UID: \"4dd410e2-30e5-4921-9a47-09d78b659cfa\") "
Jul 29 05:06:56.891916 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:56.891844    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4dd410e2-30e5-4921-9a47-09d78b659cfa-plugins-config-volume\") pod \"4dd410e2-30e5-4921-9a47-09d78b659cfa\" (UID: \"4dd410e2-30e5-4921-9a47-09d78b659cfa\") "
Jul 29 05:06:56.892211 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:56.892186    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4dd410e2-30e5-4921-9a47-09d78b659cfa-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4dd410e2-30e5-4921-9a47-09d78b659cfa" (UID: "4dd410e2-30e5-4921-9a47-09d78b659cfa"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 05:06:56.893859 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:56.893836    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dd410e2-30e5-4921-9a47-09d78b659cfa-kube-api-access-7cq4f" (OuterVolumeSpecName: "kube-api-access-7cq4f") pod "4dd410e2-30e5-4921-9a47-09d78b659cfa" (UID: "4dd410e2-30e5-4921-9a47-09d78b659cfa"). InnerVolumeSpecName "kube-api-access-7cq4f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 05:06:56.992721 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:56.992690    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4dd410e2-30e5-4921-9a47-09d78b659cfa-plugins-config-volume\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 05:06:56.992721 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:56.992719    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7cq4f\" (UniqueName: \"kubernetes.io/projected/4dd410e2-30e5-4921-9a47-09d78b659cfa-kube-api-access-7cq4f\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 05:06:57.308321 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:57.308282    2572 generic.go:356] "Generic (PLEG): container finished" podID="4dd410e2-30e5-4921-9a47-09d78b659cfa" containerID="24788856078be1ae35c0e73829b393862701c1a89b3e47da2df296339b6fa5bf" exitCode=0
Jul 29 05:06:57.308321 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:57.308319    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4-rlngf" event={"ID":"4dd410e2-30e5-4921-9a47-09d78b659cfa","Type":"ContainerDied","Data":"24788856078be1ae35c0e73829b393862701c1a89b3e47da2df296339b6fa5bf"}
Jul 29 05:06:57.308557 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:57.308329    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4-rlngf"
Jul 29 05:06:57.308557 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:57.308364    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4-rlngf" event={"ID":"4dd410e2-30e5-4921-9a47-09d78b659cfa","Type":"ContainerDied","Data":"a851d2caf31e04952583b8b852c33cec89474f5d47ed0a8207a729e4eaa4ff1a"}
Jul 29 05:06:57.308557 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:57.308386    2572 scope.go:117] "RemoveContainer" containerID="24788856078be1ae35c0e73829b393862701c1a89b3e47da2df296339b6fa5bf"
Jul 29 05:06:57.318016 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:57.317985    2572 scope.go:117] "RemoveContainer" containerID="24788856078be1ae35c0e73829b393862701c1a89b3e47da2df296339b6fa5bf"
Jul 29 05:06:57.318293 ip-10-0-130-4 kubenswrapper[2572]: E0729 05:06:57.318272    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24788856078be1ae35c0e73829b393862701c1a89b3e47da2df296339b6fa5bf\": container with ID starting with 24788856078be1ae35c0e73829b393862701c1a89b3e47da2df296339b6fa5bf not found: ID does not exist" containerID="24788856078be1ae35c0e73829b393862701c1a89b3e47da2df296339b6fa5bf"
Jul 29 05:06:57.318366 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:57.318301    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24788856078be1ae35c0e73829b393862701c1a89b3e47da2df296339b6fa5bf"} err="failed to get container status \"24788856078be1ae35c0e73829b393862701c1a89b3e47da2df296339b6fa5bf\": rpc error: code = NotFound desc = could not find container \"24788856078be1ae35c0e73829b393862701c1a89b3e47da2df296339b6fa5bf\": container with ID starting with 24788856078be1ae35c0e73829b393862701c1a89b3e47da2df296339b6fa5bf not found: ID does not exist"
Jul 29 05:06:57.329795 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:57.329768    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4-rlngf"]
Jul 29 05:06:57.332971 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:57.332952    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-b1dab2-6ddf9787b4-rlngf"]
Jul 29 05:06:58.147995 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:58.147961    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26fd1eb9-5e23-4412-aafc-06329674f5ce" path="/var/lib/kubelet/pods/26fd1eb9-5e23-4412-aafc-06329674f5ce/volumes"
Jul 29 05:06:58.148359 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:58.148314    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4dd410e2-30e5-4921-9a47-09d78b659cfa" path="/var/lib/kubelet/pods/4dd410e2-30e5-4921-9a47-09d78b659cfa/volumes"
Jul 29 05:06:58.779515 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:06:58.779463    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 05:07:03.489004 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:03.488960    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6eef04-98kl2"]
Jul 29 05:07:03.489367 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:03.489345    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26fd1eb9-5e23-4412-aafc-06329674f5ce" containerName="revoke-keys"
Jul 29 05:07:03.489367 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:03.489356    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="26fd1eb9-5e23-4412-aafc-06329674f5ce" containerName="revoke-keys"
Jul 29 05:07:03.489439 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:03.489379    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dd410e2-30e5-4921-9a47-09d78b659cfa" containerName="payload-processing"
Jul 29 05:07:03.489439 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:03.489386    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dd410e2-30e5-4921-9a47-09d78b659cfa" containerName="payload-processing"
Jul 29 05:07:03.489518 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:03.489463    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="26fd1eb9-5e23-4412-aafc-06329674f5ce" containerName="revoke-keys"
Jul 29 05:07:03.489518 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:03.489470    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4dd410e2-30e5-4921-9a47-09d78b659cfa" containerName="payload-processing"
Jul 29 05:07:03.493867 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:03.493848    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6eef04-98kl2"
Jul 29 05:07:03.496556 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:03.496538    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mxv5w\""
Jul 29 05:07:03.496666 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:03.496643    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 05:07:03.500286 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:03.500264    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6eef04-98kl2"]
Jul 29 05:07:03.655667 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:03.655629    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36eb9cf0-0ec8-4dd7-9ec1-fc33cb77ea6d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-6eef04-98kl2\" (UID: \"36eb9cf0-0ec8-4dd7-9ec1-fc33cb77ea6d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6eef04-98kl2"
Jul 29 05:07:03.756779 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:03.756709    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36eb9cf0-0ec8-4dd7-9ec1-fc33cb77ea6d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-6eef04-98kl2\" (UID: \"36eb9cf0-0ec8-4dd7-9ec1-fc33cb77ea6d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6eef04-98kl2"
Jul 29 05:07:03.757355 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:03.757330    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36eb9cf0-0ec8-4dd7-9ec1-fc33cb77ea6d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-6eef04-98kl2\" (UID: \"36eb9cf0-0ec8-4dd7-9ec1-fc33cb77ea6d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6eef04-98kl2"
Jul 29 05:07:03.805711 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:03.805684    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6eef04-98kl2"
Jul 29 05:07:04.147264 ip-10-0-130-4 kubenswrapper[2572]: W0729 05:07:04.147237    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36eb9cf0_0ec8_4dd7_9ec1_fc33cb77ea6d.slice/crio-c74ce3668768440710dd7eeab60eacba610be0b19f7b3b2217eecc465da0a087 WatchSource:0}: Error finding container c74ce3668768440710dd7eeab60eacba610be0b19f7b3b2217eecc465da0a087: Status 404 returned error can't find the container with id c74ce3668768440710dd7eeab60eacba610be0b19f7b3b2217eecc465da0a087
Jul 29 05:07:04.149433 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:04.149410    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6eef04-98kl2"]
Jul 29 05:07:04.345460 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:04.345430    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6eef04-98kl2" event={"ID":"36eb9cf0-0ec8-4dd7-9ec1-fc33cb77ea6d","Type":"ContainerStarted","Data":"c74ce3668768440710dd7eeab60eacba610be0b19f7b3b2217eecc465da0a087"}
Jul 29 05:07:05.351832 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:05.351792    2572 generic.go:356] "Generic (PLEG): container finished" podID="36eb9cf0-0ec8-4dd7-9ec1-fc33cb77ea6d" containerID="5f71edef351b688e741fc713fdfc7967ea961042a496d7b655eef411e3b24807" exitCode=0
Jul 29 05:07:05.352183 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:05.351853    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6eef04-98kl2" event={"ID":"36eb9cf0-0ec8-4dd7-9ec1-fc33cb77ea6d","Type":"ContainerDied","Data":"5f71edef351b688e741fc713fdfc7967ea961042a496d7b655eef411e3b24807"}
Jul 29 05:07:06.489378 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:06.489356    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6eef04-98kl2"
Jul 29 05:07:06.585286 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:06.585255    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36eb9cf0-0ec8-4dd7-9ec1-fc33cb77ea6d-maas-api-service-ca\") pod \"36eb9cf0-0ec8-4dd7-9ec1-fc33cb77ea6d\" (UID: \"36eb9cf0-0ec8-4dd7-9ec1-fc33cb77ea6d\") "
Jul 29 05:07:06.585572 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:06.585548    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36eb9cf0-0ec8-4dd7-9ec1-fc33cb77ea6d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "36eb9cf0-0ec8-4dd7-9ec1-fc33cb77ea6d" (UID: "36eb9cf0-0ec8-4dd7-9ec1-fc33cb77ea6d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 05:07:06.686210 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:06.686131    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36eb9cf0-0ec8-4dd7-9ec1-fc33cb77ea6d-maas-api-service-ca\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 05:07:07.363800 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:07.363760    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6eef04-98kl2" event={"ID":"36eb9cf0-0ec8-4dd7-9ec1-fc33cb77ea6d","Type":"ContainerDied","Data":"c74ce3668768440710dd7eeab60eacba610be0b19f7b3b2217eecc465da0a087"}
Jul 29 05:07:07.364001 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:07.363818    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c74ce3668768440710dd7eeab60eacba610be0b19f7b3b2217eecc465da0a087"
Jul 29 05:07:07.364001 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:07.363775    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6eef04-98kl2"
Jul 29 05:07:08.721594 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:08.721535    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-6eef04-29755020-wtwpj"]
Jul 29 05:07:08.725696 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:08.725661    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-6eef04-29755020-wtwpj"]
Jul 29 05:07:08.888800 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:08.888765    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6eef04-98kl2"]
Jul 29 05:07:08.891649 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:08.891618    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6eef04-98kl2"]
Jul 29 05:07:10.147664 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:10.147633    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36eb9cf0-0ec8-4dd7-9ec1-fc33cb77ea6d" path="/var/lib/kubelet/pods/36eb9cf0-0ec8-4dd7-9ec1-fc33cb77ea6d/volumes"
Jul 29 05:07:10.148029 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:10.147915    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd6b088f-3fa5-49e1-b277-d436673d05fd" path="/var/lib/kubelet/pods/cd6b088f-3fa5-49e1-b277-d436673d05fd/volumes"
Jul 29 05:07:12.484102 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:12.484069    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 05:07:15.980853 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:15.980814    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-be8bc5-dnqcj"]
Jul 29 05:07:15.981246 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:15.981232    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36eb9cf0-0ec8-4dd7-9ec1-fc33cb77ea6d" containerName="revoke-keys"
Jul 29 05:07:15.981291 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:15.981247    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="36eb9cf0-0ec8-4dd7-9ec1-fc33cb77ea6d" containerName="revoke-keys"
Jul 29 05:07:15.981331 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:15.981315    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="36eb9cf0-0ec8-4dd7-9ec1-fc33cb77ea6d" containerName="revoke-keys"
Jul 29 05:07:15.984697 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:15.984680    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-be8bc5-dnqcj"
Jul 29 05:07:15.987900 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:15.987881    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mxv5w\""
Jul 29 05:07:15.987900 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:15.987897    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 05:07:15.993165 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:15.993140    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-be8bc5-dnqcj"]
Jul 29 05:07:16.065869 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:16.065838    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1043102b-2eb1-4076-980d-573e349eb7f5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-be8bc5-dnqcj\" (UID: \"1043102b-2eb1-4076-980d-573e349eb7f5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-be8bc5-dnqcj"
Jul 29 05:07:16.166966 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:16.166937    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1043102b-2eb1-4076-980d-573e349eb7f5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-be8bc5-dnqcj\" (UID: \"1043102b-2eb1-4076-980d-573e349eb7f5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-be8bc5-dnqcj"
Jul 29 05:07:16.167543 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:16.167527    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1043102b-2eb1-4076-980d-573e349eb7f5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-be8bc5-dnqcj\" (UID: \"1043102b-2eb1-4076-980d-573e349eb7f5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-be8bc5-dnqcj"
Jul 29 05:07:16.295791 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:16.295704    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-be8bc5-dnqcj"
Jul 29 05:07:16.435354 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:16.435332    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-be8bc5-dnqcj"]
Jul 29 05:07:16.437559 ip-10-0-130-4 kubenswrapper[2572]: W0729 05:07:16.437489    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1043102b_2eb1_4076_980d_573e349eb7f5.slice/crio-0e40255917a26e131453db331d0bbacbf7f95bf0d65be7a0abe9f050e9cb7ace WatchSource:0}: Error finding container 0e40255917a26e131453db331d0bbacbf7f95bf0d65be7a0abe9f050e9cb7ace: Status 404 returned error can't find the container with id 0e40255917a26e131453db331d0bbacbf7f95bf0d65be7a0abe9f050e9cb7ace
Jul 29 05:07:17.420702 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:17.420656    2572 generic.go:356] "Generic (PLEG): container finished" podID="1043102b-2eb1-4076-980d-573e349eb7f5" containerID="3186041a3c1248e886cd0e63e615919740f06d7db04faa267fd4c25d405c3a7c" exitCode=0
Jul 29 05:07:17.421126 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:17.420750    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-be8bc5-dnqcj" event={"ID":"1043102b-2eb1-4076-980d-573e349eb7f5","Type":"ContainerDied","Data":"3186041a3c1248e886cd0e63e615919740f06d7db04faa267fd4c25d405c3a7c"}
Jul 29 05:07:17.421126 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:17.420854    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-be8bc5-dnqcj" event={"ID":"1043102b-2eb1-4076-980d-573e349eb7f5","Type":"ContainerStarted","Data":"0e40255917a26e131453db331d0bbacbf7f95bf0d65be7a0abe9f050e9cb7ace"}
Jul 29 05:07:18.552424 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:18.552388    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-be8bc5-dnqcj"
Jul 29 05:07:18.586659 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:18.586634    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1043102b-2eb1-4076-980d-573e349eb7f5-maas-api-service-ca\") pod \"1043102b-2eb1-4076-980d-573e349eb7f5\" (UID: \"1043102b-2eb1-4076-980d-573e349eb7f5\") "
Jul 29 05:07:18.586982 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:18.586957    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1043102b-2eb1-4076-980d-573e349eb7f5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1043102b-2eb1-4076-980d-573e349eb7f5" (UID: "1043102b-2eb1-4076-980d-573e349eb7f5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 05:07:18.687565 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:18.687477    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1043102b-2eb1-4076-980d-573e349eb7f5-maas-api-service-ca\") on node \"ip-10-0-130-4.ec2.internal\" DevicePath \"\""
Jul 29 05:07:19.433188 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:19.433155    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-be8bc5-dnqcj"
Jul 29 05:07:19.433390 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:19.433191    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-be8bc5-dnqcj" event={"ID":"1043102b-2eb1-4076-980d-573e349eb7f5","Type":"ContainerDied","Data":"0e40255917a26e131453db331d0bbacbf7f95bf0d65be7a0abe9f050e9cb7ace"}
Jul 29 05:07:19.433390 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:19.433239    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0e40255917a26e131453db331d0bbacbf7f95bf0d65be7a0abe9f050e9cb7ace"
Jul 29 05:07:26.575732 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:26.575702    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-be8bc5-29755020-wll28"]
Jul 29 05:07:26.581063 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:26.581039    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-be8bc5-29755020-wll28"]
Jul 29 05:07:26.935022 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:26.934988    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-be8bc5-dnqcj"]
Jul 29 05:07:26.939209 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:26.939182    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-be8bc5-dnqcj"]
Jul 29 05:07:28.149027 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:28.148992    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1043102b-2eb1-4076-980d-573e349eb7f5" path="/var/lib/kubelet/pods/1043102b-2eb1-4076-980d-573e349eb7f5/volumes"
Jul 29 05:07:28.149395 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:28.149272    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7f939d6-a940-4f00-8f77-3970b406985b" path="/var/lib/kubelet/pods/c7f939d6-a940-4f00-8f77-3970b406985b/volumes"
Jul 29 05:07:29.498335 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:29.498299    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jn88m"]
Jul 29 05:07:40.027643 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:40.027607    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-cthxg_20443ca3-c07a-4931-946a-5dabf4ee539b/manager/0.log"
Jul 29 05:07:40.724318 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:40.724292    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64c765c8-tr4vz_bed5eefc-3f59-455f-87d0-c180dc472ae7/copy-manifests/0.log"
Jul 29 05:07:40.731902 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:40.731873    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64c765c8-tr4vz_bed5eefc-3f59-455f-87d0-c180dc472ae7/manager/0.log"
Jul 29 05:07:41.422423 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:41.422398    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29755020-mhr49_a5b0e6b7-84b4-46a5-b305-799f6fbe37c1/cleanup/0.log"
Jul 29 05:07:43.482935 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:43.482904    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-jn88m_6f4d7c11-6c60-4c8a-9d9f-972ac0430813/limitador/0.log"
Jul 29 05:07:44.182618 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:44.182590    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-76ccb86b9-9dqb8_b5c5dc98-bc8f-4b33-97c9-356d4c60ada1/kube-auth-proxy/0.log"
Jul 29 05:07:45.168382 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:45.168357    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-swv4f_943237de-e0a7-4015-bda2-827a1b164502/main/0.log"
Jul 29 05:07:45.386071 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:45.386035    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl5szt_9b2e62d8-052b-43a7-8725-3807e1947115/main/0.log"
Jul 29 05:07:45.606118 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:45.606093    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-gflm5_51cff2f2-45dc-4442-9c4f-0540142ff6e8/main/0.log"
Jul 29 05:07:54.107100 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:54.107061    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ftvjm_ad8e0e9f-d912-40df-98b5-5e17f77aa631/global-pull-secret-syncer/0.log"
Jul 29 05:07:54.238731 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:54.238702    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-548lx_dddb6b6e-32b5-4bcf-85d8-8c4d57451fe9/konnectivity-agent/0.log"
Jul 29 05:07:54.284856 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:54.284824    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-4.ec2.internal_9c7cb484c0a90a7b37dbbc2d4d151971/haproxy/0.log"
Jul 29 05:07:54.527290 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:54.527210    2572 scope.go:117] "RemoveContainer" containerID="e04a0829d7a7ad42dbbd32035ad3e8913c2f9f46c6e1f75299a327a457137218"
Jul 29 05:07:54.535961 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:54.535940    2572 scope.go:117] "RemoveContainer" containerID="67eae26a6916ad5e21446acbbd3222d0a8c733ed8d40bbcb8d3756bb0f6f7089"
Jul 29 05:07:59.252345 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:07:59.252311    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-jn88m_6f4d7c11-6c60-4c8a-9d9f-972ac0430813/limitador/0.log"
Jul 29 05:08:01.018531 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:01.018421    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96/alertmanager/0.log"
Jul 29 05:08:01.047221 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:01.047197    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96/config-reloader/0.log"
Jul 29 05:08:01.077059 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:01.077031    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96/kube-rbac-proxy-web/0.log"
Jul 29 05:08:01.108812 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:01.108779    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96/kube-rbac-proxy/0.log"
Jul 29 05:08:01.139732 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:01.139708    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96/kube-rbac-proxy-metric/0.log"
Jul 29 05:08:01.162715 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:01.162692    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96/prom-label-proxy/0.log"
Jul 29 05:08:01.184974 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:01.184955    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bda2f880-ab5b-4f5c-ade0-5e43b2c9dc96/init-config-reloader/0.log"
Jul 29 05:08:01.281308 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:01.281229    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-2tsrx_0e36ed56-ec3e-413f-8cd7-b4955804d557/kube-state-metrics/0.log"
Jul 29 05:08:01.298548 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:01.298522    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-2tsrx_0e36ed56-ec3e-413f-8cd7-b4955804d557/kube-rbac-proxy-main/0.log"
Jul 29 05:08:01.320546 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:01.320526    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-2tsrx_0e36ed56-ec3e-413f-8cd7-b4955804d557/kube-rbac-proxy-self/0.log"
Jul 29 05:08:01.347214 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:01.347189    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-78c57778cc-rzf4d_3f51c5b1-20d1-41ee-9cdd-e91466edba0c/metrics-server/0.log"
Jul 29 05:08:01.372240 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:01.372214    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-hs7fd_cab041a4-c65e-4289-b8b9-bf16486fcbdd/monitoring-plugin/0.log"
Jul 29 05:08:01.565246 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:01.565172    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nvlt9_9365ba50-d29a-42ed-a00c-d90acac83158/node-exporter/0.log"
Jul 29 05:08:01.588494 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:01.588448    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nvlt9_9365ba50-d29a-42ed-a00c-d90acac83158/kube-rbac-proxy/0.log"
Jul 29 05:08:01.610897 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:01.610877    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nvlt9_9365ba50-d29a-42ed-a00c-d90acac83158/init-textfile/0.log"
Jul 29 05:08:01.647248 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:01.647226    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-mgwlp_07f13065-7fae-4b45-b8de-f3a093c67ae7/kube-rbac-proxy-main/0.log"
Jul 29 05:08:01.675931 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:01.675903    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-mgwlp_07f13065-7fae-4b45-b8de-f3a093c67ae7/kube-rbac-proxy-self/0.log"
Jul 29 05:08:01.701105 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:01.701079    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-mgwlp_07f13065-7fae-4b45-b8de-f3a093c67ae7/openshift-state-metrics/0.log"
Jul 29 05:08:01.749721 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:01.749685    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d/prometheus/0.log"
Jul 29 05:08:01.798889 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:01.798869    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d/config-reloader/0.log"
Jul 29 05:08:01.864479 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:01.864460    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d/thanos-sidecar/0.log"
Jul 29 05:08:01.924675 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:01.924650    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d/kube-rbac-proxy-web/0.log"
Jul 29 05:08:01.967342 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:01.967321    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d/kube-rbac-proxy/0.log"
Jul 29 05:08:01.991181 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:01.991159    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d/kube-rbac-proxy-thanos/0.log"
Jul 29 05:08:02.014069 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:02.014050    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4d77fbb0-0119-4f0f-b7e8-c0d38522ff8d/init-config-reloader/0.log"
Jul 29 05:08:02.048906 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:02.048886    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-fpn2n_e4e57029-e4b1-4a9b-a2c7-7482eb5a1a83/prometheus-operator/0.log"
Jul 29 05:08:02.076273 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:02.076254    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-fpn2n_e4e57029-e4b1-4a9b-a2c7-7482eb5a1a83/kube-rbac-proxy/0.log"
Jul 29 05:08:02.115390 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:02.115331    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-n2sbd_ddc1c31c-c048-4dc1-868d-92378b66d759/prometheus-operator-admission-webhook/0.log"
Jul 29 05:08:02.248005 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:02.247978    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b44b78b75-zgh2w_18c3c56e-b5d1-49ba-acca-b28e821f32eb/thanos-query/0.log"
Jul 29 05:08:02.271542 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:02.271495    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b44b78b75-zgh2w_18c3c56e-b5d1-49ba-acca-b28e821f32eb/kube-rbac-proxy-web/0.log"
Jul 29 05:08:02.295707 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:02.295683    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b44b78b75-zgh2w_18c3c56e-b5d1-49ba-acca-b28e821f32eb/kube-rbac-proxy/0.log"
Jul 29 05:08:02.324592 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:02.324569    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b44b78b75-zgh2w_18c3c56e-b5d1-49ba-acca-b28e821f32eb/prom-label-proxy/0.log"
Jul 29 05:08:02.346361 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:02.346338    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b44b78b75-zgh2w_18c3c56e-b5d1-49ba-acca-b28e821f32eb/kube-rbac-proxy-rules/0.log"
Jul 29 05:08:02.373441 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:02.373418    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b44b78b75-zgh2w_18c3c56e-b5d1-49ba-acca-b28e821f32eb/kube-rbac-proxy-metrics/0.log"
Jul 29 05:08:04.083125 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:04.083095    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bld4p/perf-node-gather-daemonset-rgp5f"]
Jul 29 05:08:04.083477 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:04.083449    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1043102b-2eb1-4076-980d-573e349eb7f5" containerName="revoke-keys"
Jul 29 05:08:04.083477 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:04.083460    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1043102b-2eb1-4076-980d-573e349eb7f5" containerName="revoke-keys"
Jul 29 05:08:04.083606 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:04.083555    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1043102b-2eb1-4076-980d-573e349eb7f5" containerName="revoke-keys"
Jul 29 05:08:04.088213 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:04.088197    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-rgp5f"
Jul 29 05:08:04.090447 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:04.090428    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bld4p\"/\"kube-root-ca.crt\""
Jul 29 05:08:04.090569 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:04.090513    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bld4p\"/\"default-dockercfg-hmmx4\""
Jul 29 05:08:04.091382 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:04.091336    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bld4p\"/\"openshift-service-ca.crt\""
Jul 29 05:08:04.093849 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:04.093826    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bld4p/perf-node-gather-daemonset-rgp5f"]
Jul 29 05:08:04.198201 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:04.198169    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/180fbb46-5ac4-434a-a6ba-f7377b944788-proc\") pod \"perf-node-gather-daemonset-rgp5f\" (UID: \"180fbb46-5ac4-434a-a6ba-f7377b944788\") " pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-rgp5f"
Jul 29 05:08:04.198358 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:04.198265    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/180fbb46-5ac4-434a-a6ba-f7377b944788-sys\") pod \"perf-node-gather-daemonset-rgp5f\" (UID: \"180fbb46-5ac4-434a-a6ba-f7377b944788\") " pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-rgp5f"
Jul 29 05:08:04.198358 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:04.198325    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/180fbb46-5ac4-434a-a6ba-f7377b944788-lib-modules\") pod \"perf-node-gather-daemonset-rgp5f\" (UID: \"180fbb46-5ac4-434a-a6ba-f7377b944788\") " pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-rgp5f"
Jul 29 05:08:04.198473 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:04.198440    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbq9n\" (UniqueName: \"kubernetes.io/projected/180fbb46-5ac4-434a-a6ba-f7377b944788-kube-api-access-jbq9n\") pod \"perf-node-gather-daemonset-rgp5f\" (UID: \"180fbb46-5ac4-434a-a6ba-f7377b944788\") " pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-rgp5f"
Jul 29 05:08:04.198564 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:04.198484    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/180fbb46-5ac4-434a-a6ba-f7377b944788-podres\") pod \"perf-node-gather-daemonset-rgp5f\" (UID: \"180fbb46-5ac4-434a-a6ba-f7377b944788\") " pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-rgp5f"
Jul 29 05:08:04.299369 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:04.299335    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/180fbb46-5ac4-434a-a6ba-f7377b944788-proc\") pod \"perf-node-gather-daemonset-rgp5f\" (UID: \"180fbb46-5ac4-434a-a6ba-f7377b944788\") " pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-rgp5f"
Jul 29 05:08:04.299558 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:04.299391    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/180fbb46-5ac4-434a-a6ba-f7377b944788-sys\") pod \"perf-node-gather-daemonset-rgp5f\" (UID: \"180fbb46-5ac4-434a-a6ba-f7377b944788\") " pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-rgp5f"
Jul 29 05:08:04.299558 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:04.299434    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/180fbb46-5ac4-434a-a6ba-f7377b944788-lib-modules\") pod \"perf-node-gather-daemonset-rgp5f\" (UID: \"180fbb46-5ac4-434a-a6ba-f7377b944788\") " pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-rgp5f"
Jul 29 05:08:04.299558 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:04.299472    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/180fbb46-5ac4-434a-a6ba-f7377b944788-proc\") pod \"perf-node-gather-daemonset-rgp5f\" (UID: \"180fbb46-5ac4-434a-a6ba-f7377b944788\") " pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-rgp5f"
Jul 29 05:08:04.299558 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:04.299522    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbq9n\" (UniqueName: \"kubernetes.io/projected/180fbb46-5ac4-434a-a6ba-f7377b944788-kube-api-access-jbq9n\") pod \"perf-node-gather-daemonset-rgp5f\" (UID: \"180fbb46-5ac4-434a-a6ba-f7377b944788\") " pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-rgp5f"
Jul 29 05:08:04.299558 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:04.299549    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/180fbb46-5ac4-434a-a6ba-f7377b944788-podres\") pod \"perf-node-gather-daemonset-rgp5f\" (UID: \"180fbb46-5ac4-434a-a6ba-f7377b944788\") " pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-rgp5f"
Jul 29 05:08:04.299786 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:04.299523    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/180fbb46-5ac4-434a-a6ba-f7377b944788-sys\") pod \"perf-node-gather-daemonset-rgp5f\" (UID: \"180fbb46-5ac4-434a-a6ba-f7377b944788\") " pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-rgp5f"
Jul 29 05:08:04.299786 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:04.299647    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/180fbb46-5ac4-434a-a6ba-f7377b944788-lib-modules\") pod \"perf-node-gather-daemonset-rgp5f\" (UID: \"180fbb46-5ac4-434a-a6ba-f7377b944788\") " pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-rgp5f"
Jul 29 05:08:04.299786 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:04.299677    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/180fbb46-5ac4-434a-a6ba-f7377b944788-podres\") pod \"perf-node-gather-daemonset-rgp5f\" (UID: \"180fbb46-5ac4-434a-a6ba-f7377b944788\") " pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-rgp5f"
Jul 29 05:08:04.308317 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:04.308296    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbq9n\" (UniqueName: \"kubernetes.io/projected/180fbb46-5ac4-434a-a6ba-f7377b944788-kube-api-access-jbq9n\") pod \"perf-node-gather-daemonset-rgp5f\" (UID: \"180fbb46-5ac4-434a-a6ba-f7377b944788\") " pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-rgp5f"
Jul 29 05:08:04.399348 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:04.399324    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-rgp5f"
Jul 29 05:08:04.539674 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:04.539648    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bld4p/perf-node-gather-daemonset-rgp5f"]
Jul 29 05:08:04.541911 ip-10-0-130-4 kubenswrapper[2572]: W0729 05:08:04.541886    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod180fbb46_5ac4_434a_a6ba_f7377b944788.slice/crio-e3a6e57eae85abc91115a45bf7e37e28eb2b4ef2df7d7604e34895f4895e0ec9 WatchSource:0}: Error finding container e3a6e57eae85abc91115a45bf7e37e28eb2b4ef2df7d7604e34895f4895e0ec9: Status 404 returned error can't find the container with id e3a6e57eae85abc91115a45bf7e37e28eb2b4ef2df7d7604e34895f4895e0ec9
Jul 29 05:08:04.664388 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:04.664310    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-rgp5f" event={"ID":"180fbb46-5ac4-434a-a6ba-f7377b944788","Type":"ContainerStarted","Data":"e3a6e57eae85abc91115a45bf7e37e28eb2b4ef2df7d7604e34895f4895e0ec9"}
Jul 29 05:08:05.670313 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:05.670272    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-rgp5f" event={"ID":"180fbb46-5ac4-434a-a6ba-f7377b944788","Type":"ContainerStarted","Data":"aada031757263a2bb0fb09c56a49840b0040c55006e5c465e3b7b430f2104efc"}
Jul 29 05:08:05.670719 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:05.670373    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-rgp5f"
Jul 29 05:08:05.688354 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:05.688304    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-rgp5f" podStartSLOduration=1.68829064 podStartE2EDuration="1.68829064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 05:08:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 05:08:05.685238078 +0000 UTC m=+3852.118276191" watchObservedRunningTime="2026-07-29 05:08:05.68829064 +0000 UTC m=+3852.121328777"
Jul 29 05:08:06.550030 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:06.549998    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f2tq9_4c4b3a0f-6a1e-49e9-9566-60cca5f58cde/dns/0.log"
Jul 29 05:08:06.574892 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:06.574867    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f2tq9_4c4b3a0f-6a1e-49e9-9566-60cca5f58cde/kube-rbac-proxy/0.log"
Jul 29 05:08:06.707428 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:06.707404    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dnkkq_f0431314-54c9-4235-a9b8-6cde6d840fe9/dns-node-resolver/0.log"
Jul 29 05:08:07.313198 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:07.313165    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mtfx7_4e738e9c-9ec3-4eee-ba0c-98a66f23cb15/node-ca/0.log"
Jul 29 05:08:08.518157 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:08.518128    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-76ccb86b9-9dqb8_b5c5dc98-bc8f-4b33-97c9-356d4c60ada1/kube-auth-proxy/0.log"
Jul 29 05:08:09.477403 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:09.477366    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-55jls_19251c81-52a7-4281-872d-3ad2ad32b2e2/serve-healthcheck-canary/0.log"
Jul 29 05:08:10.029977 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:10.029952    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2mknl_30460d33-1c48-4aae-abfd-0573702aa066/kube-rbac-proxy/0.log"
Jul 29 05:08:10.052647 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:10.052609    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2mknl_30460d33-1c48-4aae-abfd-0573702aa066/exporter/0.log"
Jul 29 05:08:10.074788 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:10.074766    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2mknl_30460d33-1c48-4aae-abfd-0573702aa066/extractor/0.log"
Jul 29 05:08:11.685985 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:11.685959    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-rgp5f"
Jul 29 05:08:12.668446 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:12.668416    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-cthxg_20443ca3-c07a-4931-946a-5dabf4ee539b/manager/0.log"
Jul 29 05:08:13.131413 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:13.131379    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64c765c8-tr4vz_bed5eefc-3f59-455f-87d0-c180dc472ae7/manager/0.log"
Jul 29 05:08:13.153590 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:13.153567    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64c765c8-tr4vz_bed5eefc-3f59-455f-87d0-c180dc472ae7/copy-manifests/0.log"
Jul 29 05:08:14.530166 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:14.530132    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-76ccb86b9-9dqb8_b5c5dc98-bc8f-4b33-97c9-356d4c60ada1/kube-auth-proxy/0.log"
Jul 29 05:08:14.585683 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:14.585648    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-75c59548f9-sch5c_717e09e6-36c0-4942-9292-1b63569aeaa5/manager/0.log"
Jul 29 05:08:16.297082 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:16.297055    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-76ccb86b9-9dqb8_b5c5dc98-bc8f-4b33-97c9-356d4c60ada1/kube-auth-proxy/0.log"
Jul 29 05:08:21.045252 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:21.045223    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kg9jl_f5975794-9295-4748-9bce-2b0ef3fbeb8d/kube-multus-additional-cni-plugins/0.log"
Jul 29 05:08:21.065522 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:21.065472    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kg9jl_f5975794-9295-4748-9bce-2b0ef3fbeb8d/egress-router-binary-copy/0.log"
Jul 29 05:08:21.085090 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:21.085073    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kg9jl_f5975794-9295-4748-9bce-2b0ef3fbeb8d/cni-plugins/0.log"
Jul 29 05:08:21.105301 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:21.105280    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kg9jl_f5975794-9295-4748-9bce-2b0ef3fbeb8d/bond-cni-plugin/0.log"
Jul 29 05:08:21.125281 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:21.125258    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kg9jl_f5975794-9295-4748-9bce-2b0ef3fbeb8d/routeoverride-cni/0.log"
Jul 29 05:08:21.144417 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:21.144401    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kg9jl_f5975794-9295-4748-9bce-2b0ef3fbeb8d/whereabouts-cni-bincopy/0.log"
Jul 29 05:08:21.164274 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:21.164249    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kg9jl_f5975794-9295-4748-9bce-2b0ef3fbeb8d/whereabouts-cni/0.log"
Jul 29 05:08:21.410346 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:21.410311    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lmjvb_8644f436-c5c4-433f-92d7-bdc490fe95be/kube-multus/0.log"
Jul 29 05:08:21.471446 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:21.471413    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-glpbr_790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec/network-metrics-daemon/0.log"
Jul 29 05:08:21.487299 ip-10-0-130-4 kubenswrapper[2572]: I0729 05:08:21.487272    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-glpbr_790cc9d0-6220-4ad0-bff0-a1ae3fbcaeec/kube-rbac-proxy/0.log"