Jul 29 00:34:12.393546 ip-10-0-138-146 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 29 00:34:12.393560 ip-10-0-138-146 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 29 00:34:12.393570 ip-10-0-138-146 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 29 00:34:12.394102 ip-10-0-138-146 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 29 00:34:22.527707 ip-10-0-138-146 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 29 00:34:22.527727 ip-10-0-138-146 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 371831b1351946ea8adcb3490a997a9e --
Jul 29 00:36:13.749968 ip-10-0-138-146 systemd[1]: Starting Kubernetes Kubelet...
Jul 29 00:36:14.100402 ip-10-0-138-146 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 00:36:14.100402 ip-10-0-138-146 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 29 00:36:14.100402 ip-10-0-138-146 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 00:36:14.100402 ip-10-0-138-146 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 29 00:36:14.100402 ip-10-0-138-146 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 00:36:14.101362 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.101279    2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 29 00:36:14.106724 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106691    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 00:36:14.106724 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106713    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 00:36:14.106724 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106718    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 00:36:14.106724 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106723    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 00:36:14.106724 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106730    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 00:36:14.107047 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106736    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 00:36:14.107047 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106741    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 00:36:14.107047 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106745    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 00:36:14.107047 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106749    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 00:36:14.107047 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106752    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 00:36:14.107047 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106756    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 00:36:14.107047 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106760    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 00:36:14.107047 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106763    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 00:36:14.107047 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106767    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 00:36:14.107047 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106770    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 00:36:14.107047 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106774    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 00:36:14.107047 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106778    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 00:36:14.107047 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106781    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 00:36:14.107047 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106785    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 00:36:14.107047 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106789    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 00:36:14.107047 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106793    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 00:36:14.107047 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106797    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 00:36:14.107047 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106800    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 00:36:14.107047 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106804    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 00:36:14.107047 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106808    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 00:36:14.107876 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106811    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 00:36:14.107876 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106815    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 00:36:14.107876 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106819    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 00:36:14.107876 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106822    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 00:36:14.107876 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106826    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 00:36:14.107876 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106838    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 00:36:14.107876 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106842    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 00:36:14.107876 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106846    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 00:36:14.107876 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106850    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 00:36:14.107876 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106854    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 00:36:14.107876 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106858    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 00:36:14.107876 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106864    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 00:36:14.107876 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106870    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 00:36:14.107876 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106875    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 00:36:14.107876 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106880    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 00:36:14.107876 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106885    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 00:36:14.107876 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106889    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 00:36:14.107876 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106896    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 00:36:14.107876 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106900    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 00:36:14.108691 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106905    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 00:36:14.108691 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106909    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 00:36:14.108691 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106913    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 00:36:14.108691 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106917    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 00:36:14.108691 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106922    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 00:36:14.108691 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106926    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 00:36:14.108691 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106930    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 00:36:14.108691 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106934    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 00:36:14.108691 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106938    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 00:36:14.108691 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106943    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 00:36:14.108691 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106947    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 00:36:14.108691 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106951    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 00:36:14.108691 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106956    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 00:36:14.108691 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106960    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 00:36:14.108691 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106964    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 00:36:14.108691 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106969    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 00:36:14.108691 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106973    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 00:36:14.108691 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106977    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 00:36:14.108691 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106982    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 00:36:14.108691 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106986    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 00:36:14.109517 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106990    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 00:36:14.109517 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106994    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 00:36:14.109517 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.106998    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 00:36:14.109517 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.107002    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 00:36:14.109517 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.107006    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 00:36:14.109517 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.107010    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 00:36:14.109517 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.107017    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 00:36:14.109517 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.107022    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 00:36:14.109517 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.107027    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 00:36:14.109517 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.107031    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 00:36:14.109517 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.107035    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 00:36:14.109517 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.107039    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 00:36:14.109517 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.107043    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 00:36:14.109517 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.107046    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 00:36:14.109517 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.107050    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 00:36:14.109517 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.107055    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 00:36:14.109517 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.107059    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 00:36:14.109517 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.107063    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 00:36:14.109517 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.107069    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 00:36:14.109517 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.107076    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 00:36:14.110393 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.107081    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 00:36:14.110393 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.107085    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 00:36:14.110393 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.107089    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 00:36:14.110393 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.107095    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 00:36:14.110393 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.107101    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 00:36:14.110393 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.107106    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 00:36:14.110393 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.107111    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 00:36:14.110393 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.107115    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 00:36:14.110393 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.107119    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 00:36:14.110393 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.107124    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 00:36:14.110393 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.107129    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 00:36:14.110393 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.107133    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 00:36:14.110393 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.107138    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 00:36:14.110393 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.107142    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 00:36:14.110393 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.107146    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 00:36:14.110393 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108345    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 00:36:14.110393 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108355    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 00:36:14.110393 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108360    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 00:36:14.110393 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108366    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 00:36:14.110393 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108370    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 00:36:14.111253 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108374    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 00:36:14.111253 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108379    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 00:36:14.111253 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108383    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 00:36:14.111253 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108388    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 00:36:14.111253 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108392    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 00:36:14.111253 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108398    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 00:36:14.111253 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108402    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 00:36:14.111253 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108406    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 00:36:14.111253 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108411    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 00:36:14.111253 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108415    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 00:36:14.111253 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108419    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 00:36:14.111253 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108424    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 00:36:14.111253 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108430    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 00:36:14.111253 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108435    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 00:36:14.111253 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108439    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 00:36:14.111253 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108443    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 00:36:14.111253 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108447    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 00:36:14.111253 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108452    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 00:36:14.111253 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108456    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 00:36:14.111886 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108463    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 00:36:14.111886 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108469    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 00:36:14.111886 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108474    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 00:36:14.111886 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108478    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 00:36:14.111886 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108483    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 00:36:14.111886 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108487    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 00:36:14.111886 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108491    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 00:36:14.111886 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108495    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 00:36:14.111886 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108500    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 00:36:14.111886 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108504    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 00:36:14.111886 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108509    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 00:36:14.111886 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108516    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 00:36:14.111886 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108520    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 00:36:14.111886 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108525    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 00:36:14.111886 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108530    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 00:36:14.111886 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108535    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 00:36:14.111886 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108539    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 00:36:14.111886 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108543    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 00:36:14.111886 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108548    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 00:36:14.111886 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108552    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 00:36:14.112622 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108556    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 00:36:14.112622 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108561    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 00:36:14.112622 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108565    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 00:36:14.112622 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108569    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 00:36:14.112622 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108573    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 00:36:14.112622 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108577    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 00:36:14.112622 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108600    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 00:36:14.112622 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108605    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 00:36:14.112622 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108609    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 00:36:14.112622 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108614    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 00:36:14.112622 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108618    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 00:36:14.112622 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108623    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 00:36:14.112622 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108630    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 00:36:14.112622 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108636    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 00:36:14.112622 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108643    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 00:36:14.112622 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108647    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 00:36:14.112622 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108652    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 00:36:14.112622 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108656    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 00:36:14.112622 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108660    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 00:36:14.113257 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108664    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 00:36:14.113257 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108669    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 00:36:14.113257 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108673    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 00:36:14.113257 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108677    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 00:36:14.113257 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108682    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 00:36:14.113257 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108686    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 00:36:14.113257 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108690    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 00:36:14.113257 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108696    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 00:36:14.113257 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108701    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 00:36:14.113257 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108705    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 00:36:14.113257 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108709    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 00:36:14.113257 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108714    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 00:36:14.113257 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108719    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 00:36:14.113257 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108723    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 00:36:14.113257 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108727    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 00:36:14.113257 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108732    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 00:36:14.113257 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108737    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 00:36:14.113257 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108741    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 00:36:14.113257 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108746    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 00:36:14.113257 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108750    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 00:36:14.113900 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108755    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 00:36:14.113900 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108762    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 00:36:14.113900 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108766    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 00:36:14.113900 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108770    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 00:36:14.113900 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108775    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 00:36:14.113900 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108779    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 00:36:14.113900 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108783    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 00:36:14.113900 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108787    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 00:36:14.113900 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108791    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 00:36:14.113900 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108795    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 00:36:14.113900 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108799    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 00:36:14.113900 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108804    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 00:36:14.113900 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108808    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 00:36:14.113900 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108813    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 00:36:14.113900 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108817    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 00:36:14.113900 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.108821    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 00:36:14.113900 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109463    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 00:36:14.113900 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109471    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 00:36:14.113900 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109476    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 00:36:14.113900 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109481    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 00:36:14.114396 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109485    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 00:36:14.114396 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109490    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 00:36:14.114396 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109494    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 00:36:14.114396 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109499    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 00:36:14.114396 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109503    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 00:36:14.114396 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109508    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 00:36:14.114396 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109512    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 00:36:14.114396 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109516    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 00:36:14.114396 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109523    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 00:36:14.114396 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109528    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 00:36:14.114396 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109533    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 00:36:14.114396 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109537    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 00:36:14.114396 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109543    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 00:36:14.114396 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109547    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 00:36:14.114396 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109552    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 00:36:14.114396 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109556    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 00:36:14.114396 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109561    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 00:36:14.114396 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109565    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 00:36:14.114396 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109569    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 00:36:14.115000 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109573    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 00:36:14.115000 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109578    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 00:36:14.115000 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109599    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 00:36:14.115000 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109603    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 00:36:14.115000 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109608    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 00:36:14.115000 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109612    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 00:36:14.115000 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109617    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 00:36:14.115000 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109621    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 00:36:14.115000 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109624    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 00:36:14.115000 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109629    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 00:36:14.115000 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109633    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 00:36:14.115000 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109637    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 00:36:14.115000 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109642    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 00:36:14.115000 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109646    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 00:36:14.115000 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109651    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 00:36:14.115000 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109655    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 00:36:14.115000 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109662    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 00:36:14.115000 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109667    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 00:36:14.115000 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109671    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 00:36:14.115000 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109676    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 00:36:14.115491 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109680    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 00:36:14.115491 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109684    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 00:36:14.115491 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109689    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 00:36:14.115491 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109693    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 00:36:14.115491 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109697    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 00:36:14.115491 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109702    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 00:36:14.115491 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109709    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 00:36:14.115491 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109713    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 00:36:14.115491 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109719    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 00:36:14.115491 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109724    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 00:36:14.115491 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109728    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 00:36:14.115491 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109733    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 00:36:14.115491 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109739    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 00:36:14.115491 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109744    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 00:36:14.115491 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109750    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 00:36:14.115491 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109755    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 00:36:14.115491 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109760    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 00:36:14.115491 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109764    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 00:36:14.115491 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109769    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 00:36:14.116010 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109773    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 00:36:14.116010 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109778    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 00:36:14.116010 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109782    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 00:36:14.116010 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109786    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 00:36:14.116010 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109790    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 00:36:14.116010 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109795    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 00:36:14.116010 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109799    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 00:36:14.116010 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109803    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 00:36:14.116010 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109807    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 00:36:14.116010 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109814    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 00:36:14.116010 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109818    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 00:36:14.116010 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109822    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 00:36:14.116010 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109826    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 00:36:14.116010 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109832    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 00:36:14.116010 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109837    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 00:36:14.116010 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109841    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 00:36:14.116010 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109846    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 00:36:14.116010 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109850    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 00:36:14.116010 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109854    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 00:36:14.116010 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109858    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 00:36:14.116523 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109863    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 00:36:14.116523 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109867    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 00:36:14.116523 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109871    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 00:36:14.116523 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109875    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 00:36:14.116523 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109879    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 00:36:14.116523 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109884    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 00:36:14.116523 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109888    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 00:36:14.116523 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109892    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 00:36:14.116523 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109896    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 00:36:14.116523 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109901    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 00:36:14.116523 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109905    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 00:36:14.116523 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109909    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 00:36:14.116523 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109913    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 00:36:14.116523 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109918    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 00:36:14.116523 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109922    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 00:36:14.116523 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109927    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 00:36:14.116523 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.109931    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 00:36:14.116523 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110035    2577 flags.go:64] FLAG: --address="0.0.0.0"
Jul 29 00:36:14.116523 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110048    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 29 00:36:14.116523 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110072    2577 flags.go:64] FLAG: --anonymous-auth="true"
Jul 29 00:36:14.116523 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110091    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 29 00:36:14.117112 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110100    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 29 00:36:14.117112 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110105    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 29 00:36:14.117112 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110112    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 29 00:36:14.117112 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110118    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 29 00:36:14.117112 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110123    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 29 00:36:14.117112 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110128    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 29 00:36:14.117112 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110134    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 29 00:36:14.117112 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110139    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 29 00:36:14.117112 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110144    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 29 00:36:14.117112 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110149    2577 flags.go:64] FLAG: --cgroup-root=""
Jul 29 00:36:14.117112 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110154    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 29 00:36:14.117112 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110161    2577 flags.go:64] FLAG: --client-ca-file=""
Jul 29 00:36:14.117112 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110167    2577 flags.go:64] FLAG: --cloud-provider="external"
Jul 29 00:36:14.117112 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110172    2577 flags.go:64] FLAG: --cluster-dns="[]"
Jul 29 00:36:14.117112 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110179    2577 flags.go:64] FLAG: --cluster-domain=""
Jul 29 00:36:14.117112 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110183    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 29 00:36:14.117112 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110188    2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 29 00:36:14.117112 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110193    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 29 00:36:14.117112 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110199    2577 flags.go:64] FLAG: --container-log-max-files="5"
Jul 29 00:36:14.117112 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110205    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 29 00:36:14.117112 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110210    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 29 00:36:14.117112 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110215    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 29 00:36:14.117112 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110221    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 29 00:36:14.117735 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110225    2577 flags.go:64] FLAG: --contention-profiling="false"
Jul 29 00:36:14.117735 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110230    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 29 00:36:14.117735 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110235    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 29 00:36:14.117735 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110240    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 29 00:36:14.117735 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110245    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 29 00:36:14.117735 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110252    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 29 00:36:14.117735 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110257    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 29 00:36:14.117735 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110261    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 29 00:36:14.117735 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110266    2577 flags.go:64] FLAG: --enable-load-reader="false"
Jul 29 00:36:14.117735 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110273    2577 flags.go:64] FLAG: --enable-server="true"
Jul 29 00:36:14.117735 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110278    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 29 00:36:14.117735 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110286    2577 flags.go:64] FLAG: --event-burst="100"
Jul 29 00:36:14.117735 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110291    2577 flags.go:64] FLAG: --event-qps="50"
Jul 29 00:36:14.117735 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110295    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 29 00:36:14.117735 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110300    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 29 00:36:14.117735 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110305    2577 flags.go:64] FLAG: --eviction-hard=""
Jul 29 00:36:14.117735 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110311    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 29 00:36:14.117735 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110316    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 29 00:36:14.117735 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110321    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 29 00:36:14.117735 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110326    2577 flags.go:64] FLAG: --eviction-soft=""
Jul 29 00:36:14.117735 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110332    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 29 00:36:14.117735 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110337    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 29 00:36:14.117735 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110343    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 29 00:36:14.117735 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110347    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 29 00:36:14.117735 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110352    2577 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 29 00:36:14.118405 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110357    2577 flags.go:64] FLAG: --fail-swap-on="true"
Jul 29 00:36:14.118405 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110361    2577 flags.go:64] FLAG: --feature-gates=""
Jul 29 00:36:14.118405 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110369    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 29 00:36:14.118405 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110374    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 29 00:36:14.118405 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110379    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 29 00:36:14.118405 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110384    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 29 00:36:14.118405 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110388    2577 flags.go:64] FLAG: --healthz-port="10248"
Jul 29 00:36:14.118405 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110393    2577 flags.go:64] FLAG: --help="false"
Jul 29 00:36:14.118405 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110398    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-138-146.ec2.internal"
Jul 29 00:36:14.118405 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110402    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 29 00:36:14.118405 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110407    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 29 00:36:14.118405 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110411    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 29 00:36:14.118405 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110417    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 29 00:36:14.118405 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110422    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 29 00:36:14.118405 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110427    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 29 00:36:14.118405 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110432    2577 flags.go:64] FLAG: --image-service-endpoint=""
Jul 29 00:36:14.118405 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110437    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 29 00:36:14.118405 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110442    2577 flags.go:64] FLAG: --kube-api-burst="100"
Jul 29 00:36:14.118405 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110447    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 29 00:36:14.118405 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110452    2577 flags.go:64] FLAG: --kube-api-qps="50"
Jul 29 00:36:14.118405 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110456    2577 flags.go:64] FLAG: --kube-reserved=""
Jul 29 00:36:14.118405 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110461    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 29 00:36:14.118405 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110466    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 29 00:36:14.118405 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110471    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 29 00:36:14.119033 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110476    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 29 00:36:14.119033 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110481    2577 flags.go:64] FLAG: --lock-file=""
Jul 29 00:36:14.119033 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110486    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 29 00:36:14.119033 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110492    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 29 00:36:14.119033 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110497    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 29 00:36:14.119033 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110506    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 29 00:36:14.119033 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110512    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 29 00:36:14.119033 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110517    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 29 00:36:14.119033 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110522    2577 flags.go:64] FLAG: --logging-format="text"
Jul 29 00:36:14.119033 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110526    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 29 00:36:14.119033 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110532    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 29 00:36:14.119033 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110536    2577 flags.go:64] FLAG: --manifest-url=""
Jul 29 00:36:14.119033 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110541    2577 flags.go:64] FLAG: --manifest-url-header=""
Jul 29 00:36:14.119033 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110548    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 29 00:36:14.119033 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110554    2577 flags.go:64] FLAG: --max-open-files="1000000"
Jul 29 00:36:14.119033 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110561    2577 flags.go:64] FLAG: --max-pods="110"
Jul 29 00:36:14.119033 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110565    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 29 00:36:14.119033 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110570    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 29 00:36:14.119033 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110575    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 29 00:36:14.119033 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110595    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 29 00:36:14.119033 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110600    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 29 00:36:14.119033 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110605    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 29 00:36:14.119033 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110611    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 29 00:36:14.119033 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110623    2577 flags.go:64] FLAG: --node-status-max-images="50"
Jul 29 00:36:14.119033 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110628    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 29 00:36:14.119666 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110633    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 29 00:36:14.119666 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110638    2577 flags.go:64] FLAG: --pod-cidr=""
Jul 29 00:36:14.119666 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110643    2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 29 00:36:14.119666 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110652    2577 flags.go:64] FLAG: --pod-manifest-path=""
Jul 29 00:36:14.119666 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110656    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 29 00:36:14.119666 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110661    2577 flags.go:64] FLAG: --pods-per-core="0"
Jul 29 00:36:14.119666 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110666    2577 flags.go:64] FLAG: --port="10250"
Jul 29 00:36:14.119666 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110671    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 29 00:36:14.119666 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110676    2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e78cb10463466602"
Jul 29 00:36:14.119666 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110688    2577 flags.go:64] FLAG: --qos-reserved=""
Jul 29 00:36:14.119666 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110693    2577 flags.go:64] FLAG: --read-only-port="10255"
Jul 29 00:36:14.119666 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110700    2577 flags.go:64] FLAG: --register-node="true"
Jul 29 00:36:14.119666 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110705    2577 flags.go:64] FLAG: --register-with-taints=""
Jul 29 00:36:14.119666 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110711    2577 flags.go:64] FLAG: --registry-burst="10"
Jul 29 00:36:14.119666 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110717    2577 flags.go:64] FLAG: --registry-qps="5"
Jul 29 00:36:14.119666 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110721    2577 flags.go:64] FLAG: --reserved-cpus=""
Jul 29 00:36:14.119666 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110726    2577 flags.go:64] FLAG: --reserved-memory=""
Jul 29 00:36:14.119666 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110732    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 29 00:36:14.119666 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110737    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 29 00:36:14.119666 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110742    2577 flags.go:64] FLAG: --rotate-certificates="false"
Jul 29 00:36:14.119666 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110747    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 29 00:36:14.119666 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110752    2577 flags.go:64] FLAG: --runonce="false"
Jul 29 00:36:14.119666 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110756    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 29 00:36:14.119666 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110761    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 29 00:36:14.119666 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110766    2577 flags.go:64] FLAG: --seccomp-default="false"
Jul 29 00:36:14.120289 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110771    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 29 00:36:14.120289 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110776    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 29 00:36:14.120289 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110781    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 29 00:36:14.120289 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110787    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 29 00:36:14.120289 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110792    2577 flags.go:64] FLAG: --storage-driver-password="root"
Jul 29 00:36:14.120289 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110797    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 29 00:36:14.120289 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110802    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 29 00:36:14.120289 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110806    2577 flags.go:64] FLAG: --storage-driver-user="root"
Jul 29 00:36:14.120289 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110811    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 29 00:36:14.120289 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110816    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 29 00:36:14.120289 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110820    2577 flags.go:64] FLAG: --system-cgroups=""
Jul 29 00:36:14.120289 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110825    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 29 00:36:14.120289 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110834    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 29 00:36:14.120289 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110839    2577 flags.go:64] FLAG: --tls-cert-file=""
Jul 29 00:36:14.120289 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110844    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 29 00:36:14.120289 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110850    2577 flags.go:64] FLAG: --tls-min-version=""
Jul 29 00:36:14.120289 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110855    2577 flags.go:64] FLAG: --tls-private-key-file=""
Jul 29 00:36:14.120289 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110860    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 29 00:36:14.120289 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110866    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 29 00:36:14.120289 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110871    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 29 00:36:14.120289 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110876    2577 flags.go:64] FLAG: --v="2"
Jul 29 00:36:14.120289 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110882    2577 flags.go:64] FLAG: --version="false"
Jul 29 00:36:14.120289 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110891    2577 flags.go:64] FLAG: --vmodule=""
Jul 29 00:36:14.120289 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110897    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 29 00:36:14.120289 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.110902    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 29 00:36:14.120934 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111087    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 00:36:14.120934 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111094    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 00:36:14.120934 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111100    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 00:36:14.120934 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111104    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 00:36:14.120934 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111109    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 00:36:14.120934 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111114    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 00:36:14.120934 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111119    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 00:36:14.120934 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111123    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 00:36:14.120934 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111128    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 00:36:14.120934 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111132    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 00:36:14.120934 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111136    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 00:36:14.120934 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111140    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 00:36:14.120934 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111144    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 00:36:14.120934 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111149    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 00:36:14.120934 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111154    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 00:36:14.120934 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111158    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 00:36:14.120934 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111163    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 00:36:14.120934 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111167    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 00:36:14.120934 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111171    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 00:36:14.120934 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111175    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 00:36:14.121459 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111180    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 00:36:14.121459 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111184    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 00:36:14.121459 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111188    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 00:36:14.121459 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111193    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 00:36:14.121459 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111197    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 00:36:14.121459 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111204    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 00:36:14.121459 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111208    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 00:36:14.121459 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111213    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 00:36:14.121459 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111217    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 00:36:14.121459 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111222    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 00:36:14.121459 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111227    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 00:36:14.121459 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111231    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 00:36:14.121459 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111236    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 00:36:14.121459 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111240    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 00:36:14.121459 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111244    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 00:36:14.121459 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111248    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 00:36:14.121459 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111252    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 00:36:14.121459 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111256    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 00:36:14.121459 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111260    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 00:36:14.121459 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111264    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 00:36:14.122001 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111268    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 00:36:14.122001 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111272    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 00:36:14.122001 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111276    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 00:36:14.122001 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111281    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 00:36:14.122001 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111285    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 00:36:14.122001 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111291    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 00:36:14.122001 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111295    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 00:36:14.122001 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111300    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 00:36:14.122001 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111304    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 00:36:14.122001 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111308    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 00:36:14.122001 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111313    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 00:36:14.122001 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111317    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 00:36:14.122001 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111321    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 00:36:14.122001 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111325    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 00:36:14.122001 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111330    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 00:36:14.122001 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111334    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 00:36:14.122001 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111339    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 00:36:14.122001 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111344    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 00:36:14.122001 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111349    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 00:36:14.122001 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111353    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 00:36:14.122483 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111357    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 00:36:14.122483 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111361    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 00:36:14.122483 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111365    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 00:36:14.122483 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111371    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 00:36:14.122483 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111376    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 00:36:14.122483 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111381    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 00:36:14.122483 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111385    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 00:36:14.122483 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111389    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 00:36:14.122483 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111393    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 00:36:14.122483 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111398    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 00:36:14.122483 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111401    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 00:36:14.122483 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111406    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 00:36:14.122483 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111410    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 00:36:14.122483 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111414    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 00:36:14.122483 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111418    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 00:36:14.122483 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111425    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 00:36:14.122483 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111431    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 00:36:14.122483 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111439    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 00:36:14.122483 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111444    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 00:36:14.122982 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111449    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 00:36:14.122982 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111454    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 00:36:14.122982 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111459    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 00:36:14.122982 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111463    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 00:36:14.122982 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111468    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 00:36:14.122982 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111472    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 00:36:14.122982 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111477    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 00:36:14.122982 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111481    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 00:36:14.122982 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111485    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 00:36:14.122982 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111489    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 00:36:14.122982 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111496    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 00:36:14.122982 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111502    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 00:36:14.122982 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111506    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 00:36:14.122982 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111510    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 00:36:14.122982 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111514    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 00:36:14.122982 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111519    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 00:36:14.122982 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111523    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 00:36:14.122982 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111528    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 00:36:14.122982 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111532    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 00:36:14.123440 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.111538    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 00:36:14.123440 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.112133    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 00:36:14.123440 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.119418    2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 29 00:36:14.123440 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.119437    2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 29 00:36:14.123440 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.119455    2577 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 29 00:36:14.123440 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.119460    2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 29 00:36:14.123440 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119528    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 00:36:14.123440 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119534    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 00:36:14.123440 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119538    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 00:36:14.123440 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119541    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 00:36:14.123440 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119544    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 00:36:14.123440 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119547    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 00:36:14.123440 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119550    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 00:36:14.123440 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119553    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 00:36:14.123817 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119556    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 00:36:14.123817 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119559    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 00:36:14.123817 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119562    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 00:36:14.123817 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119564    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 00:36:14.123817 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119567    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 00:36:14.123817 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119570    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 00:36:14.123817 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119573    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 00:36:14.123817 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119577    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 00:36:14.123817 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119597    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 00:36:14.123817 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119600    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 00:36:14.123817 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119603    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 00:36:14.123817 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119606    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 00:36:14.123817 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119609    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 00:36:14.123817 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119612    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 00:36:14.123817 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119615    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 00:36:14.123817 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119617    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 00:36:14.123817 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119627    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 00:36:14.123817 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119629    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 00:36:14.123817 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119632    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 00:36:14.124276 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119635    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 00:36:14.124276 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119637    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 00:36:14.124276 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119641    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 00:36:14.124276 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119644    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 00:36:14.124276 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119646    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 00:36:14.124276 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119649    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 00:36:14.124276 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119652    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 00:36:14.124276 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119654    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 00:36:14.124276 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119658    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 00:36:14.124276 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119661    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 00:36:14.124276 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119663    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 00:36:14.124276 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119666    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 00:36:14.124276 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119669    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 00:36:14.124276 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119672    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 00:36:14.124276 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119674    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 00:36:14.124276 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119677    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 00:36:14.124276 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119680    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 00:36:14.124276 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119683    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 00:36:14.124276 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119685    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 00:36:14.124276 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119688    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 00:36:14.124786 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119690    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 00:36:14.124786 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119693    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 00:36:14.124786 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119696    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 00:36:14.124786 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119698    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 00:36:14.124786 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119701    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 00:36:14.124786 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119703    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 00:36:14.124786 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119706    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 00:36:14.124786 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119709    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 00:36:14.124786 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119712    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 00:36:14.124786 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119714    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 00:36:14.124786 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119722    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 00:36:14.124786 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119724    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 00:36:14.124786 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119727    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 00:36:14.124786 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119730    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 00:36:14.124786 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119735    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 00:36:14.124786 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119738    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 00:36:14.124786 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119741    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 00:36:14.124786 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119744    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 00:36:14.124786 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119747    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 00:36:14.124786 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119749    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 00:36:14.125278 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119753    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 00:36:14.125278 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119756    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 00:36:14.125278 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119758    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 00:36:14.125278 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119761    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 00:36:14.125278 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119763    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 00:36:14.125278 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119767    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 00:36:14.125278 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119769    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 00:36:14.125278 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119772    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 00:36:14.125278 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119776    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 00:36:14.125278 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119778    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 00:36:14.125278 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119781    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 00:36:14.125278 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119783    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 00:36:14.125278 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119786    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 00:36:14.125278 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119789    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 00:36:14.125278 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119791    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 00:36:14.125278 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119794    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 00:36:14.125278 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119796    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 00:36:14.125278 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119799    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 00:36:14.125278 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119802    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 00:36:14.125278 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119804    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 00:36:14.125841 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119806    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 00:36:14.125841 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119809    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 00:36:14.125841 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119811    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 00:36:14.125841 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119825    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 00:36:14.125841 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119829    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 00:36:14.125841 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119832    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 00:36:14.125841 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119836    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 00:36:14.125841 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119839    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 00:36:14.125841 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119842    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 00:36:14.125841 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119844    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 00:36:14.125841 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119847    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 00:36:14.125841 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.119850    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 00:36:14.125841 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.119860    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 00:36:14.125841 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120006    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 00:36:14.126190 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120010    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 00:36:14.126190 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120014    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 00:36:14.126190 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120016    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 00:36:14.126190 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120019    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 00:36:14.126190 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120022    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 00:36:14.126190 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120025    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 00:36:14.126190 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120027    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 00:36:14.126190 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120030    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 00:36:14.126190 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120032    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 00:36:14.126190 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120035    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 00:36:14.126190 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120038    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 00:36:14.126190 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120040    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 00:36:14.126190 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120043    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 00:36:14.126190 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120045    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 00:36:14.126190 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120047    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 00:36:14.126190 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120050    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 00:36:14.126190 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120053    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 00:36:14.126190 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120056    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 00:36:14.126190 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120058    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 00:36:14.126190 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120060    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 00:36:14.126708 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120063    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 00:36:14.126708 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120065    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 00:36:14.126708 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120075    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 00:36:14.126708 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120077    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 00:36:14.126708 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120081    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 00:36:14.126708 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120084    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 00:36:14.126708 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120087    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 00:36:14.126708 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120089    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 00:36:14.126708 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120091    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 00:36:14.126708 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120094    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 00:36:14.126708 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120096    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 00:36:14.126708 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120099    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 00:36:14.126708 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120101    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 00:36:14.126708 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120104    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 00:36:14.126708 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120106    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 00:36:14.126708 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120109    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 00:36:14.126708 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120113    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 00:36:14.126708 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120117    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 00:36:14.126708 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120120    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 00:36:14.127179 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120122    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 00:36:14.127179 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120125    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 00:36:14.127179 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120128    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 00:36:14.127179 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120130    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 00:36:14.127179 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120133    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 00:36:14.127179 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120135    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 00:36:14.127179 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120138    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 00:36:14.127179 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120141    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 00:36:14.127179 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120143    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 00:36:14.127179 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120146    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 00:36:14.127179 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120148    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 00:36:14.127179 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120151    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 00:36:14.127179 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120154    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 00:36:14.127179 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120156    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 00:36:14.127179 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120159    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 00:36:14.127179 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120161    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 00:36:14.127179 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120169    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 00:36:14.127179 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120172    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 00:36:14.127179 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120175    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 00:36:14.127179 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120178    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 00:36:14.127673 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120180    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 00:36:14.127673 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120183    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 00:36:14.127673 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120186    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 00:36:14.127673 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120188    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 00:36:14.127673 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120191    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 00:36:14.127673 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120193    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 00:36:14.127673 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120196    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 00:36:14.127673 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120198    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 00:36:14.127673 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120201    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 00:36:14.127673 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120203    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 00:36:14.127673 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120206    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 00:36:14.127673 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120208    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 00:36:14.127673 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120211    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 00:36:14.127673 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120213    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 00:36:14.127673 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120216    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 00:36:14.127673 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120218    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 00:36:14.127673 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120221    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 00:36:14.127673 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120223    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 00:36:14.127673 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120226    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 00:36:14.127673 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120228    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 00:36:14.128165 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120231    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 00:36:14.128165 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120234    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 00:36:14.128165 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120238    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 00:36:14.128165 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120241    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 00:36:14.128165 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120245    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 00:36:14.128165 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120248    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 00:36:14.128165 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120251    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 00:36:14.128165 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120254    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 00:36:14.128165 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120257    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 00:36:14.128165 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120265    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 00:36:14.128165 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120269    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 00:36:14.128165 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120278    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 00:36:14.128165 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120281    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 00:36:14.128165 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120283    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 00:36:14.128165 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120286    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 00:36:14.128165 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120289    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 00:36:14.128165 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120291    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 00:36:14.128165 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120295    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 00:36:14.128165 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:14.120298    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 00:36:14.128641 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.120303    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 00:36:14.128641 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.120441    2577 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 29 00:36:14.128641 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.122573    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 29 00:36:14.128641 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.123925    2577 server.go:1019] "Starting client certificate rotation"
Jul 29 00:36:14.128641 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.124042    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 00:36:14.128641 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.124080    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 00:36:14.128641 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.126735    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 00:36:14.131703 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.131679    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 00:36:14.143248 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.143224    2577 log.go:25] "Validated CRI v1 runtime API"
Jul 29 00:36:14.145529 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.145510    2577 log.go:25] "Validated CRI v1 image API"
Jul 29 00:36:14.146345 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.146320    2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 29 00:36:14.150748 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.150717    2577 fs.go:135] Filesystem UUIDs: map[6639a815-6aef-40b0-86ba-3245c9096da7:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 dcaf42e1-b06a-4e59-98ac-1c8df11db21a:/dev/nvme0n1p4]
Jul 29 00:36:14.150831 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.150746    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 29 00:36:14.156028 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.156000    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 00:36:14.156155 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.155951    2577 manager.go:216] Machine: {Timestamp:2026-07-29 00:36:14.154795902 +0000 UTC m=+0.299253463 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100369 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec213e18a65882a5554be30a33953fdb SystemUUID:ec213e18-a658-82a5-554b-e30a33953fdb BootID:371831b1-3519-46ea-8adc-b3490a997a9e Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:08:8e:5e:5a:af Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:08:8e:5e:5a:af Speed:0 Mtu:9001} {Name:ovs-system MacAddress:02:b3:bb:cd:44:4e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 29 00:36:14.156155 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.156122    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 29 00:36:14.156318 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.156302    2577 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 29 00:36:14.158302 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.158270    2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 29 00:36:14.158478 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.158304    2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-146.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 29 00:36:14.159045 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.159032    2577 topology_manager.go:138] "Creating topology manager with none policy"
Jul 29 00:36:14.159114 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.159049    2577 container_manager_linux.go:309] "Creating device plugin manager"
Jul 29 00:36:14.159114 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.159059    2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 00:36:14.159696 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.159684    2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 00:36:14.160666 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.160654    2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 29 00:36:14.163427 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.163412    2577 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 00:36:14.163565 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.163554    2577 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 29 00:36:14.163646 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.163609    2577 kubelet.go:486] "Attempting to sync node with API server"
Jul 29 00:36:14.163646 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.163624    2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 29 00:36:14.163646 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.163645    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 29 00:36:14.163777 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.163661    2577 kubelet.go:398] "Adding apiserver pod source"
Jul 29 00:36:14.163777 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.163676    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 29 00:36:14.164097 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.164081    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 00:36:14.164154 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.164112    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 00:36:14.166703 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.166688    2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 29 00:36:14.171395 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.171376    2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 29 00:36:14.171480 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.171408    2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 29 00:36:14.173286 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.173273    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 29 00:36:14.173338 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.173291    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 29 00:36:14.173338 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.173297    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 29 00:36:14.173338 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.173303    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 29 00:36:14.173338 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.173311    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 29 00:36:14.173338 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.173317    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 29 00:36:14.173338 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.173324    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 29 00:36:14.173338 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.173329    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 29 00:36:14.173338 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.173336    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 29 00:36:14.173338 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.173342    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 29 00:36:14.173565 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.173350    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 29 00:36:14.173565 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.173356    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 29 00:36:14.174035 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.174026    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 29 00:36:14.174035 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.174034    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 29 00:36:14.174937 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.174922    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d8q4t"
Jul 29 00:36:14.175540 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:14.175514    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-146.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 29 00:36:14.175540 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:14.175518    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 29 00:36:14.177295 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.177283    2577 server.go:1268] "Started kubelet"
Jul 29 00:36:14.177425 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.177371    2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 29 00:36:14.177492 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.177449    2577 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 29 00:36:14.177492 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.177433    2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 29 00:36:14.178175 ip-10-0-138-146 systemd[1]: Started Kubernetes Kubelet.
Jul 29 00:36:14.179445 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.179426    2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 29 00:36:14.179524 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.179511    2577 server.go:310] "Adding debug handlers to kubelet server"
Jul 29 00:36:14.180450 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.180426    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d8q4t"
Jul 29 00:36:14.182668 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:14.182648    2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 29 00:36:14.186048 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.186032    2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-146.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 29 00:36:14.186865 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:14.186053    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-146.ec2.internal.18c69b96c6891f23  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-146.ec2.internal,UID:ip-10-0-138-146.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-146.ec2.internal,},FirstTimestamp:2026-07-29 00:36:14.177255203 +0000 UTC m=+0.321712775,LastTimestamp:2026-07-29 00:36:14.177255203 +0000 UTC m=+0.321712775,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-146.ec2.internal,}"
Jul 29 00:36:14.188657 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.188643    2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 29 00:36:14.188730 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.188662    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 29 00:36:14.188901 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:14.188793    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-146.ec2.internal\" not found"
Jul 29 00:36:14.189250 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.189233    2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 29 00:36:14.189250 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.189245    2577 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 29 00:36:14.189250 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.189261    2577 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 29 00:36:14.189449 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.189338    2577 reconstruct.go:97] "Volume reconstruction finished"
Jul 29 00:36:14.189449 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.189348    2577 reconciler.go:29] "Reconciler: start to sync state"
Jul 29 00:36:14.189562 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.189548    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 29 00:36:14.189629 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.189563    2577 factory.go:55] Registering systemd factory
Jul 29 00:36:14.189629 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.189571    2577 factory.go:223] Registration of the systemd container factory successfully
Jul 29 00:36:14.189802 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.189789    2577 factory.go:153] Registering CRI-O factory
Jul 29 00:36:14.189802 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.189803    2577 factory.go:223] Registration of the crio container factory successfully
Jul 29 00:36:14.189919 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.189824    2577 factory.go:103] Registering Raw factory
Jul 29 00:36:14.189919 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.189839    2577 manager.go:1196] Started watching for new ooms in manager
Jul 29 00:36:14.190357 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.190339    2577 manager.go:349] Starting recovery of all containers
Jul 29 00:36:14.201844 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.201809    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 00:36:14.202457 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.202443    2577 manager.go:354] Recovery completed
Jul 29 00:36:14.203671 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:14.203653    2577 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 29 00:36:14.205278 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:14.205259    2577 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-146.ec2.internal\" not found" node="ip-10-0-138-146.ec2.internal"
Jul 29 00:36:14.206816 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.206805    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 00:36:14.208556 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.208535    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 00:36:14.208652 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.208573    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 00:36:14.208652 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.208602    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasSufficientPID"
Jul 29 00:36:14.209178 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.209163    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 00:36:14.209260 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.209164    2577 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 29 00:36:14.209260 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.209197    2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 29 00:36:14.209260 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.209220    2577 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 00:36:14.209876 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.209860    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 00:36:14.209943 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.209892    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 00:36:14.209943 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.209907    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasSufficientPID"
Jul 29 00:36:14.211954 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.211940    2577 policy_none.go:49] "None policy: Start"
Jul 29 00:36:14.212011 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.211961    2577 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 29 00:36:14.212011 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.211972    2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 29 00:36:14.213895 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.213884    2577 policy_none.go:47] "Start"
Jul 29 00:36:14.255530 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.255325    2577 manager.go:337] "Starting Device Plugin manager"
Jul 29 00:36:14.255670 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:14.255558    2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 29 00:36:14.255670 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.255574    2577 server.go:87] "Starting device plugin registration server"
Jul 29 00:36:14.255853 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.255840    2577 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 29 00:36:14.255908 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.255855    2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 29 00:36:14.255975 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.255963    2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 29 00:36:14.256051 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.256038    2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 29 00:36:14.256051 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.256051    2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 29 00:36:14.256660 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:14.256637    2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 29 00:36:14.256755 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:14.256692    2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-146.ec2.internal\" not found"
Jul 29 00:36:14.295892 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.295844    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 29 00:36:14.302766 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.297163    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 29 00:36:14.302766 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.297200    2577 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 29 00:36:14.302766 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.297227    2577 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 29 00:36:14.302766 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:14.297272    2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 29 00:36:14.302766 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.300141    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 00:36:14.356482 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.356353    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 00:36:14.357380 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.357362    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 00:36:14.357446 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.357396    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 00:36:14.357446 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.357408    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasSufficientPID"
Jul 29 00:36:14.357446 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.357433    2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-146.ec2.internal"
Jul 29 00:36:14.366421 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.366395    2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-146.ec2.internal"
Jul 29 00:36:14.366527 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:14.366430    2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-146.ec2.internal\": node \"ip-10-0-138-146.ec2.internal\" not found"
Jul 29 00:36:14.380462 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:14.380434    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-146.ec2.internal\" not found"
Jul 29 00:36:14.397494 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.397456    2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-146.ec2.internal"]
Jul 29 00:36:14.397665 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.397549    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 00:36:14.398647 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.398630    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 00:36:14.398755 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.398668    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 00:36:14.398755 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.398685    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasSufficientPID"
Jul 29 00:36:14.401229 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.401211    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 00:36:14.401349 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.401333    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal"
Jul 29 00:36:14.401400 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.401382    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 00:36:14.402115 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.402095    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 00:36:14.402216 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.402128    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 00:36:14.402216 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.402096    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 00:36:14.402216 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.402139    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasSufficientPID"
Jul 29 00:36:14.402216 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.402162    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 00:36:14.402216 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.402174    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasSufficientPID"
Jul 29 00:36:14.404506 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.404487    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-146.ec2.internal"
Jul 29 00:36:14.404592 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.404520    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 00:36:14.405333 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.405318    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 00:36:14.405410 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.405348    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 00:36:14.405410 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.405363    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeHasSufficientPID"
Jul 29 00:36:14.428679 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:14.428644    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-146.ec2.internal\" not found" node="ip-10-0-138-146.ec2.internal"
Jul 29 00:36:14.433451 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:14.433426    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-146.ec2.internal\" not found" node="ip-10-0-138-146.ec2.internal"
Jul 29 00:36:14.480943 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:14.480912    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-146.ec2.internal\" not found"
Jul 29 00:36:14.582343 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:14.582298    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-146.ec2.internal\" not found"
Jul 29 00:36:14.591325 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.591305    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4fb1ab675b74af15fe9c3bb2fade2db2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal\" (UID: \"4fb1ab675b74af15fe9c3bb2fade2db2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal"
Jul 29 00:36:14.591429 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.591333    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fb1ab675b74af15fe9c3bb2fade2db2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal\" (UID: \"4fb1ab675b74af15fe9c3bb2fade2db2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal"
Jul 29 00:36:14.591429 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.591357    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7de2163f97d96577b1944d1e86114197-config\") pod \"kube-apiserver-proxy-ip-10-0-138-146.ec2.internal\" (UID: \"7de2163f97d96577b1944d1e86114197\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-146.ec2.internal"
Jul 29 00:36:14.683713 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:14.683637    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-146.ec2.internal\" not found"
Jul 29 00:36:14.691514 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.691491    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4fb1ab675b74af15fe9c3bb2fade2db2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal\" (UID: \"4fb1ab675b74af15fe9c3bb2fade2db2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal"
Jul 29 00:36:14.691584 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.691522    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fb1ab675b74af15fe9c3bb2fade2db2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal\" (UID: \"4fb1ab675b74af15fe9c3bb2fade2db2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal"
Jul 29 00:36:14.692074 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.692046    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4fb1ab675b74af15fe9c3bb2fade2db2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal\" (UID: \"4fb1ab675b74af15fe9c3bb2fade2db2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal"
Jul 29 00:36:14.692134 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.692117    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7de2163f97d96577b1944d1e86114197-config\") pod \"kube-apiserver-proxy-ip-10-0-138-146.ec2.internal\" (UID: \"7de2163f97d96577b1944d1e86114197\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-146.ec2.internal"
Jul 29 00:36:14.692170 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.692119    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fb1ab675b74af15fe9c3bb2fade2db2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal\" (UID: \"4fb1ab675b74af15fe9c3bb2fade2db2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal"
Jul 29 00:36:14.692170 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.692138    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7de2163f97d96577b1944d1e86114197-config\") pod \"kube-apiserver-proxy-ip-10-0-138-146.ec2.internal\" (UID: \"7de2163f97d96577b1944d1e86114197\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-146.ec2.internal"
Jul 29 00:36:14.734273 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.734236    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal"
Jul 29 00:36:14.737587 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:14.737557    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-146.ec2.internal"
Jul 29 00:36:14.784600 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:14.784558    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-146.ec2.internal\" not found"
Jul 29 00:36:14.891099 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:14.891059    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-146.ec2.internal\" not found"
Jul 29 00:36:14.992020 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:14.991940    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-146.ec2.internal\" not found"
Jul 29 00:36:15.092081 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:15.092047    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-146.ec2.internal\" not found"
Jul 29 00:36:15.112798 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.112773    2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 00:36:15.117433 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.117410    2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 00:36:15.123696 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.123676    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 29 00:36:15.123840 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.123817    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 00:36:15.123892 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.123845    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 00:36:15.123892 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.123852    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 00:36:15.123892 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.123863    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 00:36:15.164436 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.164386    2577 apiserver.go:52] "Watching apiserver"
Jul 29 00:36:15.182383 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.182350    2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 29 00:36:15.182783 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.182756    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-jswzt","openshift-cluster-node-tuning-operator/tuned-64zbn","openshift-dns/node-resolver-4hcbn","openshift-image-registry/node-ca-7w5v9","openshift-multus/multus-5762b","openshift-multus/multus-additional-cni-plugins-mqkpn","openshift-network-diagnostics/network-check-target-hcb88","openshift-network-operator/iptables-alerter-98hrh","kube-system/konnectivity-agent-khbnj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssvhl","openshift-multus/network-metrics-daemon-tzrn2","openshift-ovn-kubernetes/ovnkube-node-tfr5v"]
Jul 29 00:36:15.185507 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.185483    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:36:15.185607 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:15.185569    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jswzt" podUID="5133632e-a2ef-4d96-a84e-296378c156bc"
Jul 29 00:36:15.187454 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.187405    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 00:31:14 +0000 UTC" deadline="2028-04-21 02:58:53.331169356 +0000 UTC"
Jul 29 00:36:15.187515 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.187453    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15170h22m38.143718521s"
Jul 29 00:36:15.187741 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.187727    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.188901 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.188883    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-146.ec2.internal"
Jul 29 00:36:15.188993 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.188902    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 29 00:36:15.189600 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.189576    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tv86b\""
Jul 29 00:36:15.189793 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.189773    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 29 00:36:15.189853 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.189812    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 29 00:36:15.190121 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.190104    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4hcbn"
Jul 29 00:36:15.191785 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.191769    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 29 00:36:15.191872 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.191768    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 29 00:36:15.192146 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.192130    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-swbgk\""
Jul 29 00:36:15.192460 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.192442    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7w5v9"
Jul 29 00:36:15.194452 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.194433    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 29 00:36:15.194452 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.194442    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rc7q8\""
Jul 29 00:36:15.194583 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.194499    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 29 00:36:15.194734 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.194720    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.194854 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.194838    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 29 00:36:15.195700 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.195684    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5133632e-a2ef-4d96-a84e-296378c156bc-kubelet-config\") pod \"global-pull-secret-syncer-jswzt\" (UID: \"5133632e-a2ef-4d96-a84e-296378c156bc\") " pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:36:15.195780 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.195707    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5133632e-a2ef-4d96-a84e-296378c156bc-dbus\") pod \"global-pull-secret-syncer-jswzt\" (UID: \"5133632e-a2ef-4d96-a84e-296378c156bc\") " pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:36:15.195780 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.195727    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dd52cd00-4e48-44f5-aa79-770415b0012a-etc-sysconfig\") pod \"tuned-64zbn\" (UID: \"dd52cd00-4e48-44f5-aa79-770415b0012a\") " pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.195780 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.195744    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dd52cd00-4e48-44f5-aa79-770415b0012a-etc-sysctl-conf\") pod \"tuned-64zbn\" (UID: \"dd52cd00-4e48-44f5-aa79-770415b0012a\") " pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.195780 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.195760    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dd52cd00-4e48-44f5-aa79-770415b0012a-etc-systemd\") pod \"tuned-64zbn\" (UID: \"dd52cd00-4e48-44f5-aa79-770415b0012a\") " pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.195925 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.195797    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dd52cd00-4e48-44f5-aa79-770415b0012a-lib-modules\") pod \"tuned-64zbn\" (UID: \"dd52cd00-4e48-44f5-aa79-770415b0012a\") " pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.195925 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.195823    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd52cd00-4e48-44f5-aa79-770415b0012a-host\") pod \"tuned-64zbn\" (UID: \"dd52cd00-4e48-44f5-aa79-770415b0012a\") " pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.195925 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.195851    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9kmh\" (UniqueName: \"kubernetes.io/projected/f89cf1a4-a323-4d76-b082-cb93514324fc-kube-api-access-v9kmh\") pod \"node-resolver-4hcbn\" (UID: \"f89cf1a4-a323-4d76-b082-cb93514324fc\") " pod="openshift-dns/node-resolver-4hcbn"
Jul 29 00:36:15.195925 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.195880    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dd52cd00-4e48-44f5-aa79-770415b0012a-etc-modprobe-d\") pod \"tuned-64zbn\" (UID: \"dd52cd00-4e48-44f5-aa79-770415b0012a\") " pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.195925 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.195896    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dd52cd00-4e48-44f5-aa79-770415b0012a-etc-sysctl-d\") pod \"tuned-64zbn\" (UID: \"dd52cd00-4e48-44f5-aa79-770415b0012a\") " pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.195925 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.195911    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd52cd00-4e48-44f5-aa79-770415b0012a-sys\") pod \"tuned-64zbn\" (UID: \"dd52cd00-4e48-44f5-aa79-770415b0012a\") " pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.196101 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.195926    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd52cd00-4e48-44f5-aa79-770415b0012a-var-lib-kubelet\") pod \"tuned-64zbn\" (UID: \"dd52cd00-4e48-44f5-aa79-770415b0012a\") " pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.196101 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.195942    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd52cd00-4e48-44f5-aa79-770415b0012a-tmp\") pod \"tuned-64zbn\" (UID: \"dd52cd00-4e48-44f5-aa79-770415b0012a\") " pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.196101 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.195957    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n28s2\" (UniqueName: \"kubernetes.io/projected/dd52cd00-4e48-44f5-aa79-770415b0012a-kube-api-access-n28s2\") pod \"tuned-64zbn\" (UID: \"dd52cd00-4e48-44f5-aa79-770415b0012a\") " pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.196101 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.195974    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5133632e-a2ef-4d96-a84e-296378c156bc-original-pull-secret\") pod \"global-pull-secret-syncer-jswzt\" (UID: \"5133632e-a2ef-4d96-a84e-296378c156bc\") " pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:36:15.196101 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.195990    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dd52cd00-4e48-44f5-aa79-770415b0012a-run\") pod \"tuned-64zbn\" (UID: \"dd52cd00-4e48-44f5-aa79-770415b0012a\") " pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.196101 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.196004    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dd52cd00-4e48-44f5-aa79-770415b0012a-etc-tuned\") pod \"tuned-64zbn\" (UID: \"dd52cd00-4e48-44f5-aa79-770415b0012a\") " pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.196101 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.196018    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f89cf1a4-a323-4d76-b082-cb93514324fc-tmp-dir\") pod \"node-resolver-4hcbn\" (UID: \"f89cf1a4-a323-4d76-b082-cb93514324fc\") " pod="openshift-dns/node-resolver-4hcbn"
Jul 29 00:36:15.196101 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.196035    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd52cd00-4e48-44f5-aa79-770415b0012a-etc-kubernetes\") pod \"tuned-64zbn\" (UID: \"dd52cd00-4e48-44f5-aa79-770415b0012a\") " pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.196101 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.196051    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f89cf1a4-a323-4d76-b082-cb93514324fc-hosts-file\") pod \"node-resolver-4hcbn\" (UID: \"f89cf1a4-a323-4d76-b082-cb93514324fc\") " pod="openshift-dns/node-resolver-4hcbn"
Jul 29 00:36:15.196455 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.196439    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 29 00:36:15.197128 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.197111    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mqkpn"
Jul 29 00:36:15.197178 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.197165    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-q2jkw\""
Jul 29 00:36:15.197224 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.197206    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 29 00:36:15.197294 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.197278    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 29 00:36:15.197559 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.197545    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 29 00:36:15.199147 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.199132    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 29 00:36:15.199292 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.199277    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 00:36:15.199370 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.199356    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal"
Jul 29 00:36:15.199898 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.199877    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 29 00:36:15.199986 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.199914    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-24qj5\""
Jul 29 00:36:15.200156 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.200141    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcb88"
Jul 29 00:36:15.200229 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:15.200206    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcb88" podUID="afd557e9-0701-488d-acd6-0f91d0002e61"
Jul 29 00:36:15.200785 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.200765    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 00:36:15.202544 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.202525    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-98hrh"
Jul 29 00:36:15.204888 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.204872    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-khbnj"
Jul 29 00:36:15.206580 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.206561    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 29 00:36:15.206873 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.206854    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 29 00:36:15.206965 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.206949    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 29 00:36:15.207008 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.206971    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7xh2q\""
Jul 29 00:36:15.207008 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.206984    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xf4fn\""
Jul 29 00:36:15.207081 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.207053    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 29 00:36:15.207113 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.207085    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 29 00:36:15.207994 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.207977    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssvhl"
Jul 29 00:36:15.209838 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.209812    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 29 00:36:15.209913 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.209871    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-z9npk\""
Jul 29 00:36:15.209913 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.209897    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 29 00:36:15.209913 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.209909    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 29 00:36:15.210259 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.210245    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrn2"
Jul 29 00:36:15.210335 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:15.210296    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzrn2" podUID="068d3131-bf24-4e3f-b450-e518d95238db"
Jul 29 00:36:15.211854 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.211835    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 00:36:15.212701 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.212678    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-146.ec2.internal"]
Jul 29 00:36:15.212799 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.212725    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal"]
Jul 29 00:36:15.212799 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.212766    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.217718 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.217693    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 29 00:36:15.217881 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.217768    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 29 00:36:15.217881 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.217841    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 29 00:36:15.218057 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.217880    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 29 00:36:15.218057 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.217922    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 29 00:36:15.218187 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.218153    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mwpcf\""
Jul 29 00:36:15.218252 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.218226    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 29 00:36:15.225952 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.225929    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-r44ng"
Jul 29 00:36:15.233909 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.233884    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-r44ng"
Jul 29 00:36:15.290518 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.290489    2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 29 00:36:15.297206 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.297177    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aacee544-c9e9-49a4-be77-072f82640155-etc-kubernetes\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.297362 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.297219    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/068d3131-bf24-4e3f-b450-e518d95238db-metrics-certs\") pod \"network-metrics-daemon-tzrn2\" (UID: \"068d3131-bf24-4e3f-b450-e518d95238db\") " pod="openshift-multus/network-metrics-daemon-tzrn2"
Jul 29 00:36:15.297362 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.297249    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cktr\" (UniqueName: \"kubernetes.io/projected/068d3131-bf24-4e3f-b450-e518d95238db-kube-api-access-7cktr\") pod \"network-metrics-daemon-tzrn2\" (UID: \"068d3131-bf24-4e3f-b450-e518d95238db\") " pod="openshift-multus/network-metrics-daemon-tzrn2"
Jul 29 00:36:15.297362 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.297275    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ac322954-06d1-4807-8a8b-59e62befe6bc-ovn-node-metrics-cert\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.297362 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.297302    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3d340227-bc79-4097-9f96-1c6e28099b20-konnectivity-ca\") pod \"konnectivity-agent-khbnj\" (UID: \"3d340227-bc79-4097-9f96-1c6e28099b20\") " pod="kube-system/konnectivity-agent-khbnj"
Jul 29 00:36:15.297577 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.297361    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f89cf1a4-a323-4d76-b082-cb93514324fc-hosts-file\") pod \"node-resolver-4hcbn\" (UID: \"f89cf1a4-a323-4d76-b082-cb93514324fc\") " pod="openshift-dns/node-resolver-4hcbn"
Jul 29 00:36:15.297577 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.297423    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aacee544-c9e9-49a4-be77-072f82640155-cnibin\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.297577 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.297468    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f89cf1a4-a323-4d76-b082-cb93514324fc-hosts-file\") pod \"node-resolver-4hcbn\" (UID: \"f89cf1a4-a323-4d76-b082-cb93514324fc\") " pod="openshift-dns/node-resolver-4hcbn"
Jul 29 00:36:15.297577 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.297518    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-host-kubelet\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.297577 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.297559    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-etc-openvswitch\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.297830 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.297651    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-run-openvswitch\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.297830 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.297677    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-log-socket\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.297830 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.297706    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d82ff890-8510-4c13-bf38-a9674ceb80b6-cnibin\") pod \"multus-additional-cni-plugins-mqkpn\" (UID: \"d82ff890-8510-4c13-bf38-a9674ceb80b6\") " pod="openshift-multus/multus-additional-cni-plugins-mqkpn"
Jul 29 00:36:15.297830 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.297729    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7f95557b-6c39-4b63-9d6c-2cdbd68e8eb2-serviceca\") pod \"node-ca-7w5v9\" (UID: \"7f95557b-6c39-4b63-9d6c-2cdbd68e8eb2\") " pod="openshift-image-registry/node-ca-7w5v9"
Jul 29 00:36:15.297830 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.297761    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dd52cd00-4e48-44f5-aa79-770415b0012a-etc-sysconfig\") pod \"tuned-64zbn\" (UID: \"dd52cd00-4e48-44f5-aa79-770415b0012a\") " pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.297830 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.297820    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d82ff890-8510-4c13-bf38-a9674ceb80b6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mqkpn\" (UID: \"d82ff890-8510-4c13-bf38-a9674ceb80b6\") " pod="openshift-multus/multus-additional-cni-plugins-mqkpn"
Jul 29 00:36:15.298125 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.297848    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dd52cd00-4e48-44f5-aa79-770415b0012a-etc-sysctl-d\") pod \"tuned-64zbn\" (UID: \"dd52cd00-4e48-44f5-aa79-770415b0012a\") " pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.298125 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.297856    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dd52cd00-4e48-44f5-aa79-770415b0012a-etc-sysconfig\") pod \"tuned-64zbn\" (UID: \"dd52cd00-4e48-44f5-aa79-770415b0012a\") " pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.298125 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.297872    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd52cd00-4e48-44f5-aa79-770415b0012a-sys\") pod \"tuned-64zbn\" (UID: \"dd52cd00-4e48-44f5-aa79-770415b0012a\") " pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.298125 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.297921    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd52cd00-4e48-44f5-aa79-770415b0012a-tmp\") pod \"tuned-64zbn\" (UID: \"dd52cd00-4e48-44f5-aa79-770415b0012a\") " pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.298125 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.297953    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n28s2\" (UniqueName: \"kubernetes.io/projected/dd52cd00-4e48-44f5-aa79-770415b0012a-kube-api-access-n28s2\") pod \"tuned-64zbn\" (UID: \"dd52cd00-4e48-44f5-aa79-770415b0012a\") " pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.298125 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.297924    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd52cd00-4e48-44f5-aa79-770415b0012a-sys\") pod \"tuned-64zbn\" (UID: \"dd52cd00-4e48-44f5-aa79-770415b0012a\") " pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.298125 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.297986    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f89cf1a4-a323-4d76-b082-cb93514324fc-tmp-dir\") pod \"node-resolver-4hcbn\" (UID: \"f89cf1a4-a323-4d76-b082-cb93514324fc\") " pod="openshift-dns/node-resolver-4hcbn"
Jul 29 00:36:15.298125 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.298016    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dd52cd00-4e48-44f5-aa79-770415b0012a-etc-sysctl-d\") pod \"tuned-64zbn\" (UID: \"dd52cd00-4e48-44f5-aa79-770415b0012a\") " pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.298125 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.298069    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-host-cni-bin\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.298125 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.298111    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d82ff890-8510-4c13-bf38-a9674ceb80b6-cni-binary-copy\") pod \"multus-additional-cni-plugins-mqkpn\" (UID: \"d82ff890-8510-4c13-bf38-a9674ceb80b6\") " pod="openshift-multus/multus-additional-cni-plugins-mqkpn"
Jul 29 00:36:15.298620 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.298149    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfxtj\" (UniqueName: \"kubernetes.io/projected/39ffad98-0754-4a8e-a71d-9268bef9d27b-kube-api-access-zfxtj\") pod \"iptables-alerter-98hrh\" (UID: \"39ffad98-0754-4a8e-a71d-9268bef9d27b\") " pod="openshift-network-operator/iptables-alerter-98hrh"
Jul 29 00:36:15.298620 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.298187    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dd52cd00-4e48-44f5-aa79-770415b0012a-run\") pod \"tuned-64zbn\" (UID: \"dd52cd00-4e48-44f5-aa79-770415b0012a\") " pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.298620 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.298214    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aacee544-c9e9-49a4-be77-072f82640155-multus-socket-dir-parent\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.298620 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.298207    2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 29 00:36:15.298620 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.298243    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.298620 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.298268    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd52cd00-4e48-44f5-aa79-770415b0012a-etc-kubernetes\") pod \"tuned-64zbn\" (UID: \"dd52cd00-4e48-44f5-aa79-770415b0012a\") " pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.298620 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.298286    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aacee544-c9e9-49a4-be77-072f82640155-host-var-lib-cni-bin\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.298620 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.298316    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkd5z\" (UniqueName: \"kubernetes.io/projected/aacee544-c9e9-49a4-be77-072f82640155-kube-api-access-tkd5z\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.298620 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.298332    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-var-lib-openvswitch\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.298620 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.298349    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dd52cd00-4e48-44f5-aa79-770415b0012a-etc-systemd\") pod \"tuned-64zbn\" (UID: \"dd52cd00-4e48-44f5-aa79-770415b0012a\") " pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.298620 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.298355    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dd52cd00-4e48-44f5-aa79-770415b0012a-run\") pod \"tuned-64zbn\" (UID: \"dd52cd00-4e48-44f5-aa79-770415b0012a\") " pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.298620 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.298368    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd52cd00-4e48-44f5-aa79-770415b0012a-host\") pod \"tuned-64zbn\" (UID: \"dd52cd00-4e48-44f5-aa79-770415b0012a\") " pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.298620 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.298381    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd52cd00-4e48-44f5-aa79-770415b0012a-etc-kubernetes\") pod \"tuned-64zbn\" (UID: \"dd52cd00-4e48-44f5-aa79-770415b0012a\") " pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.298620 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.298361    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f89cf1a4-a323-4d76-b082-cb93514324fc-tmp-dir\") pod \"node-resolver-4hcbn\" (UID: \"f89cf1a4-a323-4d76-b082-cb93514324fc\") " pod="openshift-dns/node-resolver-4hcbn"
Jul 29 00:36:15.298620 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.298386    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7n8w\" (UniqueName: \"kubernetes.io/projected/afd557e9-0701-488d-acd6-0f91d0002e61-kube-api-access-f7n8w\") pod \"network-check-target-hcb88\" (UID: \"afd557e9-0701-488d-acd6-0f91d0002e61\") " pod="openshift-network-diagnostics/network-check-target-hcb88"
Jul 29 00:36:15.298620 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.298424    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-systemd-units\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.298620 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.298431    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd52cd00-4e48-44f5-aa79-770415b0012a-host\") pod \"tuned-64zbn\" (UID: \"dd52cd00-4e48-44f5-aa79-770415b0012a\") " pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.299546 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.298432    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dd52cd00-4e48-44f5-aa79-770415b0012a-etc-systemd\") pod \"tuned-64zbn\" (UID: \"dd52cd00-4e48-44f5-aa79-770415b0012a\") " pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.299546 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.298469    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d82ff890-8510-4c13-bf38-a9674ceb80b6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mqkpn\" (UID: \"d82ff890-8510-4c13-bf38-a9674ceb80b6\") " pod="openshift-multus/multus-additional-cni-plugins-mqkpn"
Jul 29 00:36:15.299546 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.298506    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dd52cd00-4e48-44f5-aa79-770415b0012a-etc-modprobe-d\") pod \"tuned-64zbn\" (UID: \"dd52cd00-4e48-44f5-aa79-770415b0012a\") " pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.299546 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.298531    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd52cd00-4e48-44f5-aa79-770415b0012a-var-lib-kubelet\") pod \"tuned-64zbn\" (UID: \"dd52cd00-4e48-44f5-aa79-770415b0012a\") " pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.299546 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.298560    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aacee544-c9e9-49a4-be77-072f82640155-host-var-lib-cni-multus\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.299546 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.298587    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-run-systemd\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.299546 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.298615    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ac322954-06d1-4807-8a8b-59e62befe6bc-ovnkube-config\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.299546 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.298649    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dd52cd00-4e48-44f5-aa79-770415b0012a-etc-modprobe-d\") pod \"tuned-64zbn\" (UID: \"dd52cd00-4e48-44f5-aa79-770415b0012a\") " pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.299546 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.298642    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg42m\" (UniqueName: \"kubernetes.io/projected/ac322954-06d1-4807-8a8b-59e62befe6bc-kube-api-access-pg42m\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.299546 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.298746    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd52cd00-4e48-44f5-aa79-770415b0012a-var-lib-kubelet\") pod \"tuned-64zbn\" (UID: \"dd52cd00-4e48-44f5-aa79-770415b0012a\") " pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.299546 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.298759    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/39ffad98-0754-4a8e-a71d-9268bef9d27b-iptables-alerter-script\") pod \"iptables-alerter-98hrh\" (UID: \"39ffad98-0754-4a8e-a71d-9268bef9d27b\") " pod="openshift-network-operator/iptables-alerter-98hrh"
Jul 29 00:36:15.299546 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.298789    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f95557b-6c39-4b63-9d6c-2cdbd68e8eb2-host\") pod \"node-ca-7w5v9\" (UID: \"7f95557b-6c39-4b63-9d6c-2cdbd68e8eb2\") " pod="openshift-image-registry/node-ca-7w5v9"
Jul 29 00:36:15.299546 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.298816    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rqwt\" (UniqueName: \"kubernetes.io/projected/7f95557b-6c39-4b63-9d6c-2cdbd68e8eb2-kube-api-access-7rqwt\") pod \"node-ca-7w5v9\" (UID: \"7f95557b-6c39-4b63-9d6c-2cdbd68e8eb2\") " pod="openshift-image-registry/node-ca-7w5v9"
Jul 29 00:36:15.299546 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.298846    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aacee544-c9e9-49a4-be77-072f82640155-multus-cni-dir\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.299546 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.298881    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aacee544-c9e9-49a4-be77-072f82640155-multus-daemon-config\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.299546 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.298922    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2hfh\" (UniqueName: \"kubernetes.io/projected/d82ff890-8510-4c13-bf38-a9674ceb80b6-kube-api-access-m2hfh\") pod \"multus-additional-cni-plugins-mqkpn\" (UID: \"d82ff890-8510-4c13-bf38-a9674ceb80b6\") " pod="openshift-multus/multus-additional-cni-plugins-mqkpn"
Jul 29 00:36:15.299546 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.298951    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aacee544-c9e9-49a4-be77-072f82640155-os-release\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.300371 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.298973    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aacee544-c9e9-49a4-be77-072f82640155-cni-binary-copy\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.300371 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.299001    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aacee544-c9e9-49a4-be77-072f82640155-host-run-multus-certs\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.300371 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.299024    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-host-slash\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.300371 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.299044    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-host-cni-netd\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.300371 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.299063    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aacee544-c9e9-49a4-be77-072f82640155-system-cni-dir\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.300371 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.299096    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5133632e-a2ef-4d96-a84e-296378c156bc-dbus\") pod \"global-pull-secret-syncer-jswzt\" (UID: \"5133632e-a2ef-4d96-a84e-296378c156bc\") " pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:36:15.300371 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.299121    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dd52cd00-4e48-44f5-aa79-770415b0012a-lib-modules\") pod \"tuned-64zbn\" (UID: \"dd52cd00-4e48-44f5-aa79-770415b0012a\") " pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.300371 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.299144    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-host-run-netns\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.300371 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.299166    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-host-run-ovn-kubernetes\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.300371 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.299188    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d82ff890-8510-4c13-bf38-a9674ceb80b6-os-release\") pod \"multus-additional-cni-plugins-mqkpn\" (UID: \"d82ff890-8510-4c13-bf38-a9674ceb80b6\") " pod="openshift-multus/multus-additional-cni-plugins-mqkpn"
Jul 29 00:36:15.300371 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.299210    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/71e97aa9-6c5d-4cbb-95f2-e0446008a06a-sys-fs\") pod \"aws-ebs-csi-driver-node-ssvhl\" (UID: \"71e97aa9-6c5d-4cbb-95f2-e0446008a06a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssvhl"
Jul 29 00:36:15.300371 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.299245    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aacee544-c9e9-49a4-be77-072f82640155-hostroot\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.300371 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.299280    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aacee544-c9e9-49a4-be77-072f82640155-multus-conf-dir\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.300371 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.299310    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dd52cd00-4e48-44f5-aa79-770415b0012a-etc-tuned\") pod \"tuned-64zbn\" (UID: \"dd52cd00-4e48-44f5-aa79-770415b0012a\") " pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.300371 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.299327    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5133632e-a2ef-4d96-a84e-296378c156bc-dbus\") pod \"global-pull-secret-syncer-jswzt\" (UID: \"5133632e-a2ef-4d96-a84e-296378c156bc\") " pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:36:15.300371 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.299338    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ac322954-06d1-4807-8a8b-59e62befe6bc-env-overrides\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.300371 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.299365    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ac322954-06d1-4807-8a8b-59e62befe6bc-ovnkube-script-lib\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.301222 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.299393    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dd52cd00-4e48-44f5-aa79-770415b0012a-lib-modules\") pod \"tuned-64zbn\" (UID: \"dd52cd00-4e48-44f5-aa79-770415b0012a\") " pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.301222 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.299392    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/71e97aa9-6c5d-4cbb-95f2-e0446008a06a-socket-dir\") pod \"aws-ebs-csi-driver-node-ssvhl\" (UID: \"71e97aa9-6c5d-4cbb-95f2-e0446008a06a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssvhl"
Jul 29 00:36:15.301222 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.299420    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-run-ovn\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.301222 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.299456    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/39ffad98-0754-4a8e-a71d-9268bef9d27b-host-slash\") pod \"iptables-alerter-98hrh\" (UID: \"39ffad98-0754-4a8e-a71d-9268bef9d27b\") " pod="openshift-network-operator/iptables-alerter-98hrh"
Jul 29 00:36:15.301222 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.299486    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/71e97aa9-6c5d-4cbb-95f2-e0446008a06a-registration-dir\") pod \"aws-ebs-csi-driver-node-ssvhl\" (UID: \"71e97aa9-6c5d-4cbb-95f2-e0446008a06a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssvhl"
Jul 29 00:36:15.301222 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.299525    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5133632e-a2ef-4d96-a84e-296378c156bc-kubelet-config\") pod \"global-pull-secret-syncer-jswzt\" (UID: \"5133632e-a2ef-4d96-a84e-296378c156bc\") " pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:36:15.301222 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.299585    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5133632e-a2ef-4d96-a84e-296378c156bc-kubelet-config\") pod \"global-pull-secret-syncer-jswzt\" (UID: \"5133632e-a2ef-4d96-a84e-296378c156bc\") " pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:36:15.301222 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.299624    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dd52cd00-4e48-44f5-aa79-770415b0012a-etc-sysctl-conf\") pod \"tuned-64zbn\" (UID: \"dd52cd00-4e48-44f5-aa79-770415b0012a\") " pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.301222 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.299680    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9kmh\" (UniqueName: \"kubernetes.io/projected/f89cf1a4-a323-4d76-b082-cb93514324fc-kube-api-access-v9kmh\") pod \"node-resolver-4hcbn\" (UID: \"f89cf1a4-a323-4d76-b082-cb93514324fc\") " pod="openshift-dns/node-resolver-4hcbn"
Jul 29 00:36:15.301222 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.299766    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-node-log\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.301222 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.299800    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dd52cd00-4e48-44f5-aa79-770415b0012a-etc-sysctl-conf\") pod \"tuned-64zbn\" (UID: \"dd52cd00-4e48-44f5-aa79-770415b0012a\") " pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.301222 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.299800    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d82ff890-8510-4c13-bf38-a9674ceb80b6-system-cni-dir\") pod \"multus-additional-cni-plugins-mqkpn\" (UID: \"d82ff890-8510-4c13-bf38-a9674ceb80b6\") " pod="openshift-multus/multus-additional-cni-plugins-mqkpn"
Jul 29 00:36:15.301222 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.299934    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d82ff890-8510-4c13-bf38-a9674ceb80b6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mqkpn\" (UID: \"d82ff890-8510-4c13-bf38-a9674ceb80b6\") " pod="openshift-multus/multus-additional-cni-plugins-mqkpn"
Jul 29 00:36:15.301222 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.299969    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p46nq\" (UniqueName: \"kubernetes.io/projected/71e97aa9-6c5d-4cbb-95f2-e0446008a06a-kube-api-access-p46nq\") pod \"aws-ebs-csi-driver-node-ssvhl\" (UID: \"71e97aa9-6c5d-4cbb-95f2-e0446008a06a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssvhl"
Jul 29 00:36:15.301222 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.300039    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aacee544-c9e9-49a4-be77-072f82640155-host-run-k8s-cni-cncf-io\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.301222 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.300097    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3d340227-bc79-4097-9f96-1c6e28099b20-agent-certs\") pod \"konnectivity-agent-khbnj\" (UID: \"3d340227-bc79-4097-9f96-1c6e28099b20\") " pod="kube-system/konnectivity-agent-khbnj"
Jul 29 00:36:15.302074 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.300135    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/71e97aa9-6c5d-4cbb-95f2-e0446008a06a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ssvhl\" (UID: \"71e97aa9-6c5d-4cbb-95f2-e0446008a06a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssvhl"
Jul 29 00:36:15.302074 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.300164    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/71e97aa9-6c5d-4cbb-95f2-e0446008a06a-device-dir\") pod \"aws-ebs-csi-driver-node-ssvhl\" (UID: \"71e97aa9-6c5d-4cbb-95f2-e0446008a06a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssvhl"
Jul 29 00:36:15.302074 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.300189    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/71e97aa9-6c5d-4cbb-95f2-e0446008a06a-etc-selinux\") pod \"aws-ebs-csi-driver-node-ssvhl\" (UID: \"71e97aa9-6c5d-4cbb-95f2-e0446008a06a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssvhl"
Jul 29 00:36:15.302074 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.300220    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5133632e-a2ef-4d96-a84e-296378c156bc-original-pull-secret\") pod \"global-pull-secret-syncer-jswzt\" (UID: \"5133632e-a2ef-4d96-a84e-296378c156bc\") " pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:36:15.302074 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.300248    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aacee544-c9e9-49a4-be77-072f82640155-host-run-netns\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.302074 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.300276    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aacee544-c9e9-49a4-be77-072f82640155-host-var-lib-kubelet\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.302074 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:15.300337    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 00:36:15.302074 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:15.300419    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5133632e-a2ef-4d96-a84e-296378c156bc-original-pull-secret podName:5133632e-a2ef-4d96-a84e-296378c156bc nodeName:}" failed. No retries permitted until 2026-07-29 00:36:15.800395738 +0000 UTC m=+1.944853309 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5133632e-a2ef-4d96-a84e-296378c156bc-original-pull-secret") pod "global-pull-secret-syncer-jswzt" (UID: "5133632e-a2ef-4d96-a84e-296378c156bc") : object "kube-system"/"original-pull-secret" not registered
Jul 29 00:36:15.302616 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.302592    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd52cd00-4e48-44f5-aa79-770415b0012a-tmp\") pod \"tuned-64zbn\" (UID: \"dd52cd00-4e48-44f5-aa79-770415b0012a\") " pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.302715 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.302630    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dd52cd00-4e48-44f5-aa79-770415b0012a-etc-tuned\") pod \"tuned-64zbn\" (UID: \"dd52cd00-4e48-44f5-aa79-770415b0012a\") " pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.308082 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.308059    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n28s2\" (UniqueName: \"kubernetes.io/projected/dd52cd00-4e48-44f5-aa79-770415b0012a-kube-api-access-n28s2\") pod \"tuned-64zbn\" (UID: \"dd52cd00-4e48-44f5-aa79-770415b0012a\") " pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.311996 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.311975    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9kmh\" (UniqueName: \"kubernetes.io/projected/f89cf1a4-a323-4d76-b082-cb93514324fc-kube-api-access-v9kmh\") pod \"node-resolver-4hcbn\" (UID: \"f89cf1a4-a323-4d76-b082-cb93514324fc\") " pod="openshift-dns/node-resolver-4hcbn"
Jul 29 00:36:15.400652 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.400582    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f95557b-6c39-4b63-9d6c-2cdbd68e8eb2-host\") pod \"node-ca-7w5v9\" (UID: \"7f95557b-6c39-4b63-9d6c-2cdbd68e8eb2\") " pod="openshift-image-registry/node-ca-7w5v9"
Jul 29 00:36:15.400652 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.400662    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rqwt\" (UniqueName: \"kubernetes.io/projected/7f95557b-6c39-4b63-9d6c-2cdbd68e8eb2-kube-api-access-7rqwt\") pod \"node-ca-7w5v9\" (UID: \"7f95557b-6c39-4b63-9d6c-2cdbd68e8eb2\") " pod="openshift-image-registry/node-ca-7w5v9"
Jul 29 00:36:15.400849 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.400654    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f95557b-6c39-4b63-9d6c-2cdbd68e8eb2-host\") pod \"node-ca-7w5v9\" (UID: \"7f95557b-6c39-4b63-9d6c-2cdbd68e8eb2\") " pod="openshift-image-registry/node-ca-7w5v9"
Jul 29 00:36:15.400849 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.400686    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aacee544-c9e9-49a4-be77-072f82640155-multus-cni-dir\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.400849 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.400706    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aacee544-c9e9-49a4-be77-072f82640155-multus-daemon-config\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.400849 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.400723    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2hfh\" (UniqueName: \"kubernetes.io/projected/d82ff890-8510-4c13-bf38-a9674ceb80b6-kube-api-access-m2hfh\") pod \"multus-additional-cni-plugins-mqkpn\" (UID: \"d82ff890-8510-4c13-bf38-a9674ceb80b6\") " pod="openshift-multus/multus-additional-cni-plugins-mqkpn"
Jul 29 00:36:15.400849 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.400740    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aacee544-c9e9-49a4-be77-072f82640155-os-release\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.400849 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.400759    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aacee544-c9e9-49a4-be77-072f82640155-cni-binary-copy\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.400849 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.400784    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aacee544-c9e9-49a4-be77-072f82640155-host-run-multus-certs\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.400849 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.400807    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-host-slash\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.400849 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.400833    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-host-cni-netd\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.400849 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.400843    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aacee544-c9e9-49a4-be77-072f82640155-multus-cni-dir\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.401353 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.400856    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aacee544-c9e9-49a4-be77-072f82640155-system-cni-dir\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.401353 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.400859    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aacee544-c9e9-49a4-be77-072f82640155-os-release\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.401353 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.400897    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-host-run-netns\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.401353 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.400913    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aacee544-c9e9-49a4-be77-072f82640155-system-cni-dir\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.401353 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.400926    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aacee544-c9e9-49a4-be77-072f82640155-host-run-multus-certs\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.401353 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.400927    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-host-run-ovn-kubernetes\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.401353 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.400973    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d82ff890-8510-4c13-bf38-a9674ceb80b6-os-release\") pod \"multus-additional-cni-plugins-mqkpn\" (UID: \"d82ff890-8510-4c13-bf38-a9674ceb80b6\") " pod="openshift-multus/multus-additional-cni-plugins-mqkpn"
Jul 29 00:36:15.401353 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.400995    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-host-run-netns\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.401353 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401004    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/71e97aa9-6c5d-4cbb-95f2-e0446008a06a-sys-fs\") pod \"aws-ebs-csi-driver-node-ssvhl\" (UID: \"71e97aa9-6c5d-4cbb-95f2-e0446008a06a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssvhl"
Jul 29 00:36:15.401353 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401044    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/71e97aa9-6c5d-4cbb-95f2-e0446008a06a-sys-fs\") pod \"aws-ebs-csi-driver-node-ssvhl\" (UID: \"71e97aa9-6c5d-4cbb-95f2-e0446008a06a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssvhl"
Jul 29 00:36:15.401353 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401058    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aacee544-c9e9-49a4-be77-072f82640155-hostroot\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.401353 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401076    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-host-run-ovn-kubernetes\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.401353 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401090    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aacee544-c9e9-49a4-be77-072f82640155-multus-conf-dir\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.401353 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401114    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aacee544-c9e9-49a4-be77-072f82640155-hostroot\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.401353 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401127    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ac322954-06d1-4807-8a8b-59e62befe6bc-env-overrides\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.401353 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401130    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-host-slash\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.401353 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401143    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aacee544-c9e9-49a4-be77-072f82640155-multus-conf-dir\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.401353 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401154    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ac322954-06d1-4807-8a8b-59e62befe6bc-ovnkube-script-lib\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.402287 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401168    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-host-cni-netd\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.402287 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401185    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/71e97aa9-6c5d-4cbb-95f2-e0446008a06a-socket-dir\") pod \"aws-ebs-csi-driver-node-ssvhl\" (UID: \"71e97aa9-6c5d-4cbb-95f2-e0446008a06a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssvhl"
Jul 29 00:36:15.402287 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401211    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-run-ovn\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.402287 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401221    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d82ff890-8510-4c13-bf38-a9674ceb80b6-os-release\") pod \"multus-additional-cni-plugins-mqkpn\" (UID: \"d82ff890-8510-4c13-bf38-a9674ceb80b6\") " pod="openshift-multus/multus-additional-cni-plugins-mqkpn"
Jul 29 00:36:15.402287 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401237    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/39ffad98-0754-4a8e-a71d-9268bef9d27b-host-slash\") pod \"iptables-alerter-98hrh\" (UID: \"39ffad98-0754-4a8e-a71d-9268bef9d27b\") " pod="openshift-network-operator/iptables-alerter-98hrh"
Jul 29 00:36:15.402287 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401264    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/71e97aa9-6c5d-4cbb-95f2-e0446008a06a-registration-dir\") pod \"aws-ebs-csi-driver-node-ssvhl\" (UID: \"71e97aa9-6c5d-4cbb-95f2-e0446008a06a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssvhl"
Jul 29 00:36:15.402287 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401270    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-run-ovn\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.402287 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401295    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-node-log\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.402287 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401309    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/39ffad98-0754-4a8e-a71d-9268bef9d27b-host-slash\") pod \"iptables-alerter-98hrh\" (UID: \"39ffad98-0754-4a8e-a71d-9268bef9d27b\") " pod="openshift-network-operator/iptables-alerter-98hrh"
Jul 29 00:36:15.402287 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401323    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d82ff890-8510-4c13-bf38-a9674ceb80b6-system-cni-dir\") pod \"multus-additional-cni-plugins-mqkpn\" (UID: \"d82ff890-8510-4c13-bf38-a9674ceb80b6\") " pod="openshift-multus/multus-additional-cni-plugins-mqkpn"
Jul 29 00:36:15.402287 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401337    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/71e97aa9-6c5d-4cbb-95f2-e0446008a06a-socket-dir\") pod \"aws-ebs-csi-driver-node-ssvhl\" (UID: \"71e97aa9-6c5d-4cbb-95f2-e0446008a06a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssvhl"
Jul 29 00:36:15.402287 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401350    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d82ff890-8510-4c13-bf38-a9674ceb80b6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mqkpn\" (UID: \"d82ff890-8510-4c13-bf38-a9674ceb80b6\") " pod="openshift-multus/multus-additional-cni-plugins-mqkpn"
Jul 29 00:36:15.402287 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401359    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/71e97aa9-6c5d-4cbb-95f2-e0446008a06a-registration-dir\") pod \"aws-ebs-csi-driver-node-ssvhl\" (UID: \"71e97aa9-6c5d-4cbb-95f2-e0446008a06a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssvhl"
Jul 29 00:36:15.402287 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401394    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-node-log\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.402287 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401406    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d82ff890-8510-4c13-bf38-a9674ceb80b6-system-cni-dir\") pod \"multus-additional-cni-plugins-mqkpn\" (UID: \"d82ff890-8510-4c13-bf38-a9674ceb80b6\") " pod="openshift-multus/multus-additional-cni-plugins-mqkpn"
Jul 29 00:36:15.402287 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401428    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p46nq\" (UniqueName: \"kubernetes.io/projected/71e97aa9-6c5d-4cbb-95f2-e0446008a06a-kube-api-access-p46nq\") pod \"aws-ebs-csi-driver-node-ssvhl\" (UID: \"71e97aa9-6c5d-4cbb-95f2-e0446008a06a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssvhl"
Jul 29 00:36:15.402287 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401461    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aacee544-c9e9-49a4-be77-072f82640155-host-run-k8s-cni-cncf-io\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.403187 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401487    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3d340227-bc79-4097-9f96-1c6e28099b20-agent-certs\") pod \"konnectivity-agent-khbnj\" (UID: \"3d340227-bc79-4097-9f96-1c6e28099b20\") " pod="kube-system/konnectivity-agent-khbnj"
Jul 29 00:36:15.403187 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401492    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aacee544-c9e9-49a4-be77-072f82640155-cni-binary-copy\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.403187 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401514    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/71e97aa9-6c5d-4cbb-95f2-e0446008a06a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ssvhl\" (UID: \"71e97aa9-6c5d-4cbb-95f2-e0446008a06a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssvhl"
Jul 29 00:36:15.403187 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401532    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aacee544-c9e9-49a4-be77-072f82640155-multus-daemon-config\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.403187 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401543    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aacee544-c9e9-49a4-be77-072f82640155-host-run-k8s-cni-cncf-io\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.403187 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401578    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/71e97aa9-6c5d-4cbb-95f2-e0446008a06a-device-dir\") pod \"aws-ebs-csi-driver-node-ssvhl\" (UID: \"71e97aa9-6c5d-4cbb-95f2-e0446008a06a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssvhl"
Jul 29 00:36:15.403187 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401539    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/71e97aa9-6c5d-4cbb-95f2-e0446008a06a-device-dir\") pod \"aws-ebs-csi-driver-node-ssvhl\" (UID: \"71e97aa9-6c5d-4cbb-95f2-e0446008a06a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssvhl"
Jul 29 00:36:15.403187 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401615    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/71e97aa9-6c5d-4cbb-95f2-e0446008a06a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ssvhl\" (UID: \"71e97aa9-6c5d-4cbb-95f2-e0446008a06a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssvhl"
Jul 29 00:36:15.403187 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401638    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/71e97aa9-6c5d-4cbb-95f2-e0446008a06a-etc-selinux\") pod \"aws-ebs-csi-driver-node-ssvhl\" (UID: \"71e97aa9-6c5d-4cbb-95f2-e0446008a06a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssvhl"
Jul 29 00:36:15.403187 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401679    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aacee544-c9e9-49a4-be77-072f82640155-host-run-netns\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.403187 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401704    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aacee544-c9e9-49a4-be77-072f82640155-host-var-lib-kubelet\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.403187 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401727    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aacee544-c9e9-49a4-be77-072f82640155-etc-kubernetes\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.403187 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401746    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ac322954-06d1-4807-8a8b-59e62befe6bc-env-overrides\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.403187 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401753    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/068d3131-bf24-4e3f-b450-e518d95238db-metrics-certs\") pod \"network-metrics-daemon-tzrn2\" (UID: \"068d3131-bf24-4e3f-b450-e518d95238db\") " pod="openshift-multus/network-metrics-daemon-tzrn2"
Jul 29 00:36:15.403187 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401781    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/71e97aa9-6c5d-4cbb-95f2-e0446008a06a-etc-selinux\") pod \"aws-ebs-csi-driver-node-ssvhl\" (UID: \"71e97aa9-6c5d-4cbb-95f2-e0446008a06a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssvhl"
Jul 29 00:36:15.403187 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401803    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cktr\" (UniqueName: \"kubernetes.io/projected/068d3131-bf24-4e3f-b450-e518d95238db-kube-api-access-7cktr\") pod \"network-metrics-daemon-tzrn2\" (UID: \"068d3131-bf24-4e3f-b450-e518d95238db\") " pod="openshift-multus/network-metrics-daemon-tzrn2"
Jul 29 00:36:15.403187 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401822    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aacee544-c9e9-49a4-be77-072f82640155-host-var-lib-kubelet\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.403970 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401827    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aacee544-c9e9-49a4-be77-072f82640155-host-run-netns\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.403970 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401835    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ac322954-06d1-4807-8a8b-59e62befe6bc-ovn-node-metrics-cert\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.403970 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401863    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3d340227-bc79-4097-9f96-1c6e28099b20-konnectivity-ca\") pod \"konnectivity-agent-khbnj\" (UID: \"3d340227-bc79-4097-9f96-1c6e28099b20\") " pod="kube-system/konnectivity-agent-khbnj"
Jul 29 00:36:15.403970 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401892    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aacee544-c9e9-49a4-be77-072f82640155-cnibin\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.403970 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401895    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ac322954-06d1-4807-8a8b-59e62befe6bc-ovnkube-script-lib\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.403970 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401918    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-host-kubelet\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.403970 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401943    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-etc-openvswitch\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.403970 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401959    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aacee544-c9e9-49a4-be77-072f82640155-cnibin\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.403970 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401967    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-run-openvswitch\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.403970 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401862    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aacee544-c9e9-49a4-be77-072f82640155-etc-kubernetes\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.403970 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.401992    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d82ff890-8510-4c13-bf38-a9674ceb80b6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mqkpn\" (UID: \"d82ff890-8510-4c13-bf38-a9674ceb80b6\") " pod="openshift-multus/multus-additional-cni-plugins-mqkpn"
Jul 29 00:36:15.403970 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.402006    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-host-kubelet\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.403970 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:15.401824    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 00:36:15.403970 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.402029    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-etc-openvswitch\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.403970 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.402037    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-log-socket\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.403970 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.402064    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-run-openvswitch\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.403970 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:15.402072    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/068d3131-bf24-4e3f-b450-e518d95238db-metrics-certs podName:068d3131-bf24-4e3f-b450-e518d95238db nodeName:}" failed. No retries permitted until 2026-07-29 00:36:15.902052541 +0000 UTC m=+2.046510099 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/068d3131-bf24-4e3f-b450-e518d95238db-metrics-certs") pod "network-metrics-daemon-tzrn2" (UID: "068d3131-bf24-4e3f-b450-e518d95238db") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 00:36:15.404573 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.402068    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-log-socket\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.404573 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.402093    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d82ff890-8510-4c13-bf38-a9674ceb80b6-cnibin\") pod \"multus-additional-cni-plugins-mqkpn\" (UID: \"d82ff890-8510-4c13-bf38-a9674ceb80b6\") " pod="openshift-multus/multus-additional-cni-plugins-mqkpn"
Jul 29 00:36:15.404573 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.402120    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7f95557b-6c39-4b63-9d6c-2cdbd68e8eb2-serviceca\") pod \"node-ca-7w5v9\" (UID: \"7f95557b-6c39-4b63-9d6c-2cdbd68e8eb2\") " pod="openshift-image-registry/node-ca-7w5v9"
Jul 29 00:36:15.404573 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.402121    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d82ff890-8510-4c13-bf38-a9674ceb80b6-cnibin\") pod \"multus-additional-cni-plugins-mqkpn\" (UID: \"d82ff890-8510-4c13-bf38-a9674ceb80b6\") " pod="openshift-multus/multus-additional-cni-plugins-mqkpn"
Jul 29 00:36:15.404573 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.402165    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d82ff890-8510-4c13-bf38-a9674ceb80b6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mqkpn\" (UID: \"d82ff890-8510-4c13-bf38-a9674ceb80b6\") " pod="openshift-multus/multus-additional-cni-plugins-mqkpn"
Jul 29 00:36:15.404573 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.402198    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-host-cni-bin\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.404573 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.402225    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d82ff890-8510-4c13-bf38-a9674ceb80b6-cni-binary-copy\") pod \"multus-additional-cni-plugins-mqkpn\" (UID: \"d82ff890-8510-4c13-bf38-a9674ceb80b6\") " pod="openshift-multus/multus-additional-cni-plugins-mqkpn"
Jul 29 00:36:15.404573 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.402253    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfxtj\" (UniqueName: \"kubernetes.io/projected/39ffad98-0754-4a8e-a71d-9268bef9d27b-kube-api-access-zfxtj\") pod \"iptables-alerter-98hrh\" (UID: \"39ffad98-0754-4a8e-a71d-9268bef9d27b\") " pod="openshift-network-operator/iptables-alerter-98hrh"
Jul 29 00:36:15.404573 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.402283    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aacee544-c9e9-49a4-be77-072f82640155-multus-socket-dir-parent\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.404573 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.402310    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.404573 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.402327    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-host-cni-bin\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.404573 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.402341    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aacee544-c9e9-49a4-be77-072f82640155-host-var-lib-cni-bin\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.404573 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.402368    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkd5z\" (UniqueName: \"kubernetes.io/projected/aacee544-c9e9-49a4-be77-072f82640155-kube-api-access-tkd5z\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.404573 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.402383    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d82ff890-8510-4c13-bf38-a9674ceb80b6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mqkpn\" (UID: \"d82ff890-8510-4c13-bf38-a9674ceb80b6\") " pod="openshift-multus/multus-additional-cni-plugins-mqkpn"
Jul 29 00:36:15.404573 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.402395    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-var-lib-openvswitch\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.404573 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.402435    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7n8w\" (UniqueName: \"kubernetes.io/projected/afd557e9-0701-488d-acd6-0f91d0002e61-kube-api-access-f7n8w\") pod \"network-check-target-hcb88\" (UID: \"afd557e9-0701-488d-acd6-0f91d0002e61\") " pod="openshift-network-diagnostics/network-check-target-hcb88"
Jul 29 00:36:15.404573 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.402441    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-var-lib-openvswitch\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.405127 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.402462    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-systemd-units\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.405127 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.402475    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3d340227-bc79-4097-9f96-1c6e28099b20-konnectivity-ca\") pod \"konnectivity-agent-khbnj\" (UID: \"3d340227-bc79-4097-9f96-1c6e28099b20\") " pod="kube-system/konnectivity-agent-khbnj"
Jul 29 00:36:15.405127 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.402488    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.405127 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.402713    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7f95557b-6c39-4b63-9d6c-2cdbd68e8eb2-serviceca\") pod \"node-ca-7w5v9\" (UID: \"7f95557b-6c39-4b63-9d6c-2cdbd68e8eb2\") " pod="openshift-image-registry/node-ca-7w5v9"
Jul 29 00:36:15.405127 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.402776    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-systemd-units\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.405127 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.402807    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d82ff890-8510-4c13-bf38-a9674ceb80b6-cni-binary-copy\") pod \"multus-additional-cni-plugins-mqkpn\" (UID: \"d82ff890-8510-4c13-bf38-a9674ceb80b6\") " pod="openshift-multus/multus-additional-cni-plugins-mqkpn"
Jul 29 00:36:15.405127 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.402824    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aacee544-c9e9-49a4-be77-072f82640155-multus-socket-dir-parent\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.405127 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.402491    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d82ff890-8510-4c13-bf38-a9674ceb80b6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mqkpn\" (UID: \"d82ff890-8510-4c13-bf38-a9674ceb80b6\") " pod="openshift-multus/multus-additional-cni-plugins-mqkpn"
Jul 29 00:36:15.405127 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.402885    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aacee544-c9e9-49a4-be77-072f82640155-host-var-lib-cni-multus\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.405127 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.402911    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-run-systemd\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.405127 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.402934    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ac322954-06d1-4807-8a8b-59e62befe6bc-ovnkube-config\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.405127 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.402941    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aacee544-c9e9-49a4-be77-072f82640155-host-var-lib-cni-multus\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.405127 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.402955    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aacee544-c9e9-49a4-be77-072f82640155-host-var-lib-cni-bin\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.405127 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.402960    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg42m\" (UniqueName: \"kubernetes.io/projected/ac322954-06d1-4807-8a8b-59e62befe6bc-kube-api-access-pg42m\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.405127 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.402988    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/39ffad98-0754-4a8e-a71d-9268bef9d27b-iptables-alerter-script\") pod \"iptables-alerter-98hrh\" (UID: \"39ffad98-0754-4a8e-a71d-9268bef9d27b\") " pod="openshift-network-operator/iptables-alerter-98hrh"
Jul 29 00:36:15.405127 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.403011    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ac322954-06d1-4807-8a8b-59e62befe6bc-run-systemd\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.405127 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.403014    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d82ff890-8510-4c13-bf38-a9674ceb80b6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mqkpn\" (UID: \"d82ff890-8510-4c13-bf38-a9674ceb80b6\") " pod="openshift-multus/multus-additional-cni-plugins-mqkpn"
Jul 29 00:36:15.405702 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.403412    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ac322954-06d1-4807-8a8b-59e62befe6bc-ovnkube-config\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.405702 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.403695    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/39ffad98-0754-4a8e-a71d-9268bef9d27b-iptables-alerter-script\") pod \"iptables-alerter-98hrh\" (UID: \"39ffad98-0754-4a8e-a71d-9268bef9d27b\") " pod="openshift-network-operator/iptables-alerter-98hrh"
Jul 29 00:36:15.405702 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.404635    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3d340227-bc79-4097-9f96-1c6e28099b20-agent-certs\") pod \"konnectivity-agent-khbnj\" (UID: \"3d340227-bc79-4097-9f96-1c6e28099b20\") " pod="kube-system/konnectivity-agent-khbnj"
Jul 29 00:36:15.405702 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.404653    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ac322954-06d1-4807-8a8b-59e62befe6bc-ovn-node-metrics-cert\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.409272 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.409242    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rqwt\" (UniqueName: \"kubernetes.io/projected/7f95557b-6c39-4b63-9d6c-2cdbd68e8eb2-kube-api-access-7rqwt\") pod \"node-ca-7w5v9\" (UID: \"7f95557b-6c39-4b63-9d6c-2cdbd68e8eb2\") " pod="openshift-image-registry/node-ca-7w5v9"
Jul 29 00:36:15.409401 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.409302    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2hfh\" (UniqueName: \"kubernetes.io/projected/d82ff890-8510-4c13-bf38-a9674ceb80b6-kube-api-access-m2hfh\") pod \"multus-additional-cni-plugins-mqkpn\" (UID: \"d82ff890-8510-4c13-bf38-a9674ceb80b6\") " pod="openshift-multus/multus-additional-cni-plugins-mqkpn"
Jul 29 00:36:15.409638 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:15.409615    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7de2163f97d96577b1944d1e86114197.slice/crio-4fd8a71e716138d3fb1921eb34f385d18f22fd5b7deec367d99b5c236acc441e WatchSource:0}: Error finding container 4fd8a71e716138d3fb1921eb34f385d18f22fd5b7deec367d99b5c236acc441e: Status 404 returned error can't find the container with id 4fd8a71e716138d3fb1921eb34f385d18f22fd5b7deec367d99b5c236acc441e
Jul 29 00:36:15.411925 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:15.411899    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 00:36:15.411925 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:15.411927    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 00:36:15.412087 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:15.411942    2577 projected.go:196] Error preparing data for projected volume kube-api-access-f7n8w for pod openshift-network-diagnostics/network-check-target-hcb88: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 00:36:15.412087 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:15.412005    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/afd557e9-0701-488d-acd6-0f91d0002e61-kube-api-access-f7n8w podName:afd557e9-0701-488d-acd6-0f91d0002e61 nodeName:}" failed. No retries permitted until 2026-07-29 00:36:15.911989962 +0000 UTC m=+2.056447533 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-f7n8w" (UniqueName: "kubernetes.io/projected/afd557e9-0701-488d-acd6-0f91d0002e61-kube-api-access-f7n8w") pod "network-check-target-hcb88" (UID: "afd557e9-0701-488d-acd6-0f91d0002e61") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 00:36:15.412352 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.412324    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p46nq\" (UniqueName: \"kubernetes.io/projected/71e97aa9-6c5d-4cbb-95f2-e0446008a06a-kube-api-access-p46nq\") pod \"aws-ebs-csi-driver-node-ssvhl\" (UID: \"71e97aa9-6c5d-4cbb-95f2-e0446008a06a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssvhl"
Jul 29 00:36:15.412971 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:15.412936    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fb1ab675b74af15fe9c3bb2fade2db2.slice/crio-a592caea41a826b2886167f1f36425a916f9795e3a139d701fd779c1a3cfc360 WatchSource:0}: Error finding container a592caea41a826b2886167f1f36425a916f9795e3a139d701fd779c1a3cfc360: Status 404 returned error can't find the container with id a592caea41a826b2886167f1f36425a916f9795e3a139d701fd779c1a3cfc360
Jul 29 00:36:15.413148 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.413113    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cktr\" (UniqueName: \"kubernetes.io/projected/068d3131-bf24-4e3f-b450-e518d95238db-kube-api-access-7cktr\") pod \"network-metrics-daemon-tzrn2\" (UID: \"068d3131-bf24-4e3f-b450-e518d95238db\") " pod="openshift-multus/network-metrics-daemon-tzrn2"
Jul 29 00:36:15.414471 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.414452    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfxtj\" (UniqueName: \"kubernetes.io/projected/39ffad98-0754-4a8e-a71d-9268bef9d27b-kube-api-access-zfxtj\") pod \"iptables-alerter-98hrh\" (UID: \"39ffad98-0754-4a8e-a71d-9268bef9d27b\") " pod="openshift-network-operator/iptables-alerter-98hrh"
Jul 29 00:36:15.414771 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.414748    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkd5z\" (UniqueName: \"kubernetes.io/projected/aacee544-c9e9-49a4-be77-072f82640155-kube-api-access-tkd5z\") pod \"multus-5762b\" (UID: \"aacee544-c9e9-49a4-be77-072f82640155\") " pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.414859 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.414826    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg42m\" (UniqueName: \"kubernetes.io/projected/ac322954-06d1-4807-8a8b-59e62befe6bc-kube-api-access-pg42m\") pod \"ovnkube-node-tfr5v\" (UID: \"ac322954-06d1-4807-8a8b-59e62befe6bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.416222 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.416205    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 00:36:15.520191 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.520083    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-64zbn"
Jul 29 00:36:15.530763 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:15.530735    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd52cd00_4e48_44f5_aa79_770415b0012a.slice/crio-0716d174b976c5baaf3fa4caca64b1bd84db6ea35c2da48216998641b3f6beae WatchSource:0}: Error finding container 0716d174b976c5baaf3fa4caca64b1bd84db6ea35c2da48216998641b3f6beae: Status 404 returned error can't find the container with id 0716d174b976c5baaf3fa4caca64b1bd84db6ea35c2da48216998641b3f6beae
Jul 29 00:36:15.539147 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.539126    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4hcbn"
Jul 29 00:36:15.548399 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:15.548372    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf89cf1a4_a323_4d76_b082_cb93514324fc.slice/crio-63580f1593e9531af95284f4c549b49d4b854ba4056810bfd120fb2a41433c0f WatchSource:0}: Error finding container 63580f1593e9531af95284f4c549b49d4b854ba4056810bfd120fb2a41433c0f: Status 404 returned error can't find the container with id 63580f1593e9531af95284f4c549b49d4b854ba4056810bfd120fb2a41433c0f
Jul 29 00:36:15.556743 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.556724    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7w5v9"
Jul 29 00:36:15.566364 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:15.566335    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f95557b_6c39_4b63_9d6c_2cdbd68e8eb2.slice/crio-509a2c2583fdc4f118e5a68bfb85828741bb18ed94195181dcedf381c7b5b337 WatchSource:0}: Error finding container 509a2c2583fdc4f118e5a68bfb85828741bb18ed94195181dcedf381c7b5b337: Status 404 returned error can't find the container with id 509a2c2583fdc4f118e5a68bfb85828741bb18ed94195181dcedf381c7b5b337
Jul 29 00:36:15.568767 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.568737    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5762b"
Jul 29 00:36:15.577742 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:15.577671    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaacee544_c9e9_49a4_be77_072f82640155.slice/crio-c6793322345e53f316e71d12d3b74bd148337f06e6dca494799d4b9f81fe21f5 WatchSource:0}: Error finding container c6793322345e53f316e71d12d3b74bd148337f06e6dca494799d4b9f81fe21f5: Status 404 returned error can't find the container with id c6793322345e53f316e71d12d3b74bd148337f06e6dca494799d4b9f81fe21f5
Jul 29 00:36:15.592196 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.592173    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mqkpn"
Jul 29 00:36:15.600460 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.600437    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-98hrh"
Jul 29 00:36:15.601235 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:15.601211    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd82ff890_8510_4c13_bf38_a9674ceb80b6.slice/crio-819f380b1921f5dba8b43f798e8c426f1cb364392521f3bba4a56a0a1f4c3fc5 WatchSource:0}: Error finding container 819f380b1921f5dba8b43f798e8c426f1cb364392521f3bba4a56a0a1f4c3fc5: Status 404 returned error can't find the container with id 819f380b1921f5dba8b43f798e8c426f1cb364392521f3bba4a56a0a1f4c3fc5
Jul 29 00:36:15.609258 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:15.609234    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39ffad98_0754_4a8e_a71d_9268bef9d27b.slice/crio-3afc731553eaa4843ad448824074959fef166bc20b774aa8b8cc7a48f085e154 WatchSource:0}: Error finding container 3afc731553eaa4843ad448824074959fef166bc20b774aa8b8cc7a48f085e154: Status 404 returned error can't find the container with id 3afc731553eaa4843ad448824074959fef166bc20b774aa8b8cc7a48f085e154
Jul 29 00:36:15.629067 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.629040    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-khbnj"
Jul 29 00:36:15.638422 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:15.638393    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d340227_bc79_4097_9f96_1c6e28099b20.slice/crio-8d75da9cb7b4ac21e2bd01b2c1667d13116b131c640acb53b37c3800ab7afcde WatchSource:0}: Error finding container 8d75da9cb7b4ac21e2bd01b2c1667d13116b131c640acb53b37c3800ab7afcde: Status 404 returned error can't find the container with id 8d75da9cb7b4ac21e2bd01b2c1667d13116b131c640acb53b37c3800ab7afcde
Jul 29 00:36:15.651644 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.651615    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssvhl"
Jul 29 00:36:15.655515 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.655491    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:15.662598 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:15.662564    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71e97aa9_6c5d_4cbb_95f2_e0446008a06a.slice/crio-d9391a19355e66f8b5d0b733494e732feaad8b52632767e7e590de7523622d08 WatchSource:0}: Error finding container d9391a19355e66f8b5d0b733494e732feaad8b52632767e7e590de7523622d08: Status 404 returned error can't find the container with id d9391a19355e66f8b5d0b733494e732feaad8b52632767e7e590de7523622d08
Jul 29 00:36:15.664567 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:36:15.664546    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac322954_06d1_4807_8a8b_59e62befe6bc.slice/crio-74a2227197dd4fcf05b02c10fb1c74a886d474d36533505d1be94394be049a90 WatchSource:0}: Error finding container 74a2227197dd4fcf05b02c10fb1c74a886d474d36533505d1be94394be049a90: Status 404 returned error can't find the container with id 74a2227197dd4fcf05b02c10fb1c74a886d474d36533505d1be94394be049a90
Jul 29 00:36:15.804745 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.804648    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5133632e-a2ef-4d96-a84e-296378c156bc-original-pull-secret\") pod \"global-pull-secret-syncer-jswzt\" (UID: \"5133632e-a2ef-4d96-a84e-296378c156bc\") " pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:36:15.804916 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:15.804785    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 00:36:15.804916 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:15.804852    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5133632e-a2ef-4d96-a84e-296378c156bc-original-pull-secret podName:5133632e-a2ef-4d96-a84e-296378c156bc nodeName:}" failed. No retries permitted until 2026-07-29 00:36:16.804831235 +0000 UTC m=+2.949288785 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5133632e-a2ef-4d96-a84e-296378c156bc-original-pull-secret") pod "global-pull-secret-syncer-jswzt" (UID: "5133632e-a2ef-4d96-a84e-296378c156bc") : object "kube-system"/"original-pull-secret" not registered
Jul 29 00:36:15.905122 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.905083    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/068d3131-bf24-4e3f-b450-e518d95238db-metrics-certs\") pod \"network-metrics-daemon-tzrn2\" (UID: \"068d3131-bf24-4e3f-b450-e518d95238db\") " pod="openshift-multus/network-metrics-daemon-tzrn2"
Jul 29 00:36:15.905269 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:15.905229    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 00:36:15.905320 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:15.905295    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/068d3131-bf24-4e3f-b450-e518d95238db-metrics-certs podName:068d3131-bf24-4e3f-b450-e518d95238db nodeName:}" failed. No retries permitted until 2026-07-29 00:36:16.905277037 +0000 UTC m=+3.049734589 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/068d3131-bf24-4e3f-b450-e518d95238db-metrics-certs") pod "network-metrics-daemon-tzrn2" (UID: "068d3131-bf24-4e3f-b450-e518d95238db") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 00:36:15.932294 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:15.932265    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 00:36:16.006136 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:16.005430    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7n8w\" (UniqueName: \"kubernetes.io/projected/afd557e9-0701-488d-acd6-0f91d0002e61-kube-api-access-f7n8w\") pod \"network-check-target-hcb88\" (UID: \"afd557e9-0701-488d-acd6-0f91d0002e61\") " pod="openshift-network-diagnostics/network-check-target-hcb88"
Jul 29 00:36:16.006136 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:16.005599    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 00:36:16.006136 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:16.005634    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 00:36:16.006136 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:16.005650    2577 projected.go:196] Error preparing data for projected volume kube-api-access-f7n8w for pod openshift-network-diagnostics/network-check-target-hcb88: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 00:36:16.006136 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:16.005707    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/afd557e9-0701-488d-acd6-0f91d0002e61-kube-api-access-f7n8w podName:afd557e9-0701-488d-acd6-0f91d0002e61 nodeName:}" failed. No retries permitted until 2026-07-29 00:36:17.005686042 +0000 UTC m=+3.150143602 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-f7n8w" (UniqueName: "kubernetes.io/projected/afd557e9-0701-488d-acd6-0f91d0002e61-kube-api-access-f7n8w") pod "network-check-target-hcb88" (UID: "afd557e9-0701-488d-acd6-0f91d0002e61") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 00:36:16.049803 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:16.049766    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 00:36:16.242818 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:16.242770    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 00:31:15 +0000 UTC" deadline="2028-01-27 10:07:47.561255377 +0000 UTC"
Jul 29 00:36:16.242818 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:16.242817    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13137h31m31.318444116s"
Jul 29 00:36:16.298265 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:16.298229    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:36:16.298556 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:16.298525    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jswzt" podUID="5133632e-a2ef-4d96-a84e-296378c156bc"
Jul 29 00:36:16.341984 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:16.341914    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4hcbn" event={"ID":"f89cf1a4-a323-4d76-b082-cb93514324fc","Type":"ContainerStarted","Data":"63580f1593e9531af95284f4c549b49d4b854ba4056810bfd120fb2a41433c0f"}
Jul 29 00:36:16.347757 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:16.347716    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal" event={"ID":"4fb1ab675b74af15fe9c3bb2fade2db2","Type":"ContainerStarted","Data":"a592caea41a826b2886167f1f36425a916f9795e3a139d701fd779c1a3cfc360"}
Jul 29 00:36:16.351138 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:16.351051    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v" event={"ID":"ac322954-06d1-4807-8a8b-59e62befe6bc","Type":"ContainerStarted","Data":"74a2227197dd4fcf05b02c10fb1c74a886d474d36533505d1be94394be049a90"}
Jul 29 00:36:16.360012 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:16.359973    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssvhl" event={"ID":"71e97aa9-6c5d-4cbb-95f2-e0446008a06a","Type":"ContainerStarted","Data":"d9391a19355e66f8b5d0b733494e732feaad8b52632767e7e590de7523622d08"}
Jul 29 00:36:16.392910 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:16.392863    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-98hrh" event={"ID":"39ffad98-0754-4a8e-a71d-9268bef9d27b","Type":"ContainerStarted","Data":"3afc731553eaa4843ad448824074959fef166bc20b774aa8b8cc7a48f085e154"}
Jul 29 00:36:16.400221 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:16.400181    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mqkpn" event={"ID":"d82ff890-8510-4c13-bf38-a9674ceb80b6","Type":"ContainerStarted","Data":"819f380b1921f5dba8b43f798e8c426f1cb364392521f3bba4a56a0a1f4c3fc5"}
Jul 29 00:36:16.402254 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:16.402223    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-64zbn" event={"ID":"dd52cd00-4e48-44f5-aa79-770415b0012a","Type":"ContainerStarted","Data":"0716d174b976c5baaf3fa4caca64b1bd84db6ea35c2da48216998641b3f6beae"}
Jul 29 00:36:16.408742 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:16.408674    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-146.ec2.internal" event={"ID":"7de2163f97d96577b1944d1e86114197","Type":"ContainerStarted","Data":"4fd8a71e716138d3fb1921eb34f385d18f22fd5b7deec367d99b5c236acc441e"}
Jul 29 00:36:16.424853 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:16.424795    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-khbnj" event={"ID":"3d340227-bc79-4097-9f96-1c6e28099b20","Type":"ContainerStarted","Data":"8d75da9cb7b4ac21e2bd01b2c1667d13116b131c640acb53b37c3800ab7afcde"}
Jul 29 00:36:16.449136 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:16.447673    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5762b" event={"ID":"aacee544-c9e9-49a4-be77-072f82640155","Type":"ContainerStarted","Data":"c6793322345e53f316e71d12d3b74bd148337f06e6dca494799d4b9f81fe21f5"}
Jul 29 00:36:16.465503 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:16.465462    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7w5v9" event={"ID":"7f95557b-6c39-4b63-9d6c-2cdbd68e8eb2","Type":"ContainerStarted","Data":"509a2c2583fdc4f118e5a68bfb85828741bb18ed94195181dcedf381c7b5b337"}
Jul 29 00:36:16.820224 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:16.820164    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5133632e-a2ef-4d96-a84e-296378c156bc-original-pull-secret\") pod \"global-pull-secret-syncer-jswzt\" (UID: \"5133632e-a2ef-4d96-a84e-296378c156bc\") " pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:36:16.820432 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:16.820366    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 00:36:16.820506 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:16.820459    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5133632e-a2ef-4d96-a84e-296378c156bc-original-pull-secret podName:5133632e-a2ef-4d96-a84e-296378c156bc nodeName:}" failed. No retries permitted until 2026-07-29 00:36:18.820441608 +0000 UTC m=+4.964899172 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5133632e-a2ef-4d96-a84e-296378c156bc-original-pull-secret") pod "global-pull-secret-syncer-jswzt" (UID: "5133632e-a2ef-4d96-a84e-296378c156bc") : object "kube-system"/"original-pull-secret" not registered
Jul 29 00:36:16.876335 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:16.876304    2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 00:36:16.921039 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:16.921003    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/068d3131-bf24-4e3f-b450-e518d95238db-metrics-certs\") pod \"network-metrics-daemon-tzrn2\" (UID: \"068d3131-bf24-4e3f-b450-e518d95238db\") " pod="openshift-multus/network-metrics-daemon-tzrn2"
Jul 29 00:36:16.921289 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:16.921232    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 00:36:16.921365 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:16.921304    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/068d3131-bf24-4e3f-b450-e518d95238db-metrics-certs podName:068d3131-bf24-4e3f-b450-e518d95238db nodeName:}" failed. No retries permitted until 2026-07-29 00:36:18.921284944 +0000 UTC m=+5.065742496 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/068d3131-bf24-4e3f-b450-e518d95238db-metrics-certs") pod "network-metrics-daemon-tzrn2" (UID: "068d3131-bf24-4e3f-b450-e518d95238db") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 00:36:17.022053 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:17.021992    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7n8w\" (UniqueName: \"kubernetes.io/projected/afd557e9-0701-488d-acd6-0f91d0002e61-kube-api-access-f7n8w\") pod \"network-check-target-hcb88\" (UID: \"afd557e9-0701-488d-acd6-0f91d0002e61\") " pod="openshift-network-diagnostics/network-check-target-hcb88"
Jul 29 00:36:17.022241 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:17.022174    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 00:36:17.022241 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:17.022194    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 00:36:17.022241 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:17.022207    2577 projected.go:196] Error preparing data for projected volume kube-api-access-f7n8w for pod openshift-network-diagnostics/network-check-target-hcb88: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 00:36:17.022412 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:17.022267    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/afd557e9-0701-488d-acd6-0f91d0002e61-kube-api-access-f7n8w podName:afd557e9-0701-488d-acd6-0f91d0002e61 nodeName:}" failed. No retries permitted until 2026-07-29 00:36:19.022247859 +0000 UTC m=+5.166705409 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-f7n8w" (UniqueName: "kubernetes.io/projected/afd557e9-0701-488d-acd6-0f91d0002e61-kube-api-access-f7n8w") pod "network-check-target-hcb88" (UID: "afd557e9-0701-488d-acd6-0f91d0002e61") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 00:36:17.243657 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:17.243578    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 00:31:15 +0000 UTC" deadline="2028-05-11 21:27:11.484448086 +0000 UTC"
Jul 29 00:36:17.243657 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:17.243655    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15668h50m54.24079762s"
Jul 29 00:36:17.298374 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:17.298343    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrn2"
Jul 29 00:36:17.298554 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:17.298498    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzrn2" podUID="068d3131-bf24-4e3f-b450-e518d95238db"
Jul 29 00:36:17.298935 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:17.298916    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcb88"
Jul 29 00:36:17.299029 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:17.299010    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcb88" podUID="afd557e9-0701-488d-acd6-0f91d0002e61"
Jul 29 00:36:17.973513 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:17.973478    2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 00:36:18.300370 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:18.300293    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:36:18.300835 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:18.300423    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jswzt" podUID="5133632e-a2ef-4d96-a84e-296378c156bc"
Jul 29 00:36:18.838876 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:18.838836    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5133632e-a2ef-4d96-a84e-296378c156bc-original-pull-secret\") pod \"global-pull-secret-syncer-jswzt\" (UID: \"5133632e-a2ef-4d96-a84e-296378c156bc\") " pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:36:18.839044 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:18.839000    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 00:36:18.839117 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:18.839053    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5133632e-a2ef-4d96-a84e-296378c156bc-original-pull-secret podName:5133632e-a2ef-4d96-a84e-296378c156bc nodeName:}" failed. No retries permitted until 2026-07-29 00:36:22.839040391 +0000 UTC m=+8.983497939 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5133632e-a2ef-4d96-a84e-296378c156bc-original-pull-secret") pod "global-pull-secret-syncer-jswzt" (UID: "5133632e-a2ef-4d96-a84e-296378c156bc") : object "kube-system"/"original-pull-secret" not registered
Jul 29 00:36:18.939456 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:18.939375    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/068d3131-bf24-4e3f-b450-e518d95238db-metrics-certs\") pod \"network-metrics-daemon-tzrn2\" (UID: \"068d3131-bf24-4e3f-b450-e518d95238db\") " pod="openshift-multus/network-metrics-daemon-tzrn2"
Jul 29 00:36:18.939663 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:18.939537    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 00:36:18.939663 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:18.939615    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/068d3131-bf24-4e3f-b450-e518d95238db-metrics-certs podName:068d3131-bf24-4e3f-b450-e518d95238db nodeName:}" failed. No retries permitted until 2026-07-29 00:36:22.939596777 +0000 UTC m=+9.084054377 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/068d3131-bf24-4e3f-b450-e518d95238db-metrics-certs") pod "network-metrics-daemon-tzrn2" (UID: "068d3131-bf24-4e3f-b450-e518d95238db") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 00:36:19.040257 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:19.040214    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7n8w\" (UniqueName: \"kubernetes.io/projected/afd557e9-0701-488d-acd6-0f91d0002e61-kube-api-access-f7n8w\") pod \"network-check-target-hcb88\" (UID: \"afd557e9-0701-488d-acd6-0f91d0002e61\") " pod="openshift-network-diagnostics/network-check-target-hcb88"
Jul 29 00:36:19.040478 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:19.040461    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 00:36:19.040564 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:19.040486    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 00:36:19.040564 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:19.040499    2577 projected.go:196] Error preparing data for projected volume kube-api-access-f7n8w for pod openshift-network-diagnostics/network-check-target-hcb88: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 00:36:19.040564 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:19.040558    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/afd557e9-0701-488d-acd6-0f91d0002e61-kube-api-access-f7n8w podName:afd557e9-0701-488d-acd6-0f91d0002e61 nodeName:}" failed. No retries permitted until 2026-07-29 00:36:23.040538246 +0000 UTC m=+9.184995816 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-f7n8w" (UniqueName: "kubernetes.io/projected/afd557e9-0701-488d-acd6-0f91d0002e61-kube-api-access-f7n8w") pod "network-check-target-hcb88" (UID: "afd557e9-0701-488d-acd6-0f91d0002e61") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 00:36:19.298342 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:19.298204    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrn2"
Jul 29 00:36:19.298342 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:19.298251    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcb88"
Jul 29 00:36:19.298560 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:19.298353    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzrn2" podUID="068d3131-bf24-4e3f-b450-e518d95238db"
Jul 29 00:36:19.298792 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:19.298750    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcb88" podUID="afd557e9-0701-488d-acd6-0f91d0002e61"
Jul 29 00:36:20.297698 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:20.297664    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:36:20.298186 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:20.297800    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jswzt" podUID="5133632e-a2ef-4d96-a84e-296378c156bc"
Jul 29 00:36:21.298138 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:21.298095    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcb88"
Jul 29 00:36:21.298615 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:21.298276    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcb88" podUID="afd557e9-0701-488d-acd6-0f91d0002e61"
Jul 29 00:36:21.298615 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:21.298095    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrn2"
Jul 29 00:36:21.298793 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:21.298747    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzrn2" podUID="068d3131-bf24-4e3f-b450-e518d95238db"
Jul 29 00:36:22.298038 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:22.297995    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:36:22.298223 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:22.298124    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jswzt" podUID="5133632e-a2ef-4d96-a84e-296378c156bc"
Jul 29 00:36:22.879767 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:22.879634    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5133632e-a2ef-4d96-a84e-296378c156bc-original-pull-secret\") pod \"global-pull-secret-syncer-jswzt\" (UID: \"5133632e-a2ef-4d96-a84e-296378c156bc\") " pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:36:22.879919 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:22.879795    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 00:36:22.879919 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:22.879865    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5133632e-a2ef-4d96-a84e-296378c156bc-original-pull-secret podName:5133632e-a2ef-4d96-a84e-296378c156bc nodeName:}" failed. No retries permitted until 2026-07-29 00:36:30.879849271 +0000 UTC m=+17.024306818 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5133632e-a2ef-4d96-a84e-296378c156bc-original-pull-secret") pod "global-pull-secret-syncer-jswzt" (UID: "5133632e-a2ef-4d96-a84e-296378c156bc") : object "kube-system"/"original-pull-secret" not registered
Jul 29 00:36:22.981100 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:22.981054    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/068d3131-bf24-4e3f-b450-e518d95238db-metrics-certs\") pod \"network-metrics-daemon-tzrn2\" (UID: \"068d3131-bf24-4e3f-b450-e518d95238db\") " pod="openshift-multus/network-metrics-daemon-tzrn2"
Jul 29 00:36:22.981289 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:22.981184    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 00:36:22.981289 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:22.981256    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/068d3131-bf24-4e3f-b450-e518d95238db-metrics-certs podName:068d3131-bf24-4e3f-b450-e518d95238db nodeName:}" failed. No retries permitted until 2026-07-29 00:36:30.981237305 +0000 UTC m=+17.125694854 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/068d3131-bf24-4e3f-b450-e518d95238db-metrics-certs") pod "network-metrics-daemon-tzrn2" (UID: "068d3131-bf24-4e3f-b450-e518d95238db") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 00:36:23.082049 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:23.082004    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7n8w\" (UniqueName: \"kubernetes.io/projected/afd557e9-0701-488d-acd6-0f91d0002e61-kube-api-access-f7n8w\") pod \"network-check-target-hcb88\" (UID: \"afd557e9-0701-488d-acd6-0f91d0002e61\") " pod="openshift-network-diagnostics/network-check-target-hcb88"
Jul 29 00:36:23.082226 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:23.082200    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 00:36:23.082267 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:23.082226    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 00:36:23.082267 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:23.082240    2577 projected.go:196] Error preparing data for projected volume kube-api-access-f7n8w for pod openshift-network-diagnostics/network-check-target-hcb88: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 00:36:23.082330 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:23.082308    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/afd557e9-0701-488d-acd6-0f91d0002e61-kube-api-access-f7n8w podName:afd557e9-0701-488d-acd6-0f91d0002e61 nodeName:}" failed. No retries permitted until 2026-07-29 00:36:31.082289021 +0000 UTC m=+17.226746572 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-f7n8w" (UniqueName: "kubernetes.io/projected/afd557e9-0701-488d-acd6-0f91d0002e61-kube-api-access-f7n8w") pod "network-check-target-hcb88" (UID: "afd557e9-0701-488d-acd6-0f91d0002e61") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 00:36:23.298235 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:23.297939    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrn2"
Jul 29 00:36:23.298235 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:23.298080    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzrn2" podUID="068d3131-bf24-4e3f-b450-e518d95238db"
Jul 29 00:36:23.298235 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:23.298199    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcb88"
Jul 29 00:36:23.298823 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:23.298296    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcb88" podUID="afd557e9-0701-488d-acd6-0f91d0002e61"
Jul 29 00:36:24.298798 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:24.298307    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:36:24.298798 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:24.298423    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jswzt" podUID="5133632e-a2ef-4d96-a84e-296378c156bc"
Jul 29 00:36:25.298376 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:25.298332    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcb88"
Jul 29 00:36:25.298376 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:25.298373    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrn2"
Jul 29 00:36:25.298662 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:25.298474    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcb88" podUID="afd557e9-0701-488d-acd6-0f91d0002e61"
Jul 29 00:36:25.298662 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:25.298592    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzrn2" podUID="068d3131-bf24-4e3f-b450-e518d95238db"
Jul 29 00:36:26.298202 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:26.298151    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:36:26.298701 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:26.298288    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jswzt" podUID="5133632e-a2ef-4d96-a84e-296378c156bc"
Jul 29 00:36:27.298364 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:27.298326    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrn2"
Jul 29 00:36:27.298822 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:27.298374    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcb88"
Jul 29 00:36:27.298822 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:27.298458    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzrn2" podUID="068d3131-bf24-4e3f-b450-e518d95238db"
Jul 29 00:36:27.298822 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:27.298563    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcb88" podUID="afd557e9-0701-488d-acd6-0f91d0002e61"
Jul 29 00:36:28.297878 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:28.297839    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:36:28.298062 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:28.297985    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jswzt" podUID="5133632e-a2ef-4d96-a84e-296378c156bc"
Jul 29 00:36:29.297844 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:29.297804    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcb88"
Jul 29 00:36:29.298320 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:29.297811    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrn2"
Jul 29 00:36:29.298320 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:29.297937    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcb88" podUID="afd557e9-0701-488d-acd6-0f91d0002e61"
Jul 29 00:36:29.298320 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:29.298040    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzrn2" podUID="068d3131-bf24-4e3f-b450-e518d95238db"
Jul 29 00:36:30.298059 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:30.298024    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:36:30.298555 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:30.298144    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jswzt" podUID="5133632e-a2ef-4d96-a84e-296378c156bc"
Jul 29 00:36:30.938972 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:30.938932    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5133632e-a2ef-4d96-a84e-296378c156bc-original-pull-secret\") pod \"global-pull-secret-syncer-jswzt\" (UID: \"5133632e-a2ef-4d96-a84e-296378c156bc\") " pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:36:30.939187 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:30.939075    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 00:36:30.939187 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:30.939153    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5133632e-a2ef-4d96-a84e-296378c156bc-original-pull-secret podName:5133632e-a2ef-4d96-a84e-296378c156bc nodeName:}" failed. No retries permitted until 2026-07-29 00:36:46.939129348 +0000 UTC m=+33.083586899 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5133632e-a2ef-4d96-a84e-296378c156bc-original-pull-secret") pod "global-pull-secret-syncer-jswzt" (UID: "5133632e-a2ef-4d96-a84e-296378c156bc") : object "kube-system"/"original-pull-secret" not registered
Jul 29 00:36:31.039940 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:31.039909    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/068d3131-bf24-4e3f-b450-e518d95238db-metrics-certs\") pod \"network-metrics-daemon-tzrn2\" (UID: \"068d3131-bf24-4e3f-b450-e518d95238db\") " pod="openshift-multus/network-metrics-daemon-tzrn2"
Jul 29 00:36:31.040119 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:31.040055    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 00:36:31.040119 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:31.040106    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/068d3131-bf24-4e3f-b450-e518d95238db-metrics-certs podName:068d3131-bf24-4e3f-b450-e518d95238db nodeName:}" failed. No retries permitted until 2026-07-29 00:36:47.040092541 +0000 UTC m=+33.184550089 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/068d3131-bf24-4e3f-b450-e518d95238db-metrics-certs") pod "network-metrics-daemon-tzrn2" (UID: "068d3131-bf24-4e3f-b450-e518d95238db") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 00:36:31.140666 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:31.140628    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7n8w\" (UniqueName: \"kubernetes.io/projected/afd557e9-0701-488d-acd6-0f91d0002e61-kube-api-access-f7n8w\") pod \"network-check-target-hcb88\" (UID: \"afd557e9-0701-488d-acd6-0f91d0002e61\") " pod="openshift-network-diagnostics/network-check-target-hcb88"
Jul 29 00:36:31.140810 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:31.140785    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 00:36:31.140853 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:31.140809    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 00:36:31.140853 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:31.140822    2577 projected.go:196] Error preparing data for projected volume kube-api-access-f7n8w for pod openshift-network-diagnostics/network-check-target-hcb88: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 00:36:31.140948 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:31.140866    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/afd557e9-0701-488d-acd6-0f91d0002e61-kube-api-access-f7n8w podName:afd557e9-0701-488d-acd6-0f91d0002e61 nodeName:}" failed. No retries permitted until 2026-07-29 00:36:47.140852984 +0000 UTC m=+33.285310532 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-f7n8w" (UniqueName: "kubernetes.io/projected/afd557e9-0701-488d-acd6-0f91d0002e61-kube-api-access-f7n8w") pod "network-check-target-hcb88" (UID: "afd557e9-0701-488d-acd6-0f91d0002e61") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 00:36:31.297635 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:31.297558    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrn2"
Jul 29 00:36:31.297799 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:31.297558    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcb88"
Jul 29 00:36:31.297799 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:31.297685    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzrn2" podUID="068d3131-bf24-4e3f-b450-e518d95238db"
Jul 29 00:36:31.297799 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:31.297761    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcb88" podUID="afd557e9-0701-488d-acd6-0f91d0002e61"
Jul 29 00:36:32.297750 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:32.297715    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:36:32.298242 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:32.297865    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jswzt" podUID="5133632e-a2ef-4d96-a84e-296378c156bc"
Jul 29 00:36:33.297782 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:33.297747    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrn2"
Jul 29 00:36:33.298210 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:33.297750    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcb88"
Jul 29 00:36:33.298210 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:33.297879    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzrn2" podUID="068d3131-bf24-4e3f-b450-e518d95238db"
Jul 29 00:36:33.298210 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:33.297942    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcb88" podUID="afd557e9-0701-488d-acd6-0f91d0002e61"
Jul 29 00:36:34.298679 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:34.298643    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:36:34.299229 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:34.298755    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jswzt" podUID="5133632e-a2ef-4d96-a84e-296378c156bc"
Jul 29 00:36:35.297945 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:35.297906    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrn2"
Jul 29 00:36:35.297945 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:35.297939    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcb88"
Jul 29 00:36:35.298141 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:35.298017    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzrn2" podUID="068d3131-bf24-4e3f-b450-e518d95238db"
Jul 29 00:36:35.298179 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:35.298147    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcb88" podUID="afd557e9-0701-488d-acd6-0f91d0002e61"
Jul 29 00:36:36.298355 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:36.298079    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:36:36.299000 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:36.298433    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jswzt" podUID="5133632e-a2ef-4d96-a84e-296378c156bc"
Jul 29 00:36:36.519039 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:36.518874    2577 generic.go:356] "Generic (PLEG): container finished" podID="4fb1ab675b74af15fe9c3bb2fade2db2" containerID="92f629205a78114f62752ccd4df60eb5b724e855fa1f56ede42963d4a4f187bc" exitCode=0
Jul 29 00:36:36.519161 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:36.518962    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal" event={"ID":"4fb1ab675b74af15fe9c3bb2fade2db2","Type":"ContainerDied","Data":"92f629205a78114f62752ccd4df60eb5b724e855fa1f56ede42963d4a4f187bc"}
Jul 29 00:36:36.521673 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:36.521654    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tfr5v_ac322954-06d1-4807-8a8b-59e62befe6bc/ovn-acl-logging/0.log"
Jul 29 00:36:36.522047 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:36.521995    2577 generic.go:356] "Generic (PLEG): container finished" podID="ac322954-06d1-4807-8a8b-59e62befe6bc" containerID="3b4b26ff10d06112eb8cea4bfbd7a0a5faa556a3a6e06ed77189ac8963ec2ed4" exitCode=1
Jul 29 00:36:36.522124 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:36.522059    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v" event={"ID":"ac322954-06d1-4807-8a8b-59e62befe6bc","Type":"ContainerStarted","Data":"eb1396a251034621b3127df23040056f80b929718f002d09a1d0aacb23623830"}
Jul 29 00:36:36.522124 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:36.522117    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v" event={"ID":"ac322954-06d1-4807-8a8b-59e62befe6bc","Type":"ContainerStarted","Data":"93f2e37ae5bd98dc70613b8d10ced411c83c014c1eea6d61c23432aecefbd91d"}
Jul 29 00:36:36.522205 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:36.522161    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v" event={"ID":"ac322954-06d1-4807-8a8b-59e62befe6bc","Type":"ContainerStarted","Data":"472127b73b11c820f0bb6ae83da5ad70b8542bb681e9ccfba95051255a51c224"}
Jul 29 00:36:36.522205 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:36.522197    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v" event={"ID":"ac322954-06d1-4807-8a8b-59e62befe6bc","Type":"ContainerDied","Data":"3b4b26ff10d06112eb8cea4bfbd7a0a5faa556a3a6e06ed77189ac8963ec2ed4"}
Jul 29 00:36:36.522286 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:36.522276    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v" event={"ID":"ac322954-06d1-4807-8a8b-59e62befe6bc","Type":"ContainerStarted","Data":"67432d9bb3c38828e418dd2d96164694eac7bc7164d4b905dde5913042f88761"}
Jul 29 00:36:36.523369 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:36.523350    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssvhl" event={"ID":"71e97aa9-6c5d-4cbb-95f2-e0446008a06a","Type":"ContainerStarted","Data":"9db17aab2ebaaebd0970fb5135093a524b944e711391ad5b5d1fc15308aa5bff"}
Jul 29 00:36:36.524838 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:36.524817    2577 generic.go:356] "Generic (PLEG): container finished" podID="d82ff890-8510-4c13-bf38-a9674ceb80b6" containerID="487d10f5333b7f08cc1f181d0ff57bc960fc28e726ef6f3c1a233d1598c90c49" exitCode=0
Jul 29 00:36:36.524928 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:36.524878    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mqkpn" event={"ID":"d82ff890-8510-4c13-bf38-a9674ceb80b6","Type":"ContainerDied","Data":"487d10f5333b7f08cc1f181d0ff57bc960fc28e726ef6f3c1a233d1598c90c49"}
Jul 29 00:36:36.526224 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:36.526208    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-64zbn" event={"ID":"dd52cd00-4e48-44f5-aa79-770415b0012a","Type":"ContainerStarted","Data":"635e1ef6eb072d1f42ace409ec93786637568ba089cb46825b32529f610fba15"}
Jul 29 00:36:36.527570 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:36.527547    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-146.ec2.internal" event={"ID":"7de2163f97d96577b1944d1e86114197","Type":"ContainerStarted","Data":"ac48da1a0248b1a07efe96caf75c054d21d04c3dea37bfe5e4efb71f42dfc270"}
Jul 29 00:36:36.531196 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:36.529396    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-khbnj" event={"ID":"3d340227-bc79-4097-9f96-1c6e28099b20","Type":"ContainerStarted","Data":"5a72e269cdfcd38df1e116156f15360efca54b265a1f0cf98c9f827797e9e16a"}
Jul 29 00:36:36.532838 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:36.532813    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5762b" event={"ID":"aacee544-c9e9-49a4-be77-072f82640155","Type":"ContainerStarted","Data":"9dc43f9181be87f8c604c2632921426e5a086565095b5927de93d83c72fa990f"}
Jul 29 00:36:36.534212 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:36.534194    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7w5v9" event={"ID":"7f95557b-6c39-4b63-9d6c-2cdbd68e8eb2","Type":"ContainerStarted","Data":"3bf42f25222dcad9feb410b058980dee27bfe77fdb7a5441544def78e414dae3"}
Jul 29 00:36:36.535477 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:36.535459    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4hcbn" event={"ID":"f89cf1a4-a323-4d76-b082-cb93514324fc","Type":"ContainerStarted","Data":"2c1ebdfd0b9373b1388718324e9df0d264d617cd8d3eb64cf7e66515fe0752f3"}
Jul 29 00:36:36.550903 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:36.550860    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-khbnj" podStartSLOduration=2.786997507 podStartE2EDuration="22.550846529s" totalImagesPullingTime="19.763849022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:36:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:36:36.550724756 +0000 UTC m=+22.695182325" watchObservedRunningTime="2026-07-29 00:36:36.550846529 +0000 UTC m=+22.695304099"
Jul 29 00:36:36.568524 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:36.568480    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-64zbn" podStartSLOduration=2.69457441 podStartE2EDuration="22.568467011s" totalImagesPullingTime="19.873892601s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 00:36:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:36:36.568039754 +0000 UTC m=+22.712497351" watchObservedRunningTime="2026-07-29 00:36:36.568467011 +0000 UTC m=+22.712924583"
Jul 29 00:36:36.601566 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:36.601526    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-146.ec2.internal" podStartSLOduration=21.601511168000002 podStartE2EDuration="21.601511168s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 00:36:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:36:36.601257566 +0000 UTC m=+22.745715146" watchObservedRunningTime="2026-07-29 00:36:36.601511168 +0000 UTC m=+22.745968738"
Jul 29 00:36:36.615649 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:36.615608    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4hcbn" podStartSLOduration=2.761222506 podStartE2EDuration="22.615577709s" totalImagesPullingTime="19.854355203s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 00:36:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:36:36.615228654 +0000 UTC m=+22.759686226" watchObservedRunningTime="2026-07-29 00:36:36.615577709 +0000 UTC m=+22.760035278"
Jul 29 00:36:36.628772 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:36.628725    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7w5v9" podStartSLOduration=2.7905714440000002 podStartE2EDuration="22.628709397s" totalImagesPullingTime="19.838137953s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 00:36:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:36:36.62854092 +0000 UTC m=+22.772998491" watchObservedRunningTime="2026-07-29 00:36:36.628709397 +0000 UTC m=+22.773166967"
Jul 29 00:36:36.644511 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:36.644469    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5762b" podStartSLOduration=2.783568196 podStartE2EDuration="22.644452702s" totalImagesPullingTime="19.860884506s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 00:36:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:36:36.644331665 +0000 UTC m=+22.788789236" watchObservedRunningTime="2026-07-29 00:36:36.644452702 +0000 UTC m=+22.788910290"
Jul 29 00:36:37.297607 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:37.297559    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrn2"
Jul 29 00:36:37.297845 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:37.297614    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcb88"
Jul 29 00:36:37.297845 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:37.297689    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzrn2" podUID="068d3131-bf24-4e3f-b450-e518d95238db"
Jul 29 00:36:37.297845 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:37.297796    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcb88" podUID="afd557e9-0701-488d-acd6-0f91d0002e61"
Jul 29 00:36:37.498131 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:37.498091    2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 29 00:36:37.540628 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:37.540575    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tfr5v_ac322954-06d1-4807-8a8b-59e62befe6bc/ovn-acl-logging/0.log"
Jul 29 00:36:37.541059 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:37.541024    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v" event={"ID":"ac322954-06d1-4807-8a8b-59e62befe6bc","Type":"ContainerStarted","Data":"73249659b68e3b01f2a8b582069d98cd1d21683f3d12cc61cbab93a3241d25b2"}
Jul 29 00:36:37.542950 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:37.542922    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssvhl" event={"ID":"71e97aa9-6c5d-4cbb-95f2-e0446008a06a","Type":"ContainerStarted","Data":"2b40f56885e72998b373c79c434d62dae04f125f596c94815df4d096fd10f666"}
Jul 29 00:36:37.546822 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:37.546793    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-98hrh" event={"ID":"39ffad98-0754-4a8e-a71d-9268bef9d27b","Type":"ContainerStarted","Data":"6a3c659b19f6695ffd18e0096fa28fc40cda4405a1bcc6219e9705e16816fad0"}
Jul 29 00:36:37.548667 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:37.548645    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal" event={"ID":"4fb1ab675b74af15fe9c3bb2fade2db2","Type":"ContainerStarted","Data":"1667c56b0fc6a7efea60539b51f208654755904b31e5431699ad631e30cc8a06"}
Jul 29 00:36:37.561780 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:37.561733    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-98hrh" podStartSLOduration=3.768246713 podStartE2EDuration="23.561716224s" totalImagesPullingTime="19.793469511s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 00:36:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:36:37.561176131 +0000 UTC m=+23.705633726" watchObservedRunningTime="2026-07-29 00:36:37.561716224 +0000 UTC m=+23.706173797"
Jul 29 00:36:37.577213 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:37.577171    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-146.ec2.internal" podStartSLOduration=22.577155952 podStartE2EDuration="22.577155952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 00:36:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:36:37.576642004 +0000 UTC m=+23.721099574" watchObservedRunningTime="2026-07-29 00:36:37.577155952 +0000 UTC m=+23.721613524"
Jul 29 00:36:38.270324 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:38.270176    2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T00:36:37.498115907Z","UUID":"5e7ca024-262c-40bf-905f-6a0fd2e31ed8","Handler":null,"Name":"","Endpoint":""}
Jul 29 00:36:38.271820 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:38.271797    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 29 00:36:38.271951 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:38.271840    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 29 00:36:38.297635 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:38.297596    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:36:38.297806 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:38.297740    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jswzt" podUID="5133632e-a2ef-4d96-a84e-296378c156bc"
Jul 29 00:36:38.378795 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:38.378759    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-khbnj"
Jul 29 00:36:38.379529 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:38.379279    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-khbnj"
Jul 29 00:36:38.551106 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:38.551015    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-khbnj"
Jul 29 00:36:38.551504 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:38.551277    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-khbnj"
Jul 29 00:36:39.297609 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:39.297432    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrn2"
Jul 29 00:36:39.297781 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:39.297471    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcb88"
Jul 29 00:36:39.297781 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:39.297720    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzrn2" podUID="068d3131-bf24-4e3f-b450-e518d95238db"
Jul 29 00:36:39.297781 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:39.297750    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcb88" podUID="afd557e9-0701-488d-acd6-0f91d0002e61"
Jul 29 00:36:39.556533 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:39.556462    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tfr5v_ac322954-06d1-4807-8a8b-59e62befe6bc/ovn-acl-logging/0.log"
Jul 29 00:36:39.556988 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:39.556878    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v" event={"ID":"ac322954-06d1-4807-8a8b-59e62befe6bc","Type":"ContainerStarted","Data":"c3c69cccea611f56d577ec34ce71f9a8b7519d92c331473d276d5e9f9d19b1ac"}
Jul 29 00:36:39.559143 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:39.559114    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssvhl" event={"ID":"71e97aa9-6c5d-4cbb-95f2-e0446008a06a","Type":"ContainerStarted","Data":"c6ee5e67b371e5620035c86afefda8645cee4176f58e2346f67fdc5e9e4cdcfe"}
Jul 29 00:36:39.580807 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:39.580723    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ssvhl" podStartSLOduration=3.061522437 podStartE2EDuration="25.580703388s" totalImagesPullingTime="22.519180951s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 00:36:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:36:39.579128427 +0000 UTC m=+25.723585998" watchObservedRunningTime="2026-07-29 00:36:39.580703388 +0000 UTC m=+25.725160959"
Jul 29 00:36:40.297966 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:40.297938    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:36:40.298142 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:40.298059    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jswzt" podUID="5133632e-a2ef-4d96-a84e-296378c156bc"
Jul 29 00:36:41.297452 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:41.297423    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcb88"
Jul 29 00:36:41.298158 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:41.297423    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrn2"
Jul 29 00:36:41.298158 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:41.297545    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcb88" podUID="afd557e9-0701-488d-acd6-0f91d0002e61"
Jul 29 00:36:41.298158 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:41.297638    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzrn2" podUID="068d3131-bf24-4e3f-b450-e518d95238db"
Jul 29 00:36:41.566746 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:41.566526    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tfr5v_ac322954-06d1-4807-8a8b-59e62befe6bc/ovn-acl-logging/0.log"
Jul 29 00:36:41.567068 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:41.567048    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v" event={"ID":"ac322954-06d1-4807-8a8b-59e62befe6bc","Type":"ContainerStarted","Data":"d10df3c37fe15bdb26870454a4402282a3d3d4ca727a51d1d9e304b59ac35cb7"}
Jul 29 00:36:41.567309 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:41.567290    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:41.567538 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:41.567520    2577 scope.go:117] "RemoveContainer" containerID="3b4b26ff10d06112eb8cea4bfbd7a0a5faa556a3a6e06ed77189ac8963ec2ed4"
Jul 29 00:36:41.569073 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:41.569047    2577 generic.go:356] "Generic (PLEG): container finished" podID="d82ff890-8510-4c13-bf38-a9674ceb80b6" containerID="9f461457e1c454491a44f0a42b565f55acfe8b78c88aed4a58db5866a004f247" exitCode=0
Jul 29 00:36:41.569161 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:41.569109    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mqkpn" event={"ID":"d82ff890-8510-4c13-bf38-a9674ceb80b6","Type":"ContainerDied","Data":"9f461457e1c454491a44f0a42b565f55acfe8b78c88aed4a58db5866a004f247"}
Jul 29 00:36:41.584880 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:41.584861    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:42.297960 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:42.297929    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:36:42.298312 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:42.298042    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jswzt" podUID="5133632e-a2ef-4d96-a84e-296378c156bc"
Jul 29 00:36:42.576074 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:42.576046    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tfr5v_ac322954-06d1-4807-8a8b-59e62befe6bc/ovn-acl-logging/0.log"
Jul 29 00:36:42.576543 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:42.576501    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v" event={"ID":"ac322954-06d1-4807-8a8b-59e62befe6bc","Type":"ContainerStarted","Data":"985b371a8f29231fea347e98cefe0fc40245a6be596517b239c180592d14ffdc"}
Jul 29 00:36:42.576762 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:42.576738    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:42.576874 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:42.576821    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:42.593261 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:42.593231    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:36:42.602251 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:42.602214    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v" podStartSLOduration=8.367378479 podStartE2EDuration="28.602201465s" totalImagesPullingTime="20.234822986s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 00:36:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:36:42.600719379 +0000 UTC m=+28.745176969" watchObservedRunningTime="2026-07-29 00:36:42.602201465 +0000 UTC m=+28.746659034"
Jul 29 00:36:43.298454 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:43.298360    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrn2"
Jul 29 00:36:43.298974 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:43.298361    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcb88"
Jul 29 00:36:43.298974 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:43.298505    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzrn2" podUID="068d3131-bf24-4e3f-b450-e518d95238db"
Jul 29 00:36:43.298974 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:43.298560    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcb88" podUID="afd557e9-0701-488d-acd6-0f91d0002e61"
Jul 29 00:36:43.581189 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:43.581159    2577 generic.go:356] "Generic (PLEG): container finished" podID="d82ff890-8510-4c13-bf38-a9674ceb80b6" containerID="f4eebdca09feff3d9b366d7a72ebb565fb525ca753bc6029ff0b01f55fce0909" exitCode=0
Jul 29 00:36:43.581361 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:43.581203    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mqkpn" event={"ID":"d82ff890-8510-4c13-bf38-a9674ceb80b6","Type":"ContainerDied","Data":"f4eebdca09feff3d9b366d7a72ebb565fb525ca753bc6029ff0b01f55fce0909"}
Jul 29 00:36:44.298755 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:44.298723    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:36:44.299123 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:44.298810    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jswzt" podUID="5133632e-a2ef-4d96-a84e-296378c156bc"
Jul 29 00:36:45.298450 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:45.298416    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrn2"
Jul 29 00:36:45.298653 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:45.298537    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzrn2" podUID="068d3131-bf24-4e3f-b450-e518d95238db"
Jul 29 00:36:45.298653 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:45.298601    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcb88"
Jul 29 00:36:45.298745 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:45.298684    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcb88" podUID="afd557e9-0701-488d-acd6-0f91d0002e61"
Jul 29 00:36:45.589147 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:45.589115    2577 generic.go:356] "Generic (PLEG): container finished" podID="d82ff890-8510-4c13-bf38-a9674ceb80b6" containerID="ddb3edc1edd4d733d5e47a6cc70fdcb9a0bd516cd46f85c1c79a6a2dee0a4159" exitCode=0
Jul 29 00:36:45.589522 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:45.589156    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mqkpn" event={"ID":"d82ff890-8510-4c13-bf38-a9674ceb80b6","Type":"ContainerDied","Data":"ddb3edc1edd4d733d5e47a6cc70fdcb9a0bd516cd46f85c1c79a6a2dee0a4159"}
Jul 29 00:36:46.298003 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:46.297967    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:36:46.298194 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:46.298099    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jswzt" podUID="5133632e-a2ef-4d96-a84e-296378c156bc"
Jul 29 00:36:46.962440 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:46.962400    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5133632e-a2ef-4d96-a84e-296378c156bc-original-pull-secret\") pod \"global-pull-secret-syncer-jswzt\" (UID: \"5133632e-a2ef-4d96-a84e-296378c156bc\") " pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:36:46.962904 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:46.962531    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 00:36:46.962904 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:46.962617    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5133632e-a2ef-4d96-a84e-296378c156bc-original-pull-secret podName:5133632e-a2ef-4d96-a84e-296378c156bc nodeName:}" failed. No retries permitted until 2026-07-29 00:37:18.962596713 +0000 UTC m=+65.107054275 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5133632e-a2ef-4d96-a84e-296378c156bc-original-pull-secret") pod "global-pull-secret-syncer-jswzt" (UID: "5133632e-a2ef-4d96-a84e-296378c156bc") : object "kube-system"/"original-pull-secret" not registered
Jul 29 00:36:47.062808 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:47.062774    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/068d3131-bf24-4e3f-b450-e518d95238db-metrics-certs\") pod \"network-metrics-daemon-tzrn2\" (UID: \"068d3131-bf24-4e3f-b450-e518d95238db\") " pod="openshift-multus/network-metrics-daemon-tzrn2"
Jul 29 00:36:47.063004 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:47.062948    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 00:36:47.063077 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:47.063021    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/068d3131-bf24-4e3f-b450-e518d95238db-metrics-certs podName:068d3131-bf24-4e3f-b450-e518d95238db nodeName:}" failed. No retries permitted until 2026-07-29 00:37:19.062999782 +0000 UTC m=+65.207457330 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/068d3131-bf24-4e3f-b450-e518d95238db-metrics-certs") pod "network-metrics-daemon-tzrn2" (UID: "068d3131-bf24-4e3f-b450-e518d95238db") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 00:36:47.163418 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:47.163375    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7n8w\" (UniqueName: \"kubernetes.io/projected/afd557e9-0701-488d-acd6-0f91d0002e61-kube-api-access-f7n8w\") pod \"network-check-target-hcb88\" (UID: \"afd557e9-0701-488d-acd6-0f91d0002e61\") " pod="openshift-network-diagnostics/network-check-target-hcb88"
Jul 29 00:36:47.163619 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:47.163509    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 00:36:47.163619 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:47.163538    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 00:36:47.163619 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:47.163552    2577 projected.go:196] Error preparing data for projected volume kube-api-access-f7n8w for pod openshift-network-diagnostics/network-check-target-hcb88: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 00:36:47.163776 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:47.163634    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/afd557e9-0701-488d-acd6-0f91d0002e61-kube-api-access-f7n8w podName:afd557e9-0701-488d-acd6-0f91d0002e61 nodeName:}" failed. No retries permitted until 2026-07-29 00:37:19.16361433 +0000 UTC m=+65.308071893 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-f7n8w" (UniqueName: "kubernetes.io/projected/afd557e9-0701-488d-acd6-0f91d0002e61-kube-api-access-f7n8w") pod "network-check-target-hcb88" (UID: "afd557e9-0701-488d-acd6-0f91d0002e61") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 00:36:47.297483 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:47.297402    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrn2"
Jul 29 00:36:47.297666 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:47.297537    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzrn2" podUID="068d3131-bf24-4e3f-b450-e518d95238db"
Jul 29 00:36:47.297666 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:47.297636    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcb88"
Jul 29 00:36:47.297772 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:47.297717    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcb88" podUID="afd557e9-0701-488d-acd6-0f91d0002e61"
Jul 29 00:36:48.297504 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:48.297460    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:36:48.297959 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:48.297615    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jswzt" podUID="5133632e-a2ef-4d96-a84e-296378c156bc"
Jul 29 00:36:49.297662 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:49.297616    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrn2"
Jul 29 00:36:49.297662 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:49.297663    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcb88"
Jul 29 00:36:49.298174 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:49.297791    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzrn2" podUID="068d3131-bf24-4e3f-b450-e518d95238db"
Jul 29 00:36:49.298174 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:49.297909    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcb88" podUID="afd557e9-0701-488d-acd6-0f91d0002e61"
Jul 29 00:36:50.298196 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:50.298165    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:36:50.298576 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:50.298274    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jswzt" podUID="5133632e-a2ef-4d96-a84e-296378c156bc"
Jul 29 00:36:50.603854 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:50.603825    2577 generic.go:356] "Generic (PLEG): container finished" podID="d82ff890-8510-4c13-bf38-a9674ceb80b6" containerID="0f5a1afee6dcaca278931572e846fe4d81b65f8a35a6e6bc2ecf1e70d1c9aab9" exitCode=0
Jul 29 00:36:50.604008 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:50.603877    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mqkpn" event={"ID":"d82ff890-8510-4c13-bf38-a9674ceb80b6","Type":"ContainerDied","Data":"0f5a1afee6dcaca278931572e846fe4d81b65f8a35a6e6bc2ecf1e70d1c9aab9"}
Jul 29 00:36:51.298073 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:51.298030    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcb88"
Jul 29 00:36:51.298260 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:51.298030    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrn2"
Jul 29 00:36:51.298260 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:51.298137    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcb88" podUID="afd557e9-0701-488d-acd6-0f91d0002e61"
Jul 29 00:36:51.298260 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:51.298219    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzrn2" podUID="068d3131-bf24-4e3f-b450-e518d95238db"
Jul 29 00:36:51.609631 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:51.609443    2577 generic.go:356] "Generic (PLEG): container finished" podID="d82ff890-8510-4c13-bf38-a9674ceb80b6" containerID="110c8c4100b0c2240de555087f38f3854f985217681fe2016ae1934ec810a1d9" exitCode=0
Jul 29 00:36:51.609631 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:51.609524    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mqkpn" event={"ID":"d82ff890-8510-4c13-bf38-a9674ceb80b6","Type":"ContainerDied","Data":"110c8c4100b0c2240de555087f38f3854f985217681fe2016ae1934ec810a1d9"}
Jul 29 00:36:52.298405 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:52.298372    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:36:52.298802 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:52.298482    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jswzt" podUID="5133632e-a2ef-4d96-a84e-296378c156bc"
Jul 29 00:36:52.615547 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:52.615510    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mqkpn" event={"ID":"d82ff890-8510-4c13-bf38-a9674ceb80b6","Type":"ContainerStarted","Data":"911112741cee4163b62d4002b1d81432760574be6bf4ab794962628e292586cd"}
Jul 29 00:36:52.636388 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:52.636345    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mqkpn" podStartSLOduration=7.98931316 podStartE2EDuration="38.636328514s" totalImagesPullingTime="30.647015354s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 00:36:14 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:36:52.636037456 +0000 UTC m=+38.780495029" watchObservedRunningTime="2026-07-29 00:36:52.636328514 +0000 UTC m=+38.780786084"
Jul 29 00:36:53.297537 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:53.297502    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrn2"
Jul 29 00:36:53.297716 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:53.297643    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzrn2" podUID="068d3131-bf24-4e3f-b450-e518d95238db"
Jul 29 00:36:53.297716 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:53.297692    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcb88"
Jul 29 00:36:53.297855 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:53.297787    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcb88" podUID="afd557e9-0701-488d-acd6-0f91d0002e61"
Jul 29 00:36:54.298530 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:54.298495    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:36:54.298924 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:54.298604    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jswzt" podUID="5133632e-a2ef-4d96-a84e-296378c156bc"
Jul 29 00:36:55.297792 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:55.297751    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcb88"
Jul 29 00:36:55.297992 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:55.297757    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrn2"
Jul 29 00:36:55.297992 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:55.297859    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcb88" podUID="afd557e9-0701-488d-acd6-0f91d0002e61"
Jul 29 00:36:55.297992 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:55.297966    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzrn2" podUID="068d3131-bf24-4e3f-b450-e518d95238db"
Jul 29 00:36:56.298386 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:56.298350    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:36:56.298809 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:56.298461    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jswzt" podUID="5133632e-a2ef-4d96-a84e-296378c156bc"
Jul 29 00:36:57.297459 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:57.297421    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrn2"
Jul 29 00:36:57.297657 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:57.297531    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzrn2" podUID="068d3131-bf24-4e3f-b450-e518d95238db"
Jul 29 00:36:57.297657 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:57.297608    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcb88"
Jul 29 00:36:57.297791 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:57.297720    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcb88" podUID="afd557e9-0701-488d-acd6-0f91d0002e61"
Jul 29 00:36:58.297984 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:58.297951    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:36:58.298350 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:58.298055    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jswzt" podUID="5133632e-a2ef-4d96-a84e-296378c156bc"
Jul 29 00:36:59.297565 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:59.297527    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcb88"
Jul 29 00:36:59.297565 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:59.297567    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrn2"
Jul 29 00:36:59.297855 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:59.297672    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcb88" podUID="afd557e9-0701-488d-acd6-0f91d0002e61"
Jul 29 00:36:59.297855 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:59.297768    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzrn2" podUID="068d3131-bf24-4e3f-b450-e518d95238db"
Jul 29 00:36:59.466532 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:59.466493    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jswzt"]
Jul 29 00:36:59.467472 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:59.466705    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:36:59.467472 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:59.466817    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jswzt" podUID="5133632e-a2ef-4d96-a84e-296378c156bc"
Jul 29 00:36:59.471561 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:59.471532    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tzrn2"]
Jul 29 00:36:59.472294 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:59.472265    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hcb88"]
Jul 29 00:36:59.631902 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:59.631871    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrn2"
Jul 29 00:36:59.631902 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:36:59.631905    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcb88"
Jul 29 00:36:59.632127 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:59.631988    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzrn2" podUID="068d3131-bf24-4e3f-b450-e518d95238db"
Jul 29 00:36:59.632185 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:36:59.632131    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcb88" podUID="afd557e9-0701-488d-acd6-0f91d0002e61"
Jul 29 00:37:01.297743 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:01.297707    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcb88"
Jul 29 00:37:01.297743 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:01.297743    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrn2"
Jul 29 00:37:01.298148 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:01.297707    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:37:01.298148 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:37:01.297819    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcb88" podUID="afd557e9-0701-488d-acd6-0f91d0002e61"
Jul 29 00:37:01.298148 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:37:01.297884    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jswzt" podUID="5133632e-a2ef-4d96-a84e-296378c156bc"
Jul 29 00:37:01.298148 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:37:01.297957    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzrn2" podUID="068d3131-bf24-4e3f-b450-e518d95238db"
Jul 29 00:37:03.298143 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.297967    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcb88"
Jul 29 00:37:03.298485 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.297967    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:37:03.298485 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:37:03.298219    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcb88" podUID="afd557e9-0701-488d-acd6-0f91d0002e61"
Jul 29 00:37:03.298485 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:37:03.298293    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jswzt" podUID="5133632e-a2ef-4d96-a84e-296378c156bc"
Jul 29 00:37:03.298485 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.297989    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrn2"
Jul 29 00:37:03.298485 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:37:03.298371    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tzrn2" podUID="068d3131-bf24-4e3f-b450-e518d95238db"
Jul 29 00:37:03.641372 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.641346    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-146.ec2.internal" event="NodeReady"
Jul 29 00:37:03.641538 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.641474    2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 29 00:37:03.688496 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.688462    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5b664c4c7d-wvn9t"]
Jul 29 00:37:03.711247 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.711207    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gc7sl"]
Jul 29 00:37:03.711417 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.711325    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b664c4c7d-wvn9t"
Jul 29 00:37:03.713567 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.713541    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 29 00:37:03.713745 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.713554    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 29 00:37:03.713986 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.713972    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-f4ctm\""
Jul 29 00:37:03.716297 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.716280    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 29 00:37:03.721092 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.721058    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 29 00:37:03.725279 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.725162    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b664c4c7d-wvn9t"]
Jul 29 00:37:03.725386 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.725303    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-88lcv"]
Jul 29 00:37:03.725386 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.725260    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gc7sl"
Jul 29 00:37:03.727513 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.727483    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 29 00:37:03.728132 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.728115    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 29 00:37:03.728249 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.728118    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2nxv8\""
Jul 29 00:37:03.746141 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.746108    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gc7sl"]
Jul 29 00:37:03.746141 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.746147    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-88lcv"]
Jul 29 00:37:03.746341 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.746249    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-88lcv"
Jul 29 00:37:03.751692 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.751656    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5x4gq\""
Jul 29 00:37:03.751692 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.751672    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 29 00:37:03.751916 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.751900    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 29 00:37:03.751976 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.751966    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 29 00:37:03.785724 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.785692    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4scg7\" (UniqueName: \"kubernetes.io/projected/23dd62d1-ab12-4d69-8e45-183f23fb5ff1-kube-api-access-4scg7\") pod \"ingress-canary-88lcv\" (UID: \"23dd62d1-ab12-4d69-8e45-183f23fb5ff1\") " pod="openshift-ingress-canary/ingress-canary-88lcv"
Jul 29 00:37:03.785724 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.785730    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12c07414-162b-46c5-83e4-5964ab05819c-registry-tls\") pod \"image-registry-5b664c4c7d-wvn9t\" (UID: \"12c07414-162b-46c5-83e4-5964ab05819c\") " pod="openshift-image-registry/image-registry-5b664c4c7d-wvn9t"
Jul 29 00:37:03.785965 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.785751    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/12c07414-162b-46c5-83e4-5964ab05819c-installation-pull-secrets\") pod \"image-registry-5b664c4c7d-wvn9t\" (UID: \"12c07414-162b-46c5-83e4-5964ab05819c\") " pod="openshift-image-registry/image-registry-5b664c4c7d-wvn9t"
Jul 29 00:37:03.785965 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.785796    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/24dc581c-bc96-46b8-961d-580e65035181-metrics-tls\") pod \"dns-default-gc7sl\" (UID: \"24dc581c-bc96-46b8-961d-580e65035181\") " pod="openshift-dns/dns-default-gc7sl"
Jul 29 00:37:03.785965 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.785861    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wftx\" (UniqueName: \"kubernetes.io/projected/24dc581c-bc96-46b8-961d-580e65035181-kube-api-access-2wftx\") pod \"dns-default-gc7sl\" (UID: \"24dc581c-bc96-46b8-961d-580e65035181\") " pod="openshift-dns/dns-default-gc7sl"
Jul 29 00:37:03.785965 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.785902    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23dd62d1-ab12-4d69-8e45-183f23fb5ff1-cert\") pod \"ingress-canary-88lcv\" (UID: \"23dd62d1-ab12-4d69-8e45-183f23fb5ff1\") " pod="openshift-ingress-canary/ingress-canary-88lcv"
Jul 29 00:37:03.785965 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.785962    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/12c07414-162b-46c5-83e4-5964ab05819c-ca-trust-extracted\") pod \"image-registry-5b664c4c7d-wvn9t\" (UID: \"12c07414-162b-46c5-83e4-5964ab05819c\") " pod="openshift-image-registry/image-registry-5b664c4c7d-wvn9t"
Jul 29 00:37:03.786183 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.785982    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/12c07414-162b-46c5-83e4-5964ab05819c-trusted-ca\") pod \"image-registry-5b664c4c7d-wvn9t\" (UID: \"12c07414-162b-46c5-83e4-5964ab05819c\") " pod="openshift-image-registry/image-registry-5b664c4c7d-wvn9t"
Jul 29 00:37:03.786183 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.786007    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12c07414-162b-46c5-83e4-5964ab05819c-bound-sa-token\") pod \"image-registry-5b664c4c7d-wvn9t\" (UID: \"12c07414-162b-46c5-83e4-5964ab05819c\") " pod="openshift-image-registry/image-registry-5b664c4c7d-wvn9t"
Jul 29 00:37:03.786183 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.786062    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/12c07414-162b-46c5-83e4-5964ab05819c-registry-certificates\") pod \"image-registry-5b664c4c7d-wvn9t\" (UID: \"12c07414-162b-46c5-83e4-5964ab05819c\") " pod="openshift-image-registry/image-registry-5b664c4c7d-wvn9t"
Jul 29 00:37:03.786183 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.786089    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/24dc581c-bc96-46b8-961d-580e65035181-config-volume\") pod \"dns-default-gc7sl\" (UID: \"24dc581c-bc96-46b8-961d-580e65035181\") " pod="openshift-dns/dns-default-gc7sl"
Jul 29 00:37:03.786183 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.786127    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/12c07414-162b-46c5-83e4-5964ab05819c-image-registry-private-configuration\") pod \"image-registry-5b664c4c7d-wvn9t\" (UID: \"12c07414-162b-46c5-83e4-5964ab05819c\") " pod="openshift-image-registry/image-registry-5b664c4c7d-wvn9t"
Jul 29 00:37:03.786357 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.786180    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24dc581c-bc96-46b8-961d-580e65035181-tmp-dir\") pod \"dns-default-gc7sl\" (UID: \"24dc581c-bc96-46b8-961d-580e65035181\") " pod="openshift-dns/dns-default-gc7sl"
Jul 29 00:37:03.786357 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.786216    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b47qw\" (UniqueName: \"kubernetes.io/projected/12c07414-162b-46c5-83e4-5964ab05819c-kube-api-access-b47qw\") pod \"image-registry-5b664c4c7d-wvn9t\" (UID: \"12c07414-162b-46c5-83e4-5964ab05819c\") " pod="openshift-image-registry/image-registry-5b664c4c7d-wvn9t"
Jul 29 00:37:03.887018 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.886977    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/12c07414-162b-46c5-83e4-5964ab05819c-registry-certificates\") pod \"image-registry-5b664c4c7d-wvn9t\" (UID: \"12c07414-162b-46c5-83e4-5964ab05819c\") " pod="openshift-image-registry/image-registry-5b664c4c7d-wvn9t"
Jul 29 00:37:03.887018 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.887018    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/24dc581c-bc96-46b8-961d-580e65035181-config-volume\") pod \"dns-default-gc7sl\" (UID: \"24dc581c-bc96-46b8-961d-580e65035181\") " pod="openshift-dns/dns-default-gc7sl"
Jul 29 00:37:03.887262 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.887043    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/12c07414-162b-46c5-83e4-5964ab05819c-image-registry-private-configuration\") pod \"image-registry-5b664c4c7d-wvn9t\" (UID: \"12c07414-162b-46c5-83e4-5964ab05819c\") " pod="openshift-image-registry/image-registry-5b664c4c7d-wvn9t"
Jul 29 00:37:03.887262 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.887059    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24dc581c-bc96-46b8-961d-580e65035181-tmp-dir\") pod \"dns-default-gc7sl\" (UID: \"24dc581c-bc96-46b8-961d-580e65035181\") " pod="openshift-dns/dns-default-gc7sl"
Jul 29 00:37:03.887262 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.887080    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b47qw\" (UniqueName: \"kubernetes.io/projected/12c07414-162b-46c5-83e4-5964ab05819c-kube-api-access-b47qw\") pod \"image-registry-5b664c4c7d-wvn9t\" (UID: \"12c07414-162b-46c5-83e4-5964ab05819c\") " pod="openshift-image-registry/image-registry-5b664c4c7d-wvn9t"
Jul 29 00:37:03.887262 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.887138    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4scg7\" (UniqueName: \"kubernetes.io/projected/23dd62d1-ab12-4d69-8e45-183f23fb5ff1-kube-api-access-4scg7\") pod \"ingress-canary-88lcv\" (UID: \"23dd62d1-ab12-4d69-8e45-183f23fb5ff1\") " pod="openshift-ingress-canary/ingress-canary-88lcv"
Jul 29 00:37:03.887262 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.887162    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12c07414-162b-46c5-83e4-5964ab05819c-registry-tls\") pod \"image-registry-5b664c4c7d-wvn9t\" (UID: \"12c07414-162b-46c5-83e4-5964ab05819c\") " pod="openshift-image-registry/image-registry-5b664c4c7d-wvn9t"
Jul 29 00:37:03.887262 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.887182    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/12c07414-162b-46c5-83e4-5964ab05819c-installation-pull-secrets\") pod \"image-registry-5b664c4c7d-wvn9t\" (UID: \"12c07414-162b-46c5-83e4-5964ab05819c\") " pod="openshift-image-registry/image-registry-5b664c4c7d-wvn9t"
Jul 29 00:37:03.887262 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.887202    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/24dc581c-bc96-46b8-961d-580e65035181-metrics-tls\") pod \"dns-default-gc7sl\" (UID: \"24dc581c-bc96-46b8-961d-580e65035181\") " pod="openshift-dns/dns-default-gc7sl"
Jul 29 00:37:03.887262 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.887222    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wftx\" (UniqueName: \"kubernetes.io/projected/24dc581c-bc96-46b8-961d-580e65035181-kube-api-access-2wftx\") pod \"dns-default-gc7sl\" (UID: \"24dc581c-bc96-46b8-961d-580e65035181\") " pod="openshift-dns/dns-default-gc7sl"
Jul 29 00:37:03.887262 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.887249    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23dd62d1-ab12-4d69-8e45-183f23fb5ff1-cert\") pod \"ingress-canary-88lcv\" (UID: \"23dd62d1-ab12-4d69-8e45-183f23fb5ff1\") " pod="openshift-ingress-canary/ingress-canary-88lcv"
Jul 29 00:37:03.887719 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.887287    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/12c07414-162b-46c5-83e4-5964ab05819c-ca-trust-extracted\") pod \"image-registry-5b664c4c7d-wvn9t\" (UID: \"12c07414-162b-46c5-83e4-5964ab05819c\") " pod="openshift-image-registry/image-registry-5b664c4c7d-wvn9t"
Jul 29 00:37:03.887719 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.887312    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/12c07414-162b-46c5-83e4-5964ab05819c-trusted-ca\") pod \"image-registry-5b664c4c7d-wvn9t\" (UID: \"12c07414-162b-46c5-83e4-5964ab05819c\") " pod="openshift-image-registry/image-registry-5b664c4c7d-wvn9t"
Jul 29 00:37:03.887719 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.887334    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12c07414-162b-46c5-83e4-5964ab05819c-bound-sa-token\") pod \"image-registry-5b664c4c7d-wvn9t\" (UID: \"12c07414-162b-46c5-83e4-5964ab05819c\") " pod="openshift-image-registry/image-registry-5b664c4c7d-wvn9t"
Jul 29 00:37:03.887719 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.887509    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24dc581c-bc96-46b8-961d-580e65035181-tmp-dir\") pod \"dns-default-gc7sl\" (UID: \"24dc581c-bc96-46b8-961d-580e65035181\") " pod="openshift-dns/dns-default-gc7sl"
Jul 29 00:37:03.887929 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.887737    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/24dc581c-bc96-46b8-961d-580e65035181-config-volume\") pod \"dns-default-gc7sl\" (UID: \"24dc581c-bc96-46b8-961d-580e65035181\") " pod="openshift-dns/dns-default-gc7sl"
Jul 29 00:37:03.887929 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.887853    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/12c07414-162b-46c5-83e4-5964ab05819c-ca-trust-extracted\") pod \"image-registry-5b664c4c7d-wvn9t\" (UID: \"12c07414-162b-46c5-83e4-5964ab05819c\") " pod="openshift-image-registry/image-registry-5b664c4c7d-wvn9t"
Jul 29 00:37:03.888118 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.888093    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/12c07414-162b-46c5-83e4-5964ab05819c-registry-certificates\") pod \"image-registry-5b664c4c7d-wvn9t\" (UID: \"12c07414-162b-46c5-83e4-5964ab05819c\") " pod="openshift-image-registry/image-registry-5b664c4c7d-wvn9t"
Jul 29 00:37:03.888556 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.888533    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/12c07414-162b-46c5-83e4-5964ab05819c-trusted-ca\") pod \"image-registry-5b664c4c7d-wvn9t\" (UID: \"12c07414-162b-46c5-83e4-5964ab05819c\") " pod="openshift-image-registry/image-registry-5b664c4c7d-wvn9t"
Jul 29 00:37:03.891328 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.891304    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/24dc581c-bc96-46b8-961d-580e65035181-metrics-tls\") pod \"dns-default-gc7sl\" (UID: \"24dc581c-bc96-46b8-961d-580e65035181\") " pod="openshift-dns/dns-default-gc7sl"
Jul 29 00:37:03.891328 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.891321    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/12c07414-162b-46c5-83e4-5964ab05819c-image-registry-private-configuration\") pod \"image-registry-5b664c4c7d-wvn9t\" (UID: \"12c07414-162b-46c5-83e4-5964ab05819c\") " pod="openshift-image-registry/image-registry-5b664c4c7d-wvn9t"
Jul 29 00:37:03.891490 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.891371    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23dd62d1-ab12-4d69-8e45-183f23fb5ff1-cert\") pod \"ingress-canary-88lcv\" (UID: \"23dd62d1-ab12-4d69-8e45-183f23fb5ff1\") " pod="openshift-ingress-canary/ingress-canary-88lcv"
Jul 29 00:37:03.891490 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.891377    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12c07414-162b-46c5-83e4-5964ab05819c-registry-tls\") pod \"image-registry-5b664c4c7d-wvn9t\" (UID: \"12c07414-162b-46c5-83e4-5964ab05819c\") " pod="openshift-image-registry/image-registry-5b664c4c7d-wvn9t"
Jul 29 00:37:03.896358 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.896337    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wftx\" (UniqueName: \"kubernetes.io/projected/24dc581c-bc96-46b8-961d-580e65035181-kube-api-access-2wftx\") pod \"dns-default-gc7sl\" (UID: \"24dc581c-bc96-46b8-961d-580e65035181\") " pod="openshift-dns/dns-default-gc7sl"
Jul 29 00:37:03.896678 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.896658    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4scg7\" (UniqueName: \"kubernetes.io/projected/23dd62d1-ab12-4d69-8e45-183f23fb5ff1-kube-api-access-4scg7\") pod \"ingress-canary-88lcv\" (UID: \"23dd62d1-ab12-4d69-8e45-183f23fb5ff1\") " pod="openshift-ingress-canary/ingress-canary-88lcv"
Jul 29 00:37:03.901328 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.901304    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/12c07414-162b-46c5-83e4-5964ab05819c-installation-pull-secrets\") pod \"image-registry-5b664c4c7d-wvn9t\" (UID: \"12c07414-162b-46c5-83e4-5964ab05819c\") " pod="openshift-image-registry/image-registry-5b664c4c7d-wvn9t"
Jul 29 00:37:03.903408 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.903383    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12c07414-162b-46c5-83e4-5964ab05819c-bound-sa-token\") pod \"image-registry-5b664c4c7d-wvn9t\" (UID: \"12c07414-162b-46c5-83e4-5964ab05819c\") " pod="openshift-image-registry/image-registry-5b664c4c7d-wvn9t"
Jul 29 00:37:03.903525 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:03.903504    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b47qw\" (UniqueName: \"kubernetes.io/projected/12c07414-162b-46c5-83e4-5964ab05819c-kube-api-access-b47qw\") pod \"image-registry-5b664c4c7d-wvn9t\" (UID: \"12c07414-162b-46c5-83e4-5964ab05819c\") " pod="openshift-image-registry/image-registry-5b664c4c7d-wvn9t"
Jul 29 00:37:04.023632 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:04.023577    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b664c4c7d-wvn9t"
Jul 29 00:37:04.034076 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:04.034036    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gc7sl"
Jul 29 00:37:04.054705 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:04.054679    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-88lcv"
Jul 29 00:37:04.195226 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:04.195197    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gc7sl"]
Jul 29 00:37:04.199208 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:37:04.199180    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24dc581c_bc96_46b8_961d_580e65035181.slice/crio-9cfe51ec8c6f551e31937b40990789997efd3b8e1ed56a160450ee14bda240d1 WatchSource:0}: Error finding container 9cfe51ec8c6f551e31937b40990789997efd3b8e1ed56a160450ee14bda240d1: Status 404 returned error can't find the container with id 9cfe51ec8c6f551e31937b40990789997efd3b8e1ed56a160450ee14bda240d1
Jul 29 00:37:04.199458 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:04.199437    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b664c4c7d-wvn9t"]
Jul 29 00:37:04.203440 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:37:04.203410    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12c07414_162b_46c5_83e4_5964ab05819c.slice/crio-b56a052eb1163a3f1161f818b8eaba438c64f223f069716b1c14d40c6e12d6b4 WatchSource:0}: Error finding container b56a052eb1163a3f1161f818b8eaba438c64f223f069716b1c14d40c6e12d6b4: Status 404 returned error can't find the container with id b56a052eb1163a3f1161f818b8eaba438c64f223f069716b1c14d40c6e12d6b4
Jul 29 00:37:04.214948 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:04.214910    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-88lcv"]
Jul 29 00:37:04.218597 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:37:04.218561    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23dd62d1_ab12_4d69_8e45_183f23fb5ff1.slice/crio-4551eb2228cff911c65f8ee9556537ea421fe4bbd2d0f2f376fe26f9e97db89b WatchSource:0}: Error finding container 4551eb2228cff911c65f8ee9556537ea421fe4bbd2d0f2f376fe26f9e97db89b: Status 404 returned error can't find the container with id 4551eb2228cff911c65f8ee9556537ea421fe4bbd2d0f2f376fe26f9e97db89b
Jul 29 00:37:04.643547 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:04.643334    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gc7sl" event={"ID":"24dc581c-bc96-46b8-961d-580e65035181","Type":"ContainerStarted","Data":"9cfe51ec8c6f551e31937b40990789997efd3b8e1ed56a160450ee14bda240d1"}
Jul 29 00:37:04.644501 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:04.644469    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-88lcv" event={"ID":"23dd62d1-ab12-4d69-8e45-183f23fb5ff1","Type":"ContainerStarted","Data":"4551eb2228cff911c65f8ee9556537ea421fe4bbd2d0f2f376fe26f9e97db89b"}
Jul 29 00:37:04.645914 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:04.645887    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b664c4c7d-wvn9t" event={"ID":"12c07414-162b-46c5-83e4-5964ab05819c","Type":"ContainerStarted","Data":"c083cbac9e77e12245e5b362bbc3a1b35411bbb080ea24d76a6a17737c638ff2"}
Jul 29 00:37:04.646021 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:04.645925    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b664c4c7d-wvn9t" event={"ID":"12c07414-162b-46c5-83e4-5964ab05819c","Type":"ContainerStarted","Data":"b56a052eb1163a3f1161f818b8eaba438c64f223f069716b1c14d40c6e12d6b4"}
Jul 29 00:37:04.646021 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:04.645961    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5b664c4c7d-wvn9t"
Jul 29 00:37:04.667259 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:04.667203    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5b664c4c7d-wvn9t" podStartSLOduration=6.667184978 podStartE2EDuration="6.667184978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:36:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:37:04.666385767 +0000 UTC m=+50.810843337" watchObservedRunningTime="2026-07-29 00:37:04.667184978 +0000 UTC m=+50.811642549"
Jul 29 00:37:05.297720 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:05.297684    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:37:05.297946 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:05.297684    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcb88"
Jul 29 00:37:05.297946 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:05.297828    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrn2"
Jul 29 00:37:05.300908 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:05.300882    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 00:37:05.301042 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:05.300917    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-44db9\""
Jul 29 00:37:05.301042 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:05.300949    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 00:37:05.301042 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:05.300964    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 00:37:05.301042 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:05.300917    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s4b5n\""
Jul 29 00:37:05.301287 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:05.301270    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 00:37:06.658868 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:06.658824    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gc7sl" event={"ID":"24dc581c-bc96-46b8-961d-580e65035181","Type":"ContainerStarted","Data":"cd51382a3463596df444c50792280684a1cc0c2e6078030bd80b337ba7f82763"}
Jul 29 00:37:07.663608 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:07.663564    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gc7sl" event={"ID":"24dc581c-bc96-46b8-961d-580e65035181","Type":"ContainerStarted","Data":"9f1db99a859ce1670f47805fc9033e4926388b39db04237c3cc66554b4e36346"}
Jul 29 00:37:07.664101 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:07.663709    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gc7sl"
Jul 29 00:37:08.668012 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:08.667847    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-88lcv" event={"ID":"23dd62d1-ab12-4d69-8e45-183f23fb5ff1","Type":"ContainerStarted","Data":"814534df7467a90372f8259a135a4af0f64a2e70fabfb99a3e2b59dc8e0888da"}
Jul 29 00:37:08.684208 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:08.684162    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gc7sl" podStartSLOduration=3.423474567 podStartE2EDuration="5.684145439s" totalImagesPullingTime="2.260670872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:37:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:37:07.679120773 +0000 UTC m=+53.823578346" watchObservedRunningTime="2026-07-29 00:37:08.684145439 +0000 UTC m=+54.828602987"
Jul 29 00:37:08.684383 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:08.684257    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-88lcv" podStartSLOduration=2.142113443 podStartE2EDuration="5.684251104s" totalImagesPullingTime="3.542137661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:37:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:37:08.683218655 +0000 UTC m=+54.827676236" watchObservedRunningTime="2026-07-29 00:37:08.684251104 +0000 UTC m=+54.828708677"
Jul 29 00:37:09.731938 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:09.731906    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-knqll"]
Jul 29 00:37:09.736295 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:09.736272    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-knqll"
Jul 29 00:37:09.738507 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:09.738485    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 29 00:37:09.738655 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:09.738577    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-krv7p\""
Jul 29 00:37:09.739261 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:09.739241    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 29 00:37:09.739261 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:09.739258    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 29 00:37:09.739399 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:09.739243    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 29 00:37:09.755849 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:09.755814    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-knqll"]
Jul 29 00:37:09.833924 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:09.833891    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0cc6fd7f-032b-4ab6-a8ca-b329395a8db5-crio-socket\") pod \"insights-runtime-extractor-knqll\" (UID: \"0cc6fd7f-032b-4ab6-a8ca-b329395a8db5\") " pod="openshift-insights/insights-runtime-extractor-knqll"
Jul 29 00:37:09.834094 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:09.833930    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0cc6fd7f-032b-4ab6-a8ca-b329395a8db5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-knqll\" (UID: \"0cc6fd7f-032b-4ab6-a8ca-b329395a8db5\") " pod="openshift-insights/insights-runtime-extractor-knqll"
Jul 29 00:37:09.834094 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:09.834074    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0cc6fd7f-032b-4ab6-a8ca-b329395a8db5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-knqll\" (UID: \"0cc6fd7f-032b-4ab6-a8ca-b329395a8db5\") " pod="openshift-insights/insights-runtime-extractor-knqll"
Jul 29 00:37:09.834183 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:09.834114    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0cc6fd7f-032b-4ab6-a8ca-b329395a8db5-data-volume\") pod \"insights-runtime-extractor-knqll\" (UID: \"0cc6fd7f-032b-4ab6-a8ca-b329395a8db5\") " pod="openshift-insights/insights-runtime-extractor-knqll"
Jul 29 00:37:09.834183 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:09.834137    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb5dq\" (UniqueName: \"kubernetes.io/projected/0cc6fd7f-032b-4ab6-a8ca-b329395a8db5-kube-api-access-nb5dq\") pod \"insights-runtime-extractor-knqll\" (UID: \"0cc6fd7f-032b-4ab6-a8ca-b329395a8db5\") " pod="openshift-insights/insights-runtime-extractor-knqll"
Jul 29 00:37:09.935069 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:09.935032    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0cc6fd7f-032b-4ab6-a8ca-b329395a8db5-data-volume\") pod \"insights-runtime-extractor-knqll\" (UID: \"0cc6fd7f-032b-4ab6-a8ca-b329395a8db5\") " pod="openshift-insights/insights-runtime-extractor-knqll"
Jul 29 00:37:09.935069 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:09.935077    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb5dq\" (UniqueName: \"kubernetes.io/projected/0cc6fd7f-032b-4ab6-a8ca-b329395a8db5-kube-api-access-nb5dq\") pod \"insights-runtime-extractor-knqll\" (UID: \"0cc6fd7f-032b-4ab6-a8ca-b329395a8db5\") " pod="openshift-insights/insights-runtime-extractor-knqll"
Jul 29 00:37:09.935285 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:09.935104    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0cc6fd7f-032b-4ab6-a8ca-b329395a8db5-crio-socket\") pod \"insights-runtime-extractor-knqll\" (UID: \"0cc6fd7f-032b-4ab6-a8ca-b329395a8db5\") " pod="openshift-insights/insights-runtime-extractor-knqll"
Jul 29 00:37:09.935285 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:09.935119    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0cc6fd7f-032b-4ab6-a8ca-b329395a8db5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-knqll\" (UID: \"0cc6fd7f-032b-4ab6-a8ca-b329395a8db5\") " pod="openshift-insights/insights-runtime-extractor-knqll"
Jul 29 00:37:09.935285 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:09.935194    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0cc6fd7f-032b-4ab6-a8ca-b329395a8db5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-knqll\" (UID: \"0cc6fd7f-032b-4ab6-a8ca-b329395a8db5\") " pod="openshift-insights/insights-runtime-extractor-knqll"
Jul 29 00:37:09.935387 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:37:09.935301    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 00:37:09.935387 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:09.935313    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0cc6fd7f-032b-4ab6-a8ca-b329395a8db5-crio-socket\") pod \"insights-runtime-extractor-knqll\" (UID: \"0cc6fd7f-032b-4ab6-a8ca-b329395a8db5\") " pod="openshift-insights/insights-runtime-extractor-knqll"
Jul 29 00:37:09.935387 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:37:09.935303    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 00:37:09.935387 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:37:09.935354    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cc6fd7f-032b-4ab6-a8ca-b329395a8db5-insights-runtime-extractor-tls podName:0cc6fd7f-032b-4ab6-a8ca-b329395a8db5 nodeName:}" failed. No retries permitted until 2026-07-29 00:37:10.435340227 +0000 UTC m=+56.579797776 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0cc6fd7f-032b-4ab6-a8ca-b329395a8db5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-knqll" (UID: "0cc6fd7f-032b-4ab6-a8ca-b329395a8db5") : secret "insights-runtime-extractor-tls" not found
Jul 29 00:37:09.935525 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:37:09.935402    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0cc6fd7f-032b-4ab6-a8ca-b329395a8db5-kube-rbac-proxy-cm podName:0cc6fd7f-032b-4ab6-a8ca-b329395a8db5 nodeName:}" failed. No retries permitted until 2026-07-29 00:37:10.435385826 +0000 UTC m=+56.579843390 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0cc6fd7f-032b-4ab6-a8ca-b329395a8db5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-knqll" (UID: "0cc6fd7f-032b-4ab6-a8ca-b329395a8db5") : configmap "kube-rbac-proxy" not found
Jul 29 00:37:09.935525 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:09.935413    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0cc6fd7f-032b-4ab6-a8ca-b329395a8db5-data-volume\") pod \"insights-runtime-extractor-knqll\" (UID: \"0cc6fd7f-032b-4ab6-a8ca-b329395a8db5\") " pod="openshift-insights/insights-runtime-extractor-knqll"
Jul 29 00:37:09.946873 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:09.946845    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb5dq\" (UniqueName: \"kubernetes.io/projected/0cc6fd7f-032b-4ab6-a8ca-b329395a8db5-kube-api-access-nb5dq\") pod \"insights-runtime-extractor-knqll\" (UID: \"0cc6fd7f-032b-4ab6-a8ca-b329395a8db5\") " pod="openshift-insights/insights-runtime-extractor-knqll"
Jul 29 00:37:10.439781 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:10.439738    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0cc6fd7f-032b-4ab6-a8ca-b329395a8db5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-knqll\" (UID: \"0cc6fd7f-032b-4ab6-a8ca-b329395a8db5\") " pod="openshift-insights/insights-runtime-extractor-knqll"
Jul 29 00:37:10.439960 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:10.439794    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0cc6fd7f-032b-4ab6-a8ca-b329395a8db5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-knqll\" (UID: \"0cc6fd7f-032b-4ab6-a8ca-b329395a8db5\") " pod="openshift-insights/insights-runtime-extractor-knqll"
Jul 29 00:37:10.440295 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:10.440272    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0cc6fd7f-032b-4ab6-a8ca-b329395a8db5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-knqll\" (UID: \"0cc6fd7f-032b-4ab6-a8ca-b329395a8db5\") " pod="openshift-insights/insights-runtime-extractor-knqll"
Jul 29 00:37:10.441981 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:10.441961    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0cc6fd7f-032b-4ab6-a8ca-b329395a8db5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-knqll\" (UID: \"0cc6fd7f-032b-4ab6-a8ca-b329395a8db5\") " pod="openshift-insights/insights-runtime-extractor-knqll"
Jul 29 00:37:10.645752 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:10.645712    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-knqll"
Jul 29 00:37:10.790296 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:10.790267    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-knqll"]
Jul 29 00:37:10.793533 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:37:10.793506    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cc6fd7f_032b_4ab6_a8ca_b329395a8db5.slice/crio-60a1a48b52818ea1d8c18f9de2a6d635f33309eff369eaf543cd9f9109326267 WatchSource:0}: Error finding container 60a1a48b52818ea1d8c18f9de2a6d635f33309eff369eaf543cd9f9109326267: Status 404 returned error can't find the container with id 60a1a48b52818ea1d8c18f9de2a6d635f33309eff369eaf543cd9f9109326267
Jul 29 00:37:11.678399 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:11.678356    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-knqll" event={"ID":"0cc6fd7f-032b-4ab6-a8ca-b329395a8db5","Type":"ContainerStarted","Data":"60a1a48b52818ea1d8c18f9de2a6d635f33309eff369eaf543cd9f9109326267"}
Jul 29 00:37:12.825208 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:12.825181    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gc7sl_24dc581c-bc96-46b8-961d-580e65035181/dns/0.log"
Jul 29 00:37:13.003694 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:13.003666    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gc7sl_24dc581c-bc96-46b8-961d-580e65035181/kube-rbac-proxy/0.log"
Jul 29 00:37:14.002799 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:14.002769    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4hcbn_f89cf1a4-a323-4d76-b082-cb93514324fc/dns-node-resolver/0.log"
Jul 29 00:37:14.603034 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:14.603001    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5b664c4c7d-wvn9t_12c07414-162b-46c5-83e4-5964ab05819c/registry/0.log"
Jul 29 00:37:14.605151 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:14.605128    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tfr5v"
Jul 29 00:37:15.202714 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:15.202683    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7w5v9_7f95557b-6c39-4b63-9d6c-2cdbd68e8eb2/node-ca/0.log"
Jul 29 00:37:16.204786 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:16.204759    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-88lcv_23dd62d1-ab12-4d69-8e45-183f23fb5ff1/serve-healthcheck-canary/0.log"
Jul 29 00:37:16.695387 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:16.695348    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-knqll" event={"ID":"0cc6fd7f-032b-4ab6-a8ca-b329395a8db5","Type":"ContainerStarted","Data":"bc9a9edf1559a4f7a833e540b38821e5b97e0fba6fe408affb0da252a77ab6ac"}
Jul 29 00:37:17.669867 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:17.669836    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gc7sl"
Jul 29 00:37:19.009945 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:19.009908    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5133632e-a2ef-4d96-a84e-296378c156bc-original-pull-secret\") pod \"global-pull-secret-syncer-jswzt\" (UID: \"5133632e-a2ef-4d96-a84e-296378c156bc\") " pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:37:19.012155 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:19.012125    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 00:37:19.022837 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:19.022810    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5133632e-a2ef-4d96-a84e-296378c156bc-original-pull-secret\") pod \"global-pull-secret-syncer-jswzt\" (UID: \"5133632e-a2ef-4d96-a84e-296378c156bc\") " pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:37:19.109979 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:19.109941    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jswzt"
Jul 29 00:37:19.111213 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:19.111182    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/068d3131-bf24-4e3f-b450-e518d95238db-metrics-certs\") pod \"network-metrics-daemon-tzrn2\" (UID: \"068d3131-bf24-4e3f-b450-e518d95238db\") " pod="openshift-multus/network-metrics-daemon-tzrn2"
Jul 29 00:37:19.113367 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:19.113326    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 00:37:19.124840 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:19.124809    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/068d3131-bf24-4e3f-b450-e518d95238db-metrics-certs\") pod \"network-metrics-daemon-tzrn2\" (UID: \"068d3131-bf24-4e3f-b450-e518d95238db\") " pod="openshift-multus/network-metrics-daemon-tzrn2"
Jul 29 00:37:19.212022 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:19.211984    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7n8w\" (UniqueName: \"kubernetes.io/projected/afd557e9-0701-488d-acd6-0f91d0002e61-kube-api-access-f7n8w\") pod \"network-check-target-hcb88\" (UID: \"afd557e9-0701-488d-acd6-0f91d0002e61\") " pod="openshift-network-diagnostics/network-check-target-hcb88"
Jul 29 00:37:19.214008 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:19.213976    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 00:37:19.224693 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:19.224669    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 00:37:19.235951 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:19.235920    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7n8w\" (UniqueName: \"kubernetes.io/projected/afd557e9-0701-488d-acd6-0f91d0002e61-kube-api-access-f7n8w\") pod \"network-check-target-hcb88\" (UID: \"afd557e9-0701-488d-acd6-0f91d0002e61\") " pod="openshift-network-diagnostics/network-check-target-hcb88"
Jul 29 00:37:19.420311 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:19.420280    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-44db9\""
Jul 29 00:37:19.426447 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:19.426419    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s4b5n\""
Jul 29 00:37:19.427654 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:19.427634    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcb88"
Jul 29 00:37:19.433443 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:19.433420    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tzrn2"
Jul 29 00:37:19.600991 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:19.600900    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tzrn2"]
Jul 29 00:37:19.605455 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:37:19.605430    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod068d3131_bf24_4e3f_b450_e518d95238db.slice/crio-30fda65fb900eac680dbc7992f95208bba5fa3adff7f81024ad0bac98e52d380 WatchSource:0}: Error finding container 30fda65fb900eac680dbc7992f95208bba5fa3adff7f81024ad0bac98e52d380: Status 404 returned error can't find the container with id 30fda65fb900eac680dbc7992f95208bba5fa3adff7f81024ad0bac98e52d380
Jul 29 00:37:19.621032 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:19.621005    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hcb88"]
Jul 29 00:37:19.623742 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:37:19.623716    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafd557e9_0701_488d_acd6_0f91d0002e61.slice/crio-3d805ab943d7e58585387008be43d1dbdb37be4c29f72e90dba91475aea90e2d WatchSource:0}: Error finding container 3d805ab943d7e58585387008be43d1dbdb37be4c29f72e90dba91475aea90e2d: Status 404 returned error can't find the container with id 3d805ab943d7e58585387008be43d1dbdb37be4c29f72e90dba91475aea90e2d
Jul 29 00:37:19.639886 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:19.639820    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jswzt"]
Jul 29 00:37:19.643954 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:37:19.643930    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5133632e_a2ef_4d96_a84e_296378c156bc.slice/crio-aab95e39069e48333c699ae512090df0c19be668b6d95ea0fbae7fc566f0fb54 WatchSource:0}: Error finding container aab95e39069e48333c699ae512090df0c19be668b6d95ea0fbae7fc566f0fb54: Status 404 returned error can't find the container with id aab95e39069e48333c699ae512090df0c19be668b6d95ea0fbae7fc566f0fb54
Jul 29 00:37:19.710769 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:19.710670    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hcb88" event={"ID":"afd557e9-0701-488d-acd6-0f91d0002e61","Type":"ContainerStarted","Data":"3d805ab943d7e58585387008be43d1dbdb37be4c29f72e90dba91475aea90e2d"}
Jul 29 00:37:19.711909 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:19.711876    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tzrn2" event={"ID":"068d3131-bf24-4e3f-b450-e518d95238db","Type":"ContainerStarted","Data":"30fda65fb900eac680dbc7992f95208bba5fa3adff7f81024ad0bac98e52d380"}
Jul 29 00:37:19.712974 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:19.712949    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jswzt" event={"ID":"5133632e-a2ef-4d96-a84e-296378c156bc","Type":"ContainerStarted","Data":"aab95e39069e48333c699ae512090df0c19be668b6d95ea0fbae7fc566f0fb54"}
Jul 29 00:37:19.714839 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:19.714817    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-knqll" event={"ID":"0cc6fd7f-032b-4ab6-a8ca-b329395a8db5","Type":"ContainerStarted","Data":"12545a1ad5b35bba9f408a4b9a22b3d9c563bb17819eba177fd26f5f41e9be42"}
Jul 29 00:37:21.727198 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:21.727092    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tzrn2" event={"ID":"068d3131-bf24-4e3f-b450-e518d95238db","Type":"ContainerStarted","Data":"d5f267575b32d82fee4fc40c14043149ec0b97c8e2e3d6e7e7b12739d88f19f9"}
Jul 29 00:37:21.727198 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:21.727160    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tzrn2" event={"ID":"068d3131-bf24-4e3f-b450-e518d95238db","Type":"ContainerStarted","Data":"3282b5e6dbdc03d75110a577e6c3b71960fcea0c5c17be7aa6fc81877ec5436b"}
Jul 29 00:37:25.090828 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.090756    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tzrn2" podStartSLOduration=69.916787282 podStartE2EDuration="1m11.090731344s" totalImagesPullingTime="1.173944062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:36:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:37:21.744063566 +0000 UTC m=+67.888521137" watchObservedRunningTime="2026-07-29 00:37:25.090731344 +0000 UTC m=+71.235188913"
Jul 29 00:37:25.091656 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.091632    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-w84pc"]
Jul 29 00:37:25.096020 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.095996    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-w84pc"
Jul 29 00:37:25.098861 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.098799    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 29 00:37:25.098861 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.098833    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 29 00:37:25.098861 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.098857    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 29 00:37:25.099129 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.098886    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 29 00:37:25.099129 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.098833    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 29 00:37:25.099296 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.099282    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-8c886\""
Jul 29 00:37:25.105793 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.105760    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-w84pc"]
Jul 29 00:37:25.122901 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.122872    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8sgwr"]
Jul 29 00:37:25.126154 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.126120    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-c6clq"]
Jul 29 00:37:25.126296 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.126246    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8sgwr"
Jul 29 00:37:25.128300 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.128275    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 29 00:37:25.128414 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.128371    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nzh86\""
Jul 29 00:37:25.128486 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.128423    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 29 00:37:25.128615 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.128573    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 29 00:37:25.129647 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.129627    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c6clq"
Jul 29 00:37:25.131518 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.131501    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 29 00:37:25.131785 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.131765    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-g7b4c\""
Jul 29 00:37:25.131873 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.131810    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 29 00:37:25.132028 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.132009    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 29 00:37:25.145089 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.145067    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-c6clq"]
Jul 29 00:37:25.153923 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.153899    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/520b4f0a-2788-4913-93a6-72d7a4c0cc1f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-w84pc\" (UID: \"520b4f0a-2788-4913-93a6-72d7a4c0cc1f\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-w84pc"
Jul 29 00:37:25.154079 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.153928    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/520b4f0a-2788-4913-93a6-72d7a4c0cc1f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-w84pc\" (UID: \"520b4f0a-2788-4913-93a6-72d7a4c0cc1f\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-w84pc"
Jul 29 00:37:25.154079 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.153984    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/520b4f0a-2788-4913-93a6-72d7a4c0cc1f-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-w84pc\" (UID: \"520b4f0a-2788-4913-93a6-72d7a4c0cc1f\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-w84pc"
Jul 29 00:37:25.154079 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.154014    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k8rc\" (UniqueName: \"kubernetes.io/projected/520b4f0a-2788-4913-93a6-72d7a4c0cc1f-kube-api-access-2k8rc\") pod \"openshift-state-metrics-b8f49f5c6-w84pc\" (UID: \"520b4f0a-2788-4913-93a6-72d7a4c0cc1f\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-w84pc"
Jul 29 00:37:25.255052 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.255020    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8f058002-0a06-4a4b-8aa7-07ab94de01fe-node-exporter-textfile\") pod \"node-exporter-8sgwr\" (UID: \"8f058002-0a06-4a4b-8aa7-07ab94de01fe\") " pod="openshift-monitoring/node-exporter-8sgwr"
Jul 29 00:37:25.255230 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.255062    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8f058002-0a06-4a4b-8aa7-07ab94de01fe-node-exporter-tls\") pod \"node-exporter-8sgwr\" (UID: \"8f058002-0a06-4a4b-8aa7-07ab94de01fe\") " pod="openshift-monitoring/node-exporter-8sgwr"
Jul 29 00:37:25.255230 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.255094    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/520b4f0a-2788-4913-93a6-72d7a4c0cc1f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-w84pc\" (UID: \"520b4f0a-2788-4913-93a6-72d7a4c0cc1f\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-w84pc"
Jul 29 00:37:25.255230 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.255123    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/62bcf3a9-3e52-4311-95d4-00ab9b46bd7a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-c6clq\" (UID: \"62bcf3a9-3e52-4311-95d4-00ab9b46bd7a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c6clq"
Jul 29 00:37:25.255386 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:37:25.255243    2577 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 29 00:37:25.255386 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.255255    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9c6d\" (UniqueName: \"kubernetes.io/projected/62bcf3a9-3e52-4311-95d4-00ab9b46bd7a-kube-api-access-l9c6d\") pod \"kube-state-metrics-56d9f944b4-c6clq\" (UID: \"62bcf3a9-3e52-4311-95d4-00ab9b46bd7a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c6clq"
Jul 29 00:37:25.255386 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:37:25.255319    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/520b4f0a-2788-4913-93a6-72d7a4c0cc1f-openshift-state-metrics-tls podName:520b4f0a-2788-4913-93a6-72d7a4c0cc1f nodeName:}" failed. No retries permitted until 2026-07-29 00:37:25.755295787 +0000 UTC m=+71.899753340 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/520b4f0a-2788-4913-93a6-72d7a4c0cc1f-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-w84pc" (UID: "520b4f0a-2788-4913-93a6-72d7a4c0cc1f") : secret "openshift-state-metrics-tls" not found
Jul 29 00:37:25.255386 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.255342    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/62bcf3a9-3e52-4311-95d4-00ab9b46bd7a-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-c6clq\" (UID: \"62bcf3a9-3e52-4311-95d4-00ab9b46bd7a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c6clq"
Jul 29 00:37:25.255386 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.255372    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8f058002-0a06-4a4b-8aa7-07ab94de01fe-node-exporter-wtmp\") pod \"node-exporter-8sgwr\" (UID: \"8f058002-0a06-4a4b-8aa7-07ab94de01fe\") " pod="openshift-monitoring/node-exporter-8sgwr"
Jul 29 00:37:25.255686 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.255402    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f058002-0a06-4a4b-8aa7-07ab94de01fe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8sgwr\" (UID: \"8f058002-0a06-4a4b-8aa7-07ab94de01fe\") " pod="openshift-monitoring/node-exporter-8sgwr"
Jul 29 00:37:25.255686 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.255459    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/62bcf3a9-3e52-4311-95d4-00ab9b46bd7a-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-c6clq\" (UID: \"62bcf3a9-3e52-4311-95d4-00ab9b46bd7a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c6clq"
Jul 29 00:37:25.255686 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.255496    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/520b4f0a-2788-4913-93a6-72d7a4c0cc1f-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-w84pc\" (UID: \"520b4f0a-2788-4913-93a6-72d7a4c0cc1f\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-w84pc"
Jul 29 00:37:25.255686 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.255528    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8f058002-0a06-4a4b-8aa7-07ab94de01fe-node-exporter-accelerators-collector-config\") pod \"node-exporter-8sgwr\" (UID: \"8f058002-0a06-4a4b-8aa7-07ab94de01fe\") " pod="openshift-monitoring/node-exporter-8sgwr"
Jul 29 00:37:25.255686 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.255560    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k8rc\" (UniqueName: \"kubernetes.io/projected/520b4f0a-2788-4913-93a6-72d7a4c0cc1f-kube-api-access-2k8rc\") pod \"openshift-state-metrics-b8f49f5c6-w84pc\" (UID: \"520b4f0a-2788-4913-93a6-72d7a4c0cc1f\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-w84pc"
Jul 29 00:37:25.255686 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.255613    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62bcf3a9-3e52-4311-95d4-00ab9b46bd7a-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-c6clq\" (UID: \"62bcf3a9-3e52-4311-95d4-00ab9b46bd7a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c6clq"
Jul 29 00:37:25.255686 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.255639    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgspb\" (UniqueName: \"kubernetes.io/projected/8f058002-0a06-4a4b-8aa7-07ab94de01fe-kube-api-access-fgspb\") pod \"node-exporter-8sgwr\" (UID: \"8f058002-0a06-4a4b-8aa7-07ab94de01fe\") " pod="openshift-monitoring/node-exporter-8sgwr"
Jul 29 00:37:25.255686 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.255672    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/520b4f0a-2788-4913-93a6-72d7a4c0cc1f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-w84pc\" (UID: \"520b4f0a-2788-4913-93a6-72d7a4c0cc1f\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-w84pc"
Jul 29 00:37:25.255991 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.255695    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8f058002-0a06-4a4b-8aa7-07ab94de01fe-root\") pod \"node-exporter-8sgwr\" (UID: \"8f058002-0a06-4a4b-8aa7-07ab94de01fe\") " pod="openshift-monitoring/node-exporter-8sgwr"
Jul 29 00:37:25.255991 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.255759    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f058002-0a06-4a4b-8aa7-07ab94de01fe-metrics-client-ca\") pod \"node-exporter-8sgwr\" (UID: \"8f058002-0a06-4a4b-8aa7-07ab94de01fe\") " pod="openshift-monitoring/node-exporter-8sgwr"
Jul 29 00:37:25.255991 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.255785    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62bcf3a9-3e52-4311-95d4-00ab9b46bd7a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-c6clq\" (UID: \"62bcf3a9-3e52-4311-95d4-00ab9b46bd7a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c6clq"
Jul 29 00:37:25.255991 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.255812    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f058002-0a06-4a4b-8aa7-07ab94de01fe-sys\") pod \"node-exporter-8sgwr\" (UID: \"8f058002-0a06-4a4b-8aa7-07ab94de01fe\") " pod="openshift-monitoring/node-exporter-8sgwr"
Jul 29 00:37:25.256211 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.256188    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/520b4f0a-2788-4913-93a6-72d7a4c0cc1f-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-w84pc\" (UID: \"520b4f0a-2788-4913-93a6-72d7a4c0cc1f\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-w84pc"
Jul 29 00:37:25.258366 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.258342    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/520b4f0a-2788-4913-93a6-72d7a4c0cc1f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-w84pc\" (UID: \"520b4f0a-2788-4913-93a6-72d7a4c0cc1f\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-w84pc"
Jul 29 00:37:25.264192 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.264166    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k8rc\" (UniqueName: \"kubernetes.io/projected/520b4f0a-2788-4913-93a6-72d7a4c0cc1f-kube-api-access-2k8rc\") pod \"openshift-state-metrics-b8f49f5c6-w84pc\" (UID: \"520b4f0a-2788-4913-93a6-72d7a4c0cc1f\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-w84pc"
Jul 29 00:37:25.356490 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.356396    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8f058002-0a06-4a4b-8aa7-07ab94de01fe-node-exporter-accelerators-collector-config\") pod \"node-exporter-8sgwr\" (UID: \"8f058002-0a06-4a4b-8aa7-07ab94de01fe\") " pod="openshift-monitoring/node-exporter-8sgwr"
Jul 29 00:37:25.356490 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.356442    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62bcf3a9-3e52-4311-95d4-00ab9b46bd7a-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-c6clq\" (UID: \"62bcf3a9-3e52-4311-95d4-00ab9b46bd7a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c6clq"
Jul 29 00:37:25.356490 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.356475    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgspb\" (UniqueName: \"kubernetes.io/projected/8f058002-0a06-4a4b-8aa7-07ab94de01fe-kube-api-access-fgspb\") pod \"node-exporter-8sgwr\" (UID: \"8f058002-0a06-4a4b-8aa7-07ab94de01fe\") " pod="openshift-monitoring/node-exporter-8sgwr"
Jul 29 00:37:25.356753 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.356505    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8f058002-0a06-4a4b-8aa7-07ab94de01fe-root\") pod \"node-exporter-8sgwr\" (UID: \"8f058002-0a06-4a4b-8aa7-07ab94de01fe\") " pod="openshift-monitoring/node-exporter-8sgwr"
Jul 29 00:37:25.356753 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.356549    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f058002-0a06-4a4b-8aa7-07ab94de01fe-metrics-client-ca\") pod \"node-exporter-8sgwr\" (UID: \"8f058002-0a06-4a4b-8aa7-07ab94de01fe\") " pod="openshift-monitoring/node-exporter-8sgwr"
Jul 29 00:37:25.356753 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.356571    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62bcf3a9-3e52-4311-95d4-00ab9b46bd7a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-c6clq\" (UID: \"62bcf3a9-3e52-4311-95d4-00ab9b46bd7a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c6clq"
Jul 29 00:37:25.356753 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.356600    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f058002-0a06-4a4b-8aa7-07ab94de01fe-sys\") pod \"node-exporter-8sgwr\" (UID: \"8f058002-0a06-4a4b-8aa7-07ab94de01fe\") " pod="openshift-monitoring/node-exporter-8sgwr"
Jul 29 00:37:25.356753 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.356618    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8f058002-0a06-4a4b-8aa7-07ab94de01fe-node-exporter-textfile\") pod \"node-exporter-8sgwr\" (UID: \"8f058002-0a06-4a4b-8aa7-07ab94de01fe\") " pod="openshift-monitoring/node-exporter-8sgwr"
Jul 29 00:37:25.356753 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.356646    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8f058002-0a06-4a4b-8aa7-07ab94de01fe-node-exporter-tls\") pod \"node-exporter-8sgwr\" (UID: \"8f058002-0a06-4a4b-8aa7-07ab94de01fe\") " pod="openshift-monitoring/node-exporter-8sgwr"
Jul 29 00:37:25.356753 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.356676    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/62bcf3a9-3e52-4311-95d4-00ab9b46bd7a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-c6clq\" (UID: \"62bcf3a9-3e52-4311-95d4-00ab9b46bd7a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c6clq"
Jul 29 00:37:25.356753 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.356708    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9c6d\" (UniqueName: \"kubernetes.io/projected/62bcf3a9-3e52-4311-95d4-00ab9b46bd7a-kube-api-access-l9c6d\") pod \"kube-state-metrics-56d9f944b4-c6clq\" (UID: \"62bcf3a9-3e52-4311-95d4-00ab9b46bd7a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c6clq"
Jul 29 00:37:25.356753 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.356748    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/62bcf3a9-3e52-4311-95d4-00ab9b46bd7a-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-c6clq\" (UID: \"62bcf3a9-3e52-4311-95d4-00ab9b46bd7a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c6clq"
Jul 29 00:37:25.357056 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.356769    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8f058002-0a06-4a4b-8aa7-07ab94de01fe-node-exporter-wtmp\") pod \"node-exporter-8sgwr\" (UID: \"8f058002-0a06-4a4b-8aa7-07ab94de01fe\") " pod="openshift-monitoring/node-exporter-8sgwr"
Jul 29 00:37:25.357056 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.356788    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f058002-0a06-4a4b-8aa7-07ab94de01fe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8sgwr\" (UID: \"8f058002-0a06-4a4b-8aa7-07ab94de01fe\") " pod="openshift-monitoring/node-exporter-8sgwr"
Jul 29 00:37:25.357056 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.356805    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/62bcf3a9-3e52-4311-95d4-00ab9b46bd7a-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-c6clq\" (UID: \"62bcf3a9-3e52-4311-95d4-00ab9b46bd7a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c6clq"
Jul 29 00:37:25.357139 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.357107    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/62bcf3a9-3e52-4311-95d4-00ab9b46bd7a-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-c6clq\" (UID: \"62bcf3a9-3e52-4311-95d4-00ab9b46bd7a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c6clq"
Jul 29 00:37:25.357139 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.357112    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8f058002-0a06-4a4b-8aa7-07ab94de01fe-node-exporter-accelerators-collector-config\") pod \"node-exporter-8sgwr\" (UID: \"8f058002-0a06-4a4b-8aa7-07ab94de01fe\") " pod="openshift-monitoring/node-exporter-8sgwr"
Jul 29 00:37:25.357213 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.357154    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62bcf3a9-3e52-4311-95d4-00ab9b46bd7a-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-c6clq\" (UID: \"62bcf3a9-3e52-4311-95d4-00ab9b46bd7a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c6clq"
Jul 29 00:37:25.357457 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.357436    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8f058002-0a06-4a4b-8aa7-07ab94de01fe-root\") pod \"node-exporter-8sgwr\" (UID: \"8f058002-0a06-4a4b-8aa7-07ab94de01fe\") " pod="openshift-monitoring/node-exporter-8sgwr"
Jul 29 00:37:25.357514 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.357501    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f058002-0a06-4a4b-8aa7-07ab94de01fe-metrics-client-ca\") pod \"node-exporter-8sgwr\" (UID: \"8f058002-0a06-4a4b-8aa7-07ab94de01fe\") " pod="openshift-monitoring/node-exporter-8sgwr"
Jul 29 00:37:25.357548 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:37:25.357532    2577 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 29 00:37:25.357627 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:37:25.357615    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62bcf3a9-3e52-4311-95d4-00ab9b46bd7a-kube-state-metrics-tls podName:62bcf3a9-3e52-4311-95d4-00ab9b46bd7a nodeName:}" failed. No retries permitted until 2026-07-29 00:37:25.857597356 +0000 UTC m=+72.002054907 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/62bcf3a9-3e52-4311-95d4-00ab9b46bd7a-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-c6clq" (UID: "62bcf3a9-3e52-4311-95d4-00ab9b46bd7a") : secret "kube-state-metrics-tls" not found
Jul 29 00:37:25.357686 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.357623    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8f058002-0a06-4a4b-8aa7-07ab94de01fe-node-exporter-wtmp\") pod \"node-exporter-8sgwr\" (UID: \"8f058002-0a06-4a4b-8aa7-07ab94de01fe\") " pod="openshift-monitoring/node-exporter-8sgwr"
Jul 29 00:37:25.357735 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.357705    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/62bcf3a9-3e52-4311-95d4-00ab9b46bd7a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-c6clq\" (UID: \"62bcf3a9-3e52-4311-95d4-00ab9b46bd7a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c6clq"
Jul 29 00:37:25.358014 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:37:25.357992    2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 29 00:37:25.358121 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:37:25.358035    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f058002-0a06-4a4b-8aa7-07ab94de01fe-node-exporter-tls podName:8f058002-0a06-4a4b-8aa7-07ab94de01fe nodeName:}" failed. No retries permitted until 2026-07-29 00:37:25.858022647 +0000 UTC m=+72.002480197 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/8f058002-0a06-4a4b-8aa7-07ab94de01fe-node-exporter-tls") pod "node-exporter-8sgwr" (UID: "8f058002-0a06-4a4b-8aa7-07ab94de01fe") : secret "node-exporter-tls" not found
Jul 29 00:37:25.358121 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.358084    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f058002-0a06-4a4b-8aa7-07ab94de01fe-sys\") pod \"node-exporter-8sgwr\" (UID: \"8f058002-0a06-4a4b-8aa7-07ab94de01fe\") " pod="openshift-monitoring/node-exporter-8sgwr"
Jul 29 00:37:25.358121 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.358088    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8f058002-0a06-4a4b-8aa7-07ab94de01fe-node-exporter-textfile\") pod \"node-exporter-8sgwr\" (UID: \"8f058002-0a06-4a4b-8aa7-07ab94de01fe\") " pod="openshift-monitoring/node-exporter-8sgwr"
Jul 29 00:37:25.360073 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.360051    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f058002-0a06-4a4b-8aa7-07ab94de01fe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8sgwr\" (UID: \"8f058002-0a06-4a4b-8aa7-07ab94de01fe\") " pod="openshift-monitoring/node-exporter-8sgwr"
Jul 29 00:37:25.360175 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.360079    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62bcf3a9-3e52-4311-95d4-00ab9b46bd7a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-c6clq\" (UID: \"62bcf3a9-3e52-4311-95d4-00ab9b46bd7a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c6clq"
Jul 29 00:37:25.371431 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.371402    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgspb\" (UniqueName: \"kubernetes.io/projected/8f058002-0a06-4a4b-8aa7-07ab94de01fe-kube-api-access-fgspb\") pod \"node-exporter-8sgwr\" (UID: \"8f058002-0a06-4a4b-8aa7-07ab94de01fe\") " pod="openshift-monitoring/node-exporter-8sgwr"
Jul 29 00:37:25.371546 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.371447    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9c6d\" (UniqueName: \"kubernetes.io/projected/62bcf3a9-3e52-4311-95d4-00ab9b46bd7a-kube-api-access-l9c6d\") pod \"kube-state-metrics-56d9f944b4-c6clq\" (UID: \"62bcf3a9-3e52-4311-95d4-00ab9b46bd7a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c6clq"
Jul 29 00:37:25.655231 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.655154    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5b664c4c7d-wvn9t"
Jul 29 00:37:25.760762 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.760710    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/520b4f0a-2788-4913-93a6-72d7a4c0cc1f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-w84pc\" (UID: \"520b4f0a-2788-4913-93a6-72d7a4c0cc1f\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-w84pc"
Jul 29 00:37:25.763335 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.763308    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/520b4f0a-2788-4913-93a6-72d7a4c0cc1f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-w84pc\" (UID: \"520b4f0a-2788-4913-93a6-72d7a4c0cc1f\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-w84pc"
Jul 29 00:37:25.861539 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.861505    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/62bcf3a9-3e52-4311-95d4-00ab9b46bd7a-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-c6clq\" (UID: \"62bcf3a9-3e52-4311-95d4-00ab9b46bd7a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c6clq"
Jul 29 00:37:25.861755 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.861620    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8f058002-0a06-4a4b-8aa7-07ab94de01fe-node-exporter-tls\") pod \"node-exporter-8sgwr\" (UID: \"8f058002-0a06-4a4b-8aa7-07ab94de01fe\") " pod="openshift-monitoring/node-exporter-8sgwr"
Jul 29 00:37:25.864273 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.864247    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/62bcf3a9-3e52-4311-95d4-00ab9b46bd7a-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-c6clq\" (UID: \"62bcf3a9-3e52-4311-95d4-00ab9b46bd7a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c6clq"
Jul 29 00:37:25.864390 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:25.864249    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8f058002-0a06-4a4b-8aa7-07ab94de01fe-node-exporter-tls\") pod \"node-exporter-8sgwr\" (UID: \"8f058002-0a06-4a4b-8aa7-07ab94de01fe\") " pod="openshift-monitoring/node-exporter-8sgwr"
Jul 29 00:37:26.007780 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:26.007696    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-w84pc"
Jul 29 00:37:26.038705 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:26.038666    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8sgwr"
Jul 29 00:37:26.045573 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:26.045550    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c6clq"
Jul 29 00:37:26.183164 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:37:26.183135    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f058002_0a06_4a4b_8aa7_07ab94de01fe.slice/crio-8c466e886996aae91fe76eb50cb9cca20cfe56fc900a4528d519e5cde85a2cb7 WatchSource:0}: Error finding container 8c466e886996aae91fe76eb50cb9cca20cfe56fc900a4528d519e5cde85a2cb7: Status 404 returned error can't find the container with id 8c466e886996aae91fe76eb50cb9cca20cfe56fc900a4528d519e5cde85a2cb7
Jul 29 00:37:26.356813 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:26.356780    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-c6clq"]
Jul 29 00:37:26.360366 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:37:26.360327    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62bcf3a9_3e52_4311_95d4_00ab9b46bd7a.slice/crio-99d43449b09c1d5c633bd70206f0333e28f75bc347c023d83b0909a0cfc84d41 WatchSource:0}: Error finding container 99d43449b09c1d5c633bd70206f0333e28f75bc347c023d83b0909a0cfc84d41: Status 404 returned error can't find the container with id 99d43449b09c1d5c633bd70206f0333e28f75bc347c023d83b0909a0cfc84d41
Jul 29 00:37:26.366123 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:26.366018    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-w84pc"]
Jul 29 00:37:26.369550 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:37:26.369525    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod520b4f0a_2788_4913_93a6_72d7a4c0cc1f.slice/crio-244f634c7ed8db0fbd1427d3f5682fcd581d159ab88486b869af2be385ad5b7f WatchSource:0}: Error finding container 244f634c7ed8db0fbd1427d3f5682fcd581d159ab88486b869af2be385ad5b7f: Status 404 returned error can't find the container with id 244f634c7ed8db0fbd1427d3f5682fcd581d159ab88486b869af2be385ad5b7f
Jul 29 00:37:26.747309 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:26.747273    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-knqll" event={"ID":"0cc6fd7f-032b-4ab6-a8ca-b329395a8db5","Type":"ContainerStarted","Data":"31ec72ab49a188a955f1d65b917335fca438e16ea227baae86c862f19514f056"}
Jul 29 00:37:26.749049 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:26.749019    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hcb88" event={"ID":"afd557e9-0701-488d-acd6-0f91d0002e61","Type":"ContainerStarted","Data":"04f5df33bb9dae8e145bf20321c5ef5751d5f334d740c261ee3399ad061eec27"}
Jul 29 00:37:26.749189 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:26.749075    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hcb88"
Jul 29 00:37:26.751273 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:26.751236    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-w84pc" event={"ID":"520b4f0a-2788-4913-93a6-72d7a4c0cc1f","Type":"ContainerStarted","Data":"a7cf3fa95b362a731a594e5fe5abd5e073e3d602b997a3852072de77d96e9ad2"}
Jul 29 00:37:26.751399 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:26.751295    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-w84pc" event={"ID":"520b4f0a-2788-4913-93a6-72d7a4c0cc1f","Type":"ContainerStarted","Data":"45e1e35293e930d096f1bbf7859c869033f3c3c67b04767c508ebf41d8af90d2"}
Jul 29 00:37:26.751399 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:26.751323    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-w84pc" event={"ID":"520b4f0a-2788-4913-93a6-72d7a4c0cc1f","Type":"ContainerStarted","Data":"244f634c7ed8db0fbd1427d3f5682fcd581d159ab88486b869af2be385ad5b7f"}
Jul 29 00:37:26.752647 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:26.752623    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8sgwr" event={"ID":"8f058002-0a06-4a4b-8aa7-07ab94de01fe","Type":"ContainerStarted","Data":"8c466e886996aae91fe76eb50cb9cca20cfe56fc900a4528d519e5cde85a2cb7"}
Jul 29 00:37:26.754347 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:26.754323    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jswzt" event={"ID":"5133632e-a2ef-4d96-a84e-296378c156bc","Type":"ContainerStarted","Data":"8deb6c4f93b4f1ffcec42467b829ef70ed1befeb09f1a08381d980d40c0b6783"}
Jul 29 00:37:26.755414 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:26.755382    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c6clq" event={"ID":"62bcf3a9-3e52-4311-95d4-00ab9b46bd7a","Type":"ContainerStarted","Data":"99d43449b09c1d5c633bd70206f0333e28f75bc347c023d83b0909a0cfc84d41"}
Jul 29 00:37:26.764451 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:26.764410    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-knqll" podStartSLOduration=2.498370136 podStartE2EDuration="17.764391523s" totalImagesPullingTime="15.266021387s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 00:37:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:37:26.763370782 +0000 UTC m=+72.907828354" watchObservedRunningTime="2026-07-29 00:37:26.764391523 +0000 UTC m=+72.908849156"
Jul 29 00:37:26.780396 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:26.780337    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hcb88" podStartSLOduration=66.224934839 podStartE2EDuration="1m12.780319879s" totalImagesPullingTime="6.55538504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:36:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:37:26.77898866 +0000 UTC m=+72.923446232" watchObservedRunningTime="2026-07-29 00:37:26.780319879 +0000 UTC m=+72.924777449"
Jul 29 00:37:26.795273 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:26.795215    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jswzt" podStartSLOduration=66.255058115 podStartE2EDuration="1m12.795185166s" totalImagesPullingTime="6.540127051s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 00:36:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:37:26.795003048 +0000 UTC m=+72.939460646" watchObservedRunningTime="2026-07-29 00:37:26.795185166 +0000 UTC m=+72.939642736"
Jul 29 00:37:27.180137 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:27.180103    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5455cb9c97-tflgb"]
Jul 29 00:37:27.183731 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:27.183703    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5455cb9c97-tflgb"
Jul 29 00:37:27.185990 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:27.185896    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 29 00:37:27.185990 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:27.185919    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 29 00:37:27.185990 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:27.185919    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 29 00:37:27.185990 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:27.185974    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 29 00:37:27.185990 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:27.185985    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 29 00:37:27.186273 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:27.186008    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-74qgs6jdv31t8\""
Jul 29 00:37:27.186273 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:27.185919    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-nfxk7\""
Jul 29 00:37:27.199268 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:27.199242    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5455cb9c97-tflgb"]
Jul 29 00:37:27.275424 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:27.275215    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7vks\" (UniqueName: \"kubernetes.io/projected/aec01d64-fe91-47d0-b4d6-acfb46d51202-kube-api-access-f7vks\") pod \"thanos-querier-5455cb9c97-tflgb\" (UID: \"aec01d64-fe91-47d0-b4d6-acfb46d51202\") " pod="openshift-monitoring/thanos-querier-5455cb9c97-tflgb"
Jul 29 00:37:27.275424 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:27.275265    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/aec01d64-fe91-47d0-b4d6-acfb46d51202-secret-thanos-querier-tls\") pod \"thanos-querier-5455cb9c97-tflgb\" (UID: \"aec01d64-fe91-47d0-b4d6-acfb46d51202\") " pod="openshift-monitoring/thanos-querier-5455cb9c97-tflgb"
Jul 29 00:37:27.275424 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:27.275288    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aec01d64-fe91-47d0-b4d6-acfb46d51202-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5455cb9c97-tflgb\" (UID: \"aec01d64-fe91-47d0-b4d6-acfb46d51202\") " pod="openshift-monitoring/thanos-querier-5455cb9c97-tflgb"
Jul 29 00:37:27.275424 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:27.275323    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aec01d64-fe91-47d0-b4d6-acfb46d51202-metrics-client-ca\") pod \"thanos-querier-5455cb9c97-tflgb\" (UID: \"aec01d64-fe91-47d0-b4d6-acfb46d51202\") " pod="openshift-monitoring/thanos-querier-5455cb9c97-tflgb"
Jul 29 00:37:27.275424 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:27.275400    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/aec01d64-fe91-47d0-b4d6-acfb46d51202-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5455cb9c97-tflgb\" (UID: \"aec01d64-fe91-47d0-b4d6-acfb46d51202\") " pod="openshift-monitoring/thanos-querier-5455cb9c97-tflgb"
Jul 29 00:37:27.275797 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:27.275435    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/aec01d64-fe91-47d0-b4d6-acfb46d51202-secret-grpc-tls\") pod \"thanos-querier-5455cb9c97-tflgb\" (UID: \"aec01d64-fe91-47d0-b4d6-acfb46d51202\") " pod="openshift-monitoring/thanos-querier-5455cb9c97-tflgb"
Jul 29 00:37:27.275797 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:27.275480    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aec01d64-fe91-47d0-b4d6-acfb46d51202-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5455cb9c97-tflgb\" (UID: \"aec01d64-fe91-47d0-b4d6-acfb46d51202\") " pod="openshift-monitoring/thanos-querier-5455cb9c97-tflgb"
Jul 29 00:37:27.275797 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:27.275544    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/aec01d64-fe91-47d0-b4d6-acfb46d51202-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5455cb9c97-tflgb\" (UID: \"aec01d64-fe91-47d0-b4d6-acfb46d51202\") " pod="openshift-monitoring/thanos-querier-5455cb9c97-tflgb"
Jul 29 00:37:27.375916 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:27.375872    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/aec01d64-fe91-47d0-b4d6-acfb46d51202-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5455cb9c97-tflgb\" (UID: \"aec01d64-fe91-47d0-b4d6-acfb46d51202\") " pod="openshift-monitoring/thanos-querier-5455cb9c97-tflgb"
Jul 29 00:37:27.376114 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:27.375924    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/aec01d64-fe91-47d0-b4d6-acfb46d51202-secret-grpc-tls\") pod \"thanos-querier-5455cb9c97-tflgb\" (UID: \"aec01d64-fe91-47d0-b4d6-acfb46d51202\") " pod="openshift-monitoring/thanos-querier-5455cb9c97-tflgb"
Jul 29 00:37:27.376114 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:27.375968    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aec01d64-fe91-47d0-b4d6-acfb46d51202-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5455cb9c97-tflgb\" (UID: \"aec01d64-fe91-47d0-b4d6-acfb46d51202\") " pod="openshift-monitoring/thanos-querier-5455cb9c97-tflgb"
Jul 29 00:37:27.376114 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:27.375998    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/aec01d64-fe91-47d0-b4d6-acfb46d51202-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5455cb9c97-tflgb\" (UID: \"aec01d64-fe91-47d0-b4d6-acfb46d51202\") " pod="openshift-monitoring/thanos-querier-5455cb9c97-tflgb"
Jul 29 00:37:27.376114 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:27.376025    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7vks\" (UniqueName: \"kubernetes.io/projected/aec01d64-fe91-47d0-b4d6-acfb46d51202-kube-api-access-f7vks\") pod \"thanos-querier-5455cb9c97-tflgb\" (UID: \"aec01d64-fe91-47d0-b4d6-acfb46d51202\") " pod="openshift-monitoring/thanos-querier-5455cb9c97-tflgb"
Jul 29 00:37:27.376114 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:27.376087    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/aec01d64-fe91-47d0-b4d6-acfb46d51202-secret-thanos-querier-tls\") pod \"thanos-querier-5455cb9c97-tflgb\" (UID: \"aec01d64-fe91-47d0-b4d6-acfb46d51202\") " pod="openshift-monitoring/thanos-querier-5455cb9c97-tflgb"
Jul 29 00:37:27.376114 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:27.376111    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aec01d64-fe91-47d0-b4d6-acfb46d51202-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5455cb9c97-tflgb\" (UID: \"aec01d64-fe91-47d0-b4d6-acfb46d51202\") " pod="openshift-monitoring/thanos-querier-5455cb9c97-tflgb"
Jul 29 00:37:27.376408 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:27.376143    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aec01d64-fe91-47d0-b4d6-acfb46d51202-metrics-client-ca\") pod \"thanos-querier-5455cb9c97-tflgb\" (UID: \"aec01d64-fe91-47d0-b4d6-acfb46d51202\") " pod="openshift-monitoring/thanos-querier-5455cb9c97-tflgb"
Jul 29 00:37:27.376953 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:27.376923    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aec01d64-fe91-47d0-b4d6-acfb46d51202-metrics-client-ca\") pod \"thanos-querier-5455cb9c97-tflgb\" (UID: \"aec01d64-fe91-47d0-b4d6-acfb46d51202\") " pod="openshift-monitoring/thanos-querier-5455cb9c97-tflgb"
Jul 29 00:37:27.378719 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:27.378694    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aec01d64-fe91-47d0-b4d6-acfb46d51202-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5455cb9c97-tflgb\" (UID: \"aec01d64-fe91-47d0-b4d6-acfb46d51202\") " pod="openshift-monitoring/thanos-querier-5455cb9c97-tflgb"
Jul 29 00:37:27.378882 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:27.378859    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/aec01d64-fe91-47d0-b4d6-acfb46d51202-secret-thanos-querier-tls\") pod \"thanos-querier-5455cb9c97-tflgb\" (UID: \"aec01d64-fe91-47d0-b4d6-acfb46d51202\") " pod="openshift-monitoring/thanos-querier-5455cb9c97-tflgb"
Jul 29 00:37:27.379031 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:27.379007    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/aec01d64-fe91-47d0-b4d6-acfb46d51202-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5455cb9c97-tflgb\" (UID: \"aec01d64-fe91-47d0-b4d6-acfb46d51202\") " pod="openshift-monitoring/thanos-querier-5455cb9c97-tflgb"
Jul 29 00:37:27.379104 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:27.379038    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/aec01d64-fe91-47d0-b4d6-acfb46d51202-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5455cb9c97-tflgb\" (UID: \"aec01d64-fe91-47d0-b4d6-acfb46d51202\") " pod="openshift-monitoring/thanos-querier-5455cb9c97-tflgb"
Jul 29 00:37:27.379104 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:27.379081    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aec01d64-fe91-47d0-b4d6-acfb46d51202-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5455cb9c97-tflgb\" (UID: \"aec01d64-fe91-47d0-b4d6-acfb46d51202\") " pod="openshift-monitoring/thanos-querier-5455cb9c97-tflgb"
Jul 29 00:37:27.379209 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:27.379195    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/aec01d64-fe91-47d0-b4d6-acfb46d51202-secret-grpc-tls\") pod \"thanos-querier-5455cb9c97-tflgb\" (UID: \"aec01d64-fe91-47d0-b4d6-acfb46d51202\") " pod="openshift-monitoring/thanos-querier-5455cb9c97-tflgb"
Jul 29 00:37:27.384222 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:27.384203    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7vks\" (UniqueName: \"kubernetes.io/projected/aec01d64-fe91-47d0-b4d6-acfb46d51202-kube-api-access-f7vks\") pod \"thanos-querier-5455cb9c97-tflgb\" (UID: \"aec01d64-fe91-47d0-b4d6-acfb46d51202\") " pod="openshift-monitoring/thanos-querier-5455cb9c97-tflgb"
Jul 29 00:37:27.509207 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:27.509151    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5455cb9c97-tflgb"
Jul 29 00:37:27.761127 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:27.761091    2577 generic.go:356] "Generic (PLEG): container finished" podID="8f058002-0a06-4a4b-8aa7-07ab94de01fe" containerID="a8bb5684f44ecbd438da793febe3b6dba38125563198f2fb2911f5072d60e0b3" exitCode=0
Jul 29 00:37:27.761319 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:27.761197    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8sgwr" event={"ID":"8f058002-0a06-4a4b-8aa7-07ab94de01fe","Type":"ContainerDied","Data":"a8bb5684f44ecbd438da793febe3b6dba38125563198f2fb2911f5072d60e0b3"}
Jul 29 00:37:28.204360 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:28.204148    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5455cb9c97-tflgb"]
Jul 29 00:37:28.206708 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:37:28.206511    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaec01d64_fe91_47d0_b4d6_acfb46d51202.slice/crio-578bc154f7ab104d01ac957ae36515c175ff5e7c0dd91e7b5c5e7c82f4588dfb WatchSource:0}: Error finding container 578bc154f7ab104d01ac957ae36515c175ff5e7c0dd91e7b5c5e7c82f4588dfb: Status 404 returned error can't find the container with id 578bc154f7ab104d01ac957ae36515c175ff5e7c0dd91e7b5c5e7c82f4588dfb
Jul 29 00:37:28.767440 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:28.767401    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-w84pc" event={"ID":"520b4f0a-2788-4913-93a6-72d7a4c0cc1f","Type":"ContainerStarted","Data":"7265c7e8078067f5a1366065914cef5e0d36119c742641c86c7b00acb4d17dfd"}
Jul 29 00:37:28.770026 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:28.769992    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8sgwr" event={"ID":"8f058002-0a06-4a4b-8aa7-07ab94de01fe","Type":"ContainerStarted","Data":"fb0182a52ceca29d105578f8dad23df2f6541fb21d7ff18fa97eb86086fb463c"}
Jul 29 00:37:28.770317 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:28.770048    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8sgwr" event={"ID":"8f058002-0a06-4a4b-8aa7-07ab94de01fe","Type":"ContainerStarted","Data":"57a2348a6335977373877337680967745899a08f09829f6ba4216b32b85d72d3"}
Jul 29 00:37:28.772847 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:28.772819    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c6clq" event={"ID":"62bcf3a9-3e52-4311-95d4-00ab9b46bd7a","Type":"ContainerStarted","Data":"ead653da35df17be156a4908fa8c7c61e339e2ce86b2d1f606b2806b5689f1b5"}
Jul 29 00:37:28.772974 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:28.772872    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c6clq" event={"ID":"62bcf3a9-3e52-4311-95d4-00ab9b46bd7a","Type":"ContainerStarted","Data":"adc53f84370af086969f8f4c9b9e4724b492cd6262622ae9b7d7b5ef6f65f3c5"}
Jul 29 00:37:28.772974 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:28.772900    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c6clq" event={"ID":"62bcf3a9-3e52-4311-95d4-00ab9b46bd7a","Type":"ContainerStarted","Data":"20924e223ca21b7e1e1fd6fcca504694211ddd1221ad36a716a9ff19f4ff76e8"}
Jul 29 00:37:28.774115 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:28.774091    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5455cb9c97-tflgb" event={"ID":"aec01d64-fe91-47d0-b4d6-acfb46d51202","Type":"ContainerStarted","Data":"578bc154f7ab104d01ac957ae36515c175ff5e7c0dd91e7b5c5e7c82f4588dfb"}
Jul 29 00:37:28.785400 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:28.785347    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-w84pc" podStartSLOduration=2.251915602 podStartE2EDuration="3.785328263s" totalImagesPullingTime="1.533412661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:37:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:37:28.784540783 +0000 UTC m=+74.928998378" watchObservedRunningTime="2026-07-29 00:37:28.785328263 +0000 UTC m=+74.929785837"
Jul 29 00:37:28.805861 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:28.805813    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8sgwr" podStartSLOduration=2.9144644680000003 podStartE2EDuration="3.805795792s" totalImagesPullingTime="827.781358ms" totalInitContainerRuntime="63.549966ms" isStatefulPod=true podCreationTimestamp="2026-07-29 00:37:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:37:28.804040549 +0000 UTC m=+74.948498144" watchObservedRunningTime="2026-07-29 00:37:28.805795792 +0000 UTC m=+74.950253362"
Jul 29 00:37:28.821617 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:28.821537    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-c6clq" podStartSLOduration=2.142963094 podStartE2EDuration="3.821513842s" totalImagesPullingTime="1.678550748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:37:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:37:28.821171425 +0000 UTC m=+74.965628998" watchObservedRunningTime="2026-07-29 00:37:28.821513842 +0000 UTC m=+74.965971414"
Jul 29 00:37:29.584921 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:29.584887    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-777f6d779c-fb68s"]
Jul 29 00:37:29.588075 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:29.588055    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-777f6d779c-fb68s"
Jul 29 00:37:29.590171 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:29.590149    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 29 00:37:29.590292 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:29.590183    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 29 00:37:29.590764 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:29.590740    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-gg288\""
Jul 29 00:37:29.590903 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:29.590773    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 29 00:37:29.590903 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:29.590796    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 29 00:37:29.590903 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:29.590863    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-5ul8hdgu1chbe\""
Jul 29 00:37:29.599123 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:29.599099    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-777f6d779c-fb68s"]
Jul 29 00:37:29.694855 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:29.694813    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3990fbdb-f010-4c3f-ab69-6652117b1a0b-metrics-server-audit-profiles\") pod \"metrics-server-777f6d779c-fb68s\" (UID: \"3990fbdb-f010-4c3f-ab69-6652117b1a0b\") " pod="openshift-monitoring/metrics-server-777f6d779c-fb68s"
Jul 29 00:37:29.694855 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:29.694860    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3990fbdb-f010-4c3f-ab69-6652117b1a0b-audit-log\") pod \"metrics-server-777f6d779c-fb68s\" (UID: \"3990fbdb-f010-4c3f-ab69-6652117b1a0b\") " pod="openshift-monitoring/metrics-server-777f6d779c-fb68s"
Jul 29 00:37:29.695087 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:29.694901    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3990fbdb-f010-4c3f-ab69-6652117b1a0b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-777f6d779c-fb68s\" (UID: \"3990fbdb-f010-4c3f-ab69-6652117b1a0b\") " pod="openshift-monitoring/metrics-server-777f6d779c-fb68s"
Jul 29 00:37:29.695087 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:29.694939    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3990fbdb-f010-4c3f-ab69-6652117b1a0b-secret-metrics-server-tls\") pod \"metrics-server-777f6d779c-fb68s\" (UID: \"3990fbdb-f010-4c3f-ab69-6652117b1a0b\") " pod="openshift-monitoring/metrics-server-777f6d779c-fb68s"
Jul 29 00:37:29.695087 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:29.694966    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqmpw\" (UniqueName: \"kubernetes.io/projected/3990fbdb-f010-4c3f-ab69-6652117b1a0b-kube-api-access-mqmpw\") pod \"metrics-server-777f6d779c-fb68s\" (UID: \"3990fbdb-f010-4c3f-ab69-6652117b1a0b\") " pod="openshift-monitoring/metrics-server-777f6d779c-fb68s"
Jul 29 00:37:29.695087 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:29.695021    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3990fbdb-f010-4c3f-ab69-6652117b1a0b-client-ca-bundle\") pod \"metrics-server-777f6d779c-fb68s\" (UID: \"3990fbdb-f010-4c3f-ab69-6652117b1a0b\") " pod="openshift-monitoring/metrics-server-777f6d779c-fb68s"
Jul 29 00:37:29.695087 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:29.695050    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3990fbdb-f010-4c3f-ab69-6652117b1a0b-secret-metrics-server-client-certs\") pod \"metrics-server-777f6d779c-fb68s\" (UID: \"3990fbdb-f010-4c3f-ab69-6652117b1a0b\") " pod="openshift-monitoring/metrics-server-777f6d779c-fb68s"
Jul 29 00:37:29.795542 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:29.795504    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3990fbdb-f010-4c3f-ab69-6652117b1a0b-secret-metrics-server-client-certs\") pod \"metrics-server-777f6d779c-fb68s\" (UID: \"3990fbdb-f010-4c3f-ab69-6652117b1a0b\") " pod="openshift-monitoring/metrics-server-777f6d779c-fb68s"
Jul 29 00:37:29.795733 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:29.795575    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3990fbdb-f010-4c3f-ab69-6652117b1a0b-metrics-server-audit-profiles\") pod \"metrics-server-777f6d779c-fb68s\" (UID: \"3990fbdb-f010-4c3f-ab69-6652117b1a0b\") " pod="openshift-monitoring/metrics-server-777f6d779c-fb68s"
Jul 29 00:37:29.795733 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:29.795620    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3990fbdb-f010-4c3f-ab69-6652117b1a0b-audit-log\") pod \"metrics-server-777f6d779c-fb68s\" (UID: \"3990fbdb-f010-4c3f-ab69-6652117b1a0b\") " pod="openshift-monitoring/metrics-server-777f6d779c-fb68s"
Jul 29 00:37:29.795733 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:29.795650    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3990fbdb-f010-4c3f-ab69-6652117b1a0b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-777f6d779c-fb68s\" (UID: \"3990fbdb-f010-4c3f-ab69-6652117b1a0b\") " pod="openshift-monitoring/metrics-server-777f6d779c-fb68s"
Jul 29 00:37:29.795733 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:29.795686    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3990fbdb-f010-4c3f-ab69-6652117b1a0b-secret-metrics-server-tls\") pod \"metrics-server-777f6d779c-fb68s\" (UID: \"3990fbdb-f010-4c3f-ab69-6652117b1a0b\") " pod="openshift-monitoring/metrics-server-777f6d779c-fb68s"
Jul 29 00:37:29.795733 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:29.795712    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqmpw\" (UniqueName: \"kubernetes.io/projected/3990fbdb-f010-4c3f-ab69-6652117b1a0b-kube-api-access-mqmpw\") pod \"metrics-server-777f6d779c-fb68s\" (UID: \"3990fbdb-f010-4c3f-ab69-6652117b1a0b\") " pod="openshift-monitoring/metrics-server-777f6d779c-fb68s"
Jul 29 00:37:29.795991 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:29.795748    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3990fbdb-f010-4c3f-ab69-6652117b1a0b-client-ca-bundle\") pod \"metrics-server-777f6d779c-fb68s\" (UID: \"3990fbdb-f010-4c3f-ab69-6652117b1a0b\") " pod="openshift-monitoring/metrics-server-777f6d779c-fb68s"
Jul 29 00:37:29.796175 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:29.796121    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3990fbdb-f010-4c3f-ab69-6652117b1a0b-audit-log\") pod \"metrics-server-777f6d779c-fb68s\" (UID: \"3990fbdb-f010-4c3f-ab69-6652117b1a0b\") " pod="openshift-monitoring/metrics-server-777f6d779c-fb68s"
Jul 29 00:37:29.796558 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:29.796530    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3990fbdb-f010-4c3f-ab69-6652117b1a0b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-777f6d779c-fb68s\" (UID: \"3990fbdb-f010-4c3f-ab69-6652117b1a0b\") " pod="openshift-monitoring/metrics-server-777f6d779c-fb68s"
Jul 29 00:37:29.796822 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:29.796798    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3990fbdb-f010-4c3f-ab69-6652117b1a0b-metrics-server-audit-profiles\") pod \"metrics-server-777f6d779c-fb68s\" (UID: \"3990fbdb-f010-4c3f-ab69-6652117b1a0b\") " pod="openshift-monitoring/metrics-server-777f6d779c-fb68s"
Jul 29 00:37:29.798820 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:29.798796    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3990fbdb-f010-4c3f-ab69-6652117b1a0b-client-ca-bundle\") pod \"metrics-server-777f6d779c-fb68s\" (UID: \"3990fbdb-f010-4c3f-ab69-6652117b1a0b\") " pod="openshift-monitoring/metrics-server-777f6d779c-fb68s"
Jul 29 00:37:29.798918 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:29.798850    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3990fbdb-f010-4c3f-ab69-6652117b1a0b-secret-metrics-server-client-certs\") pod \"metrics-server-777f6d779c-fb68s\" (UID: \"3990fbdb-f010-4c3f-ab69-6652117b1a0b\") " pod="openshift-monitoring/metrics-server-777f6d779c-fb68s"
Jul 29 00:37:29.798918 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:29.798907    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3990fbdb-f010-4c3f-ab69-6652117b1a0b-secret-metrics-server-tls\") pod \"metrics-server-777f6d779c-fb68s\" (UID: \"3990fbdb-f010-4c3f-ab69-6652117b1a0b\") " pod="openshift-monitoring/metrics-server-777f6d779c-fb68s"
Jul 29 00:37:29.805105 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:29.805081    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqmpw\" (UniqueName: \"kubernetes.io/projected/3990fbdb-f010-4c3f-ab69-6652117b1a0b-kube-api-access-mqmpw\") pod \"metrics-server-777f6d779c-fb68s\" (UID: \"3990fbdb-f010-4c3f-ab69-6652117b1a0b\") " pod="openshift-monitoring/metrics-server-777f6d779c-fb68s"
Jul 29 00:37:29.897571 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:29.897489    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-777f6d779c-fb68s"
Jul 29 00:37:30.226270 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:30.226241    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-777f6d779c-fb68s"]
Jul 29 00:37:30.229552 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:37:30.229526    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3990fbdb_f010_4c3f_ab69_6652117b1a0b.slice/crio-85c6276ccd5782f9b89f2ae2b1e5c7c36eb624754ee4b6cca5eeb56a9b0d73e4 WatchSource:0}: Error finding container 85c6276ccd5782f9b89f2ae2b1e5c7c36eb624754ee4b6cca5eeb56a9b0d73e4: Status 404 returned error can't find the container with id 85c6276ccd5782f9b89f2ae2b1e5c7c36eb624754ee4b6cca5eeb56a9b0d73e4
Jul 29 00:37:30.343334 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:30.343301    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6cfc47b79f-p9lpp"]
Jul 29 00:37:30.346893 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:30.346868    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6cfc47b79f-p9lpp"
Jul 29 00:37:30.349141 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:30.348995    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 29 00:37:30.349141 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:30.349040    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 29 00:37:30.349141 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:30.349129    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 29 00:37:30.349374 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:30.349149    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 29 00:37:30.349426 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:30.349394    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-7h6hw\""
Jul 29 00:37:30.349480 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:30.349439    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 29 00:37:30.354741 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:30.354511    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 29 00:37:30.367104 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:30.367079    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6cfc47b79f-p9lpp"]
Jul 29 00:37:30.401392 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:30.401281    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a194f138-170d-4c72-8129-186c5c8945ef-serving-certs-ca-bundle\") pod \"telemeter-client-6cfc47b79f-p9lpp\" (UID: \"a194f138-170d-4c72-8129-186c5c8945ef\") " pod="openshift-monitoring/telemeter-client-6cfc47b79f-p9lpp"
Jul 29 00:37:30.401392 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:30.401317    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a194f138-170d-4c72-8129-186c5c8945ef-telemeter-client-tls\") pod \"telemeter-client-6cfc47b79f-p9lpp\" (UID: \"a194f138-170d-4c72-8129-186c5c8945ef\") " pod="openshift-monitoring/telemeter-client-6cfc47b79f-p9lpp"
Jul 29 00:37:30.401392 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:30.401345    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a194f138-170d-4c72-8129-186c5c8945ef-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6cfc47b79f-p9lpp\" (UID: \"a194f138-170d-4c72-8129-186c5c8945ef\") " pod="openshift-monitoring/telemeter-client-6cfc47b79f-p9lpp"
Jul 29 00:37:30.401707 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:30.401431    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a194f138-170d-4c72-8129-186c5c8945ef-metrics-client-ca\") pod \"telemeter-client-6cfc47b79f-p9lpp\" (UID: \"a194f138-170d-4c72-8129-186c5c8945ef\") " pod="openshift-monitoring/telemeter-client-6cfc47b79f-p9lpp"
Jul 29 00:37:30.401707 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:30.401482    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a194f138-170d-4c72-8129-186c5c8945ef-federate-client-tls\") pod \"telemeter-client-6cfc47b79f-p9lpp\" (UID: \"a194f138-170d-4c72-8129-186c5c8945ef\") " pod="openshift-monitoring/telemeter-client-6cfc47b79f-p9lpp"
Jul 29 00:37:30.401707 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:30.401520    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a194f138-170d-4c72-8129-186c5c8945ef-secret-telemeter-client\") pod \"telemeter-client-6cfc47b79f-p9lpp\" (UID: \"a194f138-170d-4c72-8129-186c5c8945ef\") " pod="openshift-monitoring/telemeter-client-6cfc47b79f-p9lpp"
Jul 29 00:37:30.401707 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:30.401547    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a194f138-170d-4c72-8129-186c5c8945ef-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6cfc47b79f-p9lpp\" (UID: \"a194f138-170d-4c72-8129-186c5c8945ef\") " pod="openshift-monitoring/telemeter-client-6cfc47b79f-p9lpp"
Jul 29 00:37:30.401707 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:30.401634    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xss8j\" (UniqueName: \"kubernetes.io/projected/a194f138-170d-4c72-8129-186c5c8945ef-kube-api-access-xss8j\") pod \"telemeter-client-6cfc47b79f-p9lpp\" (UID: \"a194f138-170d-4c72-8129-186c5c8945ef\") " pod="openshift-monitoring/telemeter-client-6cfc47b79f-p9lpp"
Jul 29 00:37:30.502137 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:30.502091    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a194f138-170d-4c72-8129-186c5c8945ef-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6cfc47b79f-p9lpp\" (UID: \"a194f138-170d-4c72-8129-186c5c8945ef\") " pod="openshift-monitoring/telemeter-client-6cfc47b79f-p9lpp"
Jul 29 00:37:30.502345 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:30.502192    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a194f138-170d-4c72-8129-186c5c8945ef-metrics-client-ca\") pod \"telemeter-client-6cfc47b79f-p9lpp\" (UID: \"a194f138-170d-4c72-8129-186c5c8945ef\") " pod="openshift-monitoring/telemeter-client-6cfc47b79f-p9lpp"
Jul 29 00:37:30.502345 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:30.502243    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a194f138-170d-4c72-8129-186c5c8945ef-federate-client-tls\") pod \"telemeter-client-6cfc47b79f-p9lpp\" (UID: \"a194f138-170d-4c72-8129-186c5c8945ef\") " pod="openshift-monitoring/telemeter-client-6cfc47b79f-p9lpp"
Jul 29 00:37:30.502345 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:30.502273    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a194f138-170d-4c72-8129-186c5c8945ef-secret-telemeter-client\") pod \"telemeter-client-6cfc47b79f-p9lpp\" (UID: \"a194f138-170d-4c72-8129-186c5c8945ef\") " pod="openshift-monitoring/telemeter-client-6cfc47b79f-p9lpp"
Jul 29 00:37:30.502345 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:30.502297    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a194f138-170d-4c72-8129-186c5c8945ef-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6cfc47b79f-p9lpp\" (UID: \"a194f138-170d-4c72-8129-186c5c8945ef\") " pod="openshift-monitoring/telemeter-client-6cfc47b79f-p9lpp"
Jul 29 00:37:30.502345 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:30.502324    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xss8j\" (UniqueName: \"kubernetes.io/projected/a194f138-170d-4c72-8129-186c5c8945ef-kube-api-access-xss8j\") pod \"telemeter-client-6cfc47b79f-p9lpp\" (UID: \"a194f138-170d-4c72-8129-186c5c8945ef\") " pod="openshift-monitoring/telemeter-client-6cfc47b79f-p9lpp"
Jul 29 00:37:30.502714 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:30.502360    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a194f138-170d-4c72-8129-186c5c8945ef-serving-certs-ca-bundle\") pod \"telemeter-client-6cfc47b79f-p9lpp\" (UID: \"a194f138-170d-4c72-8129-186c5c8945ef\") " pod="openshift-monitoring/telemeter-client-6cfc47b79f-p9lpp"
Jul 29 00:37:30.502714 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:30.502479    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a194f138-170d-4c72-8129-186c5c8945ef-telemeter-client-tls\") pod \"telemeter-client-6cfc47b79f-p9lpp\" (UID: \"a194f138-170d-4c72-8129-186c5c8945ef\") " pod="openshift-monitoring/telemeter-client-6cfc47b79f-p9lpp"
Jul 29 00:37:30.503177 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:30.503111    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a194f138-170d-4c72-8129-186c5c8945ef-serving-certs-ca-bundle\") pod \"telemeter-client-6cfc47b79f-p9lpp\" (UID: \"a194f138-170d-4c72-8129-186c5c8945ef\") " pod="openshift-monitoring/telemeter-client-6cfc47b79f-p9lpp"
Jul 29 00:37:30.503177 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:30.503129    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a194f138-170d-4c72-8129-186c5c8945ef-metrics-client-ca\") pod \"telemeter-client-6cfc47b79f-p9lpp\" (UID: \"a194f138-170d-4c72-8129-186c5c8945ef\") " pod="openshift-monitoring/telemeter-client-6cfc47b79f-p9lpp"
Jul 29 00:37:30.503619 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:30.503576    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a194f138-170d-4c72-8129-186c5c8945ef-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6cfc47b79f-p9lpp\" (UID: \"a194f138-170d-4c72-8129-186c5c8945ef\") " pod="openshift-monitoring/telemeter-client-6cfc47b79f-p9lpp"
Jul 29 00:37:30.505030 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:30.505008    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a194f138-170d-4c72-8129-186c5c8945ef-telemeter-client-tls\") pod \"telemeter-client-6cfc47b79f-p9lpp\" (UID: \"a194f138-170d-4c72-8129-186c5c8945ef\") " pod="openshift-monitoring/telemeter-client-6cfc47b79f-p9lpp"
Jul 29 00:37:30.505152 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:30.505069    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a194f138-170d-4c72-8129-186c5c8945ef-secret-telemeter-client\") pod \"telemeter-client-6cfc47b79f-p9lpp\" (UID: \"a194f138-170d-4c72-8129-186c5c8945ef\") " pod="openshift-monitoring/telemeter-client-6cfc47b79f-p9lpp"
Jul 29 00:37:30.505245 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:30.505227    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a194f138-170d-4c72-8129-186c5c8945ef-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6cfc47b79f-p9lpp\" (UID: \"a194f138-170d-4c72-8129-186c5c8945ef\") " pod="openshift-monitoring/telemeter-client-6cfc47b79f-p9lpp"
Jul 29 00:37:30.505320 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:30.505299    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a194f138-170d-4c72-8129-186c5c8945ef-federate-client-tls\") pod \"telemeter-client-6cfc47b79f-p9lpp\" (UID: \"a194f138-170d-4c72-8129-186c5c8945ef\") " pod="openshift-monitoring/telemeter-client-6cfc47b79f-p9lpp"
Jul 29 00:37:30.516698 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:30.516680    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xss8j\" (UniqueName: \"kubernetes.io/projected/a194f138-170d-4c72-8129-186c5c8945ef-kube-api-access-xss8j\") pod \"telemeter-client-6cfc47b79f-p9lpp\" (UID: \"a194f138-170d-4c72-8129-186c5c8945ef\") " pod="openshift-monitoring/telemeter-client-6cfc47b79f-p9lpp"
Jul 29 00:37:30.657533 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:30.657453    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6cfc47b79f-p9lpp"
Jul 29 00:37:30.786245 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:30.786206    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-777f6d779c-fb68s" event={"ID":"3990fbdb-f010-4c3f-ab69-6652117b1a0b","Type":"ContainerStarted","Data":"85c6276ccd5782f9b89f2ae2b1e5c7c36eb624754ee4b6cca5eeb56a9b0d73e4"}
Jul 29 00:37:30.788766 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:30.788739    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5455cb9c97-tflgb" event={"ID":"aec01d64-fe91-47d0-b4d6-acfb46d51202","Type":"ContainerStarted","Data":"af329b67adbe7453dbe783ce4b20d1097607f4d3cbef8e2946f527d8d8c7cbec"}
Jul 29 00:37:30.788908 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:30.788797    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5455cb9c97-tflgb" event={"ID":"aec01d64-fe91-47d0-b4d6-acfb46d51202","Type":"ContainerStarted","Data":"3915af4b96d4d98dbb8e581bd96e6ff1ca37ea95f833622960e5ffcb50483bd5"}
Jul 29 00:37:30.788908 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:30.788836    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5455cb9c97-tflgb" event={"ID":"aec01d64-fe91-47d0-b4d6-acfb46d51202","Type":"ContainerStarted","Data":"66328c8a857e0e3f35893ebb4936c855885266a2692637effa720929cc89cd72"}
Jul 29 00:37:30.796264 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:30.796183    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6cfc47b79f-p9lpp"]
Jul 29 00:37:30.802436 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:37:30.802403    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda194f138_170d_4c72_8129_186c5c8945ef.slice/crio-b8f0eec6093182abcf5127968f2580c18a448808b58323dc1dced0fef716fa68 WatchSource:0}: Error finding container b8f0eec6093182abcf5127968f2580c18a448808b58323dc1dced0fef716fa68: Status 404 returned error can't find the container with id b8f0eec6093182abcf5127968f2580c18a448808b58323dc1dced0fef716fa68
Jul 29 00:37:31.476834 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.476247    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 00:37:31.481943 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.481920    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.497954 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.497927    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 29 00:37:31.498116 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.497978    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 29 00:37:31.498594 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.498209    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 29 00:37:31.498594 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.498244    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-gcp9q\""
Jul 29 00:37:31.498594 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.498393    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 29 00:37:31.498594 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.498405    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 29 00:37:31.498846 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.498677    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 29 00:37:31.498846 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.498812    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 29 00:37:31.498965 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.498948    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 29 00:37:31.499019 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.498975    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 29 00:37:31.499070 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.499017    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 29 00:37:31.499115 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.499076    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 29 00:37:31.499161 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.499131    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2jbhk94g08fqs\""
Jul 29 00:37:31.499215 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.499174    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 29 00:37:31.499384 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.499364    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 29 00:37:31.501031 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.501008    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 29 00:37:31.526545 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.526505    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 00:37:31.611004 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.610963    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/282ce192-1408-4581-b4f6-30f8395e0380-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.611166 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.611013    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/282ce192-1408-4581-b4f6-30f8395e0380-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.611166 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.611041    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/282ce192-1408-4581-b4f6-30f8395e0380-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.611166 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.611112    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/282ce192-1408-4581-b4f6-30f8395e0380-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.611166 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.611147    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/282ce192-1408-4581-b4f6-30f8395e0380-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.611310 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.611177    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/282ce192-1408-4581-b4f6-30f8395e0380-web-config\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.611310 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.611204    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/282ce192-1408-4581-b4f6-30f8395e0380-config-out\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.611310 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.611240    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/282ce192-1408-4581-b4f6-30f8395e0380-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.611310 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.611263    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/282ce192-1408-4581-b4f6-30f8395e0380-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.611310 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.611295    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/282ce192-1408-4581-b4f6-30f8395e0380-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.611504 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.611317    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/282ce192-1408-4581-b4f6-30f8395e0380-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.611504 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.611344    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/282ce192-1408-4581-b4f6-30f8395e0380-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.611504 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.611367    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/282ce192-1408-4581-b4f6-30f8395e0380-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.611504 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.611416    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/282ce192-1408-4581-b4f6-30f8395e0380-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.611504 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.611473    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/282ce192-1408-4581-b4f6-30f8395e0380-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.611699 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.611507    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/282ce192-1408-4581-b4f6-30f8395e0380-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.611699 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.611552    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/282ce192-1408-4581-b4f6-30f8395e0380-config\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.611699 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.611596    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69vtv\" (UniqueName: \"kubernetes.io/projected/282ce192-1408-4581-b4f6-30f8395e0380-kube-api-access-69vtv\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.611699 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.611622    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/282ce192-1408-4581-b4f6-30f8395e0380-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.611699 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.611647    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/282ce192-1408-4581-b4f6-30f8395e0380-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.712578 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.712548    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/282ce192-1408-4581-b4f6-30f8395e0380-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.712973 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.712602    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/282ce192-1408-4581-b4f6-30f8395e0380-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.712973 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.712632    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/282ce192-1408-4581-b4f6-30f8395e0380-web-config\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.712973 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.712665    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/282ce192-1408-4581-b4f6-30f8395e0380-config-out\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.712973 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.712682    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/282ce192-1408-4581-b4f6-30f8395e0380-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.712973 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.712704    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/282ce192-1408-4581-b4f6-30f8395e0380-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.712973 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.712740    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/282ce192-1408-4581-b4f6-30f8395e0380-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.712973 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.712762    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/282ce192-1408-4581-b4f6-30f8395e0380-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.712973 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.712792    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/282ce192-1408-4581-b4f6-30f8395e0380-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.712973 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.712815    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/282ce192-1408-4581-b4f6-30f8395e0380-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.713416 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.713300    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/282ce192-1408-4581-b4f6-30f8395e0380-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.713416 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.713357    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/282ce192-1408-4581-b4f6-30f8395e0380-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.713416 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.713386    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/282ce192-1408-4581-b4f6-30f8395e0380-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.713565 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.713425    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/282ce192-1408-4581-b4f6-30f8395e0380-config\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.713565 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.713461    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69vtv\" (UniqueName: \"kubernetes.io/projected/282ce192-1408-4581-b4f6-30f8395e0380-kube-api-access-69vtv\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.713565 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.713488    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/282ce192-1408-4581-b4f6-30f8395e0380-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.713565 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.713517    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/282ce192-1408-4581-b4f6-30f8395e0380-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.713565 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.713540    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/282ce192-1408-4581-b4f6-30f8395e0380-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.713565 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.713565    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/282ce192-1408-4581-b4f6-30f8395e0380-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.713886 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.713616    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/282ce192-1408-4581-b4f6-30f8395e0380-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.713886 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.713639    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/282ce192-1408-4581-b4f6-30f8395e0380-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.714211 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.714186    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/282ce192-1408-4581-b4f6-30f8395e0380-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.714857 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.714833    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/282ce192-1408-4581-b4f6-30f8395e0380-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.715883 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.715858    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/282ce192-1408-4581-b4f6-30f8395e0380-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.715963 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.715912    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/282ce192-1408-4581-b4f6-30f8395e0380-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.716112 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.716092    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/282ce192-1408-4581-b4f6-30f8395e0380-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.716500 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.716477    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/282ce192-1408-4581-b4f6-30f8395e0380-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.716629 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.716610    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/282ce192-1408-4581-b4f6-30f8395e0380-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.717014 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.716980    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/282ce192-1408-4581-b4f6-30f8395e0380-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.717538 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.717520    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/282ce192-1408-4581-b4f6-30f8395e0380-web-config\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.717892 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.717826    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/282ce192-1408-4581-b4f6-30f8395e0380-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.717978 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.717832    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/282ce192-1408-4581-b4f6-30f8395e0380-config-out\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.718455 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.718430    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/282ce192-1408-4581-b4f6-30f8395e0380-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.719723 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.719691    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/282ce192-1408-4581-b4f6-30f8395e0380-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.719828 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.719768    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/282ce192-1408-4581-b4f6-30f8395e0380-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.719955 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.719931    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/282ce192-1408-4581-b4f6-30f8395e0380-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.720389 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.720368    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/282ce192-1408-4581-b4f6-30f8395e0380-config\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.720804 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.720781    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/282ce192-1408-4581-b4f6-30f8395e0380-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.721295 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.721276    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/282ce192-1408-4581-b4f6-30f8395e0380-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.725267 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.725245    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69vtv\" (UniqueName: \"kubernetes.io/projected/282ce192-1408-4581-b4f6-30f8395e0380-kube-api-access-69vtv\") pod \"prometheus-k8s-0\" (UID: \"282ce192-1408-4581-b4f6-30f8395e0380\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.794095 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.794068    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cfc47b79f-p9lpp" event={"ID":"a194f138-170d-4c72-8129-186c5c8945ef","Type":"ContainerStarted","Data":"b8f0eec6093182abcf5127968f2580c18a448808b58323dc1dced0fef716fa68"}
Jul 29 00:37:31.796866 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.796843    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:31.797202 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.797174    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5455cb9c97-tflgb" event={"ID":"aec01d64-fe91-47d0-b4d6-acfb46d51202","Type":"ContainerStarted","Data":"7b7e5442480df2d55672afa51fdfa60d6730ae52d28a5558194ba5fe327a9c45"}
Jul 29 00:37:31.797284 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.797253    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5455cb9c97-tflgb" event={"ID":"aec01d64-fe91-47d0-b4d6-acfb46d51202","Type":"ContainerStarted","Data":"668b0d52415d48e8704dc6afa029cc62232a7e0b6d0aec4eb7dd811009b1ed3b"}
Jul 29 00:37:31.797350 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.797297    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5455cb9c97-tflgb" event={"ID":"aec01d64-fe91-47d0-b4d6-acfb46d51202","Type":"ContainerStarted","Data":"475f98b6d99a10e133b89b18fec152b4d7335c2e1ea1d556dae9e1ead9255ef3"}
Jul 29 00:37:31.797497 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.797414    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5455cb9c97-tflgb"
Jul 29 00:37:31.954225 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.954166    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5455cb9c97-tflgb" podStartSLOduration=2.215945101 podStartE2EDuration="4.954141958s" totalImagesPullingTime="2.738196857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:37:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:37:31.849132347 +0000 UTC m=+77.993589917" watchObservedRunningTime="2026-07-29 00:37:31.954141958 +0000 UTC m=+78.098599528"
Jul 29 00:37:31.955034 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:31.955012    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 00:37:31.960951 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:37:31.960908    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod282ce192_1408_4581_b4f6_30f8395e0380.slice/crio-0517770deeaf3c9125b34ad667af8c4ff1b26ff4e01f49d705dc69b0bdcbcf95 WatchSource:0}: Error finding container 0517770deeaf3c9125b34ad667af8c4ff1b26ff4e01f49d705dc69b0bdcbcf95: Status 404 returned error can't find the container with id 0517770deeaf3c9125b34ad667af8c4ff1b26ff4e01f49d705dc69b0bdcbcf95
Jul 29 00:37:32.803226 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:32.803179    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-777f6d779c-fb68s" event={"ID":"3990fbdb-f010-4c3f-ab69-6652117b1a0b","Type":"ContainerStarted","Data":"165292868a21080e110d3bd0954689abb6a1b4d3c328e264632225dc62774c3d"}
Jul 29 00:37:32.804639 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:32.804612    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"282ce192-1408-4581-b4f6-30f8395e0380","Type":"ContainerStarted","Data":"0517770deeaf3c9125b34ad667af8c4ff1b26ff4e01f49d705dc69b0bdcbcf95"}
Jul 29 00:37:32.822814 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:32.822763    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-777f6d779c-fb68s" podStartSLOduration=2.298887654 podStartE2EDuration="3.82274637s" totalImagesPullingTime="1.523858716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:37:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:37:32.821219517 +0000 UTC m=+78.965677107" watchObservedRunningTime="2026-07-29 00:37:32.82274637 +0000 UTC m=+78.967203939"
Jul 29 00:37:33.811101 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:33.811063    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cfc47b79f-p9lpp" event={"ID":"a194f138-170d-4c72-8129-186c5c8945ef","Type":"ContainerStarted","Data":"ed15a8967dd64d27f4d7b6a72022dcd8ee2b7540dbe225a07b7c5c4727807848"}
Jul 29 00:37:33.811508 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:33.811132    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cfc47b79f-p9lpp" event={"ID":"a194f138-170d-4c72-8129-186c5c8945ef","Type":"ContainerStarted","Data":"3dec11766914f43c5abab7e407cc2c86739198f48788153299c2b29501be9203"}
Jul 29 00:37:33.811508 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:33.811159    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cfc47b79f-p9lpp" event={"ID":"a194f138-170d-4c72-8129-186c5c8945ef","Type":"ContainerStarted","Data":"f77b9eb993b0f13b31528047e4302a32d24c6fb701b3c4abeac7fd894f966755"}
Jul 29 00:37:33.812563 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:33.812535    2577 generic.go:356] "Generic (PLEG): container finished" podID="282ce192-1408-4581-b4f6-30f8395e0380" containerID="7fb06857a77bd145dc21af05de93d5d55a3644e2e18df129eaf1ba7e5fb00f04" exitCode=0
Jul 29 00:37:33.812673 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:33.812619    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"282ce192-1408-4581-b4f6-30f8395e0380","Type":"ContainerDied","Data":"7fb06857a77bd145dc21af05de93d5d55a3644e2e18df129eaf1ba7e5fb00f04"}
Jul 29 00:37:33.832905 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:33.832824    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6cfc47b79f-p9lpp" podStartSLOduration=1.177006915 podStartE2EDuration="3.832804027s" totalImagesPullingTime="2.655797112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:37:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:37:33.831787134 +0000 UTC m=+79.976244706" watchObservedRunningTime="2026-07-29 00:37:33.832804027 +0000 UTC m=+79.977261597"
Jul 29 00:37:37.810919 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:37.810892    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5455cb9c97-tflgb"
Jul 29 00:37:37.830175 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:37.830140    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"282ce192-1408-4581-b4f6-30f8395e0380","Type":"ContainerStarted","Data":"0e0b656547631b2267b4ca41b1c9af20b3dad30032e62f6d7c3d30ba6645f486"}
Jul 29 00:37:37.830339 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:37.830221    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"282ce192-1408-4581-b4f6-30f8395e0380","Type":"ContainerStarted","Data":"76a5e45ec7ec9fc3ee56de7b2ad96c02153fd5168fda0c4ad2d047183d504df7"}
Jul 29 00:37:37.830339 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:37.830266    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"282ce192-1408-4581-b4f6-30f8395e0380","Type":"ContainerStarted","Data":"dbeef03fa23ce472e66a838ca8b8f87dd01386cecc5bb475b2a682037a32f185"}
Jul 29 00:37:37.830339 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:37.830301    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"282ce192-1408-4581-b4f6-30f8395e0380","Type":"ContainerStarted","Data":"fcf1e3144cafaf172816635b31705e7ba21d2ecfce83b29bf50b1aaa29233aef"}
Jul 29 00:37:37.830339 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:37.830338    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"282ce192-1408-4581-b4f6-30f8395e0380","Type":"ContainerStarted","Data":"ec01f512874ba5524b402ad1181e79542206d57eb92561ccc30430ca48e109cd"}
Jul 29 00:37:37.830572 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:37.830375    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"282ce192-1408-4581-b4f6-30f8395e0380","Type":"ContainerStarted","Data":"d792d909b5cb65f89a66144e285e3d52636de3ec35e77d23dee482e658aca1ca"}
Jul 29 00:37:37.906914 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:37.906860    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.321245676 podStartE2EDuration="6.906840608s" totalImagesPullingTime="4.562366071s" totalInitContainerRuntime="23.228861ms" isStatefulPod=false podCreationTimestamp="2026-07-29 00:37:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:37:37.905619567 +0000 UTC m=+84.050077138" watchObservedRunningTime="2026-07-29 00:37:37.906840608 +0000 UTC m=+84.051298179"
Jul 29 00:37:41.797366 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:41.797317    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:37:49.898118 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:49.898076    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-777f6d779c-fb68s"
Jul 29 00:37:49.898506 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:49.898141    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-777f6d779c-fb68s"
Jul 29 00:37:57.764499 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:37:57.764468    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hcb88"
Jul 29 00:38:09.903535 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:38:09.903507    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-777f6d779c-fb68s"
Jul 29 00:38:09.907564 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:38:09.907538    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-777f6d779c-fb68s"
Jul 29 00:38:31.797410 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:38:31.797367    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:38:31.816925 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:38:31.816898    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:38:32.046665 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:38:32.046622    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 00:40:38.731297 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:40:38.731222    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d22wz"]
Jul 29 00:40:38.734337 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:40:38.734320    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d22wz"
Jul 29 00:40:38.736395 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:40:38.736371    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 29 00:40:38.736536 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:40:38.736468    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 29 00:40:38.736871 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:40:38.736851    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-7b7mr\""
Jul 29 00:40:38.741115 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:40:38.741078    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d22wz"]
Jul 29 00:40:38.827486 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:40:38.827449    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3f16949-db6c-42d5-b104-867a758170d4-tmp\") pod \"openshift-lws-operator-fd8ccff4c-d22wz\" (UID: \"f3f16949-db6c-42d5-b104-867a758170d4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d22wz"
Jul 29 00:40:38.827683 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:40:38.827520    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vn5f\" (UniqueName: \"kubernetes.io/projected/f3f16949-db6c-42d5-b104-867a758170d4-kube-api-access-6vn5f\") pod \"openshift-lws-operator-fd8ccff4c-d22wz\" (UID: \"f3f16949-db6c-42d5-b104-867a758170d4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d22wz"
Jul 29 00:40:38.928925 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:40:38.928890    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vn5f\" (UniqueName: \"kubernetes.io/projected/f3f16949-db6c-42d5-b104-867a758170d4-kube-api-access-6vn5f\") pod \"openshift-lws-operator-fd8ccff4c-d22wz\" (UID: \"f3f16949-db6c-42d5-b104-867a758170d4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d22wz"
Jul 29 00:40:38.929035 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:40:38.928959    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3f16949-db6c-42d5-b104-867a758170d4-tmp\") pod \"openshift-lws-operator-fd8ccff4c-d22wz\" (UID: \"f3f16949-db6c-42d5-b104-867a758170d4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d22wz"
Jul 29 00:40:38.929281 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:40:38.929266    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3f16949-db6c-42d5-b104-867a758170d4-tmp\") pod \"openshift-lws-operator-fd8ccff4c-d22wz\" (UID: \"f3f16949-db6c-42d5-b104-867a758170d4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d22wz"
Jul 29 00:40:38.936385 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:40:38.936356    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vn5f\" (UniqueName: \"kubernetes.io/projected/f3f16949-db6c-42d5-b104-867a758170d4-kube-api-access-6vn5f\") pod \"openshift-lws-operator-fd8ccff4c-d22wz\" (UID: \"f3f16949-db6c-42d5-b104-867a758170d4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d22wz"
Jul 29 00:40:39.055569 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:40:39.055477    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d22wz"
Jul 29 00:40:39.183715 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:40:39.183690    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d22wz"]
Jul 29 00:40:39.186080 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:40:39.186046    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf3f16949_db6c_42d5_b104_867a758170d4.slice/crio-fffffe02b13266a926eb3620ecea4263f46ec047ec46ce6b2e83a0c9b01ccfae WatchSource:0}: Error finding container fffffe02b13266a926eb3620ecea4263f46ec047ec46ce6b2e83a0c9b01ccfae: Status 404 returned error can't find the container with id fffffe02b13266a926eb3620ecea4263f46ec047ec46ce6b2e83a0c9b01ccfae
Jul 29 00:40:39.482164 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:40:39.482131    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d22wz" event={"ID":"f3f16949-db6c-42d5-b104-867a758170d4","Type":"ContainerStarted","Data":"fffffe02b13266a926eb3620ecea4263f46ec047ec46ce6b2e83a0c9b01ccfae"}
Jul 29 00:40:42.496533 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:40:42.496494    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d22wz" event={"ID":"f3f16949-db6c-42d5-b104-867a758170d4","Type":"ContainerStarted","Data":"50a4d471c9af3438d6a903cfa353b4c06eb95ca9b4983dedc9d83a52ce6be299"}
Jul 29 00:40:42.514132 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:40:42.514080    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d22wz" podStartSLOduration=1.943882636 podStartE2EDuration="4.514063825s" totalImagesPullingTime="2.570181189s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:40:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:40:42.512016933 +0000 UTC m=+268.656474514" watchObservedRunningTime="2026-07-29 00:40:42.514063825 +0000 UTC m=+268.658521395"
Jul 29 00:40:58.678102 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:40:58.678063    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8"]
Jul 29 00:40:58.681801 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:40:58.681779    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8"
Jul 29 00:40:58.688993 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:40:58.688872    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 29 00:40:58.690976 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:40:58.690954    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-mbnrz\""
Jul 29 00:40:58.691090 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:40:58.690978    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 29 00:40:58.691090 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:40:58.691000    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 29 00:40:58.691090 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:40:58.691007    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 29 00:40:58.707731 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:40:58.707696    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8"]
Jul 29 00:40:58.804304 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:40:58.804260    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/43dc1497-b349-42f0-9571-9ad4e2e12b75-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8\" (UID: \"43dc1497-b349-42f0-9571-9ad4e2e12b75\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8"
Jul 29 00:40:58.804304 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:40:58.804303    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjchp\" (UniqueName: \"kubernetes.io/projected/43dc1497-b349-42f0-9571-9ad4e2e12b75-kube-api-access-wjchp\") pod \"opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8\" (UID: \"43dc1497-b349-42f0-9571-9ad4e2e12b75\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8"
Jul 29 00:40:58.804523 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:40:58.804334    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43dc1497-b349-42f0-9571-9ad4e2e12b75-tmp\") pod \"opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8\" (UID: \"43dc1497-b349-42f0-9571-9ad4e2e12b75\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8"
Jul 29 00:40:58.804523 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:40:58.804446    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/43dc1497-b349-42f0-9571-9ad4e2e12b75-manifests\") pod \"opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8\" (UID: \"43dc1497-b349-42f0-9571-9ad4e2e12b75\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8"
Jul 29 00:40:58.804626 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:40:58.804502    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/43dc1497-b349-42f0-9571-9ad4e2e12b75-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8\" (UID: \"43dc1497-b349-42f0-9571-9ad4e2e12b75\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8"
Jul 29 00:40:58.905637 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:40:58.905572    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/43dc1497-b349-42f0-9571-9ad4e2e12b75-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8\" (UID: \"43dc1497-b349-42f0-9571-9ad4e2e12b75\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8"
Jul 29 00:40:58.905800 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:40:58.905642    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjchp\" (UniqueName: \"kubernetes.io/projected/43dc1497-b349-42f0-9571-9ad4e2e12b75-kube-api-access-wjchp\") pod \"opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8\" (UID: \"43dc1497-b349-42f0-9571-9ad4e2e12b75\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8"
Jul 29 00:40:58.905800 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:40:58.905677    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43dc1497-b349-42f0-9571-9ad4e2e12b75-tmp\") pod \"opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8\" (UID: \"43dc1497-b349-42f0-9571-9ad4e2e12b75\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8"
Jul 29 00:40:58.905800 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:40:58.905744    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/43dc1497-b349-42f0-9571-9ad4e2e12b75-manifests\") pod \"opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8\" (UID: \"43dc1497-b349-42f0-9571-9ad4e2e12b75\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8"
Jul 29 00:40:58.905800 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:40:58.905793    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/43dc1497-b349-42f0-9571-9ad4e2e12b75-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8\" (UID: \"43dc1497-b349-42f0-9571-9ad4e2e12b75\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8"
Jul 29 00:40:58.906251 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:40:58.906223    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/43dc1497-b349-42f0-9571-9ad4e2e12b75-manifests\") pod \"opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8\" (UID: \"43dc1497-b349-42f0-9571-9ad4e2e12b75\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8"
Jul 29 00:40:58.907999 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:40:58.907968    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43dc1497-b349-42f0-9571-9ad4e2e12b75-tmp\") pod \"opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8\" (UID: \"43dc1497-b349-42f0-9571-9ad4e2e12b75\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8"
Jul 29 00:40:58.908221 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:40:58.908201    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/43dc1497-b349-42f0-9571-9ad4e2e12b75-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8\" (UID: \"43dc1497-b349-42f0-9571-9ad4e2e12b75\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8"
Jul 29 00:40:58.908318 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:40:58.908298    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/43dc1497-b349-42f0-9571-9ad4e2e12b75-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8\" (UID: \"43dc1497-b349-42f0-9571-9ad4e2e12b75\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8"
Jul 29 00:40:58.917008 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:40:58.916979    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjchp\" (UniqueName: \"kubernetes.io/projected/43dc1497-b349-42f0-9571-9ad4e2e12b75-kube-api-access-wjchp\") pod \"opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8\" (UID: \"43dc1497-b349-42f0-9571-9ad4e2e12b75\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8"
Jul 29 00:40:58.991839 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:40:58.991732    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8"
Jul 29 00:40:59.144276 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:40:59.144177    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8"]
Jul 29 00:40:59.147211 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:40:59.147184    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43dc1497_b349_42f0_9571_9ad4e2e12b75.slice/crio-5d94b05c8f96b4c1a7ec564b457dcfa2a0335a56b49aa57ff9ca5ea01c432643 WatchSource:0}: Error finding container 5d94b05c8f96b4c1a7ec564b457dcfa2a0335a56b49aa57ff9ca5ea01c432643: Status 404 returned error can't find the container with id 5d94b05c8f96b4c1a7ec564b457dcfa2a0335a56b49aa57ff9ca5ea01c432643
Jul 29 00:40:59.562497 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:40:59.562463    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8" event={"ID":"43dc1497-b349-42f0-9571-9ad4e2e12b75","Type":"ContainerStarted","Data":"5d94b05c8f96b4c1a7ec564b457dcfa2a0335a56b49aa57ff9ca5ea01c432643"}
Jul 29 00:41:02.578808 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:02.578769    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8" event={"ID":"43dc1497-b349-42f0-9571-9ad4e2e12b75","Type":"ContainerStarted","Data":"838e0fd3383a2ff3f5924b4e0a1595767cee070c9df76350bae08fbcb791f93a"}
Jul 29 00:41:03.583938 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:03.583897    2577 generic.go:356] "Generic (PLEG): container finished" podID="43dc1497-b349-42f0-9571-9ad4e2e12b75" containerID="838e0fd3383a2ff3f5924b4e0a1595767cee070c9df76350bae08fbcb791f93a" exitCode=0
Jul 29 00:41:03.584334 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:03.583981    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8" event={"ID":"43dc1497-b349-42f0-9571-9ad4e2e12b75","Type":"ContainerDied","Data":"838e0fd3383a2ff3f5924b4e0a1595767cee070c9df76350bae08fbcb791f93a"}
Jul 29 00:41:04.589822 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:04.589789    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8" event={"ID":"43dc1497-b349-42f0-9571-9ad4e2e12b75","Type":"ContainerStarted","Data":"92246643a9d16c5d34d9deb839d59280eb93b238b7c795cd617f3dd8eb1d6958"}
Jul 29 00:41:04.590225 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:04.589904    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8"
Jul 29 00:41:04.612774 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:04.612716    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8" podStartSLOduration=1.99957472 podStartE2EDuration="6.612696751s" totalImagesPullingTime="3.59710825s" totalInitContainerRuntime="1.016013781s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:40:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:41:04.611733587 +0000 UTC m=+290.756191158" watchObservedRunningTime="2026-07-29 00:41:04.612696751 +0000 UTC m=+290.757154323"
Jul 29 00:41:14.202946 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:14.202915    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tfr5v_ac322954-06d1-4807-8a8b-59e62befe6bc/ovn-acl-logging/0.log"
Jul 29 00:41:14.214373 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:14.214349    2577 kubelet.go:1648] "Image garbage collection succeeded"
Jul 29 00:41:14.215134 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:14.215115    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tfr5v_ac322954-06d1-4807-8a8b-59e62befe6bc/ovn-acl-logging/0.log"
Jul 29 00:41:15.597023 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:15.596993    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8"
Jul 29 00:41:18.861844 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:18.861812    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-75d55f5564-8xsr5"]
Jul 29 00:41:18.866703 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:18.866687    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75d55f5564-8xsr5"
Jul 29 00:41:18.869560 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:18.869525    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 29 00:41:18.870215 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:18.870197    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 29 00:41:18.870296 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:18.870242    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 29 00:41:18.870296 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:18.870243    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 29 00:41:18.871329 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:18.871314    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-kjwjd\""
Jul 29 00:41:18.882078 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:18.882055    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75d55f5564-8xsr5"]
Jul 29 00:41:18.957865 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:18.957830    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de7d69f3-462e-4662-9b91-fb826c4d16b3-tmp\") pod \"kube-auth-proxy-75d55f5564-8xsr5\" (UID: \"de7d69f3-462e-4662-9b91-fb826c4d16b3\") " pod="openshift-ingress/kube-auth-proxy-75d55f5564-8xsr5"
Jul 29 00:41:18.958054 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:18.957880    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de7d69f3-462e-4662-9b91-fb826c4d16b3-tls-certs\") pod \"kube-auth-proxy-75d55f5564-8xsr5\" (UID: \"de7d69f3-462e-4662-9b91-fb826c4d16b3\") " pod="openshift-ingress/kube-auth-proxy-75d55f5564-8xsr5"
Jul 29 00:41:18.958054 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:18.957968    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9b4v\" (UniqueName: \"kubernetes.io/projected/de7d69f3-462e-4662-9b91-fb826c4d16b3-kube-api-access-g9b4v\") pod \"kube-auth-proxy-75d55f5564-8xsr5\" (UID: \"de7d69f3-462e-4662-9b91-fb826c4d16b3\") " pod="openshift-ingress/kube-auth-proxy-75d55f5564-8xsr5"
Jul 29 00:41:19.059321 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:19.059280    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9b4v\" (UniqueName: \"kubernetes.io/projected/de7d69f3-462e-4662-9b91-fb826c4d16b3-kube-api-access-g9b4v\") pod \"kube-auth-proxy-75d55f5564-8xsr5\" (UID: \"de7d69f3-462e-4662-9b91-fb826c4d16b3\") " pod="openshift-ingress/kube-auth-proxy-75d55f5564-8xsr5"
Jul 29 00:41:19.059514 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:19.059336    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de7d69f3-462e-4662-9b91-fb826c4d16b3-tmp\") pod \"kube-auth-proxy-75d55f5564-8xsr5\" (UID: \"de7d69f3-462e-4662-9b91-fb826c4d16b3\") " pod="openshift-ingress/kube-auth-proxy-75d55f5564-8xsr5"
Jul 29 00:41:19.059514 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:19.059372    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de7d69f3-462e-4662-9b91-fb826c4d16b3-tls-certs\") pod \"kube-auth-proxy-75d55f5564-8xsr5\" (UID: \"de7d69f3-462e-4662-9b91-fb826c4d16b3\") " pod="openshift-ingress/kube-auth-proxy-75d55f5564-8xsr5"
Jul 29 00:41:19.061730 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:19.061699    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de7d69f3-462e-4662-9b91-fb826c4d16b3-tmp\") pod \"kube-auth-proxy-75d55f5564-8xsr5\" (UID: \"de7d69f3-462e-4662-9b91-fb826c4d16b3\") " pod="openshift-ingress/kube-auth-proxy-75d55f5564-8xsr5"
Jul 29 00:41:19.061929 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:19.061912    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de7d69f3-462e-4662-9b91-fb826c4d16b3-tls-certs\") pod \"kube-auth-proxy-75d55f5564-8xsr5\" (UID: \"de7d69f3-462e-4662-9b91-fb826c4d16b3\") " pod="openshift-ingress/kube-auth-proxy-75d55f5564-8xsr5"
Jul 29 00:41:19.070969 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:19.070944    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9b4v\" (UniqueName: \"kubernetes.io/projected/de7d69f3-462e-4662-9b91-fb826c4d16b3-kube-api-access-g9b4v\") pod \"kube-auth-proxy-75d55f5564-8xsr5\" (UID: \"de7d69f3-462e-4662-9b91-fb826c4d16b3\") " pod="openshift-ingress/kube-auth-proxy-75d55f5564-8xsr5"
Jul 29 00:41:19.175845 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:19.175769    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75d55f5564-8xsr5"
Jul 29 00:41:19.329695 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:19.329663    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75d55f5564-8xsr5"]
Jul 29 00:41:19.332717 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:41:19.332686    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde7d69f3_462e_4662_9b91_fb826c4d16b3.slice/crio-878bc9ef9d5bc0d891b2632d8b3044e0a05bbca7dd6b127886c39398f0392cef WatchSource:0}: Error finding container 878bc9ef9d5bc0d891b2632d8b3044e0a05bbca7dd6b127886c39398f0392cef: Status 404 returned error can't find the container with id 878bc9ef9d5bc0d891b2632d8b3044e0a05bbca7dd6b127886c39398f0392cef
Jul 29 00:41:19.334385 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:19.334372    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 00:41:19.652455 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:19.652424    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75d55f5564-8xsr5" event={"ID":"de7d69f3-462e-4662-9b91-fb826c4d16b3","Type":"ContainerStarted","Data":"878bc9ef9d5bc0d891b2632d8b3044e0a05bbca7dd6b127886c39398f0392cef"}
Jul 29 00:41:22.668380 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:22.668343    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75d55f5564-8xsr5" event={"ID":"de7d69f3-462e-4662-9b91-fb826c4d16b3","Type":"ContainerStarted","Data":"7e08a1c1d0806c322ea7e78200c039e4d38e7de163458bf191692692eeec9fe3"}
Jul 29 00:41:22.683801 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:22.683756    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-75d55f5564-8xsr5" podStartSLOduration=2.042922802 podStartE2EDuration="4.683737693s" totalImagesPullingTime="2.640814891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:41:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:41:22.682178297 +0000 UTC m=+308.826635868" watchObservedRunningTime="2026-07-29 00:41:22.683737693 +0000 UTC m=+308.828195262"
Jul 29 00:41:26.186815 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.186781    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm"]
Jul 29 00:41:26.189944 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.189925    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm"
Jul 29 00:41:26.192132 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.192110    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 29 00:41:26.192256 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.192113    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-mlk9w\""
Jul 29 00:41:26.203514 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.203489    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm"]
Jul 29 00:41:26.223914 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.223882    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51a02f62-5669-4a95-a578-188a3c60833c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm\" (UID: \"51a02f62-5669-4a95-a578-188a3c60833c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm"
Jul 29 00:41:26.223914 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.223918    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51a02f62-5669-4a95-a578-188a3c60833c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm\" (UID: \"51a02f62-5669-4a95-a578-188a3c60833c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm"
Jul 29 00:41:26.224107 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.223951    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51a02f62-5669-4a95-a578-188a3c60833c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm\" (UID: \"51a02f62-5669-4a95-a578-188a3c60833c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm"
Jul 29 00:41:26.224107 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.224040    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51a02f62-5669-4a95-a578-188a3c60833c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm\" (UID: \"51a02f62-5669-4a95-a578-188a3c60833c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm"
Jul 29 00:41:26.224107 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.224093    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51a02f62-5669-4a95-a578-188a3c60833c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm\" (UID: \"51a02f62-5669-4a95-a578-188a3c60833c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm"
Jul 29 00:41:26.224198 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.224150    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51a02f62-5669-4a95-a578-188a3c60833c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm\" (UID: \"51a02f62-5669-4a95-a578-188a3c60833c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm"
Jul 29 00:41:26.224198 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.224177    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51a02f62-5669-4a95-a578-188a3c60833c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm\" (UID: \"51a02f62-5669-4a95-a578-188a3c60833c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm"
Jul 29 00:41:26.224198 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.224194    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6l7r\" (UniqueName: \"kubernetes.io/projected/51a02f62-5669-4a95-a578-188a3c60833c-kube-api-access-x6l7r\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm\" (UID: \"51a02f62-5669-4a95-a578-188a3c60833c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm"
Jul 29 00:41:26.224289 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.224222    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51a02f62-5669-4a95-a578-188a3c60833c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm\" (UID: \"51a02f62-5669-4a95-a578-188a3c60833c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm"
Jul 29 00:41:26.267864 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.267834    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8"]
Jul 29 00:41:26.271134 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.271113    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8"
Jul 29 00:41:26.311921 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.311885    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8"]
Jul 29 00:41:26.324729 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.324694    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51a02f62-5669-4a95-a578-188a3c60833c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm\" (UID: \"51a02f62-5669-4a95-a578-188a3c60833c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm"
Jul 29 00:41:26.324897 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.324735    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51a02f62-5669-4a95-a578-188a3c60833c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm\" (UID: \"51a02f62-5669-4a95-a578-188a3c60833c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm"
Jul 29 00:41:26.324897 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.324753    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51a02f62-5669-4a95-a578-188a3c60833c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm\" (UID: \"51a02f62-5669-4a95-a578-188a3c60833c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm"
Jul 29 00:41:26.324897 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.324771    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6l7r\" (UniqueName: \"kubernetes.io/projected/51a02f62-5669-4a95-a578-188a3c60833c-kube-api-access-x6l7r\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm\" (UID: \"51a02f62-5669-4a95-a578-188a3c60833c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm"
Jul 29 00:41:26.324897 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.324798    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51a02f62-5669-4a95-a578-188a3c60833c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm\" (UID: \"51a02f62-5669-4a95-a578-188a3c60833c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm"
Jul 29 00:41:26.325098 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.324915    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e518a241-e1d6-4dcd-94cd-8fa60ae3e311-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8\" (UID: \"e518a241-e1d6-4dcd-94cd-8fa60ae3e311\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8"
Jul 29 00:41:26.325098 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.324957    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e518a241-e1d6-4dcd-94cd-8fa60ae3e311-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8\" (UID: \"e518a241-e1d6-4dcd-94cd-8fa60ae3e311\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8"
Jul 29 00:41:26.325098 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.325001    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e518a241-e1d6-4dcd-94cd-8fa60ae3e311-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8\" (UID: \"e518a241-e1d6-4dcd-94cd-8fa60ae3e311\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8"
Jul 29 00:41:26.325098 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.325054    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e518a241-e1d6-4dcd-94cd-8fa60ae3e311-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8\" (UID: \"e518a241-e1d6-4dcd-94cd-8fa60ae3e311\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8"
Jul 29 00:41:26.325268 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.325106    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51a02f62-5669-4a95-a578-188a3c60833c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm\" (UID: \"51a02f62-5669-4a95-a578-188a3c60833c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm"
Jul 29 00:41:26.325268 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.325133    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51a02f62-5669-4a95-a578-188a3c60833c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm\" (UID: \"51a02f62-5669-4a95-a578-188a3c60833c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm"
Jul 29 00:41:26.325268 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.325170    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hmmb\" (UniqueName: \"kubernetes.io/projected/e518a241-e1d6-4dcd-94cd-8fa60ae3e311-kube-api-access-2hmmb\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8\" (UID: \"e518a241-e1d6-4dcd-94cd-8fa60ae3e311\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8"
Jul 29 00:41:26.325268 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.325190    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51a02f62-5669-4a95-a578-188a3c60833c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm\" (UID: \"51a02f62-5669-4a95-a578-188a3c60833c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm"
Jul 29 00:41:26.325268 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.325199    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e518a241-e1d6-4dcd-94cd-8fa60ae3e311-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8\" (UID: \"e518a241-e1d6-4dcd-94cd-8fa60ae3e311\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8"
Jul 29 00:41:26.325268 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.325221    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51a02f62-5669-4a95-a578-188a3c60833c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm\" (UID: \"51a02f62-5669-4a95-a578-188a3c60833c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm"
Jul 29 00:41:26.325268 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.325260    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e518a241-e1d6-4dcd-94cd-8fa60ae3e311-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8\" (UID: \"e518a241-e1d6-4dcd-94cd-8fa60ae3e311\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8"
Jul 29 00:41:26.325575 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.325290    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e518a241-e1d6-4dcd-94cd-8fa60ae3e311-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8\" (UID: \"e518a241-e1d6-4dcd-94cd-8fa60ae3e311\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8"
Jul 29 00:41:26.325575 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.325342    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51a02f62-5669-4a95-a578-188a3c60833c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm\" (UID: \"51a02f62-5669-4a95-a578-188a3c60833c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm"
Jul 29 00:41:26.325575 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.325363    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e518a241-e1d6-4dcd-94cd-8fa60ae3e311-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8\" (UID: \"e518a241-e1d6-4dcd-94cd-8fa60ae3e311\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8"
Jul 29 00:41:26.325575 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.325368    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51a02f62-5669-4a95-a578-188a3c60833c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm\" (UID: \"51a02f62-5669-4a95-a578-188a3c60833c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm"
Jul 29 00:41:26.325575 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.325399    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51a02f62-5669-4a95-a578-188a3c60833c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm\" (UID: \"51a02f62-5669-4a95-a578-188a3c60833c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm"
Jul 29 00:41:26.325575 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.325522    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51a02f62-5669-4a95-a578-188a3c60833c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm\" (UID: \"51a02f62-5669-4a95-a578-188a3c60833c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm"
Jul 29 00:41:26.325784 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.325694    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51a02f62-5669-4a95-a578-188a3c60833c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm\" (UID: \"51a02f62-5669-4a95-a578-188a3c60833c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm"
Jul 29 00:41:26.327405 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.327373    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51a02f62-5669-4a95-a578-188a3c60833c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm\" (UID: \"51a02f62-5669-4a95-a578-188a3c60833c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm"
Jul 29 00:41:26.327660 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.327643    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51a02f62-5669-4a95-a578-188a3c60833c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm\" (UID: \"51a02f62-5669-4a95-a578-188a3c60833c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm"
Jul 29 00:41:26.335508 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.335488    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51a02f62-5669-4a95-a578-188a3c60833c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm\" (UID: \"51a02f62-5669-4a95-a578-188a3c60833c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm"
Jul 29 00:41:26.339353 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.339330    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6l7r\" (UniqueName: \"kubernetes.io/projected/51a02f62-5669-4a95-a578-188a3c60833c-kube-api-access-x6l7r\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm\" (UID: \"51a02f62-5669-4a95-a578-188a3c60833c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm"
Jul 29 00:41:26.426155 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.426117    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hmmb\" (UniqueName: \"kubernetes.io/projected/e518a241-e1d6-4dcd-94cd-8fa60ae3e311-kube-api-access-2hmmb\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8\" (UID: \"e518a241-e1d6-4dcd-94cd-8fa60ae3e311\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8"
Jul 29 00:41:26.426155 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.426154    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e518a241-e1d6-4dcd-94cd-8fa60ae3e311-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8\" (UID: \"e518a241-e1d6-4dcd-94cd-8fa60ae3e311\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8"
Jul 29 00:41:26.426366 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.426173    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e518a241-e1d6-4dcd-94cd-8fa60ae3e311-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8\" (UID: \"e518a241-e1d6-4dcd-94cd-8fa60ae3e311\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8"
Jul 29 00:41:26.426366 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.426191    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e518a241-e1d6-4dcd-94cd-8fa60ae3e311-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8\" (UID: \"e518a241-e1d6-4dcd-94cd-8fa60ae3e311\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8"
Jul 29 00:41:26.426366 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.426217    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e518a241-e1d6-4dcd-94cd-8fa60ae3e311-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8\" (UID: \"e518a241-e1d6-4dcd-94cd-8fa60ae3e311\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8"
Jul 29 00:41:26.426366 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.426278    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e518a241-e1d6-4dcd-94cd-8fa60ae3e311-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8\" (UID: \"e518a241-e1d6-4dcd-94cd-8fa60ae3e311\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8"
Jul 29 00:41:26.426366 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.426348    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e518a241-e1d6-4dcd-94cd-8fa60ae3e311-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8\" (UID: \"e518a241-e1d6-4dcd-94cd-8fa60ae3e311\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8"
Jul 29 00:41:26.426631 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.426368    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e518a241-e1d6-4dcd-94cd-8fa60ae3e311-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8\" (UID: \"e518a241-e1d6-4dcd-94cd-8fa60ae3e311\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8"
Jul 29 00:41:26.426631 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.426391    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e518a241-e1d6-4dcd-94cd-8fa60ae3e311-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8\" (UID: \"e518a241-e1d6-4dcd-94cd-8fa60ae3e311\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8"
Jul 29 00:41:26.426856 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.426832    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e518a241-e1d6-4dcd-94cd-8fa60ae3e311-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8\" (UID: \"e518a241-e1d6-4dcd-94cd-8fa60ae3e311\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8"
Jul 29 00:41:26.426971 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.426947    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e518a241-e1d6-4dcd-94cd-8fa60ae3e311-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8\" (UID: \"e518a241-e1d6-4dcd-94cd-8fa60ae3e311\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8"
Jul 29 00:41:26.427070 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.426882    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e518a241-e1d6-4dcd-94cd-8fa60ae3e311-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8\" (UID: \"e518a241-e1d6-4dcd-94cd-8fa60ae3e311\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8"
Jul 29 00:41:26.427070 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.426837    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e518a241-e1d6-4dcd-94cd-8fa60ae3e311-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8\" (UID: \"e518a241-e1d6-4dcd-94cd-8fa60ae3e311\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8"
Jul 29 00:41:26.427160 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.427065    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e518a241-e1d6-4dcd-94cd-8fa60ae3e311-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8\" (UID: \"e518a241-e1d6-4dcd-94cd-8fa60ae3e311\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8"
Jul 29 00:41:26.429020 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.429000    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e518a241-e1d6-4dcd-94cd-8fa60ae3e311-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8\" (UID: \"e518a241-e1d6-4dcd-94cd-8fa60ae3e311\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8"
Jul 29 00:41:26.429209 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.429192    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e518a241-e1d6-4dcd-94cd-8fa60ae3e311-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8\" (UID: \"e518a241-e1d6-4dcd-94cd-8fa60ae3e311\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8"
Jul 29 00:41:26.448794 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.448733    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e518a241-e1d6-4dcd-94cd-8fa60ae3e311-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8\" (UID: \"e518a241-e1d6-4dcd-94cd-8fa60ae3e311\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8"
Jul 29 00:41:26.448794 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.448781    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hmmb\" (UniqueName: \"kubernetes.io/projected/e518a241-e1d6-4dcd-94cd-8fa60ae3e311-kube-api-access-2hmmb\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8\" (UID: \"e518a241-e1d6-4dcd-94cd-8fa60ae3e311\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8"
Jul 29 00:41:26.500397 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.500366    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm"
Jul 29 00:41:26.583054 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.583021    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8"
Jul 29 00:41:26.645564 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.645050    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm"]
Jul 29 00:41:26.651080 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:41:26.650718    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51a02f62_5669_4a95_a578_188a3c60833c.slice/crio-8c5470fd824c180aad2ba46c0d4eea1f768af96e56c806c42c2aafd11ae6ec3e WatchSource:0}: Error finding container 8c5470fd824c180aad2ba46c0d4eea1f768af96e56c806c42c2aafd11ae6ec3e: Status 404 returned error can't find the container with id 8c5470fd824c180aad2ba46c0d4eea1f768af96e56c806c42c2aafd11ae6ec3e
Jul 29 00:41:26.687544 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.687509    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm" event={"ID":"51a02f62-5669-4a95-a578-188a3c60833c","Type":"ContainerStarted","Data":"8c5470fd824c180aad2ba46c0d4eea1f768af96e56c806c42c2aafd11ae6ec3e"}
Jul 29 00:41:26.726417 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:26.726387    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8"]
Jul 29 00:41:26.728817 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:41:26.728786    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode518a241_e1d6_4dcd_94cd_8fa60ae3e311.slice/crio-26f4d4423207a8edce16c35db495abfc417db7fed81109a9044e0a918ba9f2c3 WatchSource:0}: Error finding container 26f4d4423207a8edce16c35db495abfc417db7fed81109a9044e0a918ba9f2c3: Status 404 returned error can't find the container with id 26f4d4423207a8edce16c35db495abfc417db7fed81109a9044e0a918ba9f2c3
Jul 29 00:41:27.694018 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:27.693976    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8" event={"ID":"e518a241-e1d6-4dcd-94cd-8fa60ae3e311","Type":"ContainerStarted","Data":"26f4d4423207a8edce16c35db495abfc417db7fed81109a9044e0a918ba9f2c3"}
Jul 29 00:41:28.587942 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:28.587906    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-896f4944f-bk8hf"]
Jul 29 00:41:28.591730 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:28.591683    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-896f4944f-bk8hf"
Jul 29 00:41:28.594819 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:28.594794    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 29 00:41:28.595045 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:28.595016    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 29 00:41:28.595620 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:28.595595    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 29 00:41:28.596022 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:28.596000    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-pg7r9\""
Jul 29 00:41:28.604779 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:28.604711    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-896f4944f-bk8hf"]
Jul 29 00:41:28.653700 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:28.653652    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d27609d6-83a3-4c8b-8980-8b7a7795550f-metrics-cert\") pod \"lws-controller-manager-896f4944f-bk8hf\" (UID: \"d27609d6-83a3-4c8b-8980-8b7a7795550f\") " pod="openshift-lws-operator/lws-controller-manager-896f4944f-bk8hf"
Jul 29 00:41:28.653908 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:28.653714    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d27609d6-83a3-4c8b-8980-8b7a7795550f-manager-config\") pod \"lws-controller-manager-896f4944f-bk8hf\" (UID: \"d27609d6-83a3-4c8b-8980-8b7a7795550f\") " pod="openshift-lws-operator/lws-controller-manager-896f4944f-bk8hf"
Jul 29 00:41:28.653908 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:28.653789    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whzzx\" (UniqueName: \"kubernetes.io/projected/d27609d6-83a3-4c8b-8980-8b7a7795550f-kube-api-access-whzzx\") pod \"lws-controller-manager-896f4944f-bk8hf\" (UID: \"d27609d6-83a3-4c8b-8980-8b7a7795550f\") " pod="openshift-lws-operator/lws-controller-manager-896f4944f-bk8hf"
Jul 29 00:41:28.653908 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:28.653840    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d27609d6-83a3-4c8b-8980-8b7a7795550f-cert\") pod \"lws-controller-manager-896f4944f-bk8hf\" (UID: \"d27609d6-83a3-4c8b-8980-8b7a7795550f\") " pod="openshift-lws-operator/lws-controller-manager-896f4944f-bk8hf"
Jul 29 00:41:28.754905 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:28.754863    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whzzx\" (UniqueName: \"kubernetes.io/projected/d27609d6-83a3-4c8b-8980-8b7a7795550f-kube-api-access-whzzx\") pod \"lws-controller-manager-896f4944f-bk8hf\" (UID: \"d27609d6-83a3-4c8b-8980-8b7a7795550f\") " pod="openshift-lws-operator/lws-controller-manager-896f4944f-bk8hf"
Jul 29 00:41:28.755360 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:28.754950    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d27609d6-83a3-4c8b-8980-8b7a7795550f-cert\") pod \"lws-controller-manager-896f4944f-bk8hf\" (UID: \"d27609d6-83a3-4c8b-8980-8b7a7795550f\") " pod="openshift-lws-operator/lws-controller-manager-896f4944f-bk8hf"
Jul 29 00:41:28.755360 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:28.755031    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d27609d6-83a3-4c8b-8980-8b7a7795550f-metrics-cert\") pod \"lws-controller-manager-896f4944f-bk8hf\" (UID: \"d27609d6-83a3-4c8b-8980-8b7a7795550f\") " pod="openshift-lws-operator/lws-controller-manager-896f4944f-bk8hf"
Jul 29 00:41:28.755360 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:28.755072    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d27609d6-83a3-4c8b-8980-8b7a7795550f-manager-config\") pod \"lws-controller-manager-896f4944f-bk8hf\" (UID: \"d27609d6-83a3-4c8b-8980-8b7a7795550f\") " pod="openshift-lws-operator/lws-controller-manager-896f4944f-bk8hf"
Jul 29 00:41:28.756025 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:28.755999    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d27609d6-83a3-4c8b-8980-8b7a7795550f-manager-config\") pod \"lws-controller-manager-896f4944f-bk8hf\" (UID: \"d27609d6-83a3-4c8b-8980-8b7a7795550f\") " pod="openshift-lws-operator/lws-controller-manager-896f4944f-bk8hf"
Jul 29 00:41:28.758983 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:28.758922    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d27609d6-83a3-4c8b-8980-8b7a7795550f-metrics-cert\") pod \"lws-controller-manager-896f4944f-bk8hf\" (UID: \"d27609d6-83a3-4c8b-8980-8b7a7795550f\") " pod="openshift-lws-operator/lws-controller-manager-896f4944f-bk8hf"
Jul 29 00:41:28.758983 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:28.758922    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d27609d6-83a3-4c8b-8980-8b7a7795550f-cert\") pod \"lws-controller-manager-896f4944f-bk8hf\" (UID: \"d27609d6-83a3-4c8b-8980-8b7a7795550f\") " pod="openshift-lws-operator/lws-controller-manager-896f4944f-bk8hf"
Jul 29 00:41:28.765685 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:28.765635    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whzzx\" (UniqueName: \"kubernetes.io/projected/d27609d6-83a3-4c8b-8980-8b7a7795550f-kube-api-access-whzzx\") pod \"lws-controller-manager-896f4944f-bk8hf\" (UID: \"d27609d6-83a3-4c8b-8980-8b7a7795550f\") " pod="openshift-lws-operator/lws-controller-manager-896f4944f-bk8hf"
Jul 29 00:41:28.908033 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:28.907941    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-896f4944f-bk8hf"
Jul 29 00:41:29.099675 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:29.099628    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-896f4944f-bk8hf"]
Jul 29 00:41:29.973848 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:41:29.973814    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd27609d6_83a3_4c8b_8980_8b7a7795550f.slice/crio-28c018e07f7d20de50fdbf2a73a012926c0c8e768532f17225ff8a892497e39c WatchSource:0}: Error finding container 28c018e07f7d20de50fdbf2a73a012926c0c8e768532f17225ff8a892497e39c: Status 404 returned error can't find the container with id 28c018e07f7d20de50fdbf2a73a012926c0c8e768532f17225ff8a892497e39c
Jul 29 00:41:30.056112 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:30.056064    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 29 00:41:30.056262 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:30.056159    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 29 00:41:30.056262 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:30.056200    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 29 00:41:30.063222 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:30.063191    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 29 00:41:30.063316 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:30.063258    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 29 00:41:30.063316 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:30.063289    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 29 00:41:30.710739 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:30.710700    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm" event={"ID":"51a02f62-5669-4a95-a578-188a3c60833c","Type":"ContainerStarted","Data":"13564fd6f3828ef1e66e3442cbea1c0577f59f409a4d5050a73ae2cb106e63c5"}
Jul 29 00:41:30.712306 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:30.712280    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8" event={"ID":"e518a241-e1d6-4dcd-94cd-8fa60ae3e311","Type":"ContainerStarted","Data":"639ab9c80fb01c1d1fcb516675285f8be31c7f4e73b736e70e8563aeb5e6b265"}
Jul 29 00:41:30.713405 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:30.713378    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-896f4944f-bk8hf" event={"ID":"d27609d6-83a3-4c8b-8980-8b7a7795550f","Type":"ContainerStarted","Data":"28c018e07f7d20de50fdbf2a73a012926c0c8e768532f17225ff8a892497e39c"}
Jul 29 00:41:30.738305 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:30.738253    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm" podStartSLOduration=1.329447549 podStartE2EDuration="4.738235073s" totalImagesPullingTime="3.408787524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:41:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:41:30.737029366 +0000 UTC m=+316.881486957" watchObservedRunningTime="2026-07-29 00:41:30.738235073 +0000 UTC m=+316.882692642"
Jul 29 00:41:30.762115 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:30.761963    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8" podStartSLOduration=1.436929167 podStartE2EDuration="4.761944812s" totalImagesPullingTime="3.325015645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:41:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:41:30.760822472 +0000 UTC m=+316.905280042" watchObservedRunningTime="2026-07-29 00:41:30.761944812 +0000 UTC m=+316.906402382"
Jul 29 00:41:31.500567 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:31.500528    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm"
Jul 29 00:41:31.502138 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:31.502108    2577 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.19:15021/healthz/ready\": dial tcp 10.134.0.19:15021: connect: connection refused" start-of-body=
Jul 29 00:41:31.502249 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:31.502174    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm" podUID="51a02f62-5669-4a95-a578-188a3c60833c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.19:15021/healthz/ready\": dial tcp 10.134.0.19:15021: connect: connection refused"
Jul 29 00:41:31.583801 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:31.583771    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8"
Jul 29 00:41:31.588388 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:31.588366    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8"
Jul 29 00:41:31.718641 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:31.718613    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8"
Jul 29 00:41:31.719544 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:31.719525    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8"
Jul 29 00:41:31.825339 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:31.825304    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm"]
Jul 29 00:41:32.501085 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:32.501046    2577 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.19:15021/healthz/ready\": dial tcp 10.134.0.19:15021: connect: connection refused" start-of-body=
Jul 29 00:41:32.501469 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:32.501105    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm" podUID="51a02f62-5669-4a95-a578-188a3c60833c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.19:15021/healthz/ready\": dial tcp 10.134.0.19:15021: connect: connection refused"
Jul 29 00:41:33.501341 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:33.501246    2577 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.19:15021/healthz/ready\": dial tcp 10.134.0.19:15021: connect: connection refused" start-of-body=
Jul 29 00:41:33.501341 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:33.501305    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm" podUID="51a02f62-5669-4a95-a578-188a3c60833c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.19:15021/healthz/ready\": dial tcp 10.134.0.19:15021: connect: connection refused"
Jul 29 00:41:33.729305 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:33.729261    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-896f4944f-bk8hf" event={"ID":"d27609d6-83a3-4c8b-8980-8b7a7795550f","Type":"ContainerStarted","Data":"213a6b030325675b22b367d8f12a77b9b94a3d83208f78908066f3f9783881ae"}
Jul 29 00:41:33.729489 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:33.729441    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-896f4944f-bk8hf"
Jul 29 00:41:33.729489 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:33.729456    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm" podUID="51a02f62-5669-4a95-a578-188a3c60833c" containerName="istio-proxy" containerID="cri-o://13564fd6f3828ef1e66e3442cbea1c0577f59f409a4d5050a73ae2cb106e63c5" gracePeriod=30
Jul 29 00:41:33.758674 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:33.758546    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-896f4944f-bk8hf" podStartSLOduration=2.5031704120000002 podStartE2EDuration="5.758529385s" totalImagesPullingTime="3.255358973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:41:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:41:33.756187388 +0000 UTC m=+319.900644958" watchObservedRunningTime="2026-07-29 00:41:33.758529385 +0000 UTC m=+319.902986954"
Jul 29 00:41:38.969664 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:38.969639    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm"
Jul 29 00:41:39.052111 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:39.052019    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51a02f62-5669-4a95-a578-188a3c60833c-istio-podinfo\") pod \"51a02f62-5669-4a95-a578-188a3c60833c\" (UID: \"51a02f62-5669-4a95-a578-188a3c60833c\") "
Jul 29 00:41:39.052111 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:39.052051    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51a02f62-5669-4a95-a578-188a3c60833c-istiod-ca-cert\") pod \"51a02f62-5669-4a95-a578-188a3c60833c\" (UID: \"51a02f62-5669-4a95-a578-188a3c60833c\") "
Jul 29 00:41:39.052111 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:39.052101    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51a02f62-5669-4a95-a578-188a3c60833c-istio-envoy\") pod \"51a02f62-5669-4a95-a578-188a3c60833c\" (UID: \"51a02f62-5669-4a95-a578-188a3c60833c\") "
Jul 29 00:41:39.052381 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:39.052121    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51a02f62-5669-4a95-a578-188a3c60833c-workload-socket\") pod \"51a02f62-5669-4a95-a578-188a3c60833c\" (UID: \"51a02f62-5669-4a95-a578-188a3c60833c\") "
Jul 29 00:41:39.052381 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:39.052137    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51a02f62-5669-4a95-a578-188a3c60833c-istio-token\") pod \"51a02f62-5669-4a95-a578-188a3c60833c\" (UID: \"51a02f62-5669-4a95-a578-188a3c60833c\") "
Jul 29 00:41:39.052381 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:39.052174    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51a02f62-5669-4a95-a578-188a3c60833c-workload-certs\") pod \"51a02f62-5669-4a95-a578-188a3c60833c\" (UID: \"51a02f62-5669-4a95-a578-188a3c60833c\") "
Jul 29 00:41:39.052381 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:39.052199    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51a02f62-5669-4a95-a578-188a3c60833c-credential-socket\") pod \"51a02f62-5669-4a95-a578-188a3c60833c\" (UID: \"51a02f62-5669-4a95-a578-188a3c60833c\") "
Jul 29 00:41:39.052381 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:39.052257    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51a02f62-5669-4a95-a578-188a3c60833c-istio-data\") pod \"51a02f62-5669-4a95-a578-188a3c60833c\" (UID: \"51a02f62-5669-4a95-a578-188a3c60833c\") "
Jul 29 00:41:39.052381 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:39.052303    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6l7r\" (UniqueName: \"kubernetes.io/projected/51a02f62-5669-4a95-a578-188a3c60833c-kube-api-access-x6l7r\") pod \"51a02f62-5669-4a95-a578-188a3c60833c\" (UID: \"51a02f62-5669-4a95-a578-188a3c60833c\") "
Jul 29 00:41:39.052703 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:39.052497    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51a02f62-5669-4a95-a578-188a3c60833c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "51a02f62-5669-4a95-a578-188a3c60833c" (UID: "51a02f62-5669-4a95-a578-188a3c60833c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:41:39.052703 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:39.052520    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51a02f62-5669-4a95-a578-188a3c60833c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "51a02f62-5669-4a95-a578-188a3c60833c" (UID: "51a02f62-5669-4a95-a578-188a3c60833c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:41:39.052806 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:39.052737    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51a02f62-5669-4a95-a578-188a3c60833c-workload-socket\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 00:41:39.052806 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:39.052757    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51a02f62-5669-4a95-a578-188a3c60833c-workload-certs\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 00:41:39.052806 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:39.052780    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51a02f62-5669-4a95-a578-188a3c60833c-istio-data" (OuterVolumeSpecName: "istio-data") pod "51a02f62-5669-4a95-a578-188a3c60833c" (UID: "51a02f62-5669-4a95-a578-188a3c60833c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:41:39.052806 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:39.052795    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51a02f62-5669-4a95-a578-188a3c60833c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "51a02f62-5669-4a95-a578-188a3c60833c" (UID: "51a02f62-5669-4a95-a578-188a3c60833c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:41:39.052985 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:39.052967    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51a02f62-5669-4a95-a578-188a3c60833c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "51a02f62-5669-4a95-a578-188a3c60833c" (UID: "51a02f62-5669-4a95-a578-188a3c60833c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 00:41:39.054550 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:39.054519    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/51a02f62-5669-4a95-a578-188a3c60833c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "51a02f62-5669-4a95-a578-188a3c60833c" (UID: "51a02f62-5669-4a95-a578-188a3c60833c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 00:41:39.054550 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:39.054538    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51a02f62-5669-4a95-a578-188a3c60833c-kube-api-access-x6l7r" (OuterVolumeSpecName: "kube-api-access-x6l7r") pod "51a02f62-5669-4a95-a578-188a3c60833c" (UID: "51a02f62-5669-4a95-a578-188a3c60833c"). InnerVolumeSpecName "kube-api-access-x6l7r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:41:39.054767 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:39.054748    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51a02f62-5669-4a95-a578-188a3c60833c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "51a02f62-5669-4a95-a578-188a3c60833c" (UID: "51a02f62-5669-4a95-a578-188a3c60833c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:41:39.054833 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:39.054815    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51a02f62-5669-4a95-a578-188a3c60833c-istio-token" (OuterVolumeSpecName: "istio-token") pod "51a02f62-5669-4a95-a578-188a3c60833c" (UID: "51a02f62-5669-4a95-a578-188a3c60833c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:41:39.153849 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:39.153810    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51a02f62-5669-4a95-a578-188a3c60833c-credential-socket\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 00:41:39.153849 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:39.153843    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51a02f62-5669-4a95-a578-188a3c60833c-istio-data\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 00:41:39.153849 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:39.153854    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6l7r\" (UniqueName: \"kubernetes.io/projected/51a02f62-5669-4a95-a578-188a3c60833c-kube-api-access-x6l7r\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 00:41:39.154079 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:39.153863    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51a02f62-5669-4a95-a578-188a3c60833c-istio-podinfo\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 00:41:39.154079 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:39.153871    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51a02f62-5669-4a95-a578-188a3c60833c-istiod-ca-cert\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 00:41:39.154079 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:39.153883    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51a02f62-5669-4a95-a578-188a3c60833c-istio-envoy\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 00:41:39.154079 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:39.153890    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51a02f62-5669-4a95-a578-188a3c60833c-istio-token\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 00:41:39.763959 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:39.763918    2577 generic.go:356] "Generic (PLEG): container finished" podID="51a02f62-5669-4a95-a578-188a3c60833c" containerID="13564fd6f3828ef1e66e3442cbea1c0577f59f409a4d5050a73ae2cb106e63c5" exitCode=0
Jul 29 00:41:39.764288 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:39.764266    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm" event={"ID":"51a02f62-5669-4a95-a578-188a3c60833c","Type":"ContainerDied","Data":"13564fd6f3828ef1e66e3442cbea1c0577f59f409a4d5050a73ae2cb106e63c5"}
Jul 29 00:41:39.764483 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:39.764467    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm" event={"ID":"51a02f62-5669-4a95-a578-188a3c60833c","Type":"ContainerDied","Data":"8c5470fd824c180aad2ba46c0d4eea1f768af96e56c806c42c2aafd11ae6ec3e"}
Jul 29 00:41:39.764639 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:39.764626    2577 scope.go:117] "RemoveContainer" containerID="13564fd6f3828ef1e66e3442cbea1c0577f59f409a4d5050a73ae2cb106e63c5"
Jul 29 00:41:39.765143 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:39.765125    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm"
Jul 29 00:41:39.774065 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:39.774045    2577 scope.go:117] "RemoveContainer" containerID="13564fd6f3828ef1e66e3442cbea1c0577f59f409a4d5050a73ae2cb106e63c5"
Jul 29 00:41:39.774352 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:41:39.774329    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13564fd6f3828ef1e66e3442cbea1c0577f59f409a4d5050a73ae2cb106e63c5\": container with ID starting with 13564fd6f3828ef1e66e3442cbea1c0577f59f409a4d5050a73ae2cb106e63c5 not found: ID does not exist" containerID="13564fd6f3828ef1e66e3442cbea1c0577f59f409a4d5050a73ae2cb106e63c5"
Jul 29 00:41:39.774406 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:39.774361    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13564fd6f3828ef1e66e3442cbea1c0577f59f409a4d5050a73ae2cb106e63c5"} err="failed to get container status \"13564fd6f3828ef1e66e3442cbea1c0577f59f409a4d5050a73ae2cb106e63c5\": rpc error: code = NotFound desc = could not find container \"13564fd6f3828ef1e66e3442cbea1c0577f59f409a4d5050a73ae2cb106e63c5\": container with ID starting with 13564fd6f3828ef1e66e3442cbea1c0577f59f409a4d5050a73ae2cb106e63c5 not found: ID does not exist"
Jul 29 00:41:39.786482 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:39.786456    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm"]
Jul 29 00:41:39.789693 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:39.789669    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8v8lm"]
Jul 29 00:41:40.303721 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:40.303689    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51a02f62-5669-4a95-a578-188a3c60833c" path="/var/lib/kubelet/pods/51a02f62-5669-4a95-a578-188a3c60833c/volumes"
Jul 29 00:41:44.737947 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:41:44.737918    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-896f4944f-bk8hf"
Jul 29 00:43:04.081067 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:04.081026    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-vgb6g"]
Jul 29 00:43:04.081538 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:04.081376    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51a02f62-5669-4a95-a578-188a3c60833c" containerName="istio-proxy"
Jul 29 00:43:04.081538 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:04.081387    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="51a02f62-5669-4a95-a578-188a3c60833c" containerName="istio-proxy"
Jul 29 00:43:04.081538 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:04.081453    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="51a02f62-5669-4a95-a578-188a3c60833c" containerName="istio-proxy"
Jul 29 00:43:04.084591 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:04.084562    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vgb6g"
Jul 29 00:43:04.087170 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:04.087122    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 29 00:43:04.087403 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:04.087383    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 29 00:43:04.087495 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:04.087396    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 29 00:43:04.087495 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:04.087458    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-frtpm\""
Jul 29 00:43:04.087612 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:04.087495    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 29 00:43:04.093296 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:04.093275    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-vgb6g"]
Jul 29 00:43:04.225999 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:04.225957    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j24xp\" (UniqueName: \"kubernetes.io/projected/bfe92e94-9165-46c0-b80e-0a6e88a3b493-kube-api-access-j24xp\") pod \"kuadrant-console-plugin-66b5774985-vgb6g\" (UID: \"bfe92e94-9165-46c0-b80e-0a6e88a3b493\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vgb6g"
Jul 29 00:43:04.225999 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:04.226001    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bfe92e94-9165-46c0-b80e-0a6e88a3b493-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-vgb6g\" (UID: \"bfe92e94-9165-46c0-b80e-0a6e88a3b493\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vgb6g"
Jul 29 00:43:04.226219 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:04.226092    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfe92e94-9165-46c0-b80e-0a6e88a3b493-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-vgb6g\" (UID: \"bfe92e94-9165-46c0-b80e-0a6e88a3b493\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vgb6g"
Jul 29 00:43:04.327572 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:04.327532    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j24xp\" (UniqueName: \"kubernetes.io/projected/bfe92e94-9165-46c0-b80e-0a6e88a3b493-kube-api-access-j24xp\") pod \"kuadrant-console-plugin-66b5774985-vgb6g\" (UID: \"bfe92e94-9165-46c0-b80e-0a6e88a3b493\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vgb6g"
Jul 29 00:43:04.327572 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:04.327573    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bfe92e94-9165-46c0-b80e-0a6e88a3b493-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-vgb6g\" (UID: \"bfe92e94-9165-46c0-b80e-0a6e88a3b493\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vgb6g"
Jul 29 00:43:04.327861 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:04.327652    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfe92e94-9165-46c0-b80e-0a6e88a3b493-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-vgb6g\" (UID: \"bfe92e94-9165-46c0-b80e-0a6e88a3b493\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vgb6g"
Jul 29 00:43:04.328306 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:04.328281    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bfe92e94-9165-46c0-b80e-0a6e88a3b493-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-vgb6g\" (UID: \"bfe92e94-9165-46c0-b80e-0a6e88a3b493\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vgb6g"
Jul 29 00:43:04.330040 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:04.330018    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfe92e94-9165-46c0-b80e-0a6e88a3b493-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-vgb6g\" (UID: \"bfe92e94-9165-46c0-b80e-0a6e88a3b493\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vgb6g"
Jul 29 00:43:04.339453 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:04.339398    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j24xp\" (UniqueName: \"kubernetes.io/projected/bfe92e94-9165-46c0-b80e-0a6e88a3b493-kube-api-access-j24xp\") pod \"kuadrant-console-plugin-66b5774985-vgb6g\" (UID: \"bfe92e94-9165-46c0-b80e-0a6e88a3b493\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vgb6g"
Jul 29 00:43:04.394357 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:04.394323    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vgb6g"
Jul 29 00:43:04.541351 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:04.541173    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-vgb6g"]
Jul 29 00:43:04.544045 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:43:04.544019    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbfe92e94_9165_46c0_b80e_0a6e88a3b493.slice/crio-506bea478a9d4503afdef5b9f9c08b9d8a0474de0377a3def22b6747d7736e34 WatchSource:0}: Error finding container 506bea478a9d4503afdef5b9f9c08b9d8a0474de0377a3def22b6747d7736e34: Status 404 returned error can't find the container with id 506bea478a9d4503afdef5b9f9c08b9d8a0474de0377a3def22b6747d7736e34
Jul 29 00:43:05.137659 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:05.137623    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vgb6g" event={"ID":"bfe92e94-9165-46c0-b80e-0a6e88a3b493","Type":"ContainerStarted","Data":"506bea478a9d4503afdef5b9f9c08b9d8a0474de0377a3def22b6747d7736e34"}
Jul 29 00:43:14.388961 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:14.388826    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pnfvd"]
Jul 29 00:43:14.428686 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:14.428641    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pnfvd"]
Jul 29 00:43:14.428870 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:14.428733    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pnfvd"
Jul 29 00:43:14.431045 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:14.431022    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-sq5mr\""
Jul 29 00:43:14.526683 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:14.526650    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4jgz\" (UniqueName: \"kubernetes.io/projected/69fb83d2-5d1a-4f5b-8fe3-cca9ebb1d063-kube-api-access-s4jgz\") pod \"kuadrant-operator-controller-manager-55467d9f7-pnfvd\" (UID: \"69fb83d2-5d1a-4f5b-8fe3-cca9ebb1d063\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pnfvd"
Jul 29 00:43:14.526852 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:14.526692    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/69fb83d2-5d1a-4f5b-8fe3-cca9ebb1d063-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-pnfvd\" (UID: \"69fb83d2-5d1a-4f5b-8fe3-cca9ebb1d063\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pnfvd"
Jul 29 00:43:14.627514 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:14.627471    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4jgz\" (UniqueName: \"kubernetes.io/projected/69fb83d2-5d1a-4f5b-8fe3-cca9ebb1d063-kube-api-access-s4jgz\") pod \"kuadrant-operator-controller-manager-55467d9f7-pnfvd\" (UID: \"69fb83d2-5d1a-4f5b-8fe3-cca9ebb1d063\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pnfvd"
Jul 29 00:43:14.627726 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:14.627521    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/69fb83d2-5d1a-4f5b-8fe3-cca9ebb1d063-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-pnfvd\" (UID: \"69fb83d2-5d1a-4f5b-8fe3-cca9ebb1d063\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pnfvd"
Jul 29 00:43:14.628005 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:14.627973    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/69fb83d2-5d1a-4f5b-8fe3-cca9ebb1d063-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-pnfvd\" (UID: \"69fb83d2-5d1a-4f5b-8fe3-cca9ebb1d063\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pnfvd"
Jul 29 00:43:14.636105 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:14.636075    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4jgz\" (UniqueName: \"kubernetes.io/projected/69fb83d2-5d1a-4f5b-8fe3-cca9ebb1d063-kube-api-access-s4jgz\") pod \"kuadrant-operator-controller-manager-55467d9f7-pnfvd\" (UID: \"69fb83d2-5d1a-4f5b-8fe3-cca9ebb1d063\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pnfvd"
Jul 29 00:43:14.741442 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:14.741355    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pnfvd"
Jul 29 00:43:14.787366 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:14.787329    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pnfvd"]
Jul 29 00:43:14.792986 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:14.792958    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pnfvd"]
Jul 29 00:43:14.821458 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:14.821424    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95kwt"]
Jul 29 00:43:14.828417 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:14.828393    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95kwt"
Jul 29 00:43:14.844052 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:14.844023    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95kwt"]
Jul 29 00:43:14.930359 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:14.930315    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcn84\" (UniqueName: \"kubernetes.io/projected/3ead9ddc-e9b6-454f-87b4-abb372d6f419-kube-api-access-tcn84\") pod \"kuadrant-operator-controller-manager-55467d9f7-95kwt\" (UID: \"3ead9ddc-e9b6-454f-87b4-abb372d6f419\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95kwt"
Jul 29 00:43:14.930527 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:14.930381    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ead9ddc-e9b6-454f-87b4-abb372d6f419-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-95kwt\" (UID: \"3ead9ddc-e9b6-454f-87b4-abb372d6f419\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95kwt"
Jul 29 00:43:15.031766 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:15.031682    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ead9ddc-e9b6-454f-87b4-abb372d6f419-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-95kwt\" (UID: \"3ead9ddc-e9b6-454f-87b4-abb372d6f419\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95kwt"
Jul 29 00:43:15.031918 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:15.031791    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcn84\" (UniqueName: \"kubernetes.io/projected/3ead9ddc-e9b6-454f-87b4-abb372d6f419-kube-api-access-tcn84\") pod \"kuadrant-operator-controller-manager-55467d9f7-95kwt\" (UID: \"3ead9ddc-e9b6-454f-87b4-abb372d6f419\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95kwt"
Jul 29 00:43:15.032178 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:15.032153    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ead9ddc-e9b6-454f-87b4-abb372d6f419-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-95kwt\" (UID: \"3ead9ddc-e9b6-454f-87b4-abb372d6f419\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95kwt"
Jul 29 00:43:15.040439 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:15.040407    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcn84\" (UniqueName: \"kubernetes.io/projected/3ead9ddc-e9b6-454f-87b4-abb372d6f419-kube-api-access-tcn84\") pod \"kuadrant-operator-controller-manager-55467d9f7-95kwt\" (UID: \"3ead9ddc-e9b6-454f-87b4-abb372d6f419\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95kwt"
Jul 29 00:43:15.143479 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:15.143441    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95kwt"
Jul 29 00:43:25.367831 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:25.367801    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95kwt"]
Jul 29 00:43:25.382809 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:43:25.382773    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ead9ddc_e9b6_454f_87b4_abb372d6f419.slice/crio-1868a5c32a1521106637e4d8e17f937cfeef12029b09386efb5b8a37d9f62fc7 WatchSource:0}: Error finding container 1868a5c32a1521106637e4d8e17f937cfeef12029b09386efb5b8a37d9f62fc7: Status 404 returned error can't find the container with id 1868a5c32a1521106637e4d8e17f937cfeef12029b09386efb5b8a37d9f62fc7
Jul 29 00:43:26.251932 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:26.251892    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95kwt" event={"ID":"3ead9ddc-e9b6-454f-87b4-abb372d6f419","Type":"ContainerStarted","Data":"1868a5c32a1521106637e4d8e17f937cfeef12029b09386efb5b8a37d9f62fc7"}
Jul 29 00:43:26.253299 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:26.253266    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vgb6g" event={"ID":"bfe92e94-9165-46c0-b80e-0a6e88a3b493","Type":"ContainerStarted","Data":"b63d4c5eb5eaf66fa330a622de359dd25a5cc2008d2e39f918f6dc7e5063b731"}
Jul 29 00:43:26.269854 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:26.269809    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vgb6g" podStartSLOduration=1.5027305690000001 podStartE2EDuration="22.269794108s" totalImagesPullingTime="20.767063539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:43:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:43:26.268356092 +0000 UTC m=+432.412813661" watchObservedRunningTime="2026-07-29 00:43:26.269794108 +0000 UTC m=+432.414251677"
Jul 29 00:43:27.766848 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:43:27.766806    2577 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-pnfvd_kuadrant-system_69fb83d2-5d1a-4f5b-8fe3-cca9ebb1d063_0(04598685fbf4c4e345c786617df136eb13437d38e86e91c3a38fc5db8b92806c): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-pnfvd to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 29 00:43:27.767153 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:43:27.766885    2577 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-pnfvd_kuadrant-system_69fb83d2-5d1a-4f5b-8fe3-cca9ebb1d063_0(04598685fbf4c4e345c786617df136eb13437d38e86e91c3a38fc5db8b92806c): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-pnfvd to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pnfvd"
Jul 29 00:43:28.264353 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:28.264323    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pnfvd"
Jul 29 00:43:28.266213 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:43:28.266183    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-pnfvd\" is forbidden: User \"system:node:ip-10-0-138-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-146.ec2.internal' and this object" podUID="69fb83d2-5d1a-4f5b-8fe3-cca9ebb1d063" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pnfvd"
Jul 29 00:43:28.295537 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:28.295506    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pnfvd"
Jul 29 00:43:28.297459 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:43:28.297417    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-pnfvd\" is forbidden: User \"system:node:ip-10-0-138-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-146.ec2.internal' and this object" podUID="69fb83d2-5d1a-4f5b-8fe3-cca9ebb1d063" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pnfvd"
Jul 29 00:43:28.355385 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:28.355347    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/69fb83d2-5d1a-4f5b-8fe3-cca9ebb1d063-extensions-socket-volume\") pod \"69fb83d2-5d1a-4f5b-8fe3-cca9ebb1d063\" (UID: \"69fb83d2-5d1a-4f5b-8fe3-cca9ebb1d063\") "
Jul 29 00:43:28.355385 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:28.355392    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4jgz\" (UniqueName: \"kubernetes.io/projected/69fb83d2-5d1a-4f5b-8fe3-cca9ebb1d063-kube-api-access-s4jgz\") pod \"69fb83d2-5d1a-4f5b-8fe3-cca9ebb1d063\" (UID: \"69fb83d2-5d1a-4f5b-8fe3-cca9ebb1d063\") "
Jul 29 00:43:28.355652 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:28.355620    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69fb83d2-5d1a-4f5b-8fe3-cca9ebb1d063-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "69fb83d2-5d1a-4f5b-8fe3-cca9ebb1d063" (UID: "69fb83d2-5d1a-4f5b-8fe3-cca9ebb1d063"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:43:28.355972 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:28.355900    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/69fb83d2-5d1a-4f5b-8fe3-cca9ebb1d063-extensions-socket-volume\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 00:43:28.357575 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:28.357548    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69fb83d2-5d1a-4f5b-8fe3-cca9ebb1d063-kube-api-access-s4jgz" (OuterVolumeSpecName: "kube-api-access-s4jgz") pod "69fb83d2-5d1a-4f5b-8fe3-cca9ebb1d063" (UID: "69fb83d2-5d1a-4f5b-8fe3-cca9ebb1d063"). InnerVolumeSpecName "kube-api-access-s4jgz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:43:28.456821 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:28.456790    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4jgz\" (UniqueName: \"kubernetes.io/projected/69fb83d2-5d1a-4f5b-8fe3-cca9ebb1d063-kube-api-access-s4jgz\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 00:43:29.269086 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:29.269052    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pnfvd"
Jul 29 00:43:29.270971 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:43:29.270937    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-pnfvd\" is forbidden: User \"system:node:ip-10-0-138-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-146.ec2.internal' and this object" podUID="69fb83d2-5d1a-4f5b-8fe3-cca9ebb1d063" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pnfvd"
Jul 29 00:43:29.277575 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:43:29.277545    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-pnfvd\" is forbidden: User \"system:node:ip-10-0-138-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-146.ec2.internal' and this object" podUID="69fb83d2-5d1a-4f5b-8fe3-cca9ebb1d063" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pnfvd"
Jul 29 00:43:30.278194 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:30.278164    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95kwt" event={"ID":"3ead9ddc-e9b6-454f-87b4-abb372d6f419","Type":"ContainerStarted","Data":"2700aade874b1d07f9c0a68a27a6b57c4838bcec6af084b8ed05238e585ed16d"}
Jul 29 00:43:30.278616 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:30.278235    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95kwt"
Jul 29 00:43:30.280034 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:43:30.280000    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-pnfvd\" is forbidden: User \"system:node:ip-10-0-138-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-146.ec2.internal' and this object" podUID="69fb83d2-5d1a-4f5b-8fe3-cca9ebb1d063" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pnfvd"
Jul 29 00:43:30.298780 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:30.298721    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95kwt" podStartSLOduration=11.916506448 podStartE2EDuration="16.298697691s" totalImagesPullingTime="4.382191243s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:43:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:43:30.296372028 +0000 UTC m=+436.440829609" watchObservedRunningTime="2026-07-29 00:43:30.298697691 +0000 UTC m=+436.443155262"
Jul 29 00:43:30.304703 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:30.304670    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69fb83d2-5d1a-4f5b-8fe3-cca9ebb1d063" path="/var/lib/kubelet/pods/69fb83d2-5d1a-4f5b-8fe3-cca9ebb1d063/volumes"
Jul 29 00:43:41.285166 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:41.285088    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95kwt"
Jul 29 00:43:53.360857 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:53.360823    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95kwt"]
Jul 29 00:43:53.361252 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:53.361074    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95kwt" podUID="3ead9ddc-e9b6-454f-87b4-abb372d6f419" containerName="manager" containerID="cri-o://2700aade874b1d07f9c0a68a27a6b57c4838bcec6af084b8ed05238e585ed16d" gracePeriod=10
Jul 29 00:43:53.599325 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:53.599295    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95kwt"
Jul 29 00:43:53.682456 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:53.682343    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ead9ddc-e9b6-454f-87b4-abb372d6f419-extensions-socket-volume\") pod \"3ead9ddc-e9b6-454f-87b4-abb372d6f419\" (UID: \"3ead9ddc-e9b6-454f-87b4-abb372d6f419\") "
Jul 29 00:43:53.682456 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:53.682406    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tcn84\" (UniqueName: \"kubernetes.io/projected/3ead9ddc-e9b6-454f-87b4-abb372d6f419-kube-api-access-tcn84\") pod \"3ead9ddc-e9b6-454f-87b4-abb372d6f419\" (UID: \"3ead9ddc-e9b6-454f-87b4-abb372d6f419\") "
Jul 29 00:43:53.682848 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:53.682821    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ead9ddc-e9b6-454f-87b4-abb372d6f419-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3ead9ddc-e9b6-454f-87b4-abb372d6f419" (UID: "3ead9ddc-e9b6-454f-87b4-abb372d6f419"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:43:53.684573 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:53.684540    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ead9ddc-e9b6-454f-87b4-abb372d6f419-kube-api-access-tcn84" (OuterVolumeSpecName: "kube-api-access-tcn84") pod "3ead9ddc-e9b6-454f-87b4-abb372d6f419" (UID: "3ead9ddc-e9b6-454f-87b4-abb372d6f419"). InnerVolumeSpecName "kube-api-access-tcn84". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:43:53.783924 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:53.783892    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcn84\" (UniqueName: \"kubernetes.io/projected/3ead9ddc-e9b6-454f-87b4-abb372d6f419-kube-api-access-tcn84\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 00:43:53.783924 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:53.783916    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ead9ddc-e9b6-454f-87b4-abb372d6f419-extensions-socket-volume\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 00:43:54.383301 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:54.383265    2577 generic.go:356] "Generic (PLEG): container finished" podID="3ead9ddc-e9b6-454f-87b4-abb372d6f419" containerID="2700aade874b1d07f9c0a68a27a6b57c4838bcec6af084b8ed05238e585ed16d" exitCode=0
Jul 29 00:43:54.383761 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:54.383310    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95kwt"
Jul 29 00:43:54.383761 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:54.383325    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95kwt" event={"ID":"3ead9ddc-e9b6-454f-87b4-abb372d6f419","Type":"ContainerDied","Data":"2700aade874b1d07f9c0a68a27a6b57c4838bcec6af084b8ed05238e585ed16d"}
Jul 29 00:43:54.383761 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:54.383371    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95kwt" event={"ID":"3ead9ddc-e9b6-454f-87b4-abb372d6f419","Type":"ContainerDied","Data":"1868a5c32a1521106637e4d8e17f937cfeef12029b09386efb5b8a37d9f62fc7"}
Jul 29 00:43:54.383761 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:54.383393    2577 scope.go:117] "RemoveContainer" containerID="2700aade874b1d07f9c0a68a27a6b57c4838bcec6af084b8ed05238e585ed16d"
Jul 29 00:43:54.392054 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:54.392031    2577 scope.go:117] "RemoveContainer" containerID="2700aade874b1d07f9c0a68a27a6b57c4838bcec6af084b8ed05238e585ed16d"
Jul 29 00:43:54.392308 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:43:54.392282    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2700aade874b1d07f9c0a68a27a6b57c4838bcec6af084b8ed05238e585ed16d\": container with ID starting with 2700aade874b1d07f9c0a68a27a6b57c4838bcec6af084b8ed05238e585ed16d not found: ID does not exist" containerID="2700aade874b1d07f9c0a68a27a6b57c4838bcec6af084b8ed05238e585ed16d"
Jul 29 00:43:54.392357 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:54.392318    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2700aade874b1d07f9c0a68a27a6b57c4838bcec6af084b8ed05238e585ed16d"} err="failed to get container status \"2700aade874b1d07f9c0a68a27a6b57c4838bcec6af084b8ed05238e585ed16d\": rpc error: code = NotFound desc = could not find container \"2700aade874b1d07f9c0a68a27a6b57c4838bcec6af084b8ed05238e585ed16d\": container with ID starting with 2700aade874b1d07f9c0a68a27a6b57c4838bcec6af084b8ed05238e585ed16d not found: ID does not exist"
Jul 29 00:43:54.403132 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:54.403102    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95kwt"]
Jul 29 00:43:54.411158 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:54.411126    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-95kwt"]
Jul 29 00:43:56.303221 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:43:56.303189    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ead9ddc-e9b6-454f-87b4-abb372d6f419" path="/var/lib/kubelet/pods/3ead9ddc-e9b6-454f-87b4-abb372d6f419/volumes"
Jul 29 00:44:02.398633 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:02.398597    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:44:02.399014 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:02.398939    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ead9ddc-e9b6-454f-87b4-abb372d6f419" containerName="manager"
Jul 29 00:44:02.399014 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:02.398950    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ead9ddc-e9b6-454f-87b4-abb372d6f419" containerName="manager"
Jul 29 00:44:02.399014 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:02.399007    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ead9ddc-e9b6-454f-87b4-abb372d6f419" containerName="manager"
Jul 29 00:44:02.453648 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:02.453598    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:44:02.453648 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:02.453643    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:44:02.453908 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:02.453721    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"
Jul 29 00:44:02.455824 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:02.455802    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 29 00:44:02.560560 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:02.560508    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grw59\" (UniqueName: \"kubernetes.io/projected/bdd22a18-a108-4e14-ac35-7dc2a03107cc-kube-api-access-grw59\") pod \"limitador-limitador-54d6d988d5-hw2xr\" (UID: \"bdd22a18-a108-4e14-ac35-7dc2a03107cc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"
Jul 29 00:44:02.560763 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:02.560607    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bdd22a18-a108-4e14-ac35-7dc2a03107cc-config-file\") pod \"limitador-limitador-54d6d988d5-hw2xr\" (UID: \"bdd22a18-a108-4e14-ac35-7dc2a03107cc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"
Jul 29 00:44:02.661533 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:02.661438    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grw59\" (UniqueName: \"kubernetes.io/projected/bdd22a18-a108-4e14-ac35-7dc2a03107cc-kube-api-access-grw59\") pod \"limitador-limitador-54d6d988d5-hw2xr\" (UID: \"bdd22a18-a108-4e14-ac35-7dc2a03107cc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"
Jul 29 00:44:02.661533 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:02.661505    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bdd22a18-a108-4e14-ac35-7dc2a03107cc-config-file\") pod \"limitador-limitador-54d6d988d5-hw2xr\" (UID: \"bdd22a18-a108-4e14-ac35-7dc2a03107cc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"
Jul 29 00:44:02.662112 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:02.662090    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bdd22a18-a108-4e14-ac35-7dc2a03107cc-config-file\") pod \"limitador-limitador-54d6d988d5-hw2xr\" (UID: \"bdd22a18-a108-4e14-ac35-7dc2a03107cc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"
Jul 29 00:44:02.670076 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:02.670041    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grw59\" (UniqueName: \"kubernetes.io/projected/bdd22a18-a108-4e14-ac35-7dc2a03107cc-kube-api-access-grw59\") pod \"limitador-limitador-54d6d988d5-hw2xr\" (UID: \"bdd22a18-a108-4e14-ac35-7dc2a03107cc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"
Jul 29 00:44:02.764202 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:02.764157    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"
Jul 29 00:44:02.823320 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:02.823286    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-klbbd"]
Jul 29 00:44:02.840505 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:02.840473    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-klbbd"]
Jul 29 00:44:02.840679 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:02.840607    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-klbbd"
Jul 29 00:44:02.844142 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:02.844118    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-h64br\""
Jul 29 00:44:02.934788 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:02.934756    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:44:02.937407 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:44:02.937381    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdd22a18_a108_4e14_ac35_7dc2a03107cc.slice/crio-4c654603bea898bfb41e36389e8962c5065815250e1cd1c9b0f02ad077b37d00 WatchSource:0}: Error finding container 4c654603bea898bfb41e36389e8962c5065815250e1cd1c9b0f02ad077b37d00: Status 404 returned error can't find the container with id 4c654603bea898bfb41e36389e8962c5065815250e1cd1c9b0f02ad077b37d00
Jul 29 00:44:02.964038 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:02.964002    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg2wf\" (UniqueName: \"kubernetes.io/projected/2fcac63a-212a-4b71-a335-4e3d011ca7a5-kube-api-access-lg2wf\") pod \"authorino-58cd955675-klbbd\" (UID: \"2fcac63a-212a-4b71-a335-4e3d011ca7a5\") " pod="kuadrant-system/authorino-58cd955675-klbbd"
Jul 29 00:44:03.064599 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:03.064542    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg2wf\" (UniqueName: \"kubernetes.io/projected/2fcac63a-212a-4b71-a335-4e3d011ca7a5-kube-api-access-lg2wf\") pod \"authorino-58cd955675-klbbd\" (UID: \"2fcac63a-212a-4b71-a335-4e3d011ca7a5\") " pod="kuadrant-system/authorino-58cd955675-klbbd"
Jul 29 00:44:03.073421 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:03.073392    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg2wf\" (UniqueName: \"kubernetes.io/projected/2fcac63a-212a-4b71-a335-4e3d011ca7a5-kube-api-access-lg2wf\") pod \"authorino-58cd955675-klbbd\" (UID: \"2fcac63a-212a-4b71-a335-4e3d011ca7a5\") " pod="kuadrant-system/authorino-58cd955675-klbbd"
Jul 29 00:44:03.150254 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:03.150216    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-klbbd"
Jul 29 00:44:03.307503 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:03.307470    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-klbbd"]
Jul 29 00:44:03.310601 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:44:03.310555    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2fcac63a_212a_4b71_a335_4e3d011ca7a5.slice/crio-873d2f23dfa34db86e7b2f7212449c4f1a21285f63ac47ca203489a9116d8500 WatchSource:0}: Error finding container 873d2f23dfa34db86e7b2f7212449c4f1a21285f63ac47ca203489a9116d8500: Status 404 returned error can't find the container with id 873d2f23dfa34db86e7b2f7212449c4f1a21285f63ac47ca203489a9116d8500
Jul 29 00:44:03.428457 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:03.428415    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-klbbd" event={"ID":"2fcac63a-212a-4b71-a335-4e3d011ca7a5","Type":"ContainerStarted","Data":"873d2f23dfa34db86e7b2f7212449c4f1a21285f63ac47ca203489a9116d8500"}
Jul 29 00:44:03.430159 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:03.430131    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-hw2xr" event={"ID":"bdd22a18-a108-4e14-ac35-7dc2a03107cc","Type":"ContainerStarted","Data":"4c654603bea898bfb41e36389e8962c5065815250e1cd1c9b0f02ad077b37d00"}
Jul 29 00:44:07.468107 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:07.468065    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-klbbd" event={"ID":"2fcac63a-212a-4b71-a335-4e3d011ca7a5","Type":"ContainerStarted","Data":"94aa79999728213e052be0d66d83c188f5cdc37561433fdc55dc97163fd332ca"}
Jul 29 00:44:07.470013 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:07.469974    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-hw2xr" event={"ID":"bdd22a18-a108-4e14-ac35-7dc2a03107cc","Type":"ContainerStarted","Data":"0bae0bb18ba7e8ed3890a67444abe2eec923ff32a6625954bae986762e113bcc"}
Jul 29 00:44:07.470163 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:07.470094    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"
Jul 29 00:44:07.481155 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:07.481122    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-klbbd"]
Jul 29 00:44:07.495700 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:07.495648    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-klbbd" podStartSLOduration=1.42183853 podStartE2EDuration="5.495632668s" totalImagesPullingTime="4.073794138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:44:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:44:07.493953008 +0000 UTC m=+473.638410596" watchObservedRunningTime="2026-07-29 00:44:07.495632668 +0000 UTC m=+473.640090266"
Jul 29 00:44:07.511792 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:07.511738    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-hw2xr" podStartSLOduration=1.072595377 podStartE2EDuration="5.511721604s" totalImagesPullingTime="4.439126227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:44:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:44:07.510265568 +0000 UTC m=+473.654723140" watchObservedRunningTime="2026-07-29 00:44:07.511721604 +0000 UTC m=+473.656179173"
Jul 29 00:44:09.478115 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:09.478074    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-klbbd" podUID="2fcac63a-212a-4b71-a335-4e3d011ca7a5" containerName="authorino" containerID="cri-o://94aa79999728213e052be0d66d83c188f5cdc37561433fdc55dc97163fd332ca" gracePeriod=30
Jul 29 00:44:09.726285 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:09.726259    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-klbbd"
Jul 29 00:44:09.832279 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:09.832249    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lg2wf\" (UniqueName: \"kubernetes.io/projected/2fcac63a-212a-4b71-a335-4e3d011ca7a5-kube-api-access-lg2wf\") pod \"2fcac63a-212a-4b71-a335-4e3d011ca7a5\" (UID: \"2fcac63a-212a-4b71-a335-4e3d011ca7a5\") "
Jul 29 00:44:09.834364 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:09.834341    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fcac63a-212a-4b71-a335-4e3d011ca7a5-kube-api-access-lg2wf" (OuterVolumeSpecName: "kube-api-access-lg2wf") pod "2fcac63a-212a-4b71-a335-4e3d011ca7a5" (UID: "2fcac63a-212a-4b71-a335-4e3d011ca7a5"). InnerVolumeSpecName "kube-api-access-lg2wf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:44:09.933422 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:09.933385    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lg2wf\" (UniqueName: \"kubernetes.io/projected/2fcac63a-212a-4b71-a335-4e3d011ca7a5-kube-api-access-lg2wf\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 00:44:10.483609 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:10.483547    2577 generic.go:356] "Generic (PLEG): container finished" podID="2fcac63a-212a-4b71-a335-4e3d011ca7a5" containerID="94aa79999728213e052be0d66d83c188f5cdc37561433fdc55dc97163fd332ca" exitCode=0
Jul 29 00:44:10.483609 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:10.483608    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-klbbd"
Jul 29 00:44:10.484091 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:10.483624    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-klbbd" event={"ID":"2fcac63a-212a-4b71-a335-4e3d011ca7a5","Type":"ContainerDied","Data":"94aa79999728213e052be0d66d83c188f5cdc37561433fdc55dc97163fd332ca"}
Jul 29 00:44:10.484091 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:10.483670    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-klbbd" event={"ID":"2fcac63a-212a-4b71-a335-4e3d011ca7a5","Type":"ContainerDied","Data":"873d2f23dfa34db86e7b2f7212449c4f1a21285f63ac47ca203489a9116d8500"}
Jul 29 00:44:10.484091 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:10.483690    2577 scope.go:117] "RemoveContainer" containerID="94aa79999728213e052be0d66d83c188f5cdc37561433fdc55dc97163fd332ca"
Jul 29 00:44:10.492113 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:10.492097    2577 scope.go:117] "RemoveContainer" containerID="94aa79999728213e052be0d66d83c188f5cdc37561433fdc55dc97163fd332ca"
Jul 29 00:44:10.492350 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:44:10.492332    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94aa79999728213e052be0d66d83c188f5cdc37561433fdc55dc97163fd332ca\": container with ID starting with 94aa79999728213e052be0d66d83c188f5cdc37561433fdc55dc97163fd332ca not found: ID does not exist" containerID="94aa79999728213e052be0d66d83c188f5cdc37561433fdc55dc97163fd332ca"
Jul 29 00:44:10.492418 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:10.492357    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94aa79999728213e052be0d66d83c188f5cdc37561433fdc55dc97163fd332ca"} err="failed to get container status \"94aa79999728213e052be0d66d83c188f5cdc37561433fdc55dc97163fd332ca\": rpc error: code = NotFound desc = could not find container \"94aa79999728213e052be0d66d83c188f5cdc37561433fdc55dc97163fd332ca\": container with ID starting with 94aa79999728213e052be0d66d83c188f5cdc37561433fdc55dc97163fd332ca not found: ID does not exist"
Jul 29 00:44:10.498974 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:10.498952    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-klbbd"]
Jul 29 00:44:10.502570 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:10.502548    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-klbbd"]
Jul 29 00:44:12.303326 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:12.303292    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fcac63a-212a-4b71-a335-4e3d011ca7a5" path="/var/lib/kubelet/pods/2fcac63a-212a-4b71-a335-4e3d011ca7a5/volumes"
Jul 29 00:44:18.475264 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:18.475231    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"
Jul 29 00:44:35.746001 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:35.745967    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zbcdb"]
Jul 29 00:44:35.746536 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:35.746517    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fcac63a-212a-4b71-a335-4e3d011ca7a5" containerName="authorino"
Jul 29 00:44:35.746666 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:35.746538    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fcac63a-212a-4b71-a335-4e3d011ca7a5" containerName="authorino"
Jul 29 00:44:35.746666 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:35.746637    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fcac63a-212a-4b71-a335-4e3d011ca7a5" containerName="authorino"
Jul 29 00:44:35.753799 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:35.753776    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zbcdb"
Jul 29 00:44:35.754717 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:35.754689    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zbcdb"]
Jul 29 00:44:35.755884 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:35.755861    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-h64br\""
Jul 29 00:44:35.858680 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:35.858645    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz624\" (UniqueName: \"kubernetes.io/projected/b5851b11-1724-45f6-9854-23f6a5a5a0f6-kube-api-access-nz624\") pod \"authorino-5d4b67c446-zbcdb\" (UID: \"b5851b11-1724-45f6-9854-23f6a5a5a0f6\") " pod="kuadrant-system/authorino-5d4b67c446-zbcdb"
Jul 29 00:44:35.959691 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:35.959657    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz624\" (UniqueName: \"kubernetes.io/projected/b5851b11-1724-45f6-9854-23f6a5a5a0f6-kube-api-access-nz624\") pod \"authorino-5d4b67c446-zbcdb\" (UID: \"b5851b11-1724-45f6-9854-23f6a5a5a0f6\") " pod="kuadrant-system/authorino-5d4b67c446-zbcdb"
Jul 29 00:44:35.967173 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:35.967141    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz624\" (UniqueName: \"kubernetes.io/projected/b5851b11-1724-45f6-9854-23f6a5a5a0f6-kube-api-access-nz624\") pod \"authorino-5d4b67c446-zbcdb\" (UID: \"b5851b11-1724-45f6-9854-23f6a5a5a0f6\") " pod="kuadrant-system/authorino-5d4b67c446-zbcdb"
Jul 29 00:44:35.976416 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:35.976391    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zbcdb"]
Jul 29 00:44:35.976667 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:35.976655    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zbcdb"
Jul 29 00:44:36.004217 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:36.004148    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7cf75f7475-gpdnv"]
Jul 29 00:44:36.015576 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:36.015548    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7cf75f7475-gpdnv"]
Jul 29 00:44:36.015746 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:36.015692    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cf75f7475-gpdnv"
Jul 29 00:44:36.038524 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:36.038495    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7cf75f7475-gpdnv"]
Jul 29 00:44:36.038893 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:44:36.038869    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-kk8wc], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-7cf75f7475-gpdnv" podUID="c9099241-c10d-4f96-8904-4cadab076b10"
Jul 29 00:44:36.060802 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:36.060769    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk8wc\" (UniqueName: \"kubernetes.io/projected/c9099241-c10d-4f96-8904-4cadab076b10-kube-api-access-kk8wc\") pod \"authorino-7cf75f7475-gpdnv\" (UID: \"c9099241-c10d-4f96-8904-4cadab076b10\") " pod="kuadrant-system/authorino-7cf75f7475-gpdnv"
Jul 29 00:44:36.109812 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:36.109781    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zbcdb"]
Jul 29 00:44:36.112488 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:44:36.112462    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb5851b11_1724_45f6_9854_23f6a5a5a0f6.slice/crio-40b8bacc0208fa9e30ee7d34c99ab1e1fcb2962cff2163f8e08db05a9f72f53b WatchSource:0}: Error finding container 40b8bacc0208fa9e30ee7d34c99ab1e1fcb2962cff2163f8e08db05a9f72f53b: Status 404 returned error can't find the container with id 40b8bacc0208fa9e30ee7d34c99ab1e1fcb2962cff2163f8e08db05a9f72f53b
Jul 29 00:44:36.161414 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:36.161379    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk8wc\" (UniqueName: \"kubernetes.io/projected/c9099241-c10d-4f96-8904-4cadab076b10-kube-api-access-kk8wc\") pod \"authorino-7cf75f7475-gpdnv\" (UID: \"c9099241-c10d-4f96-8904-4cadab076b10\") " pod="kuadrant-system/authorino-7cf75f7475-gpdnv"
Jul 29 00:44:36.168724 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:36.168694    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk8wc\" (UniqueName: \"kubernetes.io/projected/c9099241-c10d-4f96-8904-4cadab076b10-kube-api-access-kk8wc\") pod \"authorino-7cf75f7475-gpdnv\" (UID: \"c9099241-c10d-4f96-8904-4cadab076b10\") " pod="kuadrant-system/authorino-7cf75f7475-gpdnv"
Jul 29 00:44:36.597656 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:36.597617    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-zbcdb" event={"ID":"b5851b11-1724-45f6-9854-23f6a5a5a0f6","Type":"ContainerStarted","Data":"97451d53d2907227c2b710eeb48d101fbf9b804ddb162818dff1f578d202c954"}
Jul 29 00:44:36.597656 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:36.597646    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cf75f7475-gpdnv"
Jul 29 00:44:36.597958 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:36.597669    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-zbcdb" event={"ID":"b5851b11-1724-45f6-9854-23f6a5a5a0f6","Type":"ContainerStarted","Data":"40b8bacc0208fa9e30ee7d34c99ab1e1fcb2962cff2163f8e08db05a9f72f53b"}
Jul 29 00:44:36.597958 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:36.597670    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-zbcdb" podUID="b5851b11-1724-45f6-9854-23f6a5a5a0f6" containerName="authorino" containerID="cri-o://97451d53d2907227c2b710eeb48d101fbf9b804ddb162818dff1f578d202c954" gracePeriod=30
Jul 29 00:44:36.606029 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:36.606007    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cf75f7475-gpdnv"
Jul 29 00:44:36.625250 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:36.625205    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-zbcdb" podStartSLOduration=1.226915704 podStartE2EDuration="1.625190443s" totalImagesPullingTime="398.274739ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:44:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:44:36.623549565 +0000 UTC m=+502.768007158" watchObservedRunningTime="2026-07-29 00:44:36.625190443 +0000 UTC m=+502.769648013"
Jul 29 00:44:36.666989 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:36.666954    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kk8wc\" (UniqueName: \"kubernetes.io/projected/c9099241-c10d-4f96-8904-4cadab076b10-kube-api-access-kk8wc\") pod \"c9099241-c10d-4f96-8904-4cadab076b10\" (UID: \"c9099241-c10d-4f96-8904-4cadab076b10\") "
Jul 29 00:44:36.668941 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:36.668914    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9099241-c10d-4f96-8904-4cadab076b10-kube-api-access-kk8wc" (OuterVolumeSpecName: "kube-api-access-kk8wc") pod "c9099241-c10d-4f96-8904-4cadab076b10" (UID: "c9099241-c10d-4f96-8904-4cadab076b10"). InnerVolumeSpecName "kube-api-access-kk8wc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:44:36.768224 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:36.768194    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kk8wc\" (UniqueName: \"kubernetes.io/projected/c9099241-c10d-4f96-8904-4cadab076b10-kube-api-access-kk8wc\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 00:44:36.829517 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:36.829493    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zbcdb"
Jul 29 00:44:36.970940 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:36.970902    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nz624\" (UniqueName: \"kubernetes.io/projected/b5851b11-1724-45f6-9854-23f6a5a5a0f6-kube-api-access-nz624\") pod \"b5851b11-1724-45f6-9854-23f6a5a5a0f6\" (UID: \"b5851b11-1724-45f6-9854-23f6a5a5a0f6\") "
Jul 29 00:44:36.973248 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:36.973203    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5851b11-1724-45f6-9854-23f6a5a5a0f6-kube-api-access-nz624" (OuterVolumeSpecName: "kube-api-access-nz624") pod "b5851b11-1724-45f6-9854-23f6a5a5a0f6" (UID: "b5851b11-1724-45f6-9854-23f6a5a5a0f6"). InnerVolumeSpecName "kube-api-access-nz624". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:44:37.072419 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:37.072386    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nz624\" (UniqueName: \"kubernetes.io/projected/b5851b11-1724-45f6-9854-23f6a5a5a0f6-kube-api-access-nz624\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 00:44:37.602963 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:37.602931    2577 generic.go:356] "Generic (PLEG): container finished" podID="b5851b11-1724-45f6-9854-23f6a5a5a0f6" containerID="97451d53d2907227c2b710eeb48d101fbf9b804ddb162818dff1f578d202c954" exitCode=2
Jul 29 00:44:37.603129 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:37.602970    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zbcdb"
Jul 29 00:44:37.603129 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:37.603018    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-zbcdb" event={"ID":"b5851b11-1724-45f6-9854-23f6a5a5a0f6","Type":"ContainerDied","Data":"97451d53d2907227c2b710eeb48d101fbf9b804ddb162818dff1f578d202c954"}
Jul 29 00:44:37.603129 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:37.603057    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-zbcdb" event={"ID":"b5851b11-1724-45f6-9854-23f6a5a5a0f6","Type":"ContainerDied","Data":"40b8bacc0208fa9e30ee7d34c99ab1e1fcb2962cff2163f8e08db05a9f72f53b"}
Jul 29 00:44:37.603129 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:37.603078    2577 scope.go:117] "RemoveContainer" containerID="97451d53d2907227c2b710eeb48d101fbf9b804ddb162818dff1f578d202c954"
Jul 29 00:44:37.603377 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:37.603168    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cf75f7475-gpdnv"
Jul 29 00:44:37.612328 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:37.612055    2577 scope.go:117] "RemoveContainer" containerID="97451d53d2907227c2b710eeb48d101fbf9b804ddb162818dff1f578d202c954"
Jul 29 00:44:37.612404 ip-10-0-138-146 kubenswrapper[2577]: E0729 00:44:37.612344    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97451d53d2907227c2b710eeb48d101fbf9b804ddb162818dff1f578d202c954\": container with ID starting with 97451d53d2907227c2b710eeb48d101fbf9b804ddb162818dff1f578d202c954 not found: ID does not exist" containerID="97451d53d2907227c2b710eeb48d101fbf9b804ddb162818dff1f578d202c954"
Jul 29 00:44:37.612404 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:37.612375    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97451d53d2907227c2b710eeb48d101fbf9b804ddb162818dff1f578d202c954"} err="failed to get container status \"97451d53d2907227c2b710eeb48d101fbf9b804ddb162818dff1f578d202c954\": rpc error: code = NotFound desc = could not find container \"97451d53d2907227c2b710eeb48d101fbf9b804ddb162818dff1f578d202c954\": container with ID starting with 97451d53d2907227c2b710eeb48d101fbf9b804ddb162818dff1f578d202c954 not found: ID does not exist"
Jul 29 00:44:37.639677 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:37.639649    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7cf75f7475-gpdnv"]
Jul 29 00:44:37.646993 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:37.646969    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7cf75f7475-gpdnv"]
Jul 29 00:44:37.662153 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:37.662128    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zbcdb"]
Jul 29 00:44:37.668566 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:37.668537    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zbcdb"]
Jul 29 00:44:38.303968 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:38.303936    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5851b11-1724-45f6-9854-23f6a5a5a0f6" path="/var/lib/kubelet/pods/b5851b11-1724-45f6-9854-23f6a5a5a0f6/volumes"
Jul 29 00:44:38.304334 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:44:38.304285    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9099241-c10d-4f96-8904-4cadab076b10" path="/var/lib/kubelet/pods/c9099241-c10d-4f96-8904-4cadab076b10/volumes"
Jul 29 00:45:18.894030 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:45:18.893994    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:45:55.313725 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:45:55.313688    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:46:11.812536 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:46:11.812500    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:46:14.234972 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:46:14.234947    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tfr5v_ac322954-06d1-4807-8a8b-59e62befe6bc/ovn-acl-logging/0.log"
Jul 29 00:46:14.241498 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:46:14.241473    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tfr5v_ac322954-06d1-4807-8a8b-59e62befe6bc/ovn-acl-logging/0.log"
Jul 29 00:46:26.609288 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:46:26.609250    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:46:52.307973 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:46:52.307888    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:47:00.809312 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:00.809272    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-nkvlk"]
Jul 29 00:47:00.809809 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:00.809781    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5851b11-1724-45f6-9854-23f6a5a5a0f6" containerName="authorino"
Jul 29 00:47:00.809809 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:00.809797    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5851b11-1724-45f6-9854-23f6a5a5a0f6" containerName="authorino"
Jul 29 00:47:00.809926 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:00.809914    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5851b11-1724-45f6-9854-23f6a5a5a0f6" containerName="authorino"
Jul 29 00:47:00.813260 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:00.813242    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nkvlk"
Jul 29 00:47:00.818203 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:00.818182    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-7rgtn\""
Jul 29 00:47:00.818557 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:00.818540    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 29 00:47:00.818865 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:00.818847    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 29 00:47:00.818865 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:00.818855    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 29 00:47:00.822139 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:00.822117    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-nkvlk"]
Jul 29 00:47:00.989254 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:00.989216    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mj9k\" (UniqueName: \"kubernetes.io/projected/d4c2d705-3b1e-4b05-8792-7afc8364ab61-kube-api-access-9mj9k\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nkvlk\" (UID: \"d4c2d705-3b1e-4b05-8792-7afc8364ab61\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nkvlk"
Jul 29 00:47:00.989432 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:00.989266    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4c2d705-3b1e-4b05-8792-7afc8364ab61-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nkvlk\" (UID: \"d4c2d705-3b1e-4b05-8792-7afc8364ab61\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nkvlk"
Jul 29 00:47:00.989432 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:00.989392    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4c2d705-3b1e-4b05-8792-7afc8364ab61-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nkvlk\" (UID: \"d4c2d705-3b1e-4b05-8792-7afc8364ab61\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nkvlk"
Jul 29 00:47:00.989538 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:00.989443    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4c2d705-3b1e-4b05-8792-7afc8364ab61-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nkvlk\" (UID: \"d4c2d705-3b1e-4b05-8792-7afc8364ab61\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nkvlk"
Jul 29 00:47:00.989538 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:00.989510    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4c2d705-3b1e-4b05-8792-7afc8364ab61-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nkvlk\" (UID: \"d4c2d705-3b1e-4b05-8792-7afc8364ab61\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nkvlk"
Jul 29 00:47:00.989652 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:00.989561    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4c2d705-3b1e-4b05-8792-7afc8364ab61-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nkvlk\" (UID: \"d4c2d705-3b1e-4b05-8792-7afc8364ab61\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nkvlk"
Jul 29 00:47:01.090576 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:01.090542    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4c2d705-3b1e-4b05-8792-7afc8364ab61-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nkvlk\" (UID: \"d4c2d705-3b1e-4b05-8792-7afc8364ab61\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nkvlk"
Jul 29 00:47:01.090769 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:01.090623    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mj9k\" (UniqueName: \"kubernetes.io/projected/d4c2d705-3b1e-4b05-8792-7afc8364ab61-kube-api-access-9mj9k\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nkvlk\" (UID: \"d4c2d705-3b1e-4b05-8792-7afc8364ab61\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nkvlk"
Jul 29 00:47:01.090769 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:01.090665    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4c2d705-3b1e-4b05-8792-7afc8364ab61-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nkvlk\" (UID: \"d4c2d705-3b1e-4b05-8792-7afc8364ab61\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nkvlk"
Jul 29 00:47:01.090769 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:01.090731    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4c2d705-3b1e-4b05-8792-7afc8364ab61-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nkvlk\" (UID: \"d4c2d705-3b1e-4b05-8792-7afc8364ab61\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nkvlk"
Jul 29 00:47:01.090929 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:01.090767    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4c2d705-3b1e-4b05-8792-7afc8364ab61-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nkvlk\" (UID: \"d4c2d705-3b1e-4b05-8792-7afc8364ab61\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nkvlk"
Jul 29 00:47:01.090929 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:01.090818    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4c2d705-3b1e-4b05-8792-7afc8364ab61-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nkvlk\" (UID: \"d4c2d705-3b1e-4b05-8792-7afc8364ab61\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nkvlk"
Jul 29 00:47:01.091049 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:01.091026    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4c2d705-3b1e-4b05-8792-7afc8364ab61-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nkvlk\" (UID: \"d4c2d705-3b1e-4b05-8792-7afc8364ab61\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nkvlk"
Jul 29 00:47:01.091109 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:01.091053    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4c2d705-3b1e-4b05-8792-7afc8364ab61-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nkvlk\" (UID: \"d4c2d705-3b1e-4b05-8792-7afc8364ab61\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nkvlk"
Jul 29 00:47:01.091166 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:01.091124    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4c2d705-3b1e-4b05-8792-7afc8364ab61-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nkvlk\" (UID: \"d4c2d705-3b1e-4b05-8792-7afc8364ab61\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nkvlk"
Jul 29 00:47:01.092985 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:01.092965    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4c2d705-3b1e-4b05-8792-7afc8364ab61-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nkvlk\" (UID: \"d4c2d705-3b1e-4b05-8792-7afc8364ab61\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nkvlk"
Jul 29 00:47:01.093303 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:01.093286    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4c2d705-3b1e-4b05-8792-7afc8364ab61-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nkvlk\" (UID: \"d4c2d705-3b1e-4b05-8792-7afc8364ab61\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nkvlk"
Jul 29 00:47:01.098150 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:01.098132    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mj9k\" (UniqueName: \"kubernetes.io/projected/d4c2d705-3b1e-4b05-8792-7afc8364ab61-kube-api-access-9mj9k\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nkvlk\" (UID: \"d4c2d705-3b1e-4b05-8792-7afc8364ab61\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nkvlk"
Jul 29 00:47:01.124108 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:01.124070    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nkvlk"
Jul 29 00:47:01.264175 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:01.264131    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-nkvlk"]
Jul 29 00:47:01.267113 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:47:01.267083    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4c2d705_3b1e_4b05_8792_7afc8364ab61.slice/crio-349ca05592469ca5bbd5ca1be2fd5d7bd46bd38c349024af119c0ef0c819d708 WatchSource:0}: Error finding container 349ca05592469ca5bbd5ca1be2fd5d7bd46bd38c349024af119c0ef0c819d708: Status 404 returned error can't find the container with id 349ca05592469ca5bbd5ca1be2fd5d7bd46bd38c349024af119c0ef0c819d708
Jul 29 00:47:01.268430 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:01.268408    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 00:47:02.249087 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:02.249059    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nkvlk" event={"ID":"d4c2d705-3b1e-4b05-8792-7afc8364ab61","Type":"ContainerStarted","Data":"349ca05592469ca5bbd5ca1be2fd5d7bd46bd38c349024af119c0ef0c819d708"}
Jul 29 00:47:03.257889 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:03.257851    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nkvlk" event={"ID":"d4c2d705-3b1e-4b05-8792-7afc8364ab61","Type":"ContainerStarted","Data":"5cde836b69e91cf594c37ab5cffbadcb54f53be899381c5e0e39d35f981087e6"}
Jul 29 00:47:03.277256 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:03.277200    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nkvlk" podStartSLOduration=2.306721769 podStartE2EDuration="3.277183422s" totalImagesPullingTime="970.461653ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:47:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:47:03.27519834 +0000 UTC m=+649.419655911" watchObservedRunningTime="2026-07-29 00:47:03.277183422 +0000 UTC m=+649.421641014"
Jul 29 00:47:03.431712 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:03.431677    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:47:11.125261 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:11.125226    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nkvlk"
Jul 29 00:47:11.125671 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:11.125298    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nkvlk"
Jul 29 00:47:11.138159 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:11.138128    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nkvlk"
Jul 29 00:47:11.304258 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:11.304223    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nkvlk"
Jul 29 00:47:12.018229 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:12.018195    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-ztg42"]
Jul 29 00:47:12.021613 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:12.021595    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ztg42"
Jul 29 00:47:12.023983 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:12.023957    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 29 00:47:12.030785 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:12.030761    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-ztg42"]
Jul 29 00:47:12.075433 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:12.075401    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d08ab07-cb1e-4980-a2a0-f37ec60fc2f0-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ztg42\" (UID: \"2d08ab07-cb1e-4980-a2a0-f37ec60fc2f0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ztg42"
Jul 29 00:47:12.075653 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:12.075459    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d08ab07-cb1e-4980-a2a0-f37ec60fc2f0-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ztg42\" (UID: \"2d08ab07-cb1e-4980-a2a0-f37ec60fc2f0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ztg42"
Jul 29 00:47:12.075653 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:12.075555    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d08ab07-cb1e-4980-a2a0-f37ec60fc2f0-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ztg42\" (UID: \"2d08ab07-cb1e-4980-a2a0-f37ec60fc2f0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ztg42"
Jul 29 00:47:12.075653 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:12.075610    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d08ab07-cb1e-4980-a2a0-f37ec60fc2f0-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ztg42\" (UID: \"2d08ab07-cb1e-4980-a2a0-f37ec60fc2f0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ztg42"
Jul 29 00:47:12.075653 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:12.075632    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwdhb\" (UniqueName: \"kubernetes.io/projected/2d08ab07-cb1e-4980-a2a0-f37ec60fc2f0-kube-api-access-bwdhb\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ztg42\" (UID: \"2d08ab07-cb1e-4980-a2a0-f37ec60fc2f0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ztg42"
Jul 29 00:47:12.075653 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:12.075653    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d08ab07-cb1e-4980-a2a0-f37ec60fc2f0-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ztg42\" (UID: \"2d08ab07-cb1e-4980-a2a0-f37ec60fc2f0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ztg42"
Jul 29 00:47:12.176530 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:12.176492    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d08ab07-cb1e-4980-a2a0-f37ec60fc2f0-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ztg42\" (UID: \"2d08ab07-cb1e-4980-a2a0-f37ec60fc2f0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ztg42"
Jul 29 00:47:12.177050 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:12.176537    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d08ab07-cb1e-4980-a2a0-f37ec60fc2f0-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ztg42\" (UID: \"2d08ab07-cb1e-4980-a2a0-f37ec60fc2f0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ztg42"
Jul 29 00:47:12.177050 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:12.176557    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwdhb\" (UniqueName: \"kubernetes.io/projected/2d08ab07-cb1e-4980-a2a0-f37ec60fc2f0-kube-api-access-bwdhb\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ztg42\" (UID: \"2d08ab07-cb1e-4980-a2a0-f37ec60fc2f0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ztg42"
Jul 29 00:47:12.177050 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:12.176576    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d08ab07-cb1e-4980-a2a0-f37ec60fc2f0-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ztg42\" (UID: \"2d08ab07-cb1e-4980-a2a0-f37ec60fc2f0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ztg42"
Jul 29 00:47:12.177050 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:12.176629    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d08ab07-cb1e-4980-a2a0-f37ec60fc2f0-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ztg42\" (UID: \"2d08ab07-cb1e-4980-a2a0-f37ec60fc2f0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ztg42"
Jul 29 00:47:12.177050 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:12.176658    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d08ab07-cb1e-4980-a2a0-f37ec60fc2f0-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ztg42\" (UID: \"2d08ab07-cb1e-4980-a2a0-f37ec60fc2f0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ztg42"
Jul 29 00:47:12.177050 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:12.177025    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d08ab07-cb1e-4980-a2a0-f37ec60fc2f0-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ztg42\" (UID: \"2d08ab07-cb1e-4980-a2a0-f37ec60fc2f0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ztg42"
Jul 29 00:47:12.177261 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:12.177061    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d08ab07-cb1e-4980-a2a0-f37ec60fc2f0-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ztg42\" (UID: \"2d08ab07-cb1e-4980-a2a0-f37ec60fc2f0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ztg42"
Jul 29 00:47:12.177261 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:12.177091    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d08ab07-cb1e-4980-a2a0-f37ec60fc2f0-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ztg42\" (UID: \"2d08ab07-cb1e-4980-a2a0-f37ec60fc2f0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ztg42"
Jul 29 00:47:12.178731 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:12.178715    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d08ab07-cb1e-4980-a2a0-f37ec60fc2f0-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ztg42\" (UID: \"2d08ab07-cb1e-4980-a2a0-f37ec60fc2f0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ztg42"
Jul 29 00:47:12.178997 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:12.178980    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d08ab07-cb1e-4980-a2a0-f37ec60fc2f0-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ztg42\" (UID: \"2d08ab07-cb1e-4980-a2a0-f37ec60fc2f0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ztg42"
Jul 29 00:47:12.185811 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:12.185780    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwdhb\" (UniqueName: \"kubernetes.io/projected/2d08ab07-cb1e-4980-a2a0-f37ec60fc2f0-kube-api-access-bwdhb\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ztg42\" (UID: \"2d08ab07-cb1e-4980-a2a0-f37ec60fc2f0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ztg42"
Jul 29 00:47:12.331077 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:12.331049    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ztg42"
Jul 29 00:47:12.473228 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:12.473190    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-ztg42"]
Jul 29 00:47:12.476324 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:47:12.476298    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2d08ab07_cb1e_4980_a2a0_f37ec60fc2f0.slice/crio-29bdb9df00c0b28d9f8772b6632127ba58ed1884a90f52fc854142c0f43306cc WatchSource:0}: Error finding container 29bdb9df00c0b28d9f8772b6632127ba58ed1884a90f52fc854142c0f43306cc: Status 404 returned error can't find the container with id 29bdb9df00c0b28d9f8772b6632127ba58ed1884a90f52fc854142c0f43306cc
Jul 29 00:47:13.302822 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:13.302793    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ztg42" event={"ID":"2d08ab07-cb1e-4980-a2a0-f37ec60fc2f0","Type":"ContainerStarted","Data":"99bc5564521fa766da58aae3bc1c68fc411fbf3eddc9f40ae459036fcc9ba139"}
Jul 29 00:47:13.302822 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:13.302833    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ztg42" event={"ID":"2d08ab07-cb1e-4980-a2a0-f37ec60fc2f0","Type":"ContainerStarted","Data":"29bdb9df00c0b28d9f8772b6632127ba58ed1884a90f52fc854142c0f43306cc"}
Jul 29 00:47:13.320302 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:13.320247    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ztg42" podStartSLOduration=1.152167038 podStartE2EDuration="1.320227034s" totalImagesPullingTime="168.059996ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:47:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:47:13.318966562 +0000 UTC m=+659.463424144" watchObservedRunningTime="2026-07-29 00:47:13.320227034 +0000 UTC m=+659.464684603"
Jul 29 00:47:15.309545 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:15.309508    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:47:22.331905 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:22.331849    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ztg42"
Jul 29 00:47:22.331905 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:22.331915    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ztg42"
Jul 29 00:47:22.345313 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:22.345280    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ztg42"
Jul 29 00:47:22.356639 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:47:22.356609    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ztg42"
Jul 29 00:48:15.630445 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:48:15.630408    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b9f6bb998-rxg65"]
Jul 29 00:48:15.633376 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:48:15.633358    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b9f6bb998-rxg65"
Jul 29 00:48:15.635880 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:48:15.635846    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 29 00:48:15.635880 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:48:15.635861    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-h64br\""
Jul 29 00:48:15.640736 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:48:15.640714    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b9f6bb998-rxg65"]
Jul 29 00:48:15.769734 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:48:15.769698    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42dsb\" (UniqueName: \"kubernetes.io/projected/bfdb191d-a481-4300-bdd2-fefdee160b67-kube-api-access-42dsb\") pod \"authorino-b9f6bb998-rxg65\" (UID: \"bfdb191d-a481-4300-bdd2-fefdee160b67\") " pod="kuadrant-system/authorino-b9f6bb998-rxg65"
Jul 29 00:48:15.769912 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:48:15.769763    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bfdb191d-a481-4300-bdd2-fefdee160b67-tls-cert\") pod \"authorino-b9f6bb998-rxg65\" (UID: \"bfdb191d-a481-4300-bdd2-fefdee160b67\") " pod="kuadrant-system/authorino-b9f6bb998-rxg65"
Jul 29 00:48:15.871026 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:48:15.870990    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42dsb\" (UniqueName: \"kubernetes.io/projected/bfdb191d-a481-4300-bdd2-fefdee160b67-kube-api-access-42dsb\") pod \"authorino-b9f6bb998-rxg65\" (UID: \"bfdb191d-a481-4300-bdd2-fefdee160b67\") " pod="kuadrant-system/authorino-b9f6bb998-rxg65"
Jul 29 00:48:15.871188 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:48:15.871079    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bfdb191d-a481-4300-bdd2-fefdee160b67-tls-cert\") pod \"authorino-b9f6bb998-rxg65\" (UID: \"bfdb191d-a481-4300-bdd2-fefdee160b67\") " pod="kuadrant-system/authorino-b9f6bb998-rxg65"
Jul 29 00:48:15.873651 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:48:15.873623    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bfdb191d-a481-4300-bdd2-fefdee160b67-tls-cert\") pod \"authorino-b9f6bb998-rxg65\" (UID: \"bfdb191d-a481-4300-bdd2-fefdee160b67\") " pod="kuadrant-system/authorino-b9f6bb998-rxg65"
Jul 29 00:48:15.877929 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:48:15.877908    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42dsb\" (UniqueName: \"kubernetes.io/projected/bfdb191d-a481-4300-bdd2-fefdee160b67-kube-api-access-42dsb\") pod \"authorino-b9f6bb998-rxg65\" (UID: \"bfdb191d-a481-4300-bdd2-fefdee160b67\") " pod="kuadrant-system/authorino-b9f6bb998-rxg65"
Jul 29 00:48:15.942960 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:48:15.942886    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b9f6bb998-rxg65"
Jul 29 00:48:16.097142 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:48:16.097114    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b9f6bb998-rxg65"]
Jul 29 00:48:16.099749 ip-10-0-138-146 kubenswrapper[2577]: W0729 00:48:16.099722    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbfdb191d_a481_4300_bdd2_fefdee160b67.slice/crio-b124af6f2fef631a0995e2f988c498e4ef6e96fcf7627fbb950ba210fba487e7 WatchSource:0}: Error finding container b124af6f2fef631a0995e2f988c498e4ef6e96fcf7627fbb950ba210fba487e7: Status 404 returned error can't find the container with id b124af6f2fef631a0995e2f988c498e4ef6e96fcf7627fbb950ba210fba487e7
Jul 29 00:48:16.593571 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:48:16.593541    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b9f6bb998-rxg65" event={"ID":"bfdb191d-a481-4300-bdd2-fefdee160b67","Type":"ContainerStarted","Data":"b124af6f2fef631a0995e2f988c498e4ef6e96fcf7627fbb950ba210fba487e7"}
Jul 29 00:48:17.601664 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:48:17.601629    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b9f6bb998-rxg65" event={"ID":"bfdb191d-a481-4300-bdd2-fefdee160b67","Type":"ContainerStarted","Data":"d7ddc4e2ca3e48509a9384a9415f22216c3d1c2cc5bf0221a155cf51527c23f0"}
Jul 29 00:48:17.647090 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:48:17.647026    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b9f6bb998-rxg65" podStartSLOduration=2.133715222 podStartE2EDuration="2.646998227s" totalImagesPullingTime="513.283005ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:48:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:48:17.645464694 +0000 UTC m=+723.789922266" watchObservedRunningTime="2026-07-29 00:48:17.646998227 +0000 UTC m=+723.791455799"
Jul 29 00:48:47.124541 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:48:47.124506    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:48:56.749544 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:48:56.749508    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:49:07.307861 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:49:07.307823    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:50:52.715993 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:50:52.715949    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:51:14.266774 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:51:14.266690    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tfr5v_ac322954-06d1-4807-8a8b-59e62befe6bc/ovn-acl-logging/0.log"
Jul 29 00:51:14.268250 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:51:14.268217    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tfr5v_ac322954-06d1-4807-8a8b-59e62befe6bc/ovn-acl-logging/0.log"
Jul 29 00:51:43.109050 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:51:43.109015    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:51:52.618273 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:51:52.618234    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:52:01.708422 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:52:01.708383    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:52:11.410698 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:52:11.410663    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:52:21.312341 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:52:21.312301    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:52:33.612860 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:52:33.612826    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:52:44.305101 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:52:44.305018    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:52:54.707863 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:52:54.707828    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:53:19.005682 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:53:19.005648    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:53:31.311124 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:53:31.311087    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:53:54.614797 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:53:54.614764    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:54:07.122838 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:54:07.122755    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:54:16.210880 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:54:16.210842    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:54:33.318994 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:54:33.318956    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:54:42.606373 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:54:42.606341    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:54:54.620705 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:54:54.620660    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:55:07.023994 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:55:07.023960    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:56:14.299398 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:56:14.299360    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tfr5v_ac322954-06d1-4807-8a8b-59e62befe6bc/ovn-acl-logging/0.log"
Jul 29 00:56:14.300500 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:56:14.300472    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tfr5v_ac322954-06d1-4807-8a8b-59e62befe6bc/ovn-acl-logging/0.log"
Jul 29 00:56:58.905675 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:56:58.905634    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:57:10.111411 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:57:10.111335    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:57:23.209873 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:57:23.209831    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:57:34.914357 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:57:34.914323    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:57:47.405747 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:57:47.405709    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:57:57.303135 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:57:57.303098    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:58:05.615074 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:58:05.615033    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:58:16.604657 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:58:16.604615    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:58:27.307837 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:58:27.307798    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:58:36.318029 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:58:36.317946    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:58:47.316404 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:58:47.316367    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:59:08.709670 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:59:08.709632    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:59:18.008952 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:59:18.008918    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:59:32.204433 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:59:32.204389    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 00:59:46.411228 ip-10-0-138-146 kubenswrapper[2577]: I0729 00:59:46.411191    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:00:19.709124 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:00:19.709044    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:00:33.814804 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:00:33.814766    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:00:41.112819 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:00:41.112781    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:00:57.512516 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:00:57.512467    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:01:06.814170 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:01:06.814123    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:01:14.331089 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:01:14.331061    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tfr5v_ac322954-06d1-4807-8a8b-59e62befe6bc/ovn-acl-logging/0.log"
Jul 29 01:01:14.333245 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:01:14.333225    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tfr5v_ac322954-06d1-4807-8a8b-59e62befe6bc/ovn-acl-logging/0.log"
Jul 29 01:01:16.105138 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:01:16.105108    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:01:26.610634 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:01:26.610576    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:01:35.608449 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:01:35.608411    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:01:44.810149 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:01:44.810107    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:01:58.412932 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:01:58.412894    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:02:07.410376 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:02:07.410343    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:02:17.112287 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:02:17.112247    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:02:27.713023 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:02:27.712987    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:02:38.713801 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:02:38.713767    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:02:45.926466 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:02:45.926426    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:03:01.811290 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:03:01.811252    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:03:11.209332 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:03:11.209249    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:03:24.512041 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:03:24.512004    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:03:38.209135 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:03:38.209099    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:03:50.815310 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:03:50.815268    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:04:07.207632 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:04:07.207525    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:04:33.253090 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:04:33.253057    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:04:44.113708 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:04:44.113627    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:05:08.513797 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:05:08.513756    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:05:19.408604 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:05:19.408529    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:05:42.906051 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:05:42.906017    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:05:53.309373 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:05:53.309342    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:06:14.359016 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:06:14.358982    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tfr5v_ac322954-06d1-4807-8a8b-59e62befe6bc/ovn-acl-logging/0.log"
Jul 29 01:06:14.362240 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:06:14.362217    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tfr5v_ac322954-06d1-4807-8a8b-59e62befe6bc/ovn-acl-logging/0.log"
Jul 29 01:06:18.011531 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:06:18.011497    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:07:38.908672 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:07:38.908576    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:07:49.317218 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:07:49.317173    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:07:59.507711 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:07:59.507676    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:08:10.907770 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:08:10.907734    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:08:45.308878 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:08:45.308841    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:09:18.209140 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:09:18.209095    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:09:40.405058 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:09:40.405024    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-9bb5bd21/e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g"]
Jul 29 01:09:40.408815 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:09:40.408793    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9bb5bd21/e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g"
Jul 29 01:09:40.411610 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:09:40.411552    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-9bb5bd21\"/\"openshift-service-ca.crt\""
Jul 29 01:09:40.411736 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:09:40.411639    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-9bb5bd21\"/\"default-dockercfg-fdkjh\""
Jul 29 01:09:40.411736 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:09:40.411641    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-9bb5bd21\"/\"e2e-lifecycle-model-9bb5bd21-kserve-self-signed-certs\""
Jul 29 01:09:40.411736 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:09:40.411724    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-9bb5bd21\"/\"kube-root-ca.crt\""
Jul 29 01:09:40.418800 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:09:40.418777    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-9bb5bd21/e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g"]
Jul 29 01:09:40.539465 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:09:40.539428    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60673cae-44dc-4871-8d22-3645e9d915f5-dshm\") pod \"e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g\" (UID: \"60673cae-44dc-4871-8d22-3645e9d915f5\") " pod="ai-tenant-e2e-mt-9bb5bd21/e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g"
Jul 29 01:09:40.539677 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:09:40.539481    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60673cae-44dc-4871-8d22-3645e9d915f5-tmp-dir\") pod \"e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g\" (UID: \"60673cae-44dc-4871-8d22-3645e9d915f5\") " pod="ai-tenant-e2e-mt-9bb5bd21/e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g"
Jul 29 01:09:40.539677 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:09:40.539547    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77c2x\" (UniqueName: \"kubernetes.io/projected/60673cae-44dc-4871-8d22-3645e9d915f5-kube-api-access-77c2x\") pod \"e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g\" (UID: \"60673cae-44dc-4871-8d22-3645e9d915f5\") " pod="ai-tenant-e2e-mt-9bb5bd21/e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g"
Jul 29 01:09:40.539677 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:09:40.539620    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60673cae-44dc-4871-8d22-3645e9d915f5-home\") pod \"e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g\" (UID: \"60673cae-44dc-4871-8d22-3645e9d915f5\") " pod="ai-tenant-e2e-mt-9bb5bd21/e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g"
Jul 29 01:09:40.539781 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:09:40.539702    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60673cae-44dc-4871-8d22-3645e9d915f5-tls-certs\") pod \"e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g\" (UID: \"60673cae-44dc-4871-8d22-3645e9d915f5\") " pod="ai-tenant-e2e-mt-9bb5bd21/e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g"
Jul 29 01:09:40.539781 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:09:40.539738    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60673cae-44dc-4871-8d22-3645e9d915f5-model-cache\") pod \"e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g\" (UID: \"60673cae-44dc-4871-8d22-3645e9d915f5\") " pod="ai-tenant-e2e-mt-9bb5bd21/e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g"
Jul 29 01:09:40.640729 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:09:40.640685    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60673cae-44dc-4871-8d22-3645e9d915f5-home\") pod \"e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g\" (UID: \"60673cae-44dc-4871-8d22-3645e9d915f5\") " pod="ai-tenant-e2e-mt-9bb5bd21/e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g"
Jul 29 01:09:40.640904 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:09:40.640768    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60673cae-44dc-4871-8d22-3645e9d915f5-tls-certs\") pod \"e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g\" (UID: \"60673cae-44dc-4871-8d22-3645e9d915f5\") " pod="ai-tenant-e2e-mt-9bb5bd21/e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g"
Jul 29 01:09:40.640904 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:09:40.640810    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60673cae-44dc-4871-8d22-3645e9d915f5-model-cache\") pod \"e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g\" (UID: \"60673cae-44dc-4871-8d22-3645e9d915f5\") " pod="ai-tenant-e2e-mt-9bb5bd21/e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g"
Jul 29 01:09:40.640904 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:09:40.640862    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60673cae-44dc-4871-8d22-3645e9d915f5-dshm\") pod \"e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g\" (UID: \"60673cae-44dc-4871-8d22-3645e9d915f5\") " pod="ai-tenant-e2e-mt-9bb5bd21/e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g"
Jul 29 01:09:40.641049 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:09:40.640904    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60673cae-44dc-4871-8d22-3645e9d915f5-tmp-dir\") pod \"e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g\" (UID: \"60673cae-44dc-4871-8d22-3645e9d915f5\") " pod="ai-tenant-e2e-mt-9bb5bd21/e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g"
Jul 29 01:09:40.641049 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:09:40.640939    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77c2x\" (UniqueName: \"kubernetes.io/projected/60673cae-44dc-4871-8d22-3645e9d915f5-kube-api-access-77c2x\") pod \"e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g\" (UID: \"60673cae-44dc-4871-8d22-3645e9d915f5\") " pod="ai-tenant-e2e-mt-9bb5bd21/e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g"
Jul 29 01:09:40.641189 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:09:40.641168    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60673cae-44dc-4871-8d22-3645e9d915f5-home\") pod \"e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g\" (UID: \"60673cae-44dc-4871-8d22-3645e9d915f5\") " pod="ai-tenant-e2e-mt-9bb5bd21/e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g"
Jul 29 01:09:40.641257 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:09:40.641191    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60673cae-44dc-4871-8d22-3645e9d915f5-model-cache\") pod \"e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g\" (UID: \"60673cae-44dc-4871-8d22-3645e9d915f5\") " pod="ai-tenant-e2e-mt-9bb5bd21/e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g"
Jul 29 01:09:40.641356 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:09:40.641336    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60673cae-44dc-4871-8d22-3645e9d915f5-tmp-dir\") pod \"e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g\" (UID: \"60673cae-44dc-4871-8d22-3645e9d915f5\") " pod="ai-tenant-e2e-mt-9bb5bd21/e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g"
Jul 29 01:09:40.643104 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:09:40.643073    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60673cae-44dc-4871-8d22-3645e9d915f5-dshm\") pod \"e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g\" (UID: \"60673cae-44dc-4871-8d22-3645e9d915f5\") " pod="ai-tenant-e2e-mt-9bb5bd21/e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g"
Jul 29 01:09:40.643342 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:09:40.643322    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60673cae-44dc-4871-8d22-3645e9d915f5-tls-certs\") pod \"e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g\" (UID: \"60673cae-44dc-4871-8d22-3645e9d915f5\") " pod="ai-tenant-e2e-mt-9bb5bd21/e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g"
Jul 29 01:09:40.648715 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:09:40.648694    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77c2x\" (UniqueName: \"kubernetes.io/projected/60673cae-44dc-4871-8d22-3645e9d915f5-kube-api-access-77c2x\") pod \"e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g\" (UID: \"60673cae-44dc-4871-8d22-3645e9d915f5\") " pod="ai-tenant-e2e-mt-9bb5bd21/e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g"
Jul 29 01:09:40.719687 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:09:40.719598    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9bb5bd21/e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g"
Jul 29 01:09:40.849926 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:09:40.849900    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-9bb5bd21/e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g"]
Jul 29 01:09:40.852702 ip-10-0-138-146 kubenswrapper[2577]: W0729 01:09:40.852678    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod60673cae_44dc_4871_8d22_3645e9d915f5.slice/crio-5592cfb846db579ef3de0796f1123d271a9c3346c6850588c7aeb42a76bfd22a WatchSource:0}: Error finding container 5592cfb846db579ef3de0796f1123d271a9c3346c6850588c7aeb42a76bfd22a: Status 404 returned error can't find the container with id 5592cfb846db579ef3de0796f1123d271a9c3346c6850588c7aeb42a76bfd22a
Jul 29 01:09:41.494162 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:09:41.494120    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9bb5bd21/e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g" event={"ID":"60673cae-44dc-4871-8d22-3645e9d915f5","Type":"ContainerStarted","Data":"e63985a6f6e143c48fdc92aba8bddfb763792952ef3052dffa14d22d41be4fad"}
Jul 29 01:09:41.494610 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:09:41.494174    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9bb5bd21/e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g" event={"ID":"60673cae-44dc-4871-8d22-3645e9d915f5","Type":"ContainerStarted","Data":"5592cfb846db579ef3de0796f1123d271a9c3346c6850588c7aeb42a76bfd22a"}
Jul 29 01:09:41.511396 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:09:41.511335    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-9bb5bd21/e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g" podStartSLOduration=1.5113181089999999 podStartE2EDuration="1.511318109s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:09:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:09:41.509671096 +0000 UTC m=+2007.654128676" watchObservedRunningTime="2026-07-29 01:09:41.511318109 +0000 UTC m=+2007.655775678"
Jul 29 01:09:43.612247 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:09:43.612213    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:09:50.720698 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:09:50.720636    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-9bb5bd21/e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g"
Jul 29 01:09:50.721186 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:09:50.720721    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-9bb5bd21/e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g"
Jul 29 01:09:50.733147 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:09:50.733115    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-9bb5bd21/e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g"
Jul 29 01:09:51.551851 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:09:51.551824    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-9bb5bd21/e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g"
Jul 29 01:09:57.411723 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:09:57.411688    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:10:19.013661 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:10:19.013622    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:10:28.849235 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:10:28.849197    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-9bb5bd21/e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g"]
Jul 29 01:10:30.317164 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:10:30.317125    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:10:43.868364 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:10:43.868270    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-9bb5bd21/e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g" podUID="60673cae-44dc-4871-8d22-3645e9d915f5" containerName="main" containerID="cri-o://e63985a6f6e143c48fdc92aba8bddfb763792952ef3052dffa14d22d41be4fad" gracePeriod=45
Jul 29 01:10:44.109209 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:10:44.109179    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9bb5bd21/e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g"
Jul 29 01:10:44.142782 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:10:44.142694    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60673cae-44dc-4871-8d22-3645e9d915f5-home\") pod \"60673cae-44dc-4871-8d22-3645e9d915f5\" (UID: \"60673cae-44dc-4871-8d22-3645e9d915f5\") "
Jul 29 01:10:44.142782 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:10:44.142767    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60673cae-44dc-4871-8d22-3645e9d915f5-tls-certs\") pod \"60673cae-44dc-4871-8d22-3645e9d915f5\" (UID: \"60673cae-44dc-4871-8d22-3645e9d915f5\") "
Jul 29 01:10:44.142998 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:10:44.142812    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60673cae-44dc-4871-8d22-3645e9d915f5-tmp-dir\") pod \"60673cae-44dc-4871-8d22-3645e9d915f5\" (UID: \"60673cae-44dc-4871-8d22-3645e9d915f5\") "
Jul 29 01:10:44.142998 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:10:44.142868    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60673cae-44dc-4871-8d22-3645e9d915f5-dshm\") pod \"60673cae-44dc-4871-8d22-3645e9d915f5\" (UID: \"60673cae-44dc-4871-8d22-3645e9d915f5\") "
Jul 29 01:10:44.142998 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:10:44.142892    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77c2x\" (UniqueName: \"kubernetes.io/projected/60673cae-44dc-4871-8d22-3645e9d915f5-kube-api-access-77c2x\") pod \"60673cae-44dc-4871-8d22-3645e9d915f5\" (UID: \"60673cae-44dc-4871-8d22-3645e9d915f5\") "
Jul 29 01:10:44.142998 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:10:44.142916    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60673cae-44dc-4871-8d22-3645e9d915f5-model-cache\") pod \"60673cae-44dc-4871-8d22-3645e9d915f5\" (UID: \"60673cae-44dc-4871-8d22-3645e9d915f5\") "
Jul 29 01:10:44.143184 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:10:44.143039    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60673cae-44dc-4871-8d22-3645e9d915f5-home" (OuterVolumeSpecName: "home") pod "60673cae-44dc-4871-8d22-3645e9d915f5" (UID: "60673cae-44dc-4871-8d22-3645e9d915f5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:10:44.143184 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:10:44.143113    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60673cae-44dc-4871-8d22-3645e9d915f5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "60673cae-44dc-4871-8d22-3645e9d915f5" (UID: "60673cae-44dc-4871-8d22-3645e9d915f5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:10:44.143303 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:10:44.143283    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60673cae-44dc-4871-8d22-3645e9d915f5-tmp-dir\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:10:44.143343 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:10:44.143311    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60673cae-44dc-4871-8d22-3645e9d915f5-home\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:10:44.143375 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:10:44.143359    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60673cae-44dc-4871-8d22-3645e9d915f5-model-cache" (OuterVolumeSpecName: "model-cache") pod "60673cae-44dc-4871-8d22-3645e9d915f5" (UID: "60673cae-44dc-4871-8d22-3645e9d915f5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:10:44.145282 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:10:44.145256    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60673cae-44dc-4871-8d22-3645e9d915f5-dshm" (OuterVolumeSpecName: "dshm") pod "60673cae-44dc-4871-8d22-3645e9d915f5" (UID: "60673cae-44dc-4871-8d22-3645e9d915f5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:10:44.145523 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:10:44.145489    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60673cae-44dc-4871-8d22-3645e9d915f5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "60673cae-44dc-4871-8d22-3645e9d915f5" (UID: "60673cae-44dc-4871-8d22-3645e9d915f5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:10:44.145523 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:10:44.145520    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60673cae-44dc-4871-8d22-3645e9d915f5-kube-api-access-77c2x" (OuterVolumeSpecName: "kube-api-access-77c2x") pod "60673cae-44dc-4871-8d22-3645e9d915f5" (UID: "60673cae-44dc-4871-8d22-3645e9d915f5"). InnerVolumeSpecName "kube-api-access-77c2x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:10:44.244744 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:10:44.244704    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60673cae-44dc-4871-8d22-3645e9d915f5-dshm\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:10:44.244744 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:10:44.244736    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77c2x\" (UniqueName: \"kubernetes.io/projected/60673cae-44dc-4871-8d22-3645e9d915f5-kube-api-access-77c2x\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:10:44.244744 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:10:44.244747    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60673cae-44dc-4871-8d22-3645e9d915f5-model-cache\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:10:44.244744 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:10:44.244757    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60673cae-44dc-4871-8d22-3645e9d915f5-tls-certs\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:10:44.785777 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:10:44.785744    2577 generic.go:356] "Generic (PLEG): container finished" podID="60673cae-44dc-4871-8d22-3645e9d915f5" containerID="e63985a6f6e143c48fdc92aba8bddfb763792952ef3052dffa14d22d41be4fad" exitCode=0
Jul 29 01:10:44.785953 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:10:44.785790    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9bb5bd21/e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g"
Jul 29 01:10:44.785953 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:10:44.785844    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9bb5bd21/e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g" event={"ID":"60673cae-44dc-4871-8d22-3645e9d915f5","Type":"ContainerDied","Data":"e63985a6f6e143c48fdc92aba8bddfb763792952ef3052dffa14d22d41be4fad"}
Jul 29 01:10:44.785953 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:10:44.785886    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9bb5bd21/e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g" event={"ID":"60673cae-44dc-4871-8d22-3645e9d915f5","Type":"ContainerDied","Data":"5592cfb846db579ef3de0796f1123d271a9c3346c6850588c7aeb42a76bfd22a"}
Jul 29 01:10:44.785953 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:10:44.785903    2577 scope.go:117] "RemoveContainer" containerID="e63985a6f6e143c48fdc92aba8bddfb763792952ef3052dffa14d22d41be4fad"
Jul 29 01:10:44.796031 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:10:44.796005    2577 scope.go:117] "RemoveContainer" containerID="e63985a6f6e143c48fdc92aba8bddfb763792952ef3052dffa14d22d41be4fad"
Jul 29 01:10:44.799556 ip-10-0-138-146 kubenswrapper[2577]: E0729 01:10:44.799526    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e63985a6f6e143c48fdc92aba8bddfb763792952ef3052dffa14d22d41be4fad\": container with ID starting with e63985a6f6e143c48fdc92aba8bddfb763792952ef3052dffa14d22d41be4fad not found: ID does not exist" containerID="e63985a6f6e143c48fdc92aba8bddfb763792952ef3052dffa14d22d41be4fad"
Jul 29 01:10:44.799742 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:10:44.799564    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e63985a6f6e143c48fdc92aba8bddfb763792952ef3052dffa14d22d41be4fad"} err="failed to get container status \"e63985a6f6e143c48fdc92aba8bddfb763792952ef3052dffa14d22d41be4fad\": rpc error: code = NotFound desc = could not find container \"e63985a6f6e143c48fdc92aba8bddfb763792952ef3052dffa14d22d41be4fad\": container with ID starting with e63985a6f6e143c48fdc92aba8bddfb763792952ef3052dffa14d22d41be4fad not found: ID does not exist"
Jul 29 01:10:44.800348 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:10:44.800266    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-9bb5bd21/e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g"]
Jul 29 01:10:44.802218 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:10:44.802197    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-9bb5bd21/e2e-lifecycle-model-9bb5bd21-kserve-77f688c547-gmw6g"]
Jul 29 01:10:46.303467 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:10:46.303434    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60673cae-44dc-4871-8d22-3645e9d915f5" path="/var/lib/kubelet/pods/60673cae-44dc-4871-8d22-3645e9d915f5/volumes"
Jul 29 01:11:14.392118 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:11:14.392085    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tfr5v_ac322954-06d1-4807-8a8b-59e62befe6bc/ovn-acl-logging/0.log"
Jul 29 01:11:14.395665 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:11:14.395636    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tfr5v_ac322954-06d1-4807-8a8b-59e62befe6bc/ovn-acl-logging/0.log"
Jul 29 01:11:21.011495 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:11:21.011447    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:11:30.907841 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:11:30.907799    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:12:22.104030 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:12:22.103996    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:12:51.209508 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:12:51.209472    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:13:10.710859 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:10.710825    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-dda27e/test-model-dda27e-kserve-7c6c7447cf-rt9c4"]
Jul 29 01:13:10.711286 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:10.711269    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60673cae-44dc-4871-8d22-3645e9d915f5" containerName="main"
Jul 29 01:13:10.711373 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:10.711290    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="60673cae-44dc-4871-8d22-3645e9d915f5" containerName="main"
Jul 29 01:13:10.711416 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:10.711383    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="60673cae-44dc-4871-8d22-3645e9d915f5" containerName="main"
Jul 29 01:13:10.714753 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:10.714733    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-dda27e/test-model-dda27e-kserve-7c6c7447cf-rt9c4"
Jul 29 01:13:10.717463 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:10.717439    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-dda27e\"/\"test-model-dda27e-kserve-self-signed-certs\""
Jul 29 01:13:10.717463 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:10.717468    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-dda27e\"/\"kube-root-ca.crt\""
Jul 29 01:13:10.717688 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:10.717504    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-dda27e\"/\"default-dockercfg-5jqkt\""
Jul 29 01:13:10.717688 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:10.717443    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-dda27e\"/\"openshift-service-ca.crt\""
Jul 29 01:13:10.722009 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:10.721898    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-dda27e/test-model-dda27e-kserve-7c6c7447cf-rt9c4"]
Jul 29 01:13:10.816337 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:10.816295    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f683990-6bd7-47da-a27f-c975ced3d4a9-tmp-dir\") pod \"test-model-dda27e-kserve-7c6c7447cf-rt9c4\" (UID: \"6f683990-6bd7-47da-a27f-c975ced3d4a9\") " pod="ai-tenant-e2e-inf-a-dda27e/test-model-dda27e-kserve-7c6c7447cf-rt9c4"
Jul 29 01:13:10.816337 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:10.816340    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f683990-6bd7-47da-a27f-c975ced3d4a9-home\") pod \"test-model-dda27e-kserve-7c6c7447cf-rt9c4\" (UID: \"6f683990-6bd7-47da-a27f-c975ced3d4a9\") " pod="ai-tenant-e2e-inf-a-dda27e/test-model-dda27e-kserve-7c6c7447cf-rt9c4"
Jul 29 01:13:10.816554 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:10.816402    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v8nc\" (UniqueName: \"kubernetes.io/projected/6f683990-6bd7-47da-a27f-c975ced3d4a9-kube-api-access-9v8nc\") pod \"test-model-dda27e-kserve-7c6c7447cf-rt9c4\" (UID: \"6f683990-6bd7-47da-a27f-c975ced3d4a9\") " pod="ai-tenant-e2e-inf-a-dda27e/test-model-dda27e-kserve-7c6c7447cf-rt9c4"
Jul 29 01:13:10.816554 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:10.816444    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f683990-6bd7-47da-a27f-c975ced3d4a9-model-cache\") pod \"test-model-dda27e-kserve-7c6c7447cf-rt9c4\" (UID: \"6f683990-6bd7-47da-a27f-c975ced3d4a9\") " pod="ai-tenant-e2e-inf-a-dda27e/test-model-dda27e-kserve-7c6c7447cf-rt9c4"
Jul 29 01:13:10.816554 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:10.816484    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f683990-6bd7-47da-a27f-c975ced3d4a9-tls-certs\") pod \"test-model-dda27e-kserve-7c6c7447cf-rt9c4\" (UID: \"6f683990-6bd7-47da-a27f-c975ced3d4a9\") " pod="ai-tenant-e2e-inf-a-dda27e/test-model-dda27e-kserve-7c6c7447cf-rt9c4"
Jul 29 01:13:10.816709 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:10.816564    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f683990-6bd7-47da-a27f-c975ced3d4a9-dshm\") pod \"test-model-dda27e-kserve-7c6c7447cf-rt9c4\" (UID: \"6f683990-6bd7-47da-a27f-c975ced3d4a9\") " pod="ai-tenant-e2e-inf-a-dda27e/test-model-dda27e-kserve-7c6c7447cf-rt9c4"
Jul 29 01:13:10.917685 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:10.917651    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f683990-6bd7-47da-a27f-c975ced3d4a9-dshm\") pod \"test-model-dda27e-kserve-7c6c7447cf-rt9c4\" (UID: \"6f683990-6bd7-47da-a27f-c975ced3d4a9\") " pod="ai-tenant-e2e-inf-a-dda27e/test-model-dda27e-kserve-7c6c7447cf-rt9c4"
Jul 29 01:13:10.917934 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:10.917728    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f683990-6bd7-47da-a27f-c975ced3d4a9-tmp-dir\") pod \"test-model-dda27e-kserve-7c6c7447cf-rt9c4\" (UID: \"6f683990-6bd7-47da-a27f-c975ced3d4a9\") " pod="ai-tenant-e2e-inf-a-dda27e/test-model-dda27e-kserve-7c6c7447cf-rt9c4"
Jul 29 01:13:10.917934 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:10.917758    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f683990-6bd7-47da-a27f-c975ced3d4a9-home\") pod \"test-model-dda27e-kserve-7c6c7447cf-rt9c4\" (UID: \"6f683990-6bd7-47da-a27f-c975ced3d4a9\") " pod="ai-tenant-e2e-inf-a-dda27e/test-model-dda27e-kserve-7c6c7447cf-rt9c4"
Jul 29 01:13:10.917934 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:10.917795    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9v8nc\" (UniqueName: \"kubernetes.io/projected/6f683990-6bd7-47da-a27f-c975ced3d4a9-kube-api-access-9v8nc\") pod \"test-model-dda27e-kserve-7c6c7447cf-rt9c4\" (UID: \"6f683990-6bd7-47da-a27f-c975ced3d4a9\") " pod="ai-tenant-e2e-inf-a-dda27e/test-model-dda27e-kserve-7c6c7447cf-rt9c4"
Jul 29 01:13:10.917934 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:10.917828    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f683990-6bd7-47da-a27f-c975ced3d4a9-model-cache\") pod \"test-model-dda27e-kserve-7c6c7447cf-rt9c4\" (UID: \"6f683990-6bd7-47da-a27f-c975ced3d4a9\") " pod="ai-tenant-e2e-inf-a-dda27e/test-model-dda27e-kserve-7c6c7447cf-rt9c4"
Jul 29 01:13:10.917934 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:10.917884    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f683990-6bd7-47da-a27f-c975ced3d4a9-tls-certs\") pod \"test-model-dda27e-kserve-7c6c7447cf-rt9c4\" (UID: \"6f683990-6bd7-47da-a27f-c975ced3d4a9\") " pod="ai-tenant-e2e-inf-a-dda27e/test-model-dda27e-kserve-7c6c7447cf-rt9c4"
Jul 29 01:13:10.918188 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:10.918171    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f683990-6bd7-47da-a27f-c975ced3d4a9-tmp-dir\") pod \"test-model-dda27e-kserve-7c6c7447cf-rt9c4\" (UID: \"6f683990-6bd7-47da-a27f-c975ced3d4a9\") " pod="ai-tenant-e2e-inf-a-dda27e/test-model-dda27e-kserve-7c6c7447cf-rt9c4"
Jul 29 01:13:10.918478 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:10.918459    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f683990-6bd7-47da-a27f-c975ced3d4a9-model-cache\") pod \"test-model-dda27e-kserve-7c6c7447cf-rt9c4\" (UID: \"6f683990-6bd7-47da-a27f-c975ced3d4a9\") " pod="ai-tenant-e2e-inf-a-dda27e/test-model-dda27e-kserve-7c6c7447cf-rt9c4"
Jul 29 01:13:10.918560 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:10.918488    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f683990-6bd7-47da-a27f-c975ced3d4a9-home\") pod \"test-model-dda27e-kserve-7c6c7447cf-rt9c4\" (UID: \"6f683990-6bd7-47da-a27f-c975ced3d4a9\") " pod="ai-tenant-e2e-inf-a-dda27e/test-model-dda27e-kserve-7c6c7447cf-rt9c4"
Jul 29 01:13:10.920010 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:10.919986    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f683990-6bd7-47da-a27f-c975ced3d4a9-dshm\") pod \"test-model-dda27e-kserve-7c6c7447cf-rt9c4\" (UID: \"6f683990-6bd7-47da-a27f-c975ced3d4a9\") " pod="ai-tenant-e2e-inf-a-dda27e/test-model-dda27e-kserve-7c6c7447cf-rt9c4"
Jul 29 01:13:10.920411 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:10.920394    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f683990-6bd7-47da-a27f-c975ced3d4a9-tls-certs\") pod \"test-model-dda27e-kserve-7c6c7447cf-rt9c4\" (UID: \"6f683990-6bd7-47da-a27f-c975ced3d4a9\") " pod="ai-tenant-e2e-inf-a-dda27e/test-model-dda27e-kserve-7c6c7447cf-rt9c4"
Jul 29 01:13:10.925575 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:10.925556    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v8nc\" (UniqueName: \"kubernetes.io/projected/6f683990-6bd7-47da-a27f-c975ced3d4a9-kube-api-access-9v8nc\") pod \"test-model-dda27e-kserve-7c6c7447cf-rt9c4\" (UID: \"6f683990-6bd7-47da-a27f-c975ced3d4a9\") " pod="ai-tenant-e2e-inf-a-dda27e/test-model-dda27e-kserve-7c6c7447cf-rt9c4"
Jul 29 01:13:11.024826 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:11.024731    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-dda27e/test-model-dda27e-kserve-7c6c7447cf-rt9c4"
Jul 29 01:13:11.157541 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:11.157518    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-dda27e/test-model-dda27e-kserve-7c6c7447cf-rt9c4"]
Jul 29 01:13:11.159894 ip-10-0-138-146 kubenswrapper[2577]: W0729 01:13:11.159855    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f683990_6bd7_47da_a27f_c975ced3d4a9.slice/crio-ab11da2913b6703321c9fc458552325f0348449608429011f56acd16a4c4be4d WatchSource:0}: Error finding container ab11da2913b6703321c9fc458552325f0348449608429011f56acd16a4c4be4d: Status 404 returned error can't find the container with id ab11da2913b6703321c9fc458552325f0348449608429011f56acd16a4c4be4d
Jul 29 01:13:11.453267 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:11.453230    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-dda27e/test-model-dda27e-kserve-7c6c7447cf-rt9c4" event={"ID":"6f683990-6bd7-47da-a27f-c975ced3d4a9","Type":"ContainerStarted","Data":"646bd4ce7c250a73f1695d58566b8c589f6f13fc1fcb41ae84b078ce320c57a4"}
Jul 29 01:13:11.453267 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:11.453270    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-dda27e/test-model-dda27e-kserve-7c6c7447cf-rt9c4" event={"ID":"6f683990-6bd7-47da-a27f-c975ced3d4a9","Type":"ContainerStarted","Data":"ab11da2913b6703321c9fc458552325f0348449608429011f56acd16a4c4be4d"}
Jul 29 01:13:11.472304 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:11.472250    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-dda27e/test-model-dda27e-kserve-7c6c7447cf-rt9c4" podStartSLOduration=1.472234651 podStartE2EDuration="1.472234651s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:13:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:11.470009525 +0000 UTC m=+2217.614467091" watchObservedRunningTime="2026-07-29 01:13:11.472234651 +0000 UTC m=+2217.616692220"
Jul 29 01:13:14.007634 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:14.007599    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:13:21.025005 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:21.024970    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-dda27e/test-model-dda27e-kserve-7c6c7447cf-rt9c4"
Jul 29 01:13:21.025005 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:21.025016    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-dda27e/test-model-dda27e-kserve-7c6c7447cf-rt9c4"
Jul 29 01:13:21.037937 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:21.037909    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-dda27e/test-model-dda27e-kserve-7c6c7447cf-rt9c4"
Jul 29 01:13:21.509607 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:21.509567    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-dda27e/test-model-dda27e-kserve-7c6c7447cf-rt9c4"
Jul 29 01:13:28.018757 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:28.018722    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:13:33.516628 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:33.516571    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-a1744c/test-model-a1744c-kserve-7b75ccfc85-hxmrg"]
Jul 29 01:13:33.520026 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:33.520005    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a1744c/test-model-a1744c-kserve-7b75ccfc85-hxmrg"
Jul 29 01:13:33.522792 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:33.522762    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-a1744c\"/\"test-model-a1744c-kserve-self-signed-certs\""
Jul 29 01:13:33.523164 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:33.522795    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-a1744c\"/\"kube-root-ca.crt\""
Jul 29 01:13:33.523164 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:33.522811    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-a1744c\"/\"default-dockercfg-gpkdl\""
Jul 29 01:13:33.523164 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:33.522765    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-a1744c\"/\"openshift-service-ca.crt\""
Jul 29 01:13:33.529941 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:33.529914    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-a1744c/test-model-a1744c-kserve-7b75ccfc85-hxmrg"]
Jul 29 01:13:33.622771 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:33.622732    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88d8d6d9-bf53-42fe-b2b3-b351c18d35a6-tls-certs\") pod \"test-model-a1744c-kserve-7b75ccfc85-hxmrg\" (UID: \"88d8d6d9-bf53-42fe-b2b3-b351c18d35a6\") " pod="ai-tenant-e2e-inf-b-a1744c/test-model-a1744c-kserve-7b75ccfc85-hxmrg"
Jul 29 01:13:33.622771 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:33.622774    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc9t4\" (UniqueName: \"kubernetes.io/projected/88d8d6d9-bf53-42fe-b2b3-b351c18d35a6-kube-api-access-nc9t4\") pod \"test-model-a1744c-kserve-7b75ccfc85-hxmrg\" (UID: \"88d8d6d9-bf53-42fe-b2b3-b351c18d35a6\") " pod="ai-tenant-e2e-inf-b-a1744c/test-model-a1744c-kserve-7b75ccfc85-hxmrg"
Jul 29 01:13:33.622983 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:33.622795    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88d8d6d9-bf53-42fe-b2b3-b351c18d35a6-model-cache\") pod \"test-model-a1744c-kserve-7b75ccfc85-hxmrg\" (UID: \"88d8d6d9-bf53-42fe-b2b3-b351c18d35a6\") " pod="ai-tenant-e2e-inf-b-a1744c/test-model-a1744c-kserve-7b75ccfc85-hxmrg"
Jul 29 01:13:33.622983 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:33.622864    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88d8d6d9-bf53-42fe-b2b3-b351c18d35a6-home\") pod \"test-model-a1744c-kserve-7b75ccfc85-hxmrg\" (UID: \"88d8d6d9-bf53-42fe-b2b3-b351c18d35a6\") " pod="ai-tenant-e2e-inf-b-a1744c/test-model-a1744c-kserve-7b75ccfc85-hxmrg"
Jul 29 01:13:33.622983 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:33.622930    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88d8d6d9-bf53-42fe-b2b3-b351c18d35a6-dshm\") pod \"test-model-a1744c-kserve-7b75ccfc85-hxmrg\" (UID: \"88d8d6d9-bf53-42fe-b2b3-b351c18d35a6\") " pod="ai-tenant-e2e-inf-b-a1744c/test-model-a1744c-kserve-7b75ccfc85-hxmrg"
Jul 29 01:13:33.623081 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:33.623027    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88d8d6d9-bf53-42fe-b2b3-b351c18d35a6-tmp-dir\") pod \"test-model-a1744c-kserve-7b75ccfc85-hxmrg\" (UID: \"88d8d6d9-bf53-42fe-b2b3-b351c18d35a6\") " pod="ai-tenant-e2e-inf-b-a1744c/test-model-a1744c-kserve-7b75ccfc85-hxmrg"
Jul 29 01:13:33.723983 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:33.723938    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88d8d6d9-bf53-42fe-b2b3-b351c18d35a6-tls-certs\") pod \"test-model-a1744c-kserve-7b75ccfc85-hxmrg\" (UID: \"88d8d6d9-bf53-42fe-b2b3-b351c18d35a6\") " pod="ai-tenant-e2e-inf-b-a1744c/test-model-a1744c-kserve-7b75ccfc85-hxmrg"
Jul 29 01:13:33.723983 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:33.723987    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc9t4\" (UniqueName: \"kubernetes.io/projected/88d8d6d9-bf53-42fe-b2b3-b351c18d35a6-kube-api-access-nc9t4\") pod \"test-model-a1744c-kserve-7b75ccfc85-hxmrg\" (UID: \"88d8d6d9-bf53-42fe-b2b3-b351c18d35a6\") " pod="ai-tenant-e2e-inf-b-a1744c/test-model-a1744c-kserve-7b75ccfc85-hxmrg"
Jul 29 01:13:33.724217 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:33.724104    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88d8d6d9-bf53-42fe-b2b3-b351c18d35a6-model-cache\") pod \"test-model-a1744c-kserve-7b75ccfc85-hxmrg\" (UID: \"88d8d6d9-bf53-42fe-b2b3-b351c18d35a6\") " pod="ai-tenant-e2e-inf-b-a1744c/test-model-a1744c-kserve-7b75ccfc85-hxmrg"
Jul 29 01:13:33.724217 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:33.724201    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88d8d6d9-bf53-42fe-b2b3-b351c18d35a6-home\") pod \"test-model-a1744c-kserve-7b75ccfc85-hxmrg\" (UID: \"88d8d6d9-bf53-42fe-b2b3-b351c18d35a6\") " pod="ai-tenant-e2e-inf-b-a1744c/test-model-a1744c-kserve-7b75ccfc85-hxmrg"
Jul 29 01:13:33.724318 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:33.724262    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88d8d6d9-bf53-42fe-b2b3-b351c18d35a6-dshm\") pod \"test-model-a1744c-kserve-7b75ccfc85-hxmrg\" (UID: \"88d8d6d9-bf53-42fe-b2b3-b351c18d35a6\") " pod="ai-tenant-e2e-inf-b-a1744c/test-model-a1744c-kserve-7b75ccfc85-hxmrg"
Jul 29 01:13:33.724384 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:33.724367    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88d8d6d9-bf53-42fe-b2b3-b351c18d35a6-tmp-dir\") pod \"test-model-a1744c-kserve-7b75ccfc85-hxmrg\" (UID: \"88d8d6d9-bf53-42fe-b2b3-b351c18d35a6\") " pod="ai-tenant-e2e-inf-b-a1744c/test-model-a1744c-kserve-7b75ccfc85-hxmrg"
Jul 29 01:13:33.724531 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:33.724511    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88d8d6d9-bf53-42fe-b2b3-b351c18d35a6-model-cache\") pod \"test-model-a1744c-kserve-7b75ccfc85-hxmrg\" (UID: \"88d8d6d9-bf53-42fe-b2b3-b351c18d35a6\") " pod="ai-tenant-e2e-inf-b-a1744c/test-model-a1744c-kserve-7b75ccfc85-hxmrg"
Jul 29 01:13:33.724611 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:33.724558    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88d8d6d9-bf53-42fe-b2b3-b351c18d35a6-home\") pod \"test-model-a1744c-kserve-7b75ccfc85-hxmrg\" (UID: \"88d8d6d9-bf53-42fe-b2b3-b351c18d35a6\") " pod="ai-tenant-e2e-inf-b-a1744c/test-model-a1744c-kserve-7b75ccfc85-hxmrg"
Jul 29 01:13:33.724701 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:33.724687    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88d8d6d9-bf53-42fe-b2b3-b351c18d35a6-tmp-dir\") pod \"test-model-a1744c-kserve-7b75ccfc85-hxmrg\" (UID: \"88d8d6d9-bf53-42fe-b2b3-b351c18d35a6\") " pod="ai-tenant-e2e-inf-b-a1744c/test-model-a1744c-kserve-7b75ccfc85-hxmrg"
Jul 29 01:13:33.726369 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:33.726349    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88d8d6d9-bf53-42fe-b2b3-b351c18d35a6-dshm\") pod \"test-model-a1744c-kserve-7b75ccfc85-hxmrg\" (UID: \"88d8d6d9-bf53-42fe-b2b3-b351c18d35a6\") " pod="ai-tenant-e2e-inf-b-a1744c/test-model-a1744c-kserve-7b75ccfc85-hxmrg"
Jul 29 01:13:33.726595 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:33.726564    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88d8d6d9-bf53-42fe-b2b3-b351c18d35a6-tls-certs\") pod \"test-model-a1744c-kserve-7b75ccfc85-hxmrg\" (UID: \"88d8d6d9-bf53-42fe-b2b3-b351c18d35a6\") " pod="ai-tenant-e2e-inf-b-a1744c/test-model-a1744c-kserve-7b75ccfc85-hxmrg"
Jul 29 01:13:33.731880 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:33.731857    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc9t4\" (UniqueName: \"kubernetes.io/projected/88d8d6d9-bf53-42fe-b2b3-b351c18d35a6-kube-api-access-nc9t4\") pod \"test-model-a1744c-kserve-7b75ccfc85-hxmrg\" (UID: \"88d8d6d9-bf53-42fe-b2b3-b351c18d35a6\") " pod="ai-tenant-e2e-inf-b-a1744c/test-model-a1744c-kserve-7b75ccfc85-hxmrg"
Jul 29 01:13:33.830171 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:33.830131    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a1744c/test-model-a1744c-kserve-7b75ccfc85-hxmrg"
Jul 29 01:13:33.969981 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:33.969946    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-a1744c/test-model-a1744c-kserve-7b75ccfc85-hxmrg"]
Jul 29 01:13:33.970552 ip-10-0-138-146 kubenswrapper[2577]: W0729 01:13:33.970520    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88d8d6d9_bf53_42fe_b2b3_b351c18d35a6.slice/crio-429fc1487b137b08a7fc360c447313b7ed64ceb0d56955ff10a4684d8fd9faf2 WatchSource:0}: Error finding container 429fc1487b137b08a7fc360c447313b7ed64ceb0d56955ff10a4684d8fd9faf2: Status 404 returned error can't find the container with id 429fc1487b137b08a7fc360c447313b7ed64ceb0d56955ff10a4684d8fd9faf2
Jul 29 01:13:34.559415 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:34.559375    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a1744c/test-model-a1744c-kserve-7b75ccfc85-hxmrg" event={"ID":"88d8d6d9-bf53-42fe-b2b3-b351c18d35a6","Type":"ContainerStarted","Data":"f969ba9d140d19f49af5f90454b5a0a885fd17d24b9caa0fc24c2e4b251c87d5"}
Jul 29 01:13:34.559415 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:34.559423    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a1744c/test-model-a1744c-kserve-7b75ccfc85-hxmrg" event={"ID":"88d8d6d9-bf53-42fe-b2b3-b351c18d35a6","Type":"ContainerStarted","Data":"429fc1487b137b08a7fc360c447313b7ed64ceb0d56955ff10a4684d8fd9faf2"}
Jul 29 01:13:34.574942 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:34.574884    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-a1744c/test-model-a1744c-kserve-7b75ccfc85-hxmrg" podStartSLOduration=1.574864056 podStartE2EDuration="1.574864056s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:13:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:34.574682768 +0000 UTC m=+2240.719140356" watchObservedRunningTime="2026-07-29 01:13:34.574864056 +0000 UTC m=+2240.719321627"
Jul 29 01:13:39.418907 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:39.418811    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:13:43.831040 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:43.831002    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-a1744c/test-model-a1744c-kserve-7b75ccfc85-hxmrg"
Jul 29 01:13:43.831529 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:43.831066    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-a1744c/test-model-a1744c-kserve-7b75ccfc85-hxmrg"
Jul 29 01:13:43.843806 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:43.843777    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-a1744c/test-model-a1744c-kserve-7b75ccfc85-hxmrg"
Jul 29 01:13:44.621604 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:13:44.621563    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-a1744c/test-model-a1744c-kserve-7b75ccfc85-hxmrg"
Jul 29 01:14:27.963747 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:27.963715    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-dda27e/test-model-dda27e-kserve-7c6c7447cf-rt9c4"]
Jul 29 01:14:28.926856 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:28.926826    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-a1744c/test-model-a1744c-kserve-7b75ccfc85-hxmrg"]
Jul 29 01:14:32.816009 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:32.815976    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:14:42.982871 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:42.982814    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-dda27e/test-model-dda27e-kserve-7c6c7447cf-rt9c4" podUID="6f683990-6bd7-47da-a27f-c975ced3d4a9" containerName="main" containerID="cri-o://646bd4ce7c250a73f1695d58566b8c589f6f13fc1fcb41ae84b078ce320c57a4" gracePeriod=45
Jul 29 01:14:43.225162 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:43.225136    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-dda27e/test-model-dda27e-kserve-7c6c7447cf-rt9c4"
Jul 29 01:14:43.303239 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:43.303141    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f683990-6bd7-47da-a27f-c975ced3d4a9-tmp-dir\") pod \"6f683990-6bd7-47da-a27f-c975ced3d4a9\" (UID: \"6f683990-6bd7-47da-a27f-c975ced3d4a9\") "
Jul 29 01:14:43.303239 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:43.303183    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9v8nc\" (UniqueName: \"kubernetes.io/projected/6f683990-6bd7-47da-a27f-c975ced3d4a9-kube-api-access-9v8nc\") pod \"6f683990-6bd7-47da-a27f-c975ced3d4a9\" (UID: \"6f683990-6bd7-47da-a27f-c975ced3d4a9\") "
Jul 29 01:14:43.303239 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:43.303206    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f683990-6bd7-47da-a27f-c975ced3d4a9-model-cache\") pod \"6f683990-6bd7-47da-a27f-c975ced3d4a9\" (UID: \"6f683990-6bd7-47da-a27f-c975ced3d4a9\") "
Jul 29 01:14:43.303239 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:43.303226    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f683990-6bd7-47da-a27f-c975ced3d4a9-dshm\") pod \"6f683990-6bd7-47da-a27f-c975ced3d4a9\" (UID: \"6f683990-6bd7-47da-a27f-c975ced3d4a9\") "
Jul 29 01:14:43.303555 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:43.303257    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f683990-6bd7-47da-a27f-c975ced3d4a9-tls-certs\") pod \"6f683990-6bd7-47da-a27f-c975ced3d4a9\" (UID: \"6f683990-6bd7-47da-a27f-c975ced3d4a9\") "
Jul 29 01:14:43.303555 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:43.303300    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f683990-6bd7-47da-a27f-c975ced3d4a9-home\") pod \"6f683990-6bd7-47da-a27f-c975ced3d4a9\" (UID: \"6f683990-6bd7-47da-a27f-c975ced3d4a9\") "
Jul 29 01:14:43.303555 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:43.303487    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f683990-6bd7-47da-a27f-c975ced3d4a9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6f683990-6bd7-47da-a27f-c975ced3d4a9" (UID: "6f683990-6bd7-47da-a27f-c975ced3d4a9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:14:43.303555 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:43.303501    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f683990-6bd7-47da-a27f-c975ced3d4a9-model-cache" (OuterVolumeSpecName: "model-cache") pod "6f683990-6bd7-47da-a27f-c975ced3d4a9" (UID: "6f683990-6bd7-47da-a27f-c975ced3d4a9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:14:43.303776 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:43.303658    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f683990-6bd7-47da-a27f-c975ced3d4a9-tmp-dir\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:14:43.303776 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:43.303711    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f683990-6bd7-47da-a27f-c975ced3d4a9-model-cache\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:14:43.303776 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:43.303724    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f683990-6bd7-47da-a27f-c975ced3d4a9-home" (OuterVolumeSpecName: "home") pod "6f683990-6bd7-47da-a27f-c975ced3d4a9" (UID: "6f683990-6bd7-47da-a27f-c975ced3d4a9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:14:43.305525 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:43.305502    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f683990-6bd7-47da-a27f-c975ced3d4a9-dshm" (OuterVolumeSpecName: "dshm") pod "6f683990-6bd7-47da-a27f-c975ced3d4a9" (UID: "6f683990-6bd7-47da-a27f-c975ced3d4a9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:14:43.305686 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:43.305534    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f683990-6bd7-47da-a27f-c975ced3d4a9-kube-api-access-9v8nc" (OuterVolumeSpecName: "kube-api-access-9v8nc") pod "6f683990-6bd7-47da-a27f-c975ced3d4a9" (UID: "6f683990-6bd7-47da-a27f-c975ced3d4a9"). InnerVolumeSpecName "kube-api-access-9v8nc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:14:43.305743 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:43.305694    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f683990-6bd7-47da-a27f-c975ced3d4a9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6f683990-6bd7-47da-a27f-c975ced3d4a9" (UID: "6f683990-6bd7-47da-a27f-c975ced3d4a9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:14:43.404729 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:43.404688    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f683990-6bd7-47da-a27f-c975ced3d4a9-home\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:14:43.404729 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:43.404718    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9v8nc\" (UniqueName: \"kubernetes.io/projected/6f683990-6bd7-47da-a27f-c975ced3d4a9-kube-api-access-9v8nc\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:14:43.404729 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:43.404730    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f683990-6bd7-47da-a27f-c975ced3d4a9-dshm\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:14:43.404729 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:43.404738    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f683990-6bd7-47da-a27f-c975ced3d4a9-tls-certs\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:14:43.879162 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:43.879125    2577 generic.go:356] "Generic (PLEG): container finished" podID="6f683990-6bd7-47da-a27f-c975ced3d4a9" containerID="646bd4ce7c250a73f1695d58566b8c589f6f13fc1fcb41ae84b078ce320c57a4" exitCode=0
Jul 29 01:14:43.879162 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:43.879164    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-dda27e/test-model-dda27e-kserve-7c6c7447cf-rt9c4"
Jul 29 01:14:43.879362 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:43.879187    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-dda27e/test-model-dda27e-kserve-7c6c7447cf-rt9c4" event={"ID":"6f683990-6bd7-47da-a27f-c975ced3d4a9","Type":"ContainerDied","Data":"646bd4ce7c250a73f1695d58566b8c589f6f13fc1fcb41ae84b078ce320c57a4"}
Jul 29 01:14:43.879362 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:43.879229    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-dda27e/test-model-dda27e-kserve-7c6c7447cf-rt9c4" event={"ID":"6f683990-6bd7-47da-a27f-c975ced3d4a9","Type":"ContainerDied","Data":"ab11da2913b6703321c9fc458552325f0348449608429011f56acd16a4c4be4d"}
Jul 29 01:14:43.879362 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:43.879247    2577 scope.go:117] "RemoveContainer" containerID="646bd4ce7c250a73f1695d58566b8c589f6f13fc1fcb41ae84b078ce320c57a4"
Jul 29 01:14:43.888553 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:43.888537    2577 scope.go:117] "RemoveContainer" containerID="646bd4ce7c250a73f1695d58566b8c589f6f13fc1fcb41ae84b078ce320c57a4"
Jul 29 01:14:43.888804 ip-10-0-138-146 kubenswrapper[2577]: E0729 01:14:43.888786    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"646bd4ce7c250a73f1695d58566b8c589f6f13fc1fcb41ae84b078ce320c57a4\": container with ID starting with 646bd4ce7c250a73f1695d58566b8c589f6f13fc1fcb41ae84b078ce320c57a4 not found: ID does not exist" containerID="646bd4ce7c250a73f1695d58566b8c589f6f13fc1fcb41ae84b078ce320c57a4"
Jul 29 01:14:43.888874 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:43.888817    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"646bd4ce7c250a73f1695d58566b8c589f6f13fc1fcb41ae84b078ce320c57a4"} err="failed to get container status \"646bd4ce7c250a73f1695d58566b8c589f6f13fc1fcb41ae84b078ce320c57a4\": rpc error: code = NotFound desc = could not find container \"646bd4ce7c250a73f1695d58566b8c589f6f13fc1fcb41ae84b078ce320c57a4\": container with ID starting with 646bd4ce7c250a73f1695d58566b8c589f6f13fc1fcb41ae84b078ce320c57a4 not found: ID does not exist"
Jul 29 01:14:43.899552 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:43.899525    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-dda27e/test-model-dda27e-kserve-7c6c7447cf-rt9c4"]
Jul 29 01:14:43.901626 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:43.901607    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-dda27e/test-model-dda27e-kserve-7c6c7447cf-rt9c4"]
Jul 29 01:14:43.945361 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:43.945330    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-a1744c/test-model-a1744c-kserve-7b75ccfc85-hxmrg" podUID="88d8d6d9-bf53-42fe-b2b3-b351c18d35a6" containerName="main" containerID="cri-o://f969ba9d140d19f49af5f90454b5a0a885fd17d24b9caa0fc24c2e4b251c87d5" gracePeriod=45
Jul 29 01:14:44.190512 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:44.190487    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a1744c/test-model-a1744c-kserve-7b75ccfc85-hxmrg"
Jul 29 01:14:44.212183 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:44.212155    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88d8d6d9-bf53-42fe-b2b3-b351c18d35a6-home\") pod \"88d8d6d9-bf53-42fe-b2b3-b351c18d35a6\" (UID: \"88d8d6d9-bf53-42fe-b2b3-b351c18d35a6\") "
Jul 29 01:14:44.212183 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:44.212189    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88d8d6d9-bf53-42fe-b2b3-b351c18d35a6-dshm\") pod \"88d8d6d9-bf53-42fe-b2b3-b351c18d35a6\" (UID: \"88d8d6d9-bf53-42fe-b2b3-b351c18d35a6\") "
Jul 29 01:14:44.212373 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:44.212230    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88d8d6d9-bf53-42fe-b2b3-b351c18d35a6-tls-certs\") pod \"88d8d6d9-bf53-42fe-b2b3-b351c18d35a6\" (UID: \"88d8d6d9-bf53-42fe-b2b3-b351c18d35a6\") "
Jul 29 01:14:44.212373 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:44.212248    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88d8d6d9-bf53-42fe-b2b3-b351c18d35a6-model-cache\") pod \"88d8d6d9-bf53-42fe-b2b3-b351c18d35a6\" (UID: \"88d8d6d9-bf53-42fe-b2b3-b351c18d35a6\") "
Jul 29 01:14:44.212373 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:44.212284    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nc9t4\" (UniqueName: \"kubernetes.io/projected/88d8d6d9-bf53-42fe-b2b3-b351c18d35a6-kube-api-access-nc9t4\") pod \"88d8d6d9-bf53-42fe-b2b3-b351c18d35a6\" (UID: \"88d8d6d9-bf53-42fe-b2b3-b351c18d35a6\") "
Jul 29 01:14:44.212511 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:44.212414    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88d8d6d9-bf53-42fe-b2b3-b351c18d35a6-home" (OuterVolumeSpecName: "home") pod "88d8d6d9-bf53-42fe-b2b3-b351c18d35a6" (UID: "88d8d6d9-bf53-42fe-b2b3-b351c18d35a6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:14:44.212511 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:44.212491    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88d8d6d9-bf53-42fe-b2b3-b351c18d35a6-tmp-dir\") pod \"88d8d6d9-bf53-42fe-b2b3-b351c18d35a6\" (UID: \"88d8d6d9-bf53-42fe-b2b3-b351c18d35a6\") "
Jul 29 01:14:44.212617 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:44.212563    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88d8d6d9-bf53-42fe-b2b3-b351c18d35a6-model-cache" (OuterVolumeSpecName: "model-cache") pod "88d8d6d9-bf53-42fe-b2b3-b351c18d35a6" (UID: "88d8d6d9-bf53-42fe-b2b3-b351c18d35a6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:14:44.212777 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:44.212748    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88d8d6d9-bf53-42fe-b2b3-b351c18d35a6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "88d8d6d9-bf53-42fe-b2b3-b351c18d35a6" (UID: "88d8d6d9-bf53-42fe-b2b3-b351c18d35a6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:14:44.212910 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:44.212893    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88d8d6d9-bf53-42fe-b2b3-b351c18d35a6-home\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:14:44.212964 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:44.212917    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88d8d6d9-bf53-42fe-b2b3-b351c18d35a6-model-cache\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:14:44.212964 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:44.212931    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88d8d6d9-bf53-42fe-b2b3-b351c18d35a6-tmp-dir\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:14:44.214543 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:44.214516    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88d8d6d9-bf53-42fe-b2b3-b351c18d35a6-kube-api-access-nc9t4" (OuterVolumeSpecName: "kube-api-access-nc9t4") pod "88d8d6d9-bf53-42fe-b2b3-b351c18d35a6" (UID: "88d8d6d9-bf53-42fe-b2b3-b351c18d35a6"). InnerVolumeSpecName "kube-api-access-nc9t4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:14:44.214686 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:44.214541    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88d8d6d9-bf53-42fe-b2b3-b351c18d35a6-dshm" (OuterVolumeSpecName: "dshm") pod "88d8d6d9-bf53-42fe-b2b3-b351c18d35a6" (UID: "88d8d6d9-bf53-42fe-b2b3-b351c18d35a6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:14:44.214736 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:44.214718    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88d8d6d9-bf53-42fe-b2b3-b351c18d35a6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "88d8d6d9-bf53-42fe-b2b3-b351c18d35a6" (UID: "88d8d6d9-bf53-42fe-b2b3-b351c18d35a6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:14:44.303759 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:44.303727    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f683990-6bd7-47da-a27f-c975ced3d4a9" path="/var/lib/kubelet/pods/6f683990-6bd7-47da-a27f-c975ced3d4a9/volumes"
Jul 29 01:14:44.314225 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:44.314201    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88d8d6d9-bf53-42fe-b2b3-b351c18d35a6-dshm\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:14:44.314225 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:44.314226    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88d8d6d9-bf53-42fe-b2b3-b351c18d35a6-tls-certs\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:14:44.314372 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:44.314237    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nc9t4\" (UniqueName: \"kubernetes.io/projected/88d8d6d9-bf53-42fe-b2b3-b351c18d35a6-kube-api-access-nc9t4\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:14:44.884492 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:44.884460    2577 generic.go:356] "Generic (PLEG): container finished" podID="88d8d6d9-bf53-42fe-b2b3-b351c18d35a6" containerID="f969ba9d140d19f49af5f90454b5a0a885fd17d24b9caa0fc24c2e4b251c87d5" exitCode=0
Jul 29 01:14:44.884668 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:44.884502    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a1744c/test-model-a1744c-kserve-7b75ccfc85-hxmrg"
Jul 29 01:14:44.884668 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:44.884539    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a1744c/test-model-a1744c-kserve-7b75ccfc85-hxmrg" event={"ID":"88d8d6d9-bf53-42fe-b2b3-b351c18d35a6","Type":"ContainerDied","Data":"f969ba9d140d19f49af5f90454b5a0a885fd17d24b9caa0fc24c2e4b251c87d5"}
Jul 29 01:14:44.884668 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:44.884574    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a1744c/test-model-a1744c-kserve-7b75ccfc85-hxmrg" event={"ID":"88d8d6d9-bf53-42fe-b2b3-b351c18d35a6","Type":"ContainerDied","Data":"429fc1487b137b08a7fc360c447313b7ed64ceb0d56955ff10a4684d8fd9faf2"}
Jul 29 01:14:44.884668 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:44.884614    2577 scope.go:117] "RemoveContainer" containerID="f969ba9d140d19f49af5f90454b5a0a885fd17d24b9caa0fc24c2e4b251c87d5"
Jul 29 01:14:44.892858 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:44.892842    2577 scope.go:117] "RemoveContainer" containerID="f969ba9d140d19f49af5f90454b5a0a885fd17d24b9caa0fc24c2e4b251c87d5"
Jul 29 01:14:44.893133 ip-10-0-138-146 kubenswrapper[2577]: E0729 01:14:44.893112    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f969ba9d140d19f49af5f90454b5a0a885fd17d24b9caa0fc24c2e4b251c87d5\": container with ID starting with f969ba9d140d19f49af5f90454b5a0a885fd17d24b9caa0fc24c2e4b251c87d5 not found: ID does not exist" containerID="f969ba9d140d19f49af5f90454b5a0a885fd17d24b9caa0fc24c2e4b251c87d5"
Jul 29 01:14:44.893179 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:44.893144    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f969ba9d140d19f49af5f90454b5a0a885fd17d24b9caa0fc24c2e4b251c87d5"} err="failed to get container status \"f969ba9d140d19f49af5f90454b5a0a885fd17d24b9caa0fc24c2e4b251c87d5\": rpc error: code = NotFound desc = could not find container \"f969ba9d140d19f49af5f90454b5a0a885fd17d24b9caa0fc24c2e4b251c87d5\": container with ID starting with f969ba9d140d19f49af5f90454b5a0a885fd17d24b9caa0fc24c2e4b251c87d5 not found: ID does not exist"
Jul 29 01:14:44.899636 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:44.899573    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-a1744c/test-model-a1744c-kserve-7b75ccfc85-hxmrg"]
Jul 29 01:14:44.905412 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:44.905387    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-a1744c/test-model-a1744c-kserve-7b75ccfc85-hxmrg"]
Jul 29 01:14:45.112600 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:45.112556    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:14:46.303356 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:14:46.303322    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88d8d6d9-bf53-42fe-b2b3-b351c18d35a6" path="/var/lib/kubelet/pods/88d8d6d9-bf53-42fe-b2b3-b351c18d35a6/volumes"
Jul 29 01:15:00.012551 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:15:00.012508    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:15:13.309891 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:15:13.309859    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:15:44.111743 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:15:44.111702    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:16:03.871149 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:16:03.871105    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4650f4-ng4cv"]
Jul 29 01:16:03.871765 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:16:03.871627    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f683990-6bd7-47da-a27f-c975ced3d4a9" containerName="main"
Jul 29 01:16:03.871765 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:16:03.871647    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f683990-6bd7-47da-a27f-c975ced3d4a9" containerName="main"
Jul 29 01:16:03.871765 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:16:03.871683    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88d8d6d9-bf53-42fe-b2b3-b351c18d35a6" containerName="main"
Jul 29 01:16:03.871765 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:16:03.871692    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="88d8d6d9-bf53-42fe-b2b3-b351c18d35a6" containerName="main"
Jul 29 01:16:03.871979 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:16:03.871783    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="88d8d6d9-bf53-42fe-b2b3-b351c18d35a6" containerName="main"
Jul 29 01:16:03.871979 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:16:03.871795    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f683990-6bd7-47da-a27f-c975ced3d4a9" containerName="main"
Jul 29 01:16:03.875030 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:16:03.875007    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4650f4-ng4cv"
Jul 29 01:16:03.876888 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:16:03.876869    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 01:16:03.877097 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:16:03.877078    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4nzwm\""
Jul 29 01:16:03.881462 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:16:03.881433    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4650f4-ng4cv"]
Jul 29 01:16:03.977941 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:16:03.977901    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/11b17277-8fbb-4e10-bbc1-5f26f93eace4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-4650f4-ng4cv\" (UID: \"11b17277-8fbb-4e10-bbc1-5f26f93eace4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4650f4-ng4cv"
Jul 29 01:16:04.079095 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:16:04.079050    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/11b17277-8fbb-4e10-bbc1-5f26f93eace4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-4650f4-ng4cv\" (UID: \"11b17277-8fbb-4e10-bbc1-5f26f93eace4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4650f4-ng4cv"
Jul 29 01:16:04.079738 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:16:04.079715    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/11b17277-8fbb-4e10-bbc1-5f26f93eace4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-4650f4-ng4cv\" (UID: \"11b17277-8fbb-4e10-bbc1-5f26f93eace4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4650f4-ng4cv"
Jul 29 01:16:04.187422 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:16:04.187330    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4650f4-ng4cv"
Jul 29 01:16:04.322023 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:16:04.321994    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4650f4-ng4cv"]
Jul 29 01:16:04.324481 ip-10-0-138-146 kubenswrapper[2577]: W0729 01:16:04.324456    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11b17277_8fbb_4e10_bbc1_5f26f93eace4.slice/crio-6706f7dde043effb3a010e9e26ba35aa464e92ec4fc6e711b40b7a4cb7b418f3 WatchSource:0}: Error finding container 6706f7dde043effb3a010e9e26ba35aa464e92ec4fc6e711b40b7a4cb7b418f3: Status 404 returned error can't find the container with id 6706f7dde043effb3a010e9e26ba35aa464e92ec4fc6e711b40b7a4cb7b418f3
Jul 29 01:16:04.326274 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:16:04.326256    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 01:16:05.260023 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:16:05.259987    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4650f4-ng4cv" event={"ID":"11b17277-8fbb-4e10-bbc1-5f26f93eace4","Type":"ContainerStarted","Data":"6706f7dde043effb3a010e9e26ba35aa464e92ec4fc6e711b40b7a4cb7b418f3"}
Jul 29 01:16:09.288100 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:16:09.288062    2577 generic.go:356] "Generic (PLEG): container finished" podID="11b17277-8fbb-4e10-bbc1-5f26f93eace4" containerID="ae16cff80ca1c804f80e1fe1e20b088a8d779ef9b93700d255b4053f09cfd405" exitCode=0
Jul 29 01:16:09.288542 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:16:09.288146    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4650f4-ng4cv" event={"ID":"11b17277-8fbb-4e10-bbc1-5f26f93eace4","Type":"ContainerDied","Data":"ae16cff80ca1c804f80e1fe1e20b088a8d779ef9b93700d255b4053f09cfd405"}
Jul 29 01:16:10.423577 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:16:10.423551    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4650f4-ng4cv"
Jul 29 01:16:10.540475 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:16:10.540438    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/11b17277-8fbb-4e10-bbc1-5f26f93eace4-maas-api-service-ca\") pod \"11b17277-8fbb-4e10-bbc1-5f26f93eace4\" (UID: \"11b17277-8fbb-4e10-bbc1-5f26f93eace4\") "
Jul 29 01:16:10.540857 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:16:10.540830    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11b17277-8fbb-4e10-bbc1-5f26f93eace4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "11b17277-8fbb-4e10-bbc1-5f26f93eace4" (UID: "11b17277-8fbb-4e10-bbc1-5f26f93eace4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:16:10.641820 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:16:10.641780    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/11b17277-8fbb-4e10-bbc1-5f26f93eace4-maas-api-service-ca\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:16:11.299182 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:16:11.299154    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4650f4-ng4cv"
Jul 29 01:16:11.299379 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:16:11.299202    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4650f4-ng4cv" event={"ID":"11b17277-8fbb-4e10-bbc1-5f26f93eace4","Type":"ContainerDied","Data":"6706f7dde043effb3a010e9e26ba35aa464e92ec4fc6e711b40b7a4cb7b418f3"}
Jul 29 01:16:11.299379 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:16:11.299239    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6706f7dde043effb3a010e9e26ba35aa464e92ec4fc6e711b40b7a4cb7b418f3"
Jul 29 01:16:14.422371 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:16:14.422340    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tfr5v_ac322954-06d1-4807-8a8b-59e62befe6bc/ovn-acl-logging/0.log"
Jul 29 01:16:14.425627 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:16:14.425602    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tfr5v_ac322954-06d1-4807-8a8b-59e62befe6bc/ovn-acl-logging/0.log"
Jul 29 01:16:19.574685 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:16:19.574646    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4650f4-ng4cv"]
Jul 29 01:16:19.577126 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:16:19.577101    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4650f4-ng4cv"]
Jul 29 01:16:20.303992 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:16:20.303954    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11b17277-8fbb-4e10-bbc1-5f26f93eace4" path="/var/lib/kubelet/pods/11b17277-8fbb-4e10-bbc1-5f26f93eace4/volumes"
Jul 29 01:16:22.045788 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:16:22.045757    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:16:46.808465 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:16:46.808384    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:16:58.809227 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:16:58.809191    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:17:25.002922 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:17:25.002885    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:17:51.312094 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:17:51.312056    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-ebcf3a/auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n"]
Jul 29 01:17:51.312647 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:17:51.312631    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11b17277-8fbb-4e10-bbc1-5f26f93eace4" containerName="revoke-keys"
Jul 29 01:17:51.312698 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:17:51.312650    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="11b17277-8fbb-4e10-bbc1-5f26f93eace4" containerName="revoke-keys"
Jul 29 01:17:51.312749 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:17:51.312738    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="11b17277-8fbb-4e10-bbc1-5f26f93eace4" containerName="revoke-keys"
Jul 29 01:17:51.315938 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:17:51.315920    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ebcf3a/auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n"
Jul 29 01:17:51.318653 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:17:51.318631    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-ebcf3a\"/\"auth-test-model-ebcf3a-kserve-self-signed-certs\""
Jul 29 01:17:51.318782 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:17:51.318655    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-ebcf3a\"/\"openshift-service-ca.crt\""
Jul 29 01:17:51.318782 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:17:51.318633    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-ebcf3a\"/\"default-dockercfg-ghpd6\""
Jul 29 01:17:51.318782 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:17:51.318632    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-ebcf3a\"/\"kube-root-ca.crt\""
Jul 29 01:17:51.325695 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:17:51.325673    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ebcf3a/auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n"]
Jul 29 01:17:51.488230 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:17:51.488195    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/176b52d7-554c-4174-9464-e81da829f27e-model-cache\") pod \"auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n\" (UID: \"176b52d7-554c-4174-9464-e81da829f27e\") " pod="ai-tenant-e2e-shared-a-ebcf3a/auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n"
Jul 29 01:17:51.488396 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:17:51.488240    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/176b52d7-554c-4174-9464-e81da829f27e-dshm\") pod \"auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n\" (UID: \"176b52d7-554c-4174-9464-e81da829f27e\") " pod="ai-tenant-e2e-shared-a-ebcf3a/auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n"
Jul 29 01:17:51.488396 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:17:51.488335    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/176b52d7-554c-4174-9464-e81da829f27e-tmp-dir\") pod \"auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n\" (UID: \"176b52d7-554c-4174-9464-e81da829f27e\") " pod="ai-tenant-e2e-shared-a-ebcf3a/auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n"
Jul 29 01:17:51.488396 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:17:51.488359    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/176b52d7-554c-4174-9464-e81da829f27e-tls-certs\") pod \"auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n\" (UID: \"176b52d7-554c-4174-9464-e81da829f27e\") " pod="ai-tenant-e2e-shared-a-ebcf3a/auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n"
Jul 29 01:17:51.488512 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:17:51.488395    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb9v9\" (UniqueName: \"kubernetes.io/projected/176b52d7-554c-4174-9464-e81da829f27e-kube-api-access-gb9v9\") pod \"auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n\" (UID: \"176b52d7-554c-4174-9464-e81da829f27e\") " pod="ai-tenant-e2e-shared-a-ebcf3a/auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n"
Jul 29 01:17:51.488512 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:17:51.488448    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/176b52d7-554c-4174-9464-e81da829f27e-home\") pod \"auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n\" (UID: \"176b52d7-554c-4174-9464-e81da829f27e\") " pod="ai-tenant-e2e-shared-a-ebcf3a/auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n"
Jul 29 01:17:51.589633 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:17:51.589561    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb9v9\" (UniqueName: \"kubernetes.io/projected/176b52d7-554c-4174-9464-e81da829f27e-kube-api-access-gb9v9\") pod \"auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n\" (UID: \"176b52d7-554c-4174-9464-e81da829f27e\") " pod="ai-tenant-e2e-shared-a-ebcf3a/auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n"
Jul 29 01:17:51.589821 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:17:51.589657    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/176b52d7-554c-4174-9464-e81da829f27e-home\") pod \"auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n\" (UID: \"176b52d7-554c-4174-9464-e81da829f27e\") " pod="ai-tenant-e2e-shared-a-ebcf3a/auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n"
Jul 29 01:17:51.589821 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:17:51.589686    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/176b52d7-554c-4174-9464-e81da829f27e-model-cache\") pod \"auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n\" (UID: \"176b52d7-554c-4174-9464-e81da829f27e\") " pod="ai-tenant-e2e-shared-a-ebcf3a/auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n"
Jul 29 01:17:51.589821 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:17:51.589716    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/176b52d7-554c-4174-9464-e81da829f27e-dshm\") pod \"auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n\" (UID: \"176b52d7-554c-4174-9464-e81da829f27e\") " pod="ai-tenant-e2e-shared-a-ebcf3a/auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n"
Jul 29 01:17:51.589821 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:17:51.589772    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/176b52d7-554c-4174-9464-e81da829f27e-tmp-dir\") pod \"auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n\" (UID: \"176b52d7-554c-4174-9464-e81da829f27e\") " pod="ai-tenant-e2e-shared-a-ebcf3a/auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n"
Jul 29 01:17:51.589821 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:17:51.589787    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/176b52d7-554c-4174-9464-e81da829f27e-tls-certs\") pod \"auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n\" (UID: \"176b52d7-554c-4174-9464-e81da829f27e\") " pod="ai-tenant-e2e-shared-a-ebcf3a/auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n"
Jul 29 01:17:51.590093 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:17:51.590069    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/176b52d7-554c-4174-9464-e81da829f27e-home\") pod \"auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n\" (UID: \"176b52d7-554c-4174-9464-e81da829f27e\") " pod="ai-tenant-e2e-shared-a-ebcf3a/auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n"
Jul 29 01:17:51.590152 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:17:51.590120    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/176b52d7-554c-4174-9464-e81da829f27e-model-cache\") pod \"auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n\" (UID: \"176b52d7-554c-4174-9464-e81da829f27e\") " pod="ai-tenant-e2e-shared-a-ebcf3a/auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n"
Jul 29 01:17:51.590152 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:17:51.590140    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/176b52d7-554c-4174-9464-e81da829f27e-tmp-dir\") pod \"auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n\" (UID: \"176b52d7-554c-4174-9464-e81da829f27e\") " pod="ai-tenant-e2e-shared-a-ebcf3a/auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n"
Jul 29 01:17:51.591995 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:17:51.591974    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/176b52d7-554c-4174-9464-e81da829f27e-dshm\") pod \"auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n\" (UID: \"176b52d7-554c-4174-9464-e81da829f27e\") " pod="ai-tenant-e2e-shared-a-ebcf3a/auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n"
Jul 29 01:17:51.592269 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:17:51.592252    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/176b52d7-554c-4174-9464-e81da829f27e-tls-certs\") pod \"auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n\" (UID: \"176b52d7-554c-4174-9464-e81da829f27e\") " pod="ai-tenant-e2e-shared-a-ebcf3a/auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n"
Jul 29 01:17:51.602349 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:17:51.602325    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb9v9\" (UniqueName: \"kubernetes.io/projected/176b52d7-554c-4174-9464-e81da829f27e-kube-api-access-gb9v9\") pod \"auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n\" (UID: \"176b52d7-554c-4174-9464-e81da829f27e\") " pod="ai-tenant-e2e-shared-a-ebcf3a/auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n"
Jul 29 01:17:51.626261 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:17:51.626231    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ebcf3a/auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n"
Jul 29 01:17:51.766901 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:17:51.766821    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ebcf3a/auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n"]
Jul 29 01:17:51.769493 ip-10-0-138-146 kubenswrapper[2577]: W0729 01:17:51.769466    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod176b52d7_554c_4174_9464_e81da829f27e.slice/crio-c1580495edc6efc9bb3d206aee77a7f9e3a970d8d18e9e2752ab4d26545235d4 WatchSource:0}: Error finding container c1580495edc6efc9bb3d206aee77a7f9e3a970d8d18e9e2752ab4d26545235d4: Status 404 returned error can't find the container with id c1580495edc6efc9bb3d206aee77a7f9e3a970d8d18e9e2752ab4d26545235d4
Jul 29 01:17:52.758485 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:17:52.758452    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ebcf3a/auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n" event={"ID":"176b52d7-554c-4174-9464-e81da829f27e","Type":"ContainerStarted","Data":"8ff1c8b51d5461d55c77d406b1a2e7cd0e0a9e6bfa8e4a5cb79e49c589476e7b"}
Jul 29 01:17:52.758485 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:17:52.758491    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ebcf3a/auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n" event={"ID":"176b52d7-554c-4174-9464-e81da829f27e","Type":"ContainerStarted","Data":"c1580495edc6efc9bb3d206aee77a7f9e3a970d8d18e9e2752ab4d26545235d4"}
Jul 29 01:17:52.775024 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:17:52.774954    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-ebcf3a/auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n" podStartSLOduration=1.774934867 podStartE2EDuration="1.774934867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:17:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:17:52.774492471 +0000 UTC m=+2498.918950058" watchObservedRunningTime="2026-07-29 01:17:52.774934867 +0000 UTC m=+2498.919392438"
Jul 29 01:17:54.702884 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:17:54.702845    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:18:01.627290 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:18:01.627256    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-ebcf3a/auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n"
Jul 29 01:18:01.627757 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:18:01.627339    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-ebcf3a/auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n"
Jul 29 01:18:01.639873 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:18:01.639845    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-ebcf3a/auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n"
Jul 29 01:18:01.812617 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:18:01.812572    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-ebcf3a/auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n"
Jul 29 01:18:27.307229 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:18:27.307192    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:18:56.907523 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:18:56.907489    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:19:17.818455 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:19:17.818420    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:19:31.506526 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:19:31.506491    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:19:42.519264 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:19:42.519182    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:19:58.114122 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:19:58.114083    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:20:12.310868 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:20:12.310828    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:20:33.119628 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:20:33.119591    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:20:52.236710 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:20:52.236675    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:21:13.918034 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:21:13.917947    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:21:14.453290 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:21:14.453260    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tfr5v_ac322954-06d1-4807-8a8b-59e62befe6bc/ovn-acl-logging/0.log"
Jul 29 01:21:14.458269 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:21:14.458242    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tfr5v_ac322954-06d1-4807-8a8b-59e62befe6bc/ovn-acl-logging/0.log"
Jul 29 01:21:31.911077 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:21:31.911037    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:21:53.420891 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:21:53.420851    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:22:11.913281 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:11.913250    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:22:14.523512 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:14.523475    2577 scope.go:117] "RemoveContainer" containerID="ae16cff80ca1c804f80e1fe1e20b088a8d779ef9b93700d255b4053f09cfd405"
Jul 29 01:22:34.111610 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:34.111066    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:22:39.105223 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:39.105139    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ebcf3a/auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n"]
Jul 29 01:22:49.612052 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:49.612020    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:22:52.613808 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:52.613766    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-ebcf3a/sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp"]
Jul 29 01:22:52.617488 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:52.617469    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ebcf3a/sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp"
Jul 29 01:22:52.619626 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:52.619602    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-ebcf3a\"/\"sub-test-model-ebcf3a-kserve-self-signed-certs\""
Jul 29 01:22:52.627725 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:52.627700    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ebcf3a/sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp"]
Jul 29 01:22:52.799859 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:52.799815    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1-home\") pod \"sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp\" (UID: \"2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1\") " pod="ai-tenant-e2e-shared-a-ebcf3a/sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp"
Jul 29 01:22:52.800051 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:52.799945    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1-model-cache\") pod \"sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp\" (UID: \"2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1\") " pod="ai-tenant-e2e-shared-a-ebcf3a/sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp"
Jul 29 01:22:52.800051 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:52.799980    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1-tmp-dir\") pod \"sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp\" (UID: \"2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1\") " pod="ai-tenant-e2e-shared-a-ebcf3a/sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp"
Jul 29 01:22:52.800051 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:52.800007    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1-dshm\") pod \"sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp\" (UID: \"2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1\") " pod="ai-tenant-e2e-shared-a-ebcf3a/sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp"
Jul 29 01:22:52.800051 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:52.800025    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1-tls-certs\") pod \"sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp\" (UID: \"2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1\") " pod="ai-tenant-e2e-shared-a-ebcf3a/sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp"
Jul 29 01:22:52.800254 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:52.800129    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6tjf\" (UniqueName: \"kubernetes.io/projected/2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1-kube-api-access-d6tjf\") pod \"sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp\" (UID: \"2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1\") " pod="ai-tenant-e2e-shared-a-ebcf3a/sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp"
Jul 29 01:22:52.901063 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:52.900984    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1-model-cache\") pod \"sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp\" (UID: \"2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1\") " pod="ai-tenant-e2e-shared-a-ebcf3a/sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp"
Jul 29 01:22:52.901063 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:52.901024    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1-tmp-dir\") pod \"sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp\" (UID: \"2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1\") " pod="ai-tenant-e2e-shared-a-ebcf3a/sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp"
Jul 29 01:22:52.901063 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:52.901046    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1-dshm\") pod \"sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp\" (UID: \"2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1\") " pod="ai-tenant-e2e-shared-a-ebcf3a/sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp"
Jul 29 01:22:52.901283 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:52.901067    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1-tls-certs\") pod \"sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp\" (UID: \"2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1\") " pod="ai-tenant-e2e-shared-a-ebcf3a/sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp"
Jul 29 01:22:52.901283 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:52.901112    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6tjf\" (UniqueName: \"kubernetes.io/projected/2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1-kube-api-access-d6tjf\") pod \"sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp\" (UID: \"2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1\") " pod="ai-tenant-e2e-shared-a-ebcf3a/sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp"
Jul 29 01:22:52.901392 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:52.901356    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1-home\") pod \"sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp\" (UID: \"2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1\") " pod="ai-tenant-e2e-shared-a-ebcf3a/sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp"
Jul 29 01:22:52.901498 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:52.901462    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1-model-cache\") pod \"sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp\" (UID: \"2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1\") " pod="ai-tenant-e2e-shared-a-ebcf3a/sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp"
Jul 29 01:22:52.901636 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:52.901466    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1-tmp-dir\") pod \"sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp\" (UID: \"2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1\") " pod="ai-tenant-e2e-shared-a-ebcf3a/sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp"
Jul 29 01:22:52.901687 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:52.901659    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1-home\") pod \"sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp\" (UID: \"2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1\") " pod="ai-tenant-e2e-shared-a-ebcf3a/sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp"
Jul 29 01:22:52.903564 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:52.903545    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1-dshm\") pod \"sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp\" (UID: \"2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1\") " pod="ai-tenant-e2e-shared-a-ebcf3a/sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp"
Jul 29 01:22:52.903742 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:52.903727    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1-tls-certs\") pod \"sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp\" (UID: \"2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1\") " pod="ai-tenant-e2e-shared-a-ebcf3a/sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp"
Jul 29 01:22:52.908923 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:52.908900    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6tjf\" (UniqueName: \"kubernetes.io/projected/2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1-kube-api-access-d6tjf\") pod \"sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp\" (UID: \"2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1\") " pod="ai-tenant-e2e-shared-a-ebcf3a/sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp"
Jul 29 01:22:52.927401 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:52.927373    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ebcf3a/sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp"
Jul 29 01:22:53.065462 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:53.065437    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ebcf3a/sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp"]
Jul 29 01:22:53.068064 ip-10-0-138-146 kubenswrapper[2577]: W0729 01:22:53.068023    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b70ef4a_cd2e_46e9_8a3e_b06194d8a5d1.slice/crio-345164dc8f6eb953c46c4578bf96f61bcef8a409836fb38d8988ae9272eeb597 WatchSource:0}: Error finding container 345164dc8f6eb953c46c4578bf96f61bcef8a409836fb38d8988ae9272eeb597: Status 404 returned error can't find the container with id 345164dc8f6eb953c46c4578bf96f61bcef8a409836fb38d8988ae9272eeb597
Jul 29 01:22:53.162577 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:53.162483    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ebcf3a/sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp" event={"ID":"2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1","Type":"ContainerStarted","Data":"e79e0511ce26ac241f57fc104091a92a013a5ecf604268669d8d107d58a2957f"}
Jul 29 01:22:53.162577 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:53.162533    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ebcf3a/sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp" event={"ID":"2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1","Type":"ContainerStarted","Data":"345164dc8f6eb953c46c4578bf96f61bcef8a409836fb38d8988ae9272eeb597"}
Jul 29 01:22:53.181215 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:53.181138    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-ebcf3a/sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp" podStartSLOduration=1.181122193 podStartE2EDuration="1.181122193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:22:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:22:53.179321162 +0000 UTC m=+2799.323778734" watchObservedRunningTime="2026-07-29 01:22:53.181122193 +0000 UTC m=+2799.325579763"
Jul 29 01:22:54.125740 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:54.125694    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-ebcf3a/auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n" podUID="176b52d7-554c-4174-9464-e81da829f27e" containerName="main" containerID="cri-o://8ff1c8b51d5461d55c77d406b1a2e7cd0e0a9e6bfa8e4a5cb79e49c589476e7b" gracePeriod=45
Jul 29 01:22:54.376293 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:54.376229    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ebcf3a/auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n"
Jul 29 01:22:54.516695 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:54.516659    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/176b52d7-554c-4174-9464-e81da829f27e-tls-certs\") pod \"176b52d7-554c-4174-9464-e81da829f27e\" (UID: \"176b52d7-554c-4174-9464-e81da829f27e\") "
Jul 29 01:22:54.516695 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:54.516700    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/176b52d7-554c-4174-9464-e81da829f27e-home\") pod \"176b52d7-554c-4174-9464-e81da829f27e\" (UID: \"176b52d7-554c-4174-9464-e81da829f27e\") "
Jul 29 01:22:54.516958 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:54.516737    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/176b52d7-554c-4174-9464-e81da829f27e-dshm\") pod \"176b52d7-554c-4174-9464-e81da829f27e\" (UID: \"176b52d7-554c-4174-9464-e81da829f27e\") "
Jul 29 01:22:54.516958 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:54.516802    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gb9v9\" (UniqueName: \"kubernetes.io/projected/176b52d7-554c-4174-9464-e81da829f27e-kube-api-access-gb9v9\") pod \"176b52d7-554c-4174-9464-e81da829f27e\" (UID: \"176b52d7-554c-4174-9464-e81da829f27e\") "
Jul 29 01:22:54.516958 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:54.516867    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/176b52d7-554c-4174-9464-e81da829f27e-model-cache\") pod \"176b52d7-554c-4174-9464-e81da829f27e\" (UID: \"176b52d7-554c-4174-9464-e81da829f27e\") "
Jul 29 01:22:54.516958 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:54.516956    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/176b52d7-554c-4174-9464-e81da829f27e-tmp-dir\") pod \"176b52d7-554c-4174-9464-e81da829f27e\" (UID: \"176b52d7-554c-4174-9464-e81da829f27e\") "
Jul 29 01:22:54.517172 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:54.516999    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/176b52d7-554c-4174-9464-e81da829f27e-home" (OuterVolumeSpecName: "home") pod "176b52d7-554c-4174-9464-e81da829f27e" (UID: "176b52d7-554c-4174-9464-e81da829f27e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:22:54.517229 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:54.517205    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/176b52d7-554c-4174-9464-e81da829f27e-model-cache" (OuterVolumeSpecName: "model-cache") pod "176b52d7-554c-4174-9464-e81da829f27e" (UID: "176b52d7-554c-4174-9464-e81da829f27e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:22:54.517283 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:54.517273    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/176b52d7-554c-4174-9464-e81da829f27e-home\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:22:54.517327 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:54.517300    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/176b52d7-554c-4174-9464-e81da829f27e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "176b52d7-554c-4174-9464-e81da829f27e" (UID: "176b52d7-554c-4174-9464-e81da829f27e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:22:54.519138 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:54.519105    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/176b52d7-554c-4174-9464-e81da829f27e-kube-api-access-gb9v9" (OuterVolumeSpecName: "kube-api-access-gb9v9") pod "176b52d7-554c-4174-9464-e81da829f27e" (UID: "176b52d7-554c-4174-9464-e81da829f27e"). InnerVolumeSpecName "kube-api-access-gb9v9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:22:54.519138 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:54.519111    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/176b52d7-554c-4174-9464-e81da829f27e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "176b52d7-554c-4174-9464-e81da829f27e" (UID: "176b52d7-554c-4174-9464-e81da829f27e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:22:54.519327 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:54.519138    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/176b52d7-554c-4174-9464-e81da829f27e-dshm" (OuterVolumeSpecName: "dshm") pod "176b52d7-554c-4174-9464-e81da829f27e" (UID: "176b52d7-554c-4174-9464-e81da829f27e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:22:54.618110 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:54.618068    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/176b52d7-554c-4174-9464-e81da829f27e-dshm\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:22:54.618110 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:54.618098    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gb9v9\" (UniqueName: \"kubernetes.io/projected/176b52d7-554c-4174-9464-e81da829f27e-kube-api-access-gb9v9\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:22:54.618110 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:54.618113    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/176b52d7-554c-4174-9464-e81da829f27e-model-cache\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:22:54.618351 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:54.618123    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/176b52d7-554c-4174-9464-e81da829f27e-tmp-dir\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:22:54.618351 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:54.618137    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/176b52d7-554c-4174-9464-e81da829f27e-tls-certs\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:22:55.174304 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:55.174271    2577 generic.go:356] "Generic (PLEG): container finished" podID="176b52d7-554c-4174-9464-e81da829f27e" containerID="8ff1c8b51d5461d55c77d406b1a2e7cd0e0a9e6bfa8e4a5cb79e49c589476e7b" exitCode=0
Jul 29 01:22:55.174834 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:55.174316    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ebcf3a/auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n"
Jul 29 01:22:55.174834 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:55.174352    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ebcf3a/auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n" event={"ID":"176b52d7-554c-4174-9464-e81da829f27e","Type":"ContainerDied","Data":"8ff1c8b51d5461d55c77d406b1a2e7cd0e0a9e6bfa8e4a5cb79e49c589476e7b"}
Jul 29 01:22:55.174834 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:55.174397    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ebcf3a/auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n" event={"ID":"176b52d7-554c-4174-9464-e81da829f27e","Type":"ContainerDied","Data":"c1580495edc6efc9bb3d206aee77a7f9e3a970d8d18e9e2752ab4d26545235d4"}
Jul 29 01:22:55.174834 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:55.174414    2577 scope.go:117] "RemoveContainer" containerID="8ff1c8b51d5461d55c77d406b1a2e7cd0e0a9e6bfa8e4a5cb79e49c589476e7b"
Jul 29 01:22:55.184238 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:55.184214    2577 scope.go:117] "RemoveContainer" containerID="8ff1c8b51d5461d55c77d406b1a2e7cd0e0a9e6bfa8e4a5cb79e49c589476e7b"
Jul 29 01:22:55.184546 ip-10-0-138-146 kubenswrapper[2577]: E0729 01:22:55.184524    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ff1c8b51d5461d55c77d406b1a2e7cd0e0a9e6bfa8e4a5cb79e49c589476e7b\": container with ID starting with 8ff1c8b51d5461d55c77d406b1a2e7cd0e0a9e6bfa8e4a5cb79e49c589476e7b not found: ID does not exist" containerID="8ff1c8b51d5461d55c77d406b1a2e7cd0e0a9e6bfa8e4a5cb79e49c589476e7b"
Jul 29 01:22:55.184647 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:55.184568    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ff1c8b51d5461d55c77d406b1a2e7cd0e0a9e6bfa8e4a5cb79e49c589476e7b"} err="failed to get container status \"8ff1c8b51d5461d55c77d406b1a2e7cd0e0a9e6bfa8e4a5cb79e49c589476e7b\": rpc error: code = NotFound desc = could not find container \"8ff1c8b51d5461d55c77d406b1a2e7cd0e0a9e6bfa8e4a5cb79e49c589476e7b\": container with ID starting with 8ff1c8b51d5461d55c77d406b1a2e7cd0e0a9e6bfa8e4a5cb79e49c589476e7b not found: ID does not exist"
Jul 29 01:22:55.200844 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:55.200819    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ebcf3a/auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n"]
Jul 29 01:22:55.204681 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:55.204655    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-ebcf3a/auth-test-model-ebcf3a-kserve-75777b94c5-7vj9n"]
Jul 29 01:22:56.303811 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:22:56.303779    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="176b52d7-554c-4174-9464-e81da829f27e" path="/var/lib/kubelet/pods/176b52d7-554c-4174-9464-e81da829f27e/volumes"
Jul 29 01:23:02.928016 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:02.927980    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-ebcf3a/sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp"
Jul 29 01:23:02.928397 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:02.928034    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-ebcf3a/sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp"
Jul 29 01:23:02.940564 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:02.940536    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-ebcf3a/sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp"
Jul 29 01:23:03.222991 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:03.222903    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-ebcf3a/sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp"
Jul 29 01:23:03.418853 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:03.418811    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:23:12.974868 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:12.974831    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-afd6d5/sub-test-model-afd6d5-kserve-584c859d4c-vt67p"]
Jul 29 01:23:12.975266 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:12.975186    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="176b52d7-554c-4174-9464-e81da829f27e" containerName="main"
Jul 29 01:23:12.975266 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:12.975198    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="176b52d7-554c-4174-9464-e81da829f27e" containerName="main"
Jul 29 01:23:12.975266 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:12.975255    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="176b52d7-554c-4174-9464-e81da829f27e" containerName="main"
Jul 29 01:23:12.979848 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:12.979824    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-afd6d5/sub-test-model-afd6d5-kserve-584c859d4c-vt67p"
Jul 29 01:23:12.982333 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:12.982308    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-afd6d5\"/\"kube-root-ca.crt\""
Jul 29 01:23:12.984109 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:12.984086    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-afd6d5\"/\"default-dockercfg-n2r8w\""
Jul 29 01:23:12.984270 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:12.984246    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-afd6d5\"/\"openshift-service-ca.crt\""
Jul 29 01:23:12.984511 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:12.984492    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-afd6d5\"/\"sub-test-model-afd6d5-kserve-self-signed-certs\""
Jul 29 01:23:12.993113 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:12.993091    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-afd6d5/sub-test-model-afd6d5-kserve-584c859d4c-vt67p"]
Jul 29 01:23:13.088975 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:13.088933    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef64c14f-3e82-4571-a921-dcc647505c32-home\") pod \"sub-test-model-afd6d5-kserve-584c859d4c-vt67p\" (UID: \"ef64c14f-3e82-4571-a921-dcc647505c32\") " pod="ai-tenant-e2e-shared-b-afd6d5/sub-test-model-afd6d5-kserve-584c859d4c-vt67p"
Jul 29 01:23:13.089147 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:13.088992    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef64c14f-3e82-4571-a921-dcc647505c32-dshm\") pod \"sub-test-model-afd6d5-kserve-584c859d4c-vt67p\" (UID: \"ef64c14f-3e82-4571-a921-dcc647505c32\") " pod="ai-tenant-e2e-shared-b-afd6d5/sub-test-model-afd6d5-kserve-584c859d4c-vt67p"
Jul 29 01:23:13.089147 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:13.089089    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdm6z\" (UniqueName: \"kubernetes.io/projected/ef64c14f-3e82-4571-a921-dcc647505c32-kube-api-access-jdm6z\") pod \"sub-test-model-afd6d5-kserve-584c859d4c-vt67p\" (UID: \"ef64c14f-3e82-4571-a921-dcc647505c32\") " pod="ai-tenant-e2e-shared-b-afd6d5/sub-test-model-afd6d5-kserve-584c859d4c-vt67p"
Jul 29 01:23:13.089147 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:13.089127    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef64c14f-3e82-4571-a921-dcc647505c32-tls-certs\") pod \"sub-test-model-afd6d5-kserve-584c859d4c-vt67p\" (UID: \"ef64c14f-3e82-4571-a921-dcc647505c32\") " pod="ai-tenant-e2e-shared-b-afd6d5/sub-test-model-afd6d5-kserve-584c859d4c-vt67p"
Jul 29 01:23:13.089259 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:13.089203    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef64c14f-3e82-4571-a921-dcc647505c32-model-cache\") pod \"sub-test-model-afd6d5-kserve-584c859d4c-vt67p\" (UID: \"ef64c14f-3e82-4571-a921-dcc647505c32\") " pod="ai-tenant-e2e-shared-b-afd6d5/sub-test-model-afd6d5-kserve-584c859d4c-vt67p"
Jul 29 01:23:13.089259 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:13.089233    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef64c14f-3e82-4571-a921-dcc647505c32-tmp-dir\") pod \"sub-test-model-afd6d5-kserve-584c859d4c-vt67p\" (UID: \"ef64c14f-3e82-4571-a921-dcc647505c32\") " pod="ai-tenant-e2e-shared-b-afd6d5/sub-test-model-afd6d5-kserve-584c859d4c-vt67p"
Jul 29 01:23:13.190034 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:13.189997    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef64c14f-3e82-4571-a921-dcc647505c32-dshm\") pod \"sub-test-model-afd6d5-kserve-584c859d4c-vt67p\" (UID: \"ef64c14f-3e82-4571-a921-dcc647505c32\") " pod="ai-tenant-e2e-shared-b-afd6d5/sub-test-model-afd6d5-kserve-584c859d4c-vt67p"
Jul 29 01:23:13.190171 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:13.190074    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdm6z\" (UniqueName: \"kubernetes.io/projected/ef64c14f-3e82-4571-a921-dcc647505c32-kube-api-access-jdm6z\") pod \"sub-test-model-afd6d5-kserve-584c859d4c-vt67p\" (UID: \"ef64c14f-3e82-4571-a921-dcc647505c32\") " pod="ai-tenant-e2e-shared-b-afd6d5/sub-test-model-afd6d5-kserve-584c859d4c-vt67p"
Jul 29 01:23:13.190171 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:13.190109    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef64c14f-3e82-4571-a921-dcc647505c32-tls-certs\") pod \"sub-test-model-afd6d5-kserve-584c859d4c-vt67p\" (UID: \"ef64c14f-3e82-4571-a921-dcc647505c32\") " pod="ai-tenant-e2e-shared-b-afd6d5/sub-test-model-afd6d5-kserve-584c859d4c-vt67p"
Jul 29 01:23:13.190281 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:13.190169    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef64c14f-3e82-4571-a921-dcc647505c32-model-cache\") pod \"sub-test-model-afd6d5-kserve-584c859d4c-vt67p\" (UID: \"ef64c14f-3e82-4571-a921-dcc647505c32\") " pod="ai-tenant-e2e-shared-b-afd6d5/sub-test-model-afd6d5-kserve-584c859d4c-vt67p"
Jul 29 01:23:13.190281 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:13.190199    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef64c14f-3e82-4571-a921-dcc647505c32-tmp-dir\") pod \"sub-test-model-afd6d5-kserve-584c859d4c-vt67p\" (UID: \"ef64c14f-3e82-4571-a921-dcc647505c32\") " pod="ai-tenant-e2e-shared-b-afd6d5/sub-test-model-afd6d5-kserve-584c859d4c-vt67p"
Jul 29 01:23:13.190281 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:13.190240    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef64c14f-3e82-4571-a921-dcc647505c32-home\") pod \"sub-test-model-afd6d5-kserve-584c859d4c-vt67p\" (UID: \"ef64c14f-3e82-4571-a921-dcc647505c32\") " pod="ai-tenant-e2e-shared-b-afd6d5/sub-test-model-afd6d5-kserve-584c859d4c-vt67p"
Jul 29 01:23:13.190640 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:13.190611    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef64c14f-3e82-4571-a921-dcc647505c32-home\") pod \"sub-test-model-afd6d5-kserve-584c859d4c-vt67p\" (UID: \"ef64c14f-3e82-4571-a921-dcc647505c32\") " pod="ai-tenant-e2e-shared-b-afd6d5/sub-test-model-afd6d5-kserve-584c859d4c-vt67p"
Jul 29 01:23:13.190640 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:13.190611    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef64c14f-3e82-4571-a921-dcc647505c32-tmp-dir\") pod \"sub-test-model-afd6d5-kserve-584c859d4c-vt67p\" (UID: \"ef64c14f-3e82-4571-a921-dcc647505c32\") " pod="ai-tenant-e2e-shared-b-afd6d5/sub-test-model-afd6d5-kserve-584c859d4c-vt67p"
Jul 29 01:23:13.190842 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:13.190675    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef64c14f-3e82-4571-a921-dcc647505c32-model-cache\") pod \"sub-test-model-afd6d5-kserve-584c859d4c-vt67p\" (UID: \"ef64c14f-3e82-4571-a921-dcc647505c32\") " pod="ai-tenant-e2e-shared-b-afd6d5/sub-test-model-afd6d5-kserve-584c859d4c-vt67p"
Jul 29 01:23:13.192245 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:13.192224    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef64c14f-3e82-4571-a921-dcc647505c32-dshm\") pod \"sub-test-model-afd6d5-kserve-584c859d4c-vt67p\" (UID: \"ef64c14f-3e82-4571-a921-dcc647505c32\") " pod="ai-tenant-e2e-shared-b-afd6d5/sub-test-model-afd6d5-kserve-584c859d4c-vt67p"
Jul 29 01:23:13.192494 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:13.192477    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef64c14f-3e82-4571-a921-dcc647505c32-tls-certs\") pod \"sub-test-model-afd6d5-kserve-584c859d4c-vt67p\" (UID: \"ef64c14f-3e82-4571-a921-dcc647505c32\") " pod="ai-tenant-e2e-shared-b-afd6d5/sub-test-model-afd6d5-kserve-584c859d4c-vt67p"
Jul 29 01:23:13.197363 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:13.197338    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdm6z\" (UniqueName: \"kubernetes.io/projected/ef64c14f-3e82-4571-a921-dcc647505c32-kube-api-access-jdm6z\") pod \"sub-test-model-afd6d5-kserve-584c859d4c-vt67p\" (UID: \"ef64c14f-3e82-4571-a921-dcc647505c32\") " pod="ai-tenant-e2e-shared-b-afd6d5/sub-test-model-afd6d5-kserve-584c859d4c-vt67p"
Jul 29 01:23:13.290119 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:13.290037    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-afd6d5/sub-test-model-afd6d5-kserve-584c859d4c-vt67p"
Jul 29 01:23:13.422016 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:13.421982    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-afd6d5/sub-test-model-afd6d5-kserve-584c859d4c-vt67p"]
Jul 29 01:23:13.425154 ip-10-0-138-146 kubenswrapper[2577]: W0729 01:23:13.425123    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef64c14f_3e82_4571_a921_dcc647505c32.slice/crio-202c30c0e996b27cedfa1306067aef7e8c263b8670144e56bf53b3ec58748189 WatchSource:0}: Error finding container 202c30c0e996b27cedfa1306067aef7e8c263b8670144e56bf53b3ec58748189: Status 404 returned error can't find the container with id 202c30c0e996b27cedfa1306067aef7e8c263b8670144e56bf53b3ec58748189
Jul 29 01:23:14.267000 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:14.266963    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-afd6d5/sub-test-model-afd6d5-kserve-584c859d4c-vt67p" event={"ID":"ef64c14f-3e82-4571-a921-dcc647505c32","Type":"ContainerStarted","Data":"b75833601d14af6f7457a4ef0ecc6f9ce2f99d4be0c14b33fef754bb45894b76"}
Jul 29 01:23:14.267391 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:14.267007    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-afd6d5/sub-test-model-afd6d5-kserve-584c859d4c-vt67p" event={"ID":"ef64c14f-3e82-4571-a921-dcc647505c32","Type":"ContainerStarted","Data":"202c30c0e996b27cedfa1306067aef7e8c263b8670144e56bf53b3ec58748189"}
Jul 29 01:23:14.282145 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:14.282088    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-afd6d5/sub-test-model-afd6d5-kserve-584c859d4c-vt67p" podStartSLOduration=2.282068048 podStartE2EDuration="2.282068048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:23:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:23:14.281672169 +0000 UTC m=+2820.426129743" watchObservedRunningTime="2026-07-29 01:23:14.282068048 +0000 UTC m=+2820.426525619"
Jul 29 01:23:16.608381 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:16.608347    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:23:23.290378 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:23.290335    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-afd6d5/sub-test-model-afd6d5-kserve-584c859d4c-vt67p"
Jul 29 01:23:23.290829 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:23.290415    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-afd6d5/sub-test-model-afd6d5-kserve-584c859d4c-vt67p"
Jul 29 01:23:23.302780 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:23.302753    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-afd6d5/sub-test-model-afd6d5-kserve-584c859d4c-vt67p"
Jul 29 01:23:23.319002 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:23.318975    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-afd6d5/sub-test-model-afd6d5-kserve-584c859d4c-vt67p"
Jul 29 01:23:50.314492 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:23:50.314460    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:24:09.740377 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:09.740296    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:24:15.634675 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:15.634637    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ebcf3a/sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp"]
Jul 29 01:24:16.410468 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:16.410436    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-afd6d5/sub-test-model-afd6d5-kserve-584c859d4c-vt67p"]
Jul 29 01:24:27.920964 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:27.920927    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:24:30.653300 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:30.653260    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-ebcf3a/sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp" podUID="2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1" containerName="main" containerID="cri-o://e79e0511ce26ac241f57fc104091a92a013a5ecf604268669d8d107d58a2957f" gracePeriod=45
Jul 29 01:24:30.914934 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:30.914874    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ebcf3a/sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp"
Jul 29 01:24:31.027370 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.027327    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6tjf\" (UniqueName: \"kubernetes.io/projected/2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1-kube-api-access-d6tjf\") pod \"2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1\" (UID: \"2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1\") "
Jul 29 01:24:31.027541 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.027381    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1-dshm\") pod \"2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1\" (UID: \"2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1\") "
Jul 29 01:24:31.027541 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.027462    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1-tls-certs\") pod \"2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1\" (UID: \"2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1\") "
Jul 29 01:24:31.027541 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.027497    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1-model-cache\") pod \"2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1\" (UID: \"2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1\") "
Jul 29 01:24:31.027541 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.027514    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1-tmp-dir\") pod \"2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1\" (UID: \"2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1\") "
Jul 29 01:24:31.027735 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.027556    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1-home\") pod \"2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1\" (UID: \"2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1\") "
Jul 29 01:24:31.027904 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.027818    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1-model-cache" (OuterVolumeSpecName: "model-cache") pod "2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1" (UID: "2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:24:31.027904 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.027869    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1" (UID: "2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:24:31.028070 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.027947    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1-model-cache\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:24:31.028070 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.027993    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1-home" (OuterVolumeSpecName: "home") pod "2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1" (UID: "2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:24:31.029638 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.029609    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1-kube-api-access-d6tjf" (OuterVolumeSpecName: "kube-api-access-d6tjf") pod "2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1" (UID: "2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1"). InnerVolumeSpecName "kube-api-access-d6tjf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:24:31.029638 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.029617    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1-dshm" (OuterVolumeSpecName: "dshm") pod "2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1" (UID: "2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:24:31.029771 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.029647    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1" (UID: "2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:24:31.129089 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.129056    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1-tls-certs\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:24:31.129089 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.129085    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1-tmp-dir\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:24:31.129089 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.129094    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1-home\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:24:31.129327 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.129103    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6tjf\" (UniqueName: \"kubernetes.io/projected/2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1-kube-api-access-d6tjf\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:24:31.129327 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.129112    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1-dshm\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:24:31.429508 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.429471    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-afd6d5/sub-test-model-afd6d5-kserve-584c859d4c-vt67p" podUID="ef64c14f-3e82-4571-a921-dcc647505c32" containerName="main" containerID="cri-o://b75833601d14af6f7457a4ef0ecc6f9ce2f99d4be0c14b33fef754bb45894b76" gracePeriod=45
Jul 29 01:24:31.626954 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.626924    2577 generic.go:356] "Generic (PLEG): container finished" podID="ef64c14f-3e82-4571-a921-dcc647505c32" containerID="b75833601d14af6f7457a4ef0ecc6f9ce2f99d4be0c14b33fef754bb45894b76" exitCode=0
Jul 29 01:24:31.627113 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.626998    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-afd6d5/sub-test-model-afd6d5-kserve-584c859d4c-vt67p" event={"ID":"ef64c14f-3e82-4571-a921-dcc647505c32","Type":"ContainerDied","Data":"b75833601d14af6f7457a4ef0ecc6f9ce2f99d4be0c14b33fef754bb45894b76"}
Jul 29 01:24:31.628333 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.628309    2577 generic.go:356] "Generic (PLEG): container finished" podID="2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1" containerID="e79e0511ce26ac241f57fc104091a92a013a5ecf604268669d8d107d58a2957f" exitCode=0
Jul 29 01:24:31.628457 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.628359    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ebcf3a/sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp"
Jul 29 01:24:31.628457 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.628366    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ebcf3a/sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp" event={"ID":"2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1","Type":"ContainerDied","Data":"e79e0511ce26ac241f57fc104091a92a013a5ecf604268669d8d107d58a2957f"}
Jul 29 01:24:31.628570 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.628460    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ebcf3a/sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp" event={"ID":"2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1","Type":"ContainerDied","Data":"345164dc8f6eb953c46c4578bf96f61bcef8a409836fb38d8988ae9272eeb597"}
Jul 29 01:24:31.628570 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.628478    2577 scope.go:117] "RemoveContainer" containerID="e79e0511ce26ac241f57fc104091a92a013a5ecf604268669d8d107d58a2957f"
Jul 29 01:24:31.637971 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.637954    2577 scope.go:117] "RemoveContainer" containerID="e79e0511ce26ac241f57fc104091a92a013a5ecf604268669d8d107d58a2957f"
Jul 29 01:24:31.638327 ip-10-0-138-146 kubenswrapper[2577]: E0729 01:24:31.638308    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e79e0511ce26ac241f57fc104091a92a013a5ecf604268669d8d107d58a2957f\": container with ID starting with e79e0511ce26ac241f57fc104091a92a013a5ecf604268669d8d107d58a2957f not found: ID does not exist" containerID="e79e0511ce26ac241f57fc104091a92a013a5ecf604268669d8d107d58a2957f"
Jul 29 01:24:31.638367 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.638338    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e79e0511ce26ac241f57fc104091a92a013a5ecf604268669d8d107d58a2957f"} err="failed to get container status \"e79e0511ce26ac241f57fc104091a92a013a5ecf604268669d8d107d58a2957f\": rpc error: code = NotFound desc = could not find container \"e79e0511ce26ac241f57fc104091a92a013a5ecf604268669d8d107d58a2957f\": container with ID starting with e79e0511ce26ac241f57fc104091a92a013a5ecf604268669d8d107d58a2957f not found: ID does not exist"
Jul 29 01:24:31.651198 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.651171    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ebcf3a/sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp"]
Jul 29 01:24:31.659624 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.659574    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-ebcf3a/sub-test-model-ebcf3a-kserve-594567dfbc-nl4xp"]
Jul 29 01:24:31.677872 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.677843    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-afd6d5/sub-test-model-afd6d5-kserve-584c859d4c-vt67p"
Jul 29 01:24:31.733173 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.733099    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef64c14f-3e82-4571-a921-dcc647505c32-model-cache\") pod \"ef64c14f-3e82-4571-a921-dcc647505c32\" (UID: \"ef64c14f-3e82-4571-a921-dcc647505c32\") "
Jul 29 01:24:31.733173 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.733151    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef64c14f-3e82-4571-a921-dcc647505c32-tmp-dir\") pod \"ef64c14f-3e82-4571-a921-dcc647505c32\" (UID: \"ef64c14f-3e82-4571-a921-dcc647505c32\") "
Jul 29 01:24:31.733377 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.733208    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef64c14f-3e82-4571-a921-dcc647505c32-tls-certs\") pod \"ef64c14f-3e82-4571-a921-dcc647505c32\" (UID: \"ef64c14f-3e82-4571-a921-dcc647505c32\") "
Jul 29 01:24:31.733377 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.733247    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdm6z\" (UniqueName: \"kubernetes.io/projected/ef64c14f-3e82-4571-a921-dcc647505c32-kube-api-access-jdm6z\") pod \"ef64c14f-3e82-4571-a921-dcc647505c32\" (UID: \"ef64c14f-3e82-4571-a921-dcc647505c32\") "
Jul 29 01:24:31.733377 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.733303    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef64c14f-3e82-4571-a921-dcc647505c32-dshm\") pod \"ef64c14f-3e82-4571-a921-dcc647505c32\" (UID: \"ef64c14f-3e82-4571-a921-dcc647505c32\") "
Jul 29 01:24:31.733377 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.733334    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef64c14f-3e82-4571-a921-dcc647505c32-home\") pod \"ef64c14f-3e82-4571-a921-dcc647505c32\" (UID: \"ef64c14f-3e82-4571-a921-dcc647505c32\") "
Jul 29 01:24:31.733614 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.733410    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef64c14f-3e82-4571-a921-dcc647505c32-model-cache" (OuterVolumeSpecName: "model-cache") pod "ef64c14f-3e82-4571-a921-dcc647505c32" (UID: "ef64c14f-3e82-4571-a921-dcc647505c32"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:24:31.733614 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.733428    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef64c14f-3e82-4571-a921-dcc647505c32-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ef64c14f-3e82-4571-a921-dcc647505c32" (UID: "ef64c14f-3e82-4571-a921-dcc647505c32"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:24:31.733713 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.733650    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef64c14f-3e82-4571-a921-dcc647505c32-home" (OuterVolumeSpecName: "home") pod "ef64c14f-3e82-4571-a921-dcc647505c32" (UID: "ef64c14f-3e82-4571-a921-dcc647505c32"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:24:31.733713 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.733701    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef64c14f-3e82-4571-a921-dcc647505c32-model-cache\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:24:31.733713 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.733715    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef64c14f-3e82-4571-a921-dcc647505c32-tmp-dir\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:24:31.735492 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.735463    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef64c14f-3e82-4571-a921-dcc647505c32-kube-api-access-jdm6z" (OuterVolumeSpecName: "kube-api-access-jdm6z") pod "ef64c14f-3e82-4571-a921-dcc647505c32" (UID: "ef64c14f-3e82-4571-a921-dcc647505c32"). InnerVolumeSpecName "kube-api-access-jdm6z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:24:31.735492 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.735467    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef64c14f-3e82-4571-a921-dcc647505c32-dshm" (OuterVolumeSpecName: "dshm") pod "ef64c14f-3e82-4571-a921-dcc647505c32" (UID: "ef64c14f-3e82-4571-a921-dcc647505c32"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:24:31.735658 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.735513    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef64c14f-3e82-4571-a921-dcc647505c32-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ef64c14f-3e82-4571-a921-dcc647505c32" (UID: "ef64c14f-3e82-4571-a921-dcc647505c32"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:24:31.834345 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.834315    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef64c14f-3e82-4571-a921-dcc647505c32-tls-certs\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:24:31.834345 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.834344    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdm6z\" (UniqueName: \"kubernetes.io/projected/ef64c14f-3e82-4571-a921-dcc647505c32-kube-api-access-jdm6z\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:24:31.834345 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.834353    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef64c14f-3e82-4571-a921-dcc647505c32-dshm\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:24:31.834628 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:31.834362    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef64c14f-3e82-4571-a921-dcc647505c32-home\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:24:32.308299 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:32.308265    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1" path="/var/lib/kubelet/pods/2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1/volumes"
Jul 29 01:24:32.634599 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:32.634556    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-afd6d5/sub-test-model-afd6d5-kserve-584c859d4c-vt67p"
Jul 29 01:24:32.634599 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:32.634578    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-afd6d5/sub-test-model-afd6d5-kserve-584c859d4c-vt67p" event={"ID":"ef64c14f-3e82-4571-a921-dcc647505c32","Type":"ContainerDied","Data":"202c30c0e996b27cedfa1306067aef7e8c263b8670144e56bf53b3ec58748189"}
Jul 29 01:24:32.634858 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:32.634642    2577 scope.go:117] "RemoveContainer" containerID="b75833601d14af6f7457a4ef0ecc6f9ce2f99d4be0c14b33fef754bb45894b76"
Jul 29 01:24:32.652826 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:32.652801    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-afd6d5/sub-test-model-afd6d5-kserve-584c859d4c-vt67p"]
Jul 29 01:24:32.656648 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:32.656619    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-afd6d5/sub-test-model-afd6d5-kserve-584c859d4c-vt67p"]
Jul 29 01:24:34.303973 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:34.303940    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef64c14f-3e82-4571-a921-dcc647505c32" path="/var/lib/kubelet/pods/ef64c14f-3e82-4571-a921-dcc647505c32/volumes"
Jul 29 01:24:41.914001 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:41.913969    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-afd6d5/rate-test-model-afd6d5-kserve-dc48655bc-ks5kn"]
Jul 29 01:24:41.914378 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:41.914303    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef64c14f-3e82-4571-a921-dcc647505c32" containerName="main"
Jul 29 01:24:41.914378 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:41.914314    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef64c14f-3e82-4571-a921-dcc647505c32" containerName="main"
Jul 29 01:24:41.914378 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:41.914329    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1" containerName="main"
Jul 29 01:24:41.914378 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:41.914334    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1" containerName="main"
Jul 29 01:24:41.914515 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:41.914392    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef64c14f-3e82-4571-a921-dcc647505c32" containerName="main"
Jul 29 01:24:41.914515 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:41.914401    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b70ef4a-cd2e-46e9-8a3e-b06194d8a5d1" containerName="main"
Jul 29 01:24:41.918764 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:41.918743    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-afd6d5/rate-test-model-afd6d5-kserve-dc48655bc-ks5kn"
Jul 29 01:24:41.921482 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:41.921456    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-afd6d5\"/\"rate-test-model-afd6d5-kserve-self-signed-certs\""
Jul 29 01:24:41.921632 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:41.921504    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-afd6d5\"/\"default-dockercfg-n2r8w\""
Jul 29 01:24:41.921632 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:41.921503    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-afd6d5\"/\"kube-root-ca.crt\""
Jul 29 01:24:41.921632 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:41.921509    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-afd6d5\"/\"openshift-service-ca.crt\""
Jul 29 01:24:41.926206 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:41.926176    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-afd6d5/rate-test-model-afd6d5-kserve-dc48655bc-ks5kn"]
Jul 29 01:24:42.037625 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:42.037592    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4bws\" (UniqueName: \"kubernetes.io/projected/779f27d6-da68-4bab-9eb9-e9fc76a4a7a2-kube-api-access-g4bws\") pod \"rate-test-model-afd6d5-kserve-dc48655bc-ks5kn\" (UID: \"779f27d6-da68-4bab-9eb9-e9fc76a4a7a2\") " pod="ai-tenant-e2e-shared-b-afd6d5/rate-test-model-afd6d5-kserve-dc48655bc-ks5kn"
Jul 29 01:24:42.037791 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:42.037679    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/779f27d6-da68-4bab-9eb9-e9fc76a4a7a2-model-cache\") pod \"rate-test-model-afd6d5-kserve-dc48655bc-ks5kn\" (UID: \"779f27d6-da68-4bab-9eb9-e9fc76a4a7a2\") " pod="ai-tenant-e2e-shared-b-afd6d5/rate-test-model-afd6d5-kserve-dc48655bc-ks5kn"
Jul 29 01:24:42.037791 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:42.037715    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/779f27d6-da68-4bab-9eb9-e9fc76a4a7a2-dshm\") pod \"rate-test-model-afd6d5-kserve-dc48655bc-ks5kn\" (UID: \"779f27d6-da68-4bab-9eb9-e9fc76a4a7a2\") " pod="ai-tenant-e2e-shared-b-afd6d5/rate-test-model-afd6d5-kserve-dc48655bc-ks5kn"
Jul 29 01:24:42.037898 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:42.037797    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/779f27d6-da68-4bab-9eb9-e9fc76a4a7a2-tmp-dir\") pod \"rate-test-model-afd6d5-kserve-dc48655bc-ks5kn\" (UID: \"779f27d6-da68-4bab-9eb9-e9fc76a4a7a2\") " pod="ai-tenant-e2e-shared-b-afd6d5/rate-test-model-afd6d5-kserve-dc48655bc-ks5kn"
Jul 29 01:24:42.037898 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:42.037815    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/779f27d6-da68-4bab-9eb9-e9fc76a4a7a2-tls-certs\") pod \"rate-test-model-afd6d5-kserve-dc48655bc-ks5kn\" (UID: \"779f27d6-da68-4bab-9eb9-e9fc76a4a7a2\") " pod="ai-tenant-e2e-shared-b-afd6d5/rate-test-model-afd6d5-kserve-dc48655bc-ks5kn"
Jul 29 01:24:42.037998 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:42.037906    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/779f27d6-da68-4bab-9eb9-e9fc76a4a7a2-home\") pod \"rate-test-model-afd6d5-kserve-dc48655bc-ks5kn\" (UID: \"779f27d6-da68-4bab-9eb9-e9fc76a4a7a2\") " pod="ai-tenant-e2e-shared-b-afd6d5/rate-test-model-afd6d5-kserve-dc48655bc-ks5kn"
Jul 29 01:24:42.139317 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:42.139278    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/779f27d6-da68-4bab-9eb9-e9fc76a4a7a2-home\") pod \"rate-test-model-afd6d5-kserve-dc48655bc-ks5kn\" (UID: \"779f27d6-da68-4bab-9eb9-e9fc76a4a7a2\") " pod="ai-tenant-e2e-shared-b-afd6d5/rate-test-model-afd6d5-kserve-dc48655bc-ks5kn"
Jul 29 01:24:42.139579 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:42.139327    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4bws\" (UniqueName: \"kubernetes.io/projected/779f27d6-da68-4bab-9eb9-e9fc76a4a7a2-kube-api-access-g4bws\") pod \"rate-test-model-afd6d5-kserve-dc48655bc-ks5kn\" (UID: \"779f27d6-da68-4bab-9eb9-e9fc76a4a7a2\") " pod="ai-tenant-e2e-shared-b-afd6d5/rate-test-model-afd6d5-kserve-dc48655bc-ks5kn"
Jul 29 01:24:42.139579 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:42.139453    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/779f27d6-da68-4bab-9eb9-e9fc76a4a7a2-model-cache\") pod \"rate-test-model-afd6d5-kserve-dc48655bc-ks5kn\" (UID: \"779f27d6-da68-4bab-9eb9-e9fc76a4a7a2\") " pod="ai-tenant-e2e-shared-b-afd6d5/rate-test-model-afd6d5-kserve-dc48655bc-ks5kn"
Jul 29 01:24:42.139579 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:42.139497    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/779f27d6-da68-4bab-9eb9-e9fc76a4a7a2-dshm\") pod \"rate-test-model-afd6d5-kserve-dc48655bc-ks5kn\" (UID: \"779f27d6-da68-4bab-9eb9-e9fc76a4a7a2\") " pod="ai-tenant-e2e-shared-b-afd6d5/rate-test-model-afd6d5-kserve-dc48655bc-ks5kn"
Jul 29 01:24:42.139579 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:42.139556    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/779f27d6-da68-4bab-9eb9-e9fc76a4a7a2-tmp-dir\") pod \"rate-test-model-afd6d5-kserve-dc48655bc-ks5kn\" (UID: \"779f27d6-da68-4bab-9eb9-e9fc76a4a7a2\") " pod="ai-tenant-e2e-shared-b-afd6d5/rate-test-model-afd6d5-kserve-dc48655bc-ks5kn"
Jul 29 01:24:42.139579 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:42.139577    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/779f27d6-da68-4bab-9eb9-e9fc76a4a7a2-tls-certs\") pod \"rate-test-model-afd6d5-kserve-dc48655bc-ks5kn\" (UID: \"779f27d6-da68-4bab-9eb9-e9fc76a4a7a2\") " pod="ai-tenant-e2e-shared-b-afd6d5/rate-test-model-afd6d5-kserve-dc48655bc-ks5kn"
Jul 29 01:24:42.139895 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:42.139805    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/779f27d6-da68-4bab-9eb9-e9fc76a4a7a2-home\") pod \"rate-test-model-afd6d5-kserve-dc48655bc-ks5kn\" (UID: \"779f27d6-da68-4bab-9eb9-e9fc76a4a7a2\") " pod="ai-tenant-e2e-shared-b-afd6d5/rate-test-model-afd6d5-kserve-dc48655bc-ks5kn"
Jul 29 01:24:42.139895 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:42.139819    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/779f27d6-da68-4bab-9eb9-e9fc76a4a7a2-model-cache\") pod \"rate-test-model-afd6d5-kserve-dc48655bc-ks5kn\" (UID: \"779f27d6-da68-4bab-9eb9-e9fc76a4a7a2\") " pod="ai-tenant-e2e-shared-b-afd6d5/rate-test-model-afd6d5-kserve-dc48655bc-ks5kn"
Jul 29 01:24:42.139895 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:42.139849    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/779f27d6-da68-4bab-9eb9-e9fc76a4a7a2-tmp-dir\") pod \"rate-test-model-afd6d5-kserve-dc48655bc-ks5kn\" (UID: \"779f27d6-da68-4bab-9eb9-e9fc76a4a7a2\") " pod="ai-tenant-e2e-shared-b-afd6d5/rate-test-model-afd6d5-kserve-dc48655bc-ks5kn"
Jul 29 01:24:42.141816 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:42.141794    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/779f27d6-da68-4bab-9eb9-e9fc76a4a7a2-dshm\") pod \"rate-test-model-afd6d5-kserve-dc48655bc-ks5kn\" (UID: \"779f27d6-da68-4bab-9eb9-e9fc76a4a7a2\") " pod="ai-tenant-e2e-shared-b-afd6d5/rate-test-model-afd6d5-kserve-dc48655bc-ks5kn"
Jul 29 01:24:42.142110 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:42.142090    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/779f27d6-da68-4bab-9eb9-e9fc76a4a7a2-tls-certs\") pod \"rate-test-model-afd6d5-kserve-dc48655bc-ks5kn\" (UID: \"779f27d6-da68-4bab-9eb9-e9fc76a4a7a2\") " pod="ai-tenant-e2e-shared-b-afd6d5/rate-test-model-afd6d5-kserve-dc48655bc-ks5kn"
Jul 29 01:24:42.147594 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:42.147567    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4bws\" (UniqueName: \"kubernetes.io/projected/779f27d6-da68-4bab-9eb9-e9fc76a4a7a2-kube-api-access-g4bws\") pod \"rate-test-model-afd6d5-kserve-dc48655bc-ks5kn\" (UID: \"779f27d6-da68-4bab-9eb9-e9fc76a4a7a2\") " pod="ai-tenant-e2e-shared-b-afd6d5/rate-test-model-afd6d5-kserve-dc48655bc-ks5kn"
Jul 29 01:24:42.230051 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:42.229961    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-afd6d5/rate-test-model-afd6d5-kserve-dc48655bc-ks5kn"
Jul 29 01:24:42.366743 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:42.366716    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-afd6d5/rate-test-model-afd6d5-kserve-dc48655bc-ks5kn"]
Jul 29 01:24:42.369434 ip-10-0-138-146 kubenswrapper[2577]: W0729 01:24:42.369397    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod779f27d6_da68_4bab_9eb9_e9fc76a4a7a2.slice/crio-3c95e679d74359ffc5283e2b8601c10df9863a4eac927d0d597f5aa38971efcb WatchSource:0}: Error finding container 3c95e679d74359ffc5283e2b8601c10df9863a4eac927d0d597f5aa38971efcb: Status 404 returned error can't find the container with id 3c95e679d74359ffc5283e2b8601c10df9863a4eac927d0d597f5aa38971efcb
Jul 29 01:24:42.682403 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:42.682363    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-afd6d5/rate-test-model-afd6d5-kserve-dc48655bc-ks5kn" event={"ID":"779f27d6-da68-4bab-9eb9-e9fc76a4a7a2","Type":"ContainerStarted","Data":"958e5b64e25530914a5bd8dc967c447f54a0e8f2922069d45d3dc0216df9a183"}
Jul 29 01:24:42.682403 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:42.682402    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-afd6d5/rate-test-model-afd6d5-kserve-dc48655bc-ks5kn" event={"ID":"779f27d6-da68-4bab-9eb9-e9fc76a4a7a2","Type":"ContainerStarted","Data":"3c95e679d74359ffc5283e2b8601c10df9863a4eac927d0d597f5aa38971efcb"}
Jul 29 01:24:42.702190 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:42.702144    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-afd6d5/rate-test-model-afd6d5-kserve-dc48655bc-ks5kn" podStartSLOduration=1.702128759 podStartE2EDuration="1.702128759s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:24:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:24:42.699849273 +0000 UTC m=+2908.844306839" watchObservedRunningTime="2026-07-29 01:24:42.702128759 +0000 UTC m=+2908.846586328"
Jul 29 01:24:45.612937 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:45.612903    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:24:52.231098 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:52.231059    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-afd6d5/rate-test-model-afd6d5-kserve-dc48655bc-ks5kn"
Jul 29 01:24:52.231098 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:52.231102    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-afd6d5/rate-test-model-afd6d5-kserve-dc48655bc-ks5kn"
Jul 29 01:24:52.243845 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:52.243817    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-afd6d5/rate-test-model-afd6d5-kserve-dc48655bc-ks5kn"
Jul 29 01:24:52.739438 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:24:52.739402    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-afd6d5/rate-test-model-afd6d5-kserve-dc48655bc-ks5kn"
Jul 29 01:25:15.422729 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:15.422694    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:25:30.107556 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:30.107510    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:25:44.608897 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:44.608815    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:25:49.203636 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:49.203601    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-afd6d5/rate-test-model-afd6d5-kserve-dc48655bc-ks5kn"]
Jul 29 01:25:50.160974 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:50.160939    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7555-140697847927728"]
Jul 29 01:25:50.164479 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:50.164461    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-140697847927728"
Jul 29 01:25:50.166519 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:50.166499    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-dbjf5\""
Jul 29 01:25:50.170018 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:50.169995    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7555-140697847927728"]
Jul 29 01:25:50.280035 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:50.280001    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5bwp\" (UniqueName: \"kubernetes.io/projected/e45b4913-5f45-4fe9-bf91-9295ffdacb2a-kube-api-access-j5bwp\") pod \"test-curl-7555-140697847927728\" (UID: \"e45b4913-5f45-4fe9-bf91-9295ffdacb2a\") " pod="opendatahub/test-curl-7555-140697847927728"
Jul 29 01:25:50.380736 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:50.380704    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5bwp\" (UniqueName: \"kubernetes.io/projected/e45b4913-5f45-4fe9-bf91-9295ffdacb2a-kube-api-access-j5bwp\") pod \"test-curl-7555-140697847927728\" (UID: \"e45b4913-5f45-4fe9-bf91-9295ffdacb2a\") " pod="opendatahub/test-curl-7555-140697847927728"
Jul 29 01:25:50.388040 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:50.388019    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5bwp\" (UniqueName: \"kubernetes.io/projected/e45b4913-5f45-4fe9-bf91-9295ffdacb2a-kube-api-access-j5bwp\") pod \"test-curl-7555-140697847927728\" (UID: \"e45b4913-5f45-4fe9-bf91-9295ffdacb2a\") " pod="opendatahub/test-curl-7555-140697847927728"
Jul 29 01:25:50.474129 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:50.474044    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-140697847927728"
Jul 29 01:25:50.606087 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:50.606061    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7555-140697847927728"]
Jul 29 01:25:50.608802 ip-10-0-138-146 kubenswrapper[2577]: W0729 01:25:50.608775    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode45b4913_5f45_4fe9_bf91_9295ffdacb2a.slice/crio-c518157c00d3eb5c28fbde9fd3a9c6fc7f2ae2dc015d86cc25263b19710014e0 WatchSource:0}: Error finding container c518157c00d3eb5c28fbde9fd3a9c6fc7f2ae2dc015d86cc25263b19710014e0: Status 404 returned error can't find the container with id c518157c00d3eb5c28fbde9fd3a9c6fc7f2ae2dc015d86cc25263b19710014e0
Jul 29 01:25:50.610086 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:50.610068    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 01:25:51.007455 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:51.007416    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7555-140697847927728" event={"ID":"e45b4913-5f45-4fe9-bf91-9295ffdacb2a","Type":"ContainerStarted","Data":"c518157c00d3eb5c28fbde9fd3a9c6fc7f2ae2dc015d86cc25263b19710014e0"}
Jul 29 01:25:52.014957 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:52.014921    2577 generic.go:356] "Generic (PLEG): container finished" podID="e45b4913-5f45-4fe9-bf91-9295ffdacb2a" containerID="3f4ef7a4e212a92e121fbdb4a6c53757a4b6a56c52fd6fdf8fe1fde8cbfb3cd2" exitCode=0
Jul 29 01:25:52.015339 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:52.015012    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7555-140697847927728" event={"ID":"e45b4913-5f45-4fe9-bf91-9295ffdacb2a","Type":"ContainerDied","Data":"3f4ef7a4e212a92e121fbdb4a6c53757a4b6a56c52fd6fdf8fe1fde8cbfb3cd2"}
Jul 29 01:25:53.156097 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:53.156071    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-140697847927728"
Jul 29 01:25:53.191815 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:53.191786    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7555-140697847927728_e45b4913-5f45-4fe9-bf91-9295ffdacb2a/test-curl-7555-140697847927728/0.log"
Jul 29 01:25:53.209071 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:53.209036    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5bwp\" (UniqueName: \"kubernetes.io/projected/e45b4913-5f45-4fe9-bf91-9295ffdacb2a-kube-api-access-j5bwp\") pod \"e45b4913-5f45-4fe9-bf91-9295ffdacb2a\" (UID: \"e45b4913-5f45-4fe9-bf91-9295ffdacb2a\") "
Jul 29 01:25:53.211224 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:53.211201    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e45b4913-5f45-4fe9-bf91-9295ffdacb2a-kube-api-access-j5bwp" (OuterVolumeSpecName: "kube-api-access-j5bwp") pod "e45b4913-5f45-4fe9-bf91-9295ffdacb2a" (UID: "e45b4913-5f45-4fe9-bf91-9295ffdacb2a"). InnerVolumeSpecName "kube-api-access-j5bwp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:25:53.214850 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:53.214825    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7555-140697847927728"]
Jul 29 01:25:53.218699 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:53.218679    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7555-140697847927728"]
Jul 29 01:25:53.310206 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:53.310113    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5bwp\" (UniqueName: \"kubernetes.io/projected/e45b4913-5f45-4fe9-bf91-9295ffdacb2a-kube-api-access-j5bwp\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:25:53.344409 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:53.344378    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7555-140697847976624"]
Jul 29 01:25:53.344760 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:53.344747    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e45b4913-5f45-4fe9-bf91-9295ffdacb2a" containerName="test-curl-7555-140697847927728"
Jul 29 01:25:53.344808 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:53.344761    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e45b4913-5f45-4fe9-bf91-9295ffdacb2a" containerName="test-curl-7555-140697847927728"
Jul 29 01:25:53.344847 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:53.344821    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e45b4913-5f45-4fe9-bf91-9295ffdacb2a" containerName="test-curl-7555-140697847927728"
Jul 29 01:25:53.347760 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:53.347744    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-140697847976624"
Jul 29 01:25:53.353663 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:53.353634    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7555-140697847976624"]
Jul 29 01:25:53.410893 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:53.410853    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5p7x\" (UniqueName: \"kubernetes.io/projected/aa892a81-dad7-4370-bf0e-7c03ab3c5c97-kube-api-access-c5p7x\") pod \"test-curl-7555-140697847976624\" (UID: \"aa892a81-dad7-4370-bf0e-7c03ab3c5c97\") " pod="opendatahub/test-curl-7555-140697847976624"
Jul 29 01:25:53.512237 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:53.512196    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5p7x\" (UniqueName: \"kubernetes.io/projected/aa892a81-dad7-4370-bf0e-7c03ab3c5c97-kube-api-access-c5p7x\") pod \"test-curl-7555-140697847976624\" (UID: \"aa892a81-dad7-4370-bf0e-7c03ab3c5c97\") " pod="opendatahub/test-curl-7555-140697847976624"
Jul 29 01:25:53.520120 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:53.520093    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5p7x\" (UniqueName: \"kubernetes.io/projected/aa892a81-dad7-4370-bf0e-7c03ab3c5c97-kube-api-access-c5p7x\") pod \"test-curl-7555-140697847976624\" (UID: \"aa892a81-dad7-4370-bf0e-7c03ab3c5c97\") " pod="opendatahub/test-curl-7555-140697847976624"
Jul 29 01:25:53.658640 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:53.658604    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-140697847976624"
Jul 29 01:25:53.786027 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:53.785991    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7555-140697847976624"]
Jul 29 01:25:53.790386 ip-10-0-138-146 kubenswrapper[2577]: W0729 01:25:53.790354    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa892a81_dad7_4370_bf0e_7c03ab3c5c97.slice/crio-0a65ac4e38c14726abd4376aac02b5ea3299588341d289cdf12b7485acd95166 WatchSource:0}: Error finding container 0a65ac4e38c14726abd4376aac02b5ea3299588341d289cdf12b7485acd95166: Status 404 returned error can't find the container with id 0a65ac4e38c14726abd4376aac02b5ea3299588341d289cdf12b7485acd95166
Jul 29 01:25:54.025610 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:54.025504    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7555-140697847976624" event={"ID":"aa892a81-dad7-4370-bf0e-7c03ab3c5c97","Type":"ContainerStarted","Data":"0a65ac4e38c14726abd4376aac02b5ea3299588341d289cdf12b7485acd95166"}
Jul 29 01:25:54.026787 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:54.026756    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-140697847927728"
Jul 29 01:25:54.026787 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:54.026771    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c518157c00d3eb5c28fbde9fd3a9c6fc7f2ae2dc015d86cc25263b19710014e0"
Jul 29 01:25:54.037038 ip-10-0-138-146 kubenswrapper[2577]: E0729 01:25:54.037008    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7555-140697847927728\" is forbidden: User \"system:node:ip-10-0-138-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-146.ec2.internal' and this object" podUID="e45b4913-5f45-4fe9-bf91-9295ffdacb2a" pod="opendatahub/test-curl-7555-140697847927728"
Jul 29 01:25:54.303134 ip-10-0-138-146 kubenswrapper[2577]: E0729 01:25:54.303033    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7555-140697847927728\" is forbidden: User \"system:node:ip-10-0-138-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-146.ec2.internal' and this object" podUID="e45b4913-5f45-4fe9-bf91-9295ffdacb2a" pod="opendatahub/test-curl-7555-140697847927728"
Jul 29 01:25:54.304248 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:54.304225    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e45b4913-5f45-4fe9-bf91-9295ffdacb2a" path="/var/lib/kubelet/pods/e45b4913-5f45-4fe9-bf91-9295ffdacb2a/volumes"
Jul 29 01:25:55.033070 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:55.033028    2577 generic.go:356] "Generic (PLEG): container finished" podID="aa892a81-dad7-4370-bf0e-7c03ab3c5c97" containerID="6ab46f38a8a4ba72902f42926051eb280a629557128b95edc0b7adfaec088430" exitCode=0
Jul 29 01:25:55.033240 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:55.033118    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7555-140697847976624" event={"ID":"aa892a81-dad7-4370-bf0e-7c03ab3c5c97","Type":"ContainerDied","Data":"6ab46f38a8a4ba72902f42926051eb280a629557128b95edc0b7adfaec088430"}
Jul 29 01:25:56.176040 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:56.176016    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-140697847976624"
Jul 29 01:25:56.194980 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:56.194949    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7555-140697847976624_aa892a81-dad7-4370-bf0e-7c03ab3c5c97/test-curl-7555-140697847976624/0.log"
Jul 29 01:25:56.215106 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:56.215072    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7555-140697847976624"]
Jul 29 01:25:56.218771 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:56.218744    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7555-140697847976624"]
Jul 29 01:25:56.240255 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:56.240223    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5p7x\" (UniqueName: \"kubernetes.io/projected/aa892a81-dad7-4370-bf0e-7c03ab3c5c97-kube-api-access-c5p7x\") pod \"aa892a81-dad7-4370-bf0e-7c03ab3c5c97\" (UID: \"aa892a81-dad7-4370-bf0e-7c03ab3c5c97\") "
Jul 29 01:25:56.242447 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:56.242418    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa892a81-dad7-4370-bf0e-7c03ab3c5c97-kube-api-access-c5p7x" (OuterVolumeSpecName: "kube-api-access-c5p7x") pod "aa892a81-dad7-4370-bf0e-7c03ab3c5c97" (UID: "aa892a81-dad7-4370-bf0e-7c03ab3c5c97"). InnerVolumeSpecName "kube-api-access-c5p7x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:25:56.303556 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:56.303478    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa892a81-dad7-4370-bf0e-7c03ab3c5c97" path="/var/lib/kubelet/pods/aa892a81-dad7-4370-bf0e-7c03ab3c5c97/volumes"
Jul 29 01:25:56.341499 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:56.341462    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5p7x\" (UniqueName: \"kubernetes.io/projected/aa892a81-dad7-4370-bf0e-7c03ab3c5c97-kube-api-access-c5p7x\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:25:56.372933 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:56.372898    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7555-140697847961616"]
Jul 29 01:25:56.373258 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:56.373246    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa892a81-dad7-4370-bf0e-7c03ab3c5c97" containerName="test-curl-7555-140697847976624"
Jul 29 01:25:56.373304 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:56.373260    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa892a81-dad7-4370-bf0e-7c03ab3c5c97" containerName="test-curl-7555-140697847976624"
Jul 29 01:25:56.373340 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:56.373328    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa892a81-dad7-4370-bf0e-7c03ab3c5c97" containerName="test-curl-7555-140697847976624"
Jul 29 01:25:56.376312 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:56.376296    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-140697847961616"
Jul 29 01:25:56.381688 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:56.381659    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7555-140697847961616"]
Jul 29 01:25:56.442977 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:56.442939    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5f66p\" (UniqueName: \"kubernetes.io/projected/0772c6c3-807e-47ee-a06c-e0e39a116464-kube-api-access-5f66p\") pod \"test-curl-7555-140697847961616\" (UID: \"0772c6c3-807e-47ee-a06c-e0e39a116464\") " pod="opendatahub/test-curl-7555-140697847961616"
Jul 29 01:25:56.544404 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:56.544366    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5f66p\" (UniqueName: \"kubernetes.io/projected/0772c6c3-807e-47ee-a06c-e0e39a116464-kube-api-access-5f66p\") pod \"test-curl-7555-140697847961616\" (UID: \"0772c6c3-807e-47ee-a06c-e0e39a116464\") " pod="opendatahub/test-curl-7555-140697847961616"
Jul 29 01:25:56.552475 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:56.552449    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5f66p\" (UniqueName: \"kubernetes.io/projected/0772c6c3-807e-47ee-a06c-e0e39a116464-kube-api-access-5f66p\") pod \"test-curl-7555-140697847961616\" (UID: \"0772c6c3-807e-47ee-a06c-e0e39a116464\") " pod="opendatahub/test-curl-7555-140697847961616"
Jul 29 01:25:56.687161 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:56.687121    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-140697847961616"
Jul 29 01:25:56.822921 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:56.822895    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7555-140697847961616"]
Jul 29 01:25:56.825027 ip-10-0-138-146 kubenswrapper[2577]: W0729 01:25:56.824990    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0772c6c3_807e_47ee_a06c_e0e39a116464.slice/crio-9cdb42d7d201504866c88ee96287bfff7d72cbea164de4c6e03a0e438f9184c8 WatchSource:0}: Error finding container 9cdb42d7d201504866c88ee96287bfff7d72cbea164de4c6e03a0e438f9184c8: Status 404 returned error can't find the container with id 9cdb42d7d201504866c88ee96287bfff7d72cbea164de4c6e03a0e438f9184c8
Jul 29 01:25:57.044848 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:57.044760    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-140697847976624"
Jul 29 01:25:57.044848 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:57.044811    2577 scope.go:117] "RemoveContainer" containerID="6ab46f38a8a4ba72902f42926051eb280a629557128b95edc0b7adfaec088430"
Jul 29 01:25:57.046279 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:57.046008    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7555-140697847961616" event={"ID":"0772c6c3-807e-47ee-a06c-e0e39a116464","Type":"ContainerStarted","Data":"9cdb42d7d201504866c88ee96287bfff7d72cbea164de4c6e03a0e438f9184c8"}
Jul 29 01:25:58.053396 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:58.053360    2577 generic.go:356] "Generic (PLEG): container finished" podID="0772c6c3-807e-47ee-a06c-e0e39a116464" containerID="100d045b88feab4d2b9374a33c44ba91302699afff6cf783a1dc75abedb07183" exitCode=0
Jul 29 01:25:58.053814 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:58.053448    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7555-140697847961616" event={"ID":"0772c6c3-807e-47ee-a06c-e0e39a116464","Type":"ContainerDied","Data":"100d045b88feab4d2b9374a33c44ba91302699afff6cf783a1dc75abedb07183"}
Jul 29 01:25:59.195183 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:59.195153    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-140697847961616"
Jul 29 01:25:59.215655 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:59.215622    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7555-140697847961616_0772c6c3-807e-47ee-a06c-e0e39a116464/test-curl-7555-140697847961616/0.log"
Jul 29 01:25:59.240713 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:59.240679    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7555-140697847961616"]
Jul 29 01:25:59.243836 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:59.243810    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7555-140697847961616"]
Jul 29 01:25:59.270310 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:59.270281    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5f66p\" (UniqueName: \"kubernetes.io/projected/0772c6c3-807e-47ee-a06c-e0e39a116464-kube-api-access-5f66p\") pod \"0772c6c3-807e-47ee-a06c-e0e39a116464\" (UID: \"0772c6c3-807e-47ee-a06c-e0e39a116464\") "
Jul 29 01:25:59.272406 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:59.272382    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0772c6c3-807e-47ee-a06c-e0e39a116464-kube-api-access-5f66p" (OuterVolumeSpecName: "kube-api-access-5f66p") pod "0772c6c3-807e-47ee-a06c-e0e39a116464" (UID: "0772c6c3-807e-47ee-a06c-e0e39a116464"). InnerVolumeSpecName "kube-api-access-5f66p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:25:59.363534 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:59.363490    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7555-140697847961616"]
Jul 29 01:25:59.363936 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:59.363918    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0772c6c3-807e-47ee-a06c-e0e39a116464" containerName="test-curl-7555-140697847961616"
Jul 29 01:25:59.364016 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:59.363939    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0772c6c3-807e-47ee-a06c-e0e39a116464" containerName="test-curl-7555-140697847961616"
Jul 29 01:25:59.364089 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:59.364028    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0772c6c3-807e-47ee-a06c-e0e39a116464" containerName="test-curl-7555-140697847961616"
Jul 29 01:25:59.366903 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:59.366880    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-140697847961616"
Jul 29 01:25:59.370151 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:59.370127    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7555-140697847961616"]
Jul 29 01:25:59.371954 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:59.371929    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5f66p\" (UniqueName: \"kubernetes.io/projected/0772c6c3-807e-47ee-a06c-e0e39a116464-kube-api-access-5f66p\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:25:59.472912 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:59.472876    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdzzf\" (UniqueName: \"kubernetes.io/projected/731e2c07-485c-4e8d-a86f-f6ebcf2c2153-kube-api-access-bdzzf\") pod \"test-curl-7555-140697847961616\" (UID: \"731e2c07-485c-4e8d-a86f-f6ebcf2c2153\") " pod="opendatahub/test-curl-7555-140697847961616"
Jul 29 01:25:59.574251 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:59.574209    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdzzf\" (UniqueName: \"kubernetes.io/projected/731e2c07-485c-4e8d-a86f-f6ebcf2c2153-kube-api-access-bdzzf\") pod \"test-curl-7555-140697847961616\" (UID: \"731e2c07-485c-4e8d-a86f-f6ebcf2c2153\") " pod="opendatahub/test-curl-7555-140697847961616"
Jul 29 01:25:59.581660 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:59.581633    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdzzf\" (UniqueName: \"kubernetes.io/projected/731e2c07-485c-4e8d-a86f-f6ebcf2c2153-kube-api-access-bdzzf\") pod \"test-curl-7555-140697847961616\" (UID: \"731e2c07-485c-4e8d-a86f-f6ebcf2c2153\") " pod="opendatahub/test-curl-7555-140697847961616"
Jul 29 01:25:59.677336 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:59.677256    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-140697847961616"
Jul 29 01:25:59.808077 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:25:59.808049    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7555-140697847961616"]
Jul 29 01:25:59.810012 ip-10-0-138-146 kubenswrapper[2577]: W0729 01:25:59.809985    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod731e2c07_485c_4e8d_a86f_f6ebcf2c2153.slice/crio-904403be1259a5528d83ecfb5a736f7db6d973578f0490c893a6e2287d5a5c53 WatchSource:0}: Error finding container 904403be1259a5528d83ecfb5a736f7db6d973578f0490c893a6e2287d5a5c53: Status 404 returned error can't find the container with id 904403be1259a5528d83ecfb5a736f7db6d973578f0490c893a6e2287d5a5c53
Jul 29 01:26:00.066961 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:00.066867    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7555-140697847961616" event={"ID":"731e2c07-485c-4e8d-a86f-f6ebcf2c2153","Type":"ContainerStarted","Data":"904403be1259a5528d83ecfb5a736f7db6d973578f0490c893a6e2287d5a5c53"}
Jul 29 01:26:00.068138 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:00.068118    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-140697847961616"
Jul 29 01:26:00.068138 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:00.068139    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9cdb42d7d201504866c88ee96287bfff7d72cbea164de4c6e03a0e438f9184c8"
Jul 29 01:26:00.079547 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:00.079511    2577 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7555-140697847961616" oldPodUID="0772c6c3-807e-47ee-a06c-e0e39a116464" podUID="731e2c07-485c-4e8d-a86f-f6ebcf2c2153"
Jul 29 01:26:00.309447 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:00.309409    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0772c6c3-807e-47ee-a06c-e0e39a116464" path="/var/lib/kubelet/pods/0772c6c3-807e-47ee-a06c-e0e39a116464/volumes"
Jul 29 01:26:01.074271 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:01.074238    2577 generic.go:356] "Generic (PLEG): container finished" podID="731e2c07-485c-4e8d-a86f-f6ebcf2c2153" containerID="a5fac305f69da444c173eb35fe0d7d21f9e8d5fb17789d00ae11fb680c5b7953" exitCode=0
Jul 29 01:26:01.074463 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:01.074331    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7555-140697847961616" event={"ID":"731e2c07-485c-4e8d-a86f-f6ebcf2c2153","Type":"ContainerDied","Data":"a5fac305f69da444c173eb35fe0d7d21f9e8d5fb17789d00ae11fb680c5b7953"}
Jul 29 01:26:01.304640 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:01.304607    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:26:02.220124 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:02.220098    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-140697847961616"
Jul 29 01:26:02.238425 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:02.238383    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7555-140697847961616_731e2c07-485c-4e8d-a86f-f6ebcf2c2153/test-curl-7555-140697847961616/0.log"
Jul 29 01:26:02.258773 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:02.258726    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7555-140697847961616"]
Jul 29 01:26:02.262137 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:02.262110    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7555-140697847961616"]
Jul 29 01:26:02.300874 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:02.300848    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdzzf\" (UniqueName: \"kubernetes.io/projected/731e2c07-485c-4e8d-a86f-f6ebcf2c2153-kube-api-access-bdzzf\") pod \"731e2c07-485c-4e8d-a86f-f6ebcf2c2153\" (UID: \"731e2c07-485c-4e8d-a86f-f6ebcf2c2153\") "
Jul 29 01:26:02.303007 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:02.302979    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/731e2c07-485c-4e8d-a86f-f6ebcf2c2153-kube-api-access-bdzzf" (OuterVolumeSpecName: "kube-api-access-bdzzf") pod "731e2c07-485c-4e8d-a86f-f6ebcf2c2153" (UID: "731e2c07-485c-4e8d-a86f-f6ebcf2c2153"). InnerVolumeSpecName "kube-api-access-bdzzf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:26:02.304311 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:02.304278    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="731e2c07-485c-4e8d-a86f-f6ebcf2c2153" path="/var/lib/kubelet/pods/731e2c07-485c-4e8d-a86f-f6ebcf2c2153/volumes"
Jul 29 01:26:02.382675 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:02.382570    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7555-140697847962624"]
Jul 29 01:26:02.382981 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:02.382967    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="731e2c07-485c-4e8d-a86f-f6ebcf2c2153" containerName="test-curl-7555-140697847961616"
Jul 29 01:26:02.383025 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:02.382983    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="731e2c07-485c-4e8d-a86f-f6ebcf2c2153" containerName="test-curl-7555-140697847961616"
Jul 29 01:26:02.383060 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:02.383051    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="731e2c07-485c-4e8d-a86f-f6ebcf2c2153" containerName="test-curl-7555-140697847961616"
Jul 29 01:26:02.386185 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:02.386166    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-140697847962624"
Jul 29 01:26:02.389618 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:02.389571    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7555-140697847962624"]
Jul 29 01:26:02.402242 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:02.402210    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdzzf\" (UniqueName: \"kubernetes.io/projected/731e2c07-485c-4e8d-a86f-f6ebcf2c2153-kube-api-access-bdzzf\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:26:02.503528 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:02.503490    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nk2b\" (UniqueName: \"kubernetes.io/projected/2d6f095e-797e-4090-a385-27ab0b5cf459-kube-api-access-4nk2b\") pod \"test-curl-7555-140697847962624\" (UID: \"2d6f095e-797e-4090-a385-27ab0b5cf459\") " pod="opendatahub/test-curl-7555-140697847962624"
Jul 29 01:26:02.604556 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:02.604506    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nk2b\" (UniqueName: \"kubernetes.io/projected/2d6f095e-797e-4090-a385-27ab0b5cf459-kube-api-access-4nk2b\") pod \"test-curl-7555-140697847962624\" (UID: \"2d6f095e-797e-4090-a385-27ab0b5cf459\") " pod="opendatahub/test-curl-7555-140697847962624"
Jul 29 01:26:02.618937 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:02.618902    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nk2b\" (UniqueName: \"kubernetes.io/projected/2d6f095e-797e-4090-a385-27ab0b5cf459-kube-api-access-4nk2b\") pod \"test-curl-7555-140697847962624\" (UID: \"2d6f095e-797e-4090-a385-27ab0b5cf459\") " pod="opendatahub/test-curl-7555-140697847962624"
Jul 29 01:26:02.697392 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:02.697300    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-140697847962624"
Jul 29 01:26:02.831097 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:02.831014    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7555-140697847962624"]
Jul 29 01:26:02.835923 ip-10-0-138-146 kubenswrapper[2577]: W0729 01:26:02.835895    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2d6f095e_797e_4090_a385_27ab0b5cf459.slice/crio-f170d6421aa0f233818f17dc0eddaab7db65ca1ddfddb7e8d99feb450747f8de WatchSource:0}: Error finding container f170d6421aa0f233818f17dc0eddaab7db65ca1ddfddb7e8d99feb450747f8de: Status 404 returned error can't find the container with id f170d6421aa0f233818f17dc0eddaab7db65ca1ddfddb7e8d99feb450747f8de
Jul 29 01:26:03.085797 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:03.085769    2577 scope.go:117] "RemoveContainer" containerID="a5fac305f69da444c173eb35fe0d7d21f9e8d5fb17789d00ae11fb680c5b7953"
Jul 29 01:26:03.085797 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:03.085767    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-140697847961616"
Jul 29 01:26:03.087120 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:03.087053    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7555-140697847962624" event={"ID":"2d6f095e-797e-4090-a385-27ab0b5cf459","Type":"ContainerStarted","Data":"f170d6421aa0f233818f17dc0eddaab7db65ca1ddfddb7e8d99feb450747f8de"}
Jul 29 01:26:04.093493 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:04.093455    2577 generic.go:356] "Generic (PLEG): container finished" podID="2d6f095e-797e-4090-a385-27ab0b5cf459" containerID="866ed43509b3514674c8724d843f9dad2deee63e9803f1ebff15dc5ad1cb8119" exitCode=0
Jul 29 01:26:04.093877 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:04.093537    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7555-140697847962624" event={"ID":"2d6f095e-797e-4090-a385-27ab0b5cf459","Type":"ContainerDied","Data":"866ed43509b3514674c8724d843f9dad2deee63e9803f1ebff15dc5ad1cb8119"}
Jul 29 01:26:04.222225 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:04.222183    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-afd6d5/rate-test-model-afd6d5-kserve-dc48655bc-ks5kn" podUID="779f27d6-da68-4bab-9eb9-e9fc76a4a7a2" containerName="main" containerID="cri-o://958e5b64e25530914a5bd8dc967c447f54a0e8f2922069d45d3dc0216df9a183" gracePeriod=45
Jul 29 01:26:04.472360 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:04.472332    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-afd6d5/rate-test-model-afd6d5-kserve-dc48655bc-ks5kn"
Jul 29 01:26:04.625497 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:04.625458    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/779f27d6-da68-4bab-9eb9-e9fc76a4a7a2-tmp-dir\") pod \"779f27d6-da68-4bab-9eb9-e9fc76a4a7a2\" (UID: \"779f27d6-da68-4bab-9eb9-e9fc76a4a7a2\") "
Jul 29 01:26:04.625497 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:04.625500    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/779f27d6-da68-4bab-9eb9-e9fc76a4a7a2-home\") pod \"779f27d6-da68-4bab-9eb9-e9fc76a4a7a2\" (UID: \"779f27d6-da68-4bab-9eb9-e9fc76a4a7a2\") "
Jul 29 01:26:04.625732 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:04.625575    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/779f27d6-da68-4bab-9eb9-e9fc76a4a7a2-dshm\") pod \"779f27d6-da68-4bab-9eb9-e9fc76a4a7a2\" (UID: \"779f27d6-da68-4bab-9eb9-e9fc76a4a7a2\") "
Jul 29 01:26:04.625732 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:04.625657    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/779f27d6-da68-4bab-9eb9-e9fc76a4a7a2-tls-certs\") pod \"779f27d6-da68-4bab-9eb9-e9fc76a4a7a2\" (UID: \"779f27d6-da68-4bab-9eb9-e9fc76a4a7a2\") "
Jul 29 01:26:04.625732 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:04.625716    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4bws\" (UniqueName: \"kubernetes.io/projected/779f27d6-da68-4bab-9eb9-e9fc76a4a7a2-kube-api-access-g4bws\") pod \"779f27d6-da68-4bab-9eb9-e9fc76a4a7a2\" (UID: \"779f27d6-da68-4bab-9eb9-e9fc76a4a7a2\") "
Jul 29 01:26:04.625862 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:04.625740    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/779f27d6-da68-4bab-9eb9-e9fc76a4a7a2-model-cache\") pod \"779f27d6-da68-4bab-9eb9-e9fc76a4a7a2\" (UID: \"779f27d6-da68-4bab-9eb9-e9fc76a4a7a2\") "
Jul 29 01:26:04.625862 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:04.625793    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/779f27d6-da68-4bab-9eb9-e9fc76a4a7a2-home" (OuterVolumeSpecName: "home") pod "779f27d6-da68-4bab-9eb9-e9fc76a4a7a2" (UID: "779f27d6-da68-4bab-9eb9-e9fc76a4a7a2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:26:04.625862 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:04.625825    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/779f27d6-da68-4bab-9eb9-e9fc76a4a7a2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "779f27d6-da68-4bab-9eb9-e9fc76a4a7a2" (UID: "779f27d6-da68-4bab-9eb9-e9fc76a4a7a2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:26:04.626057 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:04.626036    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/779f27d6-da68-4bab-9eb9-e9fc76a4a7a2-tmp-dir\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:26:04.626183 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:04.626139    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/779f27d6-da68-4bab-9eb9-e9fc76a4a7a2-home\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:26:04.626183 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:04.626039    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/779f27d6-da68-4bab-9eb9-e9fc76a4a7a2-model-cache" (OuterVolumeSpecName: "model-cache") pod "779f27d6-da68-4bab-9eb9-e9fc76a4a7a2" (UID: "779f27d6-da68-4bab-9eb9-e9fc76a4a7a2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:26:04.627912 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:04.627883    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/779f27d6-da68-4bab-9eb9-e9fc76a4a7a2-kube-api-access-g4bws" (OuterVolumeSpecName: "kube-api-access-g4bws") pod "779f27d6-da68-4bab-9eb9-e9fc76a4a7a2" (UID: "779f27d6-da68-4bab-9eb9-e9fc76a4a7a2"). InnerVolumeSpecName "kube-api-access-g4bws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:26:04.627912 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:04.627901    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/779f27d6-da68-4bab-9eb9-e9fc76a4a7a2-dshm" (OuterVolumeSpecName: "dshm") pod "779f27d6-da68-4bab-9eb9-e9fc76a4a7a2" (UID: "779f27d6-da68-4bab-9eb9-e9fc76a4a7a2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:26:04.628081 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:04.627904    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/779f27d6-da68-4bab-9eb9-e9fc76a4a7a2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "779f27d6-da68-4bab-9eb9-e9fc76a4a7a2" (UID: "779f27d6-da68-4bab-9eb9-e9fc76a4a7a2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:26:04.726851 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:04.726756    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/779f27d6-da68-4bab-9eb9-e9fc76a4a7a2-dshm\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:26:04.726851 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:04.726788    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/779f27d6-da68-4bab-9eb9-e9fc76a4a7a2-tls-certs\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:26:04.726851 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:04.726800    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4bws\" (UniqueName: \"kubernetes.io/projected/779f27d6-da68-4bab-9eb9-e9fc76a4a7a2-kube-api-access-g4bws\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:26:04.726851 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:04.726810    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/779f27d6-da68-4bab-9eb9-e9fc76a4a7a2-model-cache\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:26:05.100725 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:05.100697    2577 generic.go:356] "Generic (PLEG): container finished" podID="779f27d6-da68-4bab-9eb9-e9fc76a4a7a2" containerID="958e5b64e25530914a5bd8dc967c447f54a0e8f2922069d45d3dc0216df9a183" exitCode=0
Jul 29 01:26:05.101160 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:05.100748    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-afd6d5/rate-test-model-afd6d5-kserve-dc48655bc-ks5kn"
Jul 29 01:26:05.101160 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:05.100792    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-afd6d5/rate-test-model-afd6d5-kserve-dc48655bc-ks5kn" event={"ID":"779f27d6-da68-4bab-9eb9-e9fc76a4a7a2","Type":"ContainerDied","Data":"958e5b64e25530914a5bd8dc967c447f54a0e8f2922069d45d3dc0216df9a183"}
Jul 29 01:26:05.101160 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:05.100843    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-afd6d5/rate-test-model-afd6d5-kserve-dc48655bc-ks5kn" event={"ID":"779f27d6-da68-4bab-9eb9-e9fc76a4a7a2","Type":"ContainerDied","Data":"3c95e679d74359ffc5283e2b8601c10df9863a4eac927d0d597f5aa38971efcb"}
Jul 29 01:26:05.101160 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:05.100864    2577 scope.go:117] "RemoveContainer" containerID="958e5b64e25530914a5bd8dc967c447f54a0e8f2922069d45d3dc0216df9a183"
Jul 29 01:26:05.113095 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:05.113049    2577 scope.go:117] "RemoveContainer" containerID="958e5b64e25530914a5bd8dc967c447f54a0e8f2922069d45d3dc0216df9a183"
Jul 29 01:26:05.113765 ip-10-0-138-146 kubenswrapper[2577]: E0729 01:26:05.113737    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"958e5b64e25530914a5bd8dc967c447f54a0e8f2922069d45d3dc0216df9a183\": container with ID starting with 958e5b64e25530914a5bd8dc967c447f54a0e8f2922069d45d3dc0216df9a183 not found: ID does not exist" containerID="958e5b64e25530914a5bd8dc967c447f54a0e8f2922069d45d3dc0216df9a183"
Jul 29 01:26:05.113888 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:05.113771    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"958e5b64e25530914a5bd8dc967c447f54a0e8f2922069d45d3dc0216df9a183"} err="failed to get container status \"958e5b64e25530914a5bd8dc967c447f54a0e8f2922069d45d3dc0216df9a183\": rpc error: code = NotFound desc = could not find container \"958e5b64e25530914a5bd8dc967c447f54a0e8f2922069d45d3dc0216df9a183\": container with ID starting with 958e5b64e25530914a5bd8dc967c447f54a0e8f2922069d45d3dc0216df9a183 not found: ID does not exist"
Jul 29 01:26:05.123092 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:05.123061    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-afd6d5/rate-test-model-afd6d5-kserve-dc48655bc-ks5kn"]
Jul 29 01:26:05.128254 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:05.128224    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-afd6d5/rate-test-model-afd6d5-kserve-dc48655bc-ks5kn"]
Jul 29 01:26:05.266042 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:05.266014    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-140697847962624"
Jul 29 01:26:05.284411 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:05.284376    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7555-140697847962624_2d6f095e-797e-4090-a385-27ab0b5cf459/test-curl-7555-140697847962624/0.log"
Jul 29 01:26:05.305996 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:05.305966    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7555-140697847962624"]
Jul 29 01:26:05.309956 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:05.309929    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7555-140697847962624"]
Jul 29 01:26:05.433218 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:05.433121    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4nk2b\" (UniqueName: \"kubernetes.io/projected/2d6f095e-797e-4090-a385-27ab0b5cf459-kube-api-access-4nk2b\") pod \"2d6f095e-797e-4090-a385-27ab0b5cf459\" (UID: \"2d6f095e-797e-4090-a385-27ab0b5cf459\") "
Jul 29 01:26:05.435401 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:05.435375    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d6f095e-797e-4090-a385-27ab0b5cf459-kube-api-access-4nk2b" (OuterVolumeSpecName: "kube-api-access-4nk2b") pod "2d6f095e-797e-4090-a385-27ab0b5cf459" (UID: "2d6f095e-797e-4090-a385-27ab0b5cf459"). InnerVolumeSpecName "kube-api-access-4nk2b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:26:05.436521 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:05.436501    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7555-140697847962624"]
Jul 29 01:26:05.436866 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:05.436854    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="779f27d6-da68-4bab-9eb9-e9fc76a4a7a2" containerName="main"
Jul 29 01:26:05.436902 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:05.436868    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="779f27d6-da68-4bab-9eb9-e9fc76a4a7a2" containerName="main"
Jul 29 01:26:05.436902 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:05.436883    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d6f095e-797e-4090-a385-27ab0b5cf459" containerName="test-curl-7555-140697847962624"
Jul 29 01:26:05.436902 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:05.436889    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d6f095e-797e-4090-a385-27ab0b5cf459" containerName="test-curl-7555-140697847962624"
Jul 29 01:26:05.436993 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:05.436949    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="779f27d6-da68-4bab-9eb9-e9fc76a4a7a2" containerName="main"
Jul 29 01:26:05.436993 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:05.436957    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d6f095e-797e-4090-a385-27ab0b5cf459" containerName="test-curl-7555-140697847962624"
Jul 29 01:26:05.440017 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:05.440002    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-140697847962624"
Jul 29 01:26:05.445919 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:05.445883    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7555-140697847962624"]
Jul 29 01:26:05.534632 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:05.534567    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pbdc\" (UniqueName: \"kubernetes.io/projected/b5f8f545-6c32-49d0-a8bb-58493e933d70-kube-api-access-2pbdc\") pod \"test-curl-7555-140697847962624\" (UID: \"b5f8f545-6c32-49d0-a8bb-58493e933d70\") " pod="opendatahub/test-curl-7555-140697847962624"
Jul 29 01:26:05.534827 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:05.534745    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4nk2b\" (UniqueName: \"kubernetes.io/projected/2d6f095e-797e-4090-a385-27ab0b5cf459-kube-api-access-4nk2b\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:26:05.635948 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:05.635899    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pbdc\" (UniqueName: \"kubernetes.io/projected/b5f8f545-6c32-49d0-a8bb-58493e933d70-kube-api-access-2pbdc\") pod \"test-curl-7555-140697847962624\" (UID: \"b5f8f545-6c32-49d0-a8bb-58493e933d70\") " pod="opendatahub/test-curl-7555-140697847962624"
Jul 29 01:26:05.645700 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:05.645666    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pbdc\" (UniqueName: \"kubernetes.io/projected/b5f8f545-6c32-49d0-a8bb-58493e933d70-kube-api-access-2pbdc\") pod \"test-curl-7555-140697847962624\" (UID: \"b5f8f545-6c32-49d0-a8bb-58493e933d70\") " pod="opendatahub/test-curl-7555-140697847962624"
Jul 29 01:26:05.751751 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:05.751649    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-140697847962624"
Jul 29 01:26:05.887028 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:05.887003    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7555-140697847962624"]
Jul 29 01:26:05.889499 ip-10-0-138-146 kubenswrapper[2577]: W0729 01:26:05.889474    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb5f8f545_6c32_49d0_a8bb_58493e933d70.slice/crio-d1ac74550ebadd473a256b65006a80c9bf3390933e8ce689bef8a09fa401c9ae WatchSource:0}: Error finding container d1ac74550ebadd473a256b65006a80c9bf3390933e8ce689bef8a09fa401c9ae: Status 404 returned error can't find the container with id d1ac74550ebadd473a256b65006a80c9bf3390933e8ce689bef8a09fa401c9ae
Jul 29 01:26:06.106287 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:06.106260    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-140697847962624"
Jul 29 01:26:06.106287 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:06.106282    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f170d6421aa0f233818f17dc0eddaab7db65ca1ddfddb7e8d99feb450747f8de"
Jul 29 01:26:06.107537 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:06.107514    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7555-140697847962624" event={"ID":"b5f8f545-6c32-49d0-a8bb-58493e933d70","Type":"ContainerStarted","Data":"d1ac74550ebadd473a256b65006a80c9bf3390933e8ce689bef8a09fa401c9ae"}
Jul 29 01:26:06.117921 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:06.117891    2577 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7555-140697847962624" oldPodUID="2d6f095e-797e-4090-a385-27ab0b5cf459" podUID="b5f8f545-6c32-49d0-a8bb-58493e933d70"
Jul 29 01:26:06.303867 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:06.303836    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d6f095e-797e-4090-a385-27ab0b5cf459" path="/var/lib/kubelet/pods/2d6f095e-797e-4090-a385-27ab0b5cf459/volumes"
Jul 29 01:26:06.304230 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:06.304218    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="779f27d6-da68-4bab-9eb9-e9fc76a4a7a2" path="/var/lib/kubelet/pods/779f27d6-da68-4bab-9eb9-e9fc76a4a7a2/volumes"
Jul 29 01:26:07.114265 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:07.114229    2577 generic.go:356] "Generic (PLEG): container finished" podID="b5f8f545-6c32-49d0-a8bb-58493e933d70" containerID="7b46cbb1f14f9ffb11825025080657a81da260c8bd12570ba87885738f749cb8" exitCode=0
Jul 29 01:26:07.114692 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:07.114282    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7555-140697847962624" event={"ID":"b5f8f545-6c32-49d0-a8bb-58493e933d70","Type":"ContainerDied","Data":"7b46cbb1f14f9ffb11825025080657a81da260c8bd12570ba87885738f749cb8"}
Jul 29 01:26:08.254316 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:08.254291    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-140697847962624"
Jul 29 01:26:08.272175 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:08.272145    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7555-140697847962624_b5f8f545-6c32-49d0-a8bb-58493e933d70/test-curl-7555-140697847962624/0.log"
Jul 29 01:26:08.291358 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:08.291326    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7555-140697847962624"]
Jul 29 01:26:08.294687 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:08.294662    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7555-140697847962624"]
Jul 29 01:26:08.363212 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:08.363182    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pbdc\" (UniqueName: \"kubernetes.io/projected/b5f8f545-6c32-49d0-a8bb-58493e933d70-kube-api-access-2pbdc\") pod \"b5f8f545-6c32-49d0-a8bb-58493e933d70\" (UID: \"b5f8f545-6c32-49d0-a8bb-58493e933d70\") "
Jul 29 01:26:08.365259 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:08.365226    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5f8f545-6c32-49d0-a8bb-58493e933d70-kube-api-access-2pbdc" (OuterVolumeSpecName: "kube-api-access-2pbdc") pod "b5f8f545-6c32-49d0-a8bb-58493e933d70" (UID: "b5f8f545-6c32-49d0-a8bb-58493e933d70"). InnerVolumeSpecName "kube-api-access-2pbdc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:26:08.464836 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:08.464802    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pbdc\" (UniqueName: \"kubernetes.io/projected/b5f8f545-6c32-49d0-a8bb-58493e933d70-kube-api-access-2pbdc\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:26:09.081967 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:09.081924    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"]
Jul 29 01:26:09.082392 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:09.082375    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5f8f545-6c32-49d0-a8bb-58493e933d70" containerName="test-curl-7555-140697847962624"
Jul 29 01:26:09.082474 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:09.082396    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5f8f545-6c32-49d0-a8bb-58493e933d70" containerName="test-curl-7555-140697847962624"
Jul 29 01:26:09.082561 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:09.082537    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5f8f545-6c32-49d0-a8bb-58493e933d70" containerName="test-curl-7555-140697847962624"
Jul 29 01:26:09.085613 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:09.085573    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"
Jul 29 01:26:09.087908 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:09.087887    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-e81b9d-openshift-default-dockercfg-gj7rz\""
Jul 29 01:26:09.096951 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:09.096923    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"]
Jul 29 01:26:09.125079 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:09.125052    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7555-140697847962624"
Jul 29 01:26:09.125079 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:09.125072    2577 scope.go:117] "RemoveContainer" containerID="7b46cbb1f14f9ffb11825025080657a81da260c8bd12570ba87885738f749cb8"
Jul 29 01:26:09.174993 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:09.174958    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/087e9740-bd95-4095-ab53-8548296895a7-workload-certs\") pod \"e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2\" (UID: \"087e9740-bd95-4095-ab53-8548296895a7\") " pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"
Jul 29 01:26:09.174993 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:09.174997    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/087e9740-bd95-4095-ab53-8548296895a7-istiod-ca-cert\") pod \"e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2\" (UID: \"087e9740-bd95-4095-ab53-8548296895a7\") " pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"
Jul 29 01:26:09.175186 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:09.175029    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/087e9740-bd95-4095-ab53-8548296895a7-istio-data\") pod \"e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2\" (UID: \"087e9740-bd95-4095-ab53-8548296895a7\") " pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"
Jul 29 01:26:09.175186 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:09.175095    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/087e9740-bd95-4095-ab53-8548296895a7-istio-podinfo\") pod \"e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2\" (UID: \"087e9740-bd95-4095-ab53-8548296895a7\") " pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"
Jul 29 01:26:09.175186 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:09.175132    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4xfh\" (UniqueName: \"kubernetes.io/projected/087e9740-bd95-4095-ab53-8548296895a7-kube-api-access-q4xfh\") pod \"e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2\" (UID: \"087e9740-bd95-4095-ab53-8548296895a7\") " pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"
Jul 29 01:26:09.175354 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:09.175190    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/087e9740-bd95-4095-ab53-8548296895a7-credential-socket\") pod \"e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2\" (UID: \"087e9740-bd95-4095-ab53-8548296895a7\") " pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"
Jul 29 01:26:09.175354 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:09.175209    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/087e9740-bd95-4095-ab53-8548296895a7-istio-token\") pod \"e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2\" (UID: \"087e9740-bd95-4095-ab53-8548296895a7\") " pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"
Jul 29 01:26:09.175354 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:09.175247    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/087e9740-bd95-4095-ab53-8548296895a7-istio-envoy\") pod \"e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2\" (UID: \"087e9740-bd95-4095-ab53-8548296895a7\") " pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"
Jul 29 01:26:09.175354 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:09.175312    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/087e9740-bd95-4095-ab53-8548296895a7-workload-socket\") pod \"e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2\" (UID: \"087e9740-bd95-4095-ab53-8548296895a7\") " pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"
Jul 29 01:26:09.276806 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:09.276755    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/087e9740-bd95-4095-ab53-8548296895a7-credential-socket\") pod \"e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2\" (UID: \"087e9740-bd95-4095-ab53-8548296895a7\") " pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"
Jul 29 01:26:09.276806 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:09.276812    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/087e9740-bd95-4095-ab53-8548296895a7-istio-token\") pod \"e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2\" (UID: \"087e9740-bd95-4095-ab53-8548296895a7\") " pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"
Jul 29 01:26:09.277394 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:09.276843    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/087e9740-bd95-4095-ab53-8548296895a7-istio-envoy\") pod \"e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2\" (UID: \"087e9740-bd95-4095-ab53-8548296895a7\") " pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"
Jul 29 01:26:09.277394 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:09.276879    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/087e9740-bd95-4095-ab53-8548296895a7-workload-socket\") pod \"e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2\" (UID: \"087e9740-bd95-4095-ab53-8548296895a7\") " pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"
Jul 29 01:26:09.277394 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:09.276913    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/087e9740-bd95-4095-ab53-8548296895a7-workload-certs\") pod \"e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2\" (UID: \"087e9740-bd95-4095-ab53-8548296895a7\") " pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"
Jul 29 01:26:09.277394 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:09.276928    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/087e9740-bd95-4095-ab53-8548296895a7-istiod-ca-cert\") pod \"e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2\" (UID: \"087e9740-bd95-4095-ab53-8548296895a7\") " pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"
Jul 29 01:26:09.277394 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:09.276952    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/087e9740-bd95-4095-ab53-8548296895a7-istio-data\") pod \"e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2\" (UID: \"087e9740-bd95-4095-ab53-8548296895a7\") " pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"
Jul 29 01:26:09.277394 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:09.276990    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/087e9740-bd95-4095-ab53-8548296895a7-istio-podinfo\") pod \"e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2\" (UID: \"087e9740-bd95-4095-ab53-8548296895a7\") " pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"
Jul 29 01:26:09.277394 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:09.277017    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4xfh\" (UniqueName: \"kubernetes.io/projected/087e9740-bd95-4095-ab53-8548296895a7-kube-api-access-q4xfh\") pod \"e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2\" (UID: \"087e9740-bd95-4095-ab53-8548296895a7\") " pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"
Jul 29 01:26:09.277394 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:09.277199    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/087e9740-bd95-4095-ab53-8548296895a7-credential-socket\") pod \"e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2\" (UID: \"087e9740-bd95-4095-ab53-8548296895a7\") " pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"
Jul 29 01:26:09.277394 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:09.277303    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/087e9740-bd95-4095-ab53-8548296895a7-workload-certs\") pod \"e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2\" (UID: \"087e9740-bd95-4095-ab53-8548296895a7\") " pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"
Jul 29 01:26:09.277394 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:09.277335    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/087e9740-bd95-4095-ab53-8548296895a7-istio-data\") pod \"e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2\" (UID: \"087e9740-bd95-4095-ab53-8548296895a7\") " pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"
Jul 29 01:26:09.277778 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:09.277500    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/087e9740-bd95-4095-ab53-8548296895a7-workload-socket\") pod \"e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2\" (UID: \"087e9740-bd95-4095-ab53-8548296895a7\") " pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"
Jul 29 01:26:09.277778 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:09.277721    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/087e9740-bd95-4095-ab53-8548296895a7-istiod-ca-cert\") pod \"e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2\" (UID: \"087e9740-bd95-4095-ab53-8548296895a7\") " pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"
Jul 29 01:26:09.279120 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:09.279103    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/087e9740-bd95-4095-ab53-8548296895a7-istio-envoy\") pod \"e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2\" (UID: \"087e9740-bd95-4095-ab53-8548296895a7\") " pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"
Jul 29 01:26:09.279390 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:09.279372    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/087e9740-bd95-4095-ab53-8548296895a7-istio-podinfo\") pod \"e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2\" (UID: \"087e9740-bd95-4095-ab53-8548296895a7\") " pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"
Jul 29 01:26:09.284617 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:09.284596    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4xfh\" (UniqueName: \"kubernetes.io/projected/087e9740-bd95-4095-ab53-8548296895a7-kube-api-access-q4xfh\") pod \"e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2\" (UID: \"087e9740-bd95-4095-ab53-8548296895a7\") " pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"
Jul 29 01:26:09.284998 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:09.284978    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/087e9740-bd95-4095-ab53-8548296895a7-istio-token\") pod \"e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2\" (UID: \"087e9740-bd95-4095-ab53-8548296895a7\") " pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"
Jul 29 01:26:09.397152 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:09.397069    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"
Jul 29 01:26:09.535460 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:09.535436    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"]
Jul 29 01:26:09.537812 ip-10-0-138-146 kubenswrapper[2577]: W0729 01:26:09.537780    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod087e9740_bd95_4095_ab53_8548296895a7.slice/crio-f5874843014989bd717521f9282de06e6bd1ccf93afbc5cb693d4bb1b91cc8d2 WatchSource:0}: Error finding container f5874843014989bd717521f9282de06e6bd1ccf93afbc5cb693d4bb1b91cc8d2: Status 404 returned error can't find the container with id f5874843014989bd717521f9282de06e6bd1ccf93afbc5cb693d4bb1b91cc8d2
Jul 29 01:26:09.540180 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:09.540143    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 29 01:26:09.540267 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:09.540248    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 29 01:26:09.540315 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:09.540298    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 29 01:26:10.132491 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:10.132457    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2" event={"ID":"087e9740-bd95-4095-ab53-8548296895a7","Type":"ContainerStarted","Data":"8bec86391792b749ee807c7846ff4ea7ecf2583d500bae0f0215f9e9ffa4264d"}
Jul 29 01:26:10.132709 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:10.132512    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2" event={"ID":"087e9740-bd95-4095-ab53-8548296895a7","Type":"ContainerStarted","Data":"f5874843014989bd717521f9282de06e6bd1ccf93afbc5cb693d4bb1b91cc8d2"}
Jul 29 01:26:10.152577 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:10.152522    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2" podStartSLOduration=1.152505663 podStartE2EDuration="1.152505663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:26:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:26:10.150864663 +0000 UTC m=+2996.295322234" watchObservedRunningTime="2026-07-29 01:26:10.152505663 +0000 UTC m=+2996.296963232"
Jul 29 01:26:10.304260 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:10.304228    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5f8f545-6c32-49d0-a8bb-58493e933d70" path="/var/lib/kubelet/pods/b5f8f545-6c32-49d0-a8bb-58493e933d70/volumes"
Jul 29 01:26:10.397265 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:10.397179    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"
Jul 29 01:26:10.402823 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:10.402799    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"
Jul 29 01:26:11.137332 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:11.137301    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"
Jul 29 01:26:11.138221 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:11.138201    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"
Jul 29 01:26:14.483078 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:14.483052    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tfr5v_ac322954-06d1-4807-8a8b-59e62befe6bc/ovn-acl-logging/0.log"
Jul 29 01:26:14.489753 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:14.489728    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tfr5v_ac322954-06d1-4807-8a8b-59e62befe6bc/ovn-acl-logging/0.log"
Jul 29 01:26:20.911815 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:20.911779    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:26:27.178799 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:27.178738    2577 patch_prober.go:28] interesting pod/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 29 01:26:27.179307 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:27.178840    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2" podUID="087e9740-bd95-4095-ab53-8548296895a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 29 01:26:29.225903 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:29.225796    2577 generic.go:356] "Generic (PLEG): container finished" podID="087e9740-bd95-4095-ab53-8548296895a7" containerID="8bec86391792b749ee807c7846ff4ea7ecf2583d500bae0f0215f9e9ffa4264d" exitCode=0
Jul 29 01:26:29.225903 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:29.225874    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2" event={"ID":"087e9740-bd95-4095-ab53-8548296895a7","Type":"ContainerDied","Data":"8bec86391792b749ee807c7846ff4ea7ecf2583d500bae0f0215f9e9ffa4264d"}
Jul 29 01:26:29.226486 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:29.226401    2577 scope.go:117] "RemoveContainer" containerID="8bec86391792b749ee807c7846ff4ea7ecf2583d500bae0f0215f9e9ffa4264d"
Jul 29 01:26:29.227523 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:29.227492    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 29 01:26:29.227644 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:29.227558    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 29 01:26:29.227644 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:29.227614    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 29 01:26:30.235345 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:30.235301    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2" event={"ID":"087e9740-bd95-4095-ab53-8548296895a7","Type":"ContainerStarted","Data":"018e81088a64152cf055515a053d320c77eedd20b324f1b52e98f7f92f5283e3"}
Jul 29 01:26:30.398261 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:30.398222    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"
Jul 29 01:26:30.398468 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:30.398447    2577 patch_prober.go:28] interesting pod/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 29 01:26:30.398515 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:30.398495    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2" podUID="087e9740-bd95-4095-ab53-8548296895a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 29 01:26:31.398374 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:31.398338    2577 patch_prober.go:28] interesting pod/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 29 01:26:31.398881 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:31.398402    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2" podUID="087e9740-bd95-4095-ab53-8548296895a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 29 01:26:32.397624 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:32.397568    2577 patch_prober.go:28] interesting pod/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 29 01:26:32.397801 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:32.397648    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2" podUID="087e9740-bd95-4095-ab53-8548296895a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 29 01:26:33.398353 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:33.398311    2577 patch_prober.go:28] interesting pod/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 29 01:26:33.398777 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:33.398371    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2" podUID="087e9740-bd95-4095-ab53-8548296895a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 29 01:26:34.401812 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:34.401782    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"
Jul 29 01:26:34.402250 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:34.402077    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"
Jul 29 01:26:34.402885 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:34.402867    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"
Jul 29 01:26:51.208358 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:26:51.208317    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:27:25.921900 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:27:25.921825    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-e81b9d/ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf"]
Jul 29 01:27:25.925215 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:27:25.925193    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-e81b9d/ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf"
Jul 29 01:27:25.928489 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:27:25.928458    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-e81b9d\"/\"default-dockercfg-fppbj\""
Jul 29 01:27:25.928489 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:27:25.928478    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-e81b9d\"/\"ipp-route-e81b9d-kserve-self-signed-certs\""
Jul 29 01:27:25.928730 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:27:25.928527    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-e81b9d\"/\"openshift-service-ca.crt\""
Jul 29 01:27:25.928865 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:27:25.928847    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-e81b9d\"/\"kube-root-ca.crt\""
Jul 29 01:27:25.934384 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:27:25.933998    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-e81b9d/ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf"]
Jul 29 01:27:26.112859 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:27:26.112828    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6030f0f-668a-4b24-a26d-637f5732a3f2-dshm\") pod \"ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf\" (UID: \"a6030f0f-668a-4b24-a26d-637f5732a3f2\") " pod="ai-tenant-e2e-ipp-a-e81b9d/ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf"
Jul 29 01:27:26.113039 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:27:26.112890    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6030f0f-668a-4b24-a26d-637f5732a3f2-tmp-dir\") pod \"ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf\" (UID: \"a6030f0f-668a-4b24-a26d-637f5732a3f2\") " pod="ai-tenant-e2e-ipp-a-e81b9d/ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf"
Jul 29 01:27:26.113039 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:27:26.112919    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7zst\" (UniqueName: \"kubernetes.io/projected/a6030f0f-668a-4b24-a26d-637f5732a3f2-kube-api-access-g7zst\") pod \"ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf\" (UID: \"a6030f0f-668a-4b24-a26d-637f5732a3f2\") " pod="ai-tenant-e2e-ipp-a-e81b9d/ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf"
Jul 29 01:27:26.113039 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:27:26.112954    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6030f0f-668a-4b24-a26d-637f5732a3f2-model-cache\") pod \"ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf\" (UID: \"a6030f0f-668a-4b24-a26d-637f5732a3f2\") " pod="ai-tenant-e2e-ipp-a-e81b9d/ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf"
Jul 29 01:27:26.113039 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:27:26.112971    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6030f0f-668a-4b24-a26d-637f5732a3f2-tls-certs\") pod \"ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf\" (UID: \"a6030f0f-668a-4b24-a26d-637f5732a3f2\") " pod="ai-tenant-e2e-ipp-a-e81b9d/ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf"
Jul 29 01:27:26.113039 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:27:26.113022    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6030f0f-668a-4b24-a26d-637f5732a3f2-home\") pod \"ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf\" (UID: \"a6030f0f-668a-4b24-a26d-637f5732a3f2\") " pod="ai-tenant-e2e-ipp-a-e81b9d/ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf"
Jul 29 01:27:26.214362 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:27:26.214269    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6030f0f-668a-4b24-a26d-637f5732a3f2-tmp-dir\") pod \"ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf\" (UID: \"a6030f0f-668a-4b24-a26d-637f5732a3f2\") " pod="ai-tenant-e2e-ipp-a-e81b9d/ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf"
Jul 29 01:27:26.214362 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:27:26.214316    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7zst\" (UniqueName: \"kubernetes.io/projected/a6030f0f-668a-4b24-a26d-637f5732a3f2-kube-api-access-g7zst\") pod \"ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf\" (UID: \"a6030f0f-668a-4b24-a26d-637f5732a3f2\") " pod="ai-tenant-e2e-ipp-a-e81b9d/ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf"
Jul 29 01:27:26.214362 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:27:26.214348    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6030f0f-668a-4b24-a26d-637f5732a3f2-model-cache\") pod \"ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf\" (UID: \"a6030f0f-668a-4b24-a26d-637f5732a3f2\") " pod="ai-tenant-e2e-ipp-a-e81b9d/ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf"
Jul 29 01:27:26.214709 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:27:26.214371    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6030f0f-668a-4b24-a26d-637f5732a3f2-tls-certs\") pod \"ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf\" (UID: \"a6030f0f-668a-4b24-a26d-637f5732a3f2\") " pod="ai-tenant-e2e-ipp-a-e81b9d/ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf"
Jul 29 01:27:26.214709 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:27:26.214403    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6030f0f-668a-4b24-a26d-637f5732a3f2-home\") pod \"ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf\" (UID: \"a6030f0f-668a-4b24-a26d-637f5732a3f2\") " pod="ai-tenant-e2e-ipp-a-e81b9d/ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf"
Jul 29 01:27:26.214709 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:27:26.214471    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6030f0f-668a-4b24-a26d-637f5732a3f2-dshm\") pod \"ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf\" (UID: \"a6030f0f-668a-4b24-a26d-637f5732a3f2\") " pod="ai-tenant-e2e-ipp-a-e81b9d/ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf"
Jul 29 01:27:26.214870 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:27:26.214716    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6030f0f-668a-4b24-a26d-637f5732a3f2-tmp-dir\") pod \"ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf\" (UID: \"a6030f0f-668a-4b24-a26d-637f5732a3f2\") " pod="ai-tenant-e2e-ipp-a-e81b9d/ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf"
Jul 29 01:27:26.214870 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:27:26.214790    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6030f0f-668a-4b24-a26d-637f5732a3f2-model-cache\") pod \"ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf\" (UID: \"a6030f0f-668a-4b24-a26d-637f5732a3f2\") " pod="ai-tenant-e2e-ipp-a-e81b9d/ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf"
Jul 29 01:27:26.214941 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:27:26.214891    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6030f0f-668a-4b24-a26d-637f5732a3f2-home\") pod \"ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf\" (UID: \"a6030f0f-668a-4b24-a26d-637f5732a3f2\") " pod="ai-tenant-e2e-ipp-a-e81b9d/ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf"
Jul 29 01:27:26.216703 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:27:26.216684    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6030f0f-668a-4b24-a26d-637f5732a3f2-dshm\") pod \"ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf\" (UID: \"a6030f0f-668a-4b24-a26d-637f5732a3f2\") " pod="ai-tenant-e2e-ipp-a-e81b9d/ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf"
Jul 29 01:27:26.216994 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:27:26.216976    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6030f0f-668a-4b24-a26d-637f5732a3f2-tls-certs\") pod \"ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf\" (UID: \"a6030f0f-668a-4b24-a26d-637f5732a3f2\") " pod="ai-tenant-e2e-ipp-a-e81b9d/ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf"
Jul 29 01:27:26.221399 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:27:26.221379    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7zst\" (UniqueName: \"kubernetes.io/projected/a6030f0f-668a-4b24-a26d-637f5732a3f2-kube-api-access-g7zst\") pod \"ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf\" (UID: \"a6030f0f-668a-4b24-a26d-637f5732a3f2\") " pod="ai-tenant-e2e-ipp-a-e81b9d/ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf"
Jul 29 01:27:26.237442 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:27:26.237413    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-e81b9d/ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf"
Jul 29 01:27:26.376645 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:27:26.376617    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-e81b9d/ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf"]
Jul 29 01:27:26.379278 ip-10-0-138-146 kubenswrapper[2577]: W0729 01:27:26.379250    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda6030f0f_668a_4b24_a26d_637f5732a3f2.slice/crio-79c65bb360eea796c60b31fd5eea5eff115c9013df2327c161e4deae437398cc WatchSource:0}: Error finding container 79c65bb360eea796c60b31fd5eea5eff115c9013df2327c161e4deae437398cc: Status 404 returned error can't find the container with id 79c65bb360eea796c60b31fd5eea5eff115c9013df2327c161e4deae437398cc
Jul 29 01:27:26.510119 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:27:26.510038    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-e81b9d/ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf" event={"ID":"a6030f0f-668a-4b24-a26d-637f5732a3f2","Type":"ContainerStarted","Data":"4ae16fa09cb7d130f1be235ae5aab80466ec63a812c504dc1e7d7bfaf463feee"}
Jul 29 01:27:26.510119 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:27:26.510084    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-e81b9d/ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf" event={"ID":"a6030f0f-668a-4b24-a26d-637f5732a3f2","Type":"ContainerStarted","Data":"79c65bb360eea796c60b31fd5eea5eff115c9013df2327c161e4deae437398cc"}
Jul 29 01:27:26.528739 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:27:26.528692    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-e81b9d/ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf" podStartSLOduration=1.528675927 podStartE2EDuration="1.528675927s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:27:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:27:26.526994454 +0000 UTC m=+3072.671452026" watchObservedRunningTime="2026-07-29 01:27:26.528675927 +0000 UTC m=+3072.673133496"
Jul 29 01:27:30.114366 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:27:30.114330    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:27:36.238469 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:27:36.238424    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-e81b9d/ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf"
Jul 29 01:27:36.238469 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:27:36.238476    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-e81b9d/ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf"
Jul 29 01:27:36.251166 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:27:36.251135    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-e81b9d/ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf"
Jul 29 01:27:36.568254 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:27:36.568175    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-e81b9d/ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf"
Jul 29 01:28:09.311153 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:09.311110    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:28:21.390979 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:21.390946    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"]
Jul 29 01:28:21.394419 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:21.394396    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"
Jul 29 01:28:21.396517 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:21.396498    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-06c978-openshift-default-dockercfg-mjwbp\""
Jul 29 01:28:21.407133 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:21.407104    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"]
Jul 29 01:28:21.448827 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:21.448785    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b359f67-66bf-4453-b260-0b25b26f14d8-workload-certs\") pod \"e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57\" (UID: \"9b359f67-66bf-4453-b260-0b25b26f14d8\") " pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"
Jul 29 01:28:21.449001 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:21.448835    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b359f67-66bf-4453-b260-0b25b26f14d8-workload-socket\") pod \"e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57\" (UID: \"9b359f67-66bf-4453-b260-0b25b26f14d8\") " pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"
Jul 29 01:28:21.449001 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:21.448862    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b359f67-66bf-4453-b260-0b25b26f14d8-istio-token\") pod \"e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57\" (UID: \"9b359f67-66bf-4453-b260-0b25b26f14d8\") " pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"
Jul 29 01:28:21.449001 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:21.448947    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b359f67-66bf-4453-b260-0b25b26f14d8-istio-data\") pod \"e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57\" (UID: \"9b359f67-66bf-4453-b260-0b25b26f14d8\") " pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"
Jul 29 01:28:21.449128 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:21.449003    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b359f67-66bf-4453-b260-0b25b26f14d8-istio-envoy\") pod \"e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57\" (UID: \"9b359f67-66bf-4453-b260-0b25b26f14d8\") " pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"
Jul 29 01:28:21.449128 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:21.449024    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b359f67-66bf-4453-b260-0b25b26f14d8-istiod-ca-cert\") pod \"e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57\" (UID: \"9b359f67-66bf-4453-b260-0b25b26f14d8\") " pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"
Jul 29 01:28:21.449128 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:21.449062    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b359f67-66bf-4453-b260-0b25b26f14d8-credential-socket\") pod \"e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57\" (UID: \"9b359f67-66bf-4453-b260-0b25b26f14d8\") " pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"
Jul 29 01:28:21.449128 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:21.449094    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b359f67-66bf-4453-b260-0b25b26f14d8-istio-podinfo\") pod \"e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57\" (UID: \"9b359f67-66bf-4453-b260-0b25b26f14d8\") " pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"
Jul 29 01:28:21.449277 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:21.449168    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5kvc\" (UniqueName: \"kubernetes.io/projected/9b359f67-66bf-4453-b260-0b25b26f14d8-kube-api-access-z5kvc\") pod \"e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57\" (UID: \"9b359f67-66bf-4453-b260-0b25b26f14d8\") " pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"
Jul 29 01:28:21.549994 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:21.549957    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b359f67-66bf-4453-b260-0b25b26f14d8-workload-certs\") pod \"e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57\" (UID: \"9b359f67-66bf-4453-b260-0b25b26f14d8\") " pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"
Jul 29 01:28:21.549994 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:21.549997    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b359f67-66bf-4453-b260-0b25b26f14d8-workload-socket\") pod \"e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57\" (UID: \"9b359f67-66bf-4453-b260-0b25b26f14d8\") " pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"
Jul 29 01:28:21.550247 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:21.550014    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b359f67-66bf-4453-b260-0b25b26f14d8-istio-token\") pod \"e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57\" (UID: \"9b359f67-66bf-4453-b260-0b25b26f14d8\") " pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"
Jul 29 01:28:21.550247 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:21.550056    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b359f67-66bf-4453-b260-0b25b26f14d8-istio-data\") pod \"e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57\" (UID: \"9b359f67-66bf-4453-b260-0b25b26f14d8\") " pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"
Jul 29 01:28:21.550247 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:21.550089    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b359f67-66bf-4453-b260-0b25b26f14d8-istio-envoy\") pod \"e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57\" (UID: \"9b359f67-66bf-4453-b260-0b25b26f14d8\") " pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"
Jul 29 01:28:21.550247 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:21.550106    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b359f67-66bf-4453-b260-0b25b26f14d8-istiod-ca-cert\") pod \"e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57\" (UID: \"9b359f67-66bf-4453-b260-0b25b26f14d8\") " pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"
Jul 29 01:28:21.550247 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:21.550140    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b359f67-66bf-4453-b260-0b25b26f14d8-credential-socket\") pod \"e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57\" (UID: \"9b359f67-66bf-4453-b260-0b25b26f14d8\") " pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"
Jul 29 01:28:21.550508 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:21.550306    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b359f67-66bf-4453-b260-0b25b26f14d8-istio-podinfo\") pod \"e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57\" (UID: \"9b359f67-66bf-4453-b260-0b25b26f14d8\") " pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"
Jul 29 01:28:21.550508 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:21.550368    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5kvc\" (UniqueName: \"kubernetes.io/projected/9b359f67-66bf-4453-b260-0b25b26f14d8-kube-api-access-z5kvc\") pod \"e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57\" (UID: \"9b359f67-66bf-4453-b260-0b25b26f14d8\") " pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"
Jul 29 01:28:21.550508 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:21.550431    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b359f67-66bf-4453-b260-0b25b26f14d8-workload-socket\") pod \"e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57\" (UID: \"9b359f67-66bf-4453-b260-0b25b26f14d8\") " pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"
Jul 29 01:28:21.550678 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:21.550505    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b359f67-66bf-4453-b260-0b25b26f14d8-workload-certs\") pod \"e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57\" (UID: \"9b359f67-66bf-4453-b260-0b25b26f14d8\") " pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"
Jul 29 01:28:21.550678 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:21.550575    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b359f67-66bf-4453-b260-0b25b26f14d8-credential-socket\") pod \"e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57\" (UID: \"9b359f67-66bf-4453-b260-0b25b26f14d8\") " pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"
Jul 29 01:28:21.550828 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:21.550807    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b359f67-66bf-4453-b260-0b25b26f14d8-istio-data\") pod \"e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57\" (UID: \"9b359f67-66bf-4453-b260-0b25b26f14d8\") " pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"
Jul 29 01:28:21.550919 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:21.550901    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b359f67-66bf-4453-b260-0b25b26f14d8-istiod-ca-cert\") pod \"e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57\" (UID: \"9b359f67-66bf-4453-b260-0b25b26f14d8\") " pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"
Jul 29 01:28:21.552528 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:21.552510    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b359f67-66bf-4453-b260-0b25b26f14d8-istio-envoy\") pod \"e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57\" (UID: \"9b359f67-66bf-4453-b260-0b25b26f14d8\") " pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"
Jul 29 01:28:21.552820 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:21.552803    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b359f67-66bf-4453-b260-0b25b26f14d8-istio-podinfo\") pod \"e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57\" (UID: \"9b359f67-66bf-4453-b260-0b25b26f14d8\") " pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"
Jul 29 01:28:21.557922 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:21.557898    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5kvc\" (UniqueName: \"kubernetes.io/projected/9b359f67-66bf-4453-b260-0b25b26f14d8-kube-api-access-z5kvc\") pod \"e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57\" (UID: \"9b359f67-66bf-4453-b260-0b25b26f14d8\") " pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"
Jul 29 01:28:21.558028 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:21.557901    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b359f67-66bf-4453-b260-0b25b26f14d8-istio-token\") pod \"e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57\" (UID: \"9b359f67-66bf-4453-b260-0b25b26f14d8\") " pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"
Jul 29 01:28:21.704812 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:21.704711    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"
Jul 29 01:28:21.844282 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:21.844246    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"]
Jul 29 01:28:21.847489 ip-10-0-138-146 kubenswrapper[2577]: W0729 01:28:21.847459    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b359f67_66bf_4453_b260_0b25b26f14d8.slice/crio-3c0ac4e8386faee25bab2cdeafaa2b462305e34f0996a353e02148b2c32dc570 WatchSource:0}: Error finding container 3c0ac4e8386faee25bab2cdeafaa2b462305e34f0996a353e02148b2c32dc570: Status 404 returned error can't find the container with id 3c0ac4e8386faee25bab2cdeafaa2b462305e34f0996a353e02148b2c32dc570
Jul 29 01:28:21.850021 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:21.849976    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 29 01:28:21.850117 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:21.850069    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 29 01:28:21.850117 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:21.850109    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 29 01:28:22.784323 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:22.784280    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57" event={"ID":"9b359f67-66bf-4453-b260-0b25b26f14d8","Type":"ContainerStarted","Data":"f7fe1951509db123432f5520efb1ec8bc77a2fe70bde783725c4ca676e2a84e7"}
Jul 29 01:28:22.784734 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:22.784350    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57" event={"ID":"9b359f67-66bf-4453-b260-0b25b26f14d8","Type":"ContainerStarted","Data":"3c0ac4e8386faee25bab2cdeafaa2b462305e34f0996a353e02148b2c32dc570"}
Jul 29 01:28:22.804863 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:22.804812    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57" podStartSLOduration=1.8047963660000002 podStartE2EDuration="1.804796366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:28:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:28:22.802594281 +0000 UTC m=+3128.947051842" watchObservedRunningTime="2026-07-29 01:28:22.804796366 +0000 UTC m=+3128.949253936"
Jul 29 01:28:23.704933 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:23.704899    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"
Jul 29 01:28:23.709728 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:23.709704    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"
Jul 29 01:28:23.789074 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:23.789035    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"
Jul 29 01:28:23.789963 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:23.789941    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"
Jul 29 01:28:29.521434 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:29.521395    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:28:38.790680 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:38.790642    2577 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 29 01:28:38.791110 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:38.790700    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57" podUID="9b359f67-66bf-4453-b260-0b25b26f14d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 29 01:28:38.877608 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:38.877555    2577 generic.go:356] "Generic (PLEG): container finished" podID="9b359f67-66bf-4453-b260-0b25b26f14d8" containerID="f7fe1951509db123432f5520efb1ec8bc77a2fe70bde783725c4ca676e2a84e7" exitCode=0
Jul 29 01:28:38.877815 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:38.877633    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57" event={"ID":"9b359f67-66bf-4453-b260-0b25b26f14d8","Type":"ContainerDied","Data":"f7fe1951509db123432f5520efb1ec8bc77a2fe70bde783725c4ca676e2a84e7"}
Jul 29 01:28:38.878154 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:38.878136    2577 scope.go:117] "RemoveContainer" containerID="f7fe1951509db123432f5520efb1ec8bc77a2fe70bde783725c4ca676e2a84e7"
Jul 29 01:28:38.879406 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:38.879378    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 29 01:28:38.879491 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:38.879445    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 29 01:28:38.879491 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:38.879476    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 29 01:28:39.884771 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:39.884737    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57" event={"ID":"9b359f67-66bf-4453-b260-0b25b26f14d8","Type":"ContainerStarted","Data":"549fb38e78916981cdf71783a08b98f0dabb3b064c3d3f4c351157d638b0a986"}
Jul 29 01:28:40.705667 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:40.705628    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"
Jul 29 01:28:40.705966 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:40.705942    2577 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 29 01:28:40.706014 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:40.705995    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57" podUID="9b359f67-66bf-4453-b260-0b25b26f14d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 29 01:28:41.706087 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:41.706045    2577 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 29 01:28:41.706483 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:41.706108    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57" podUID="9b359f67-66bf-4453-b260-0b25b26f14d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 29 01:28:42.706064 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:42.706031    2577 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 29 01:28:42.706241 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:42.706086    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57" podUID="9b359f67-66bf-4453-b260-0b25b26f14d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 29 01:28:43.705827 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:43.705787    2577 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 29 01:28:43.706015 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:43.705856    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57" podUID="9b359f67-66bf-4453-b260-0b25b26f14d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 29 01:28:44.709539 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:44.709510    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"
Jul 29 01:28:44.709934 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:44.709862    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"
Jul 29 01:28:44.710605 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:44.710568    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"
Jul 29 01:28:50.391449 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:50.391409    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-06c978-d2dpr"]
Jul 29 01:28:50.395462 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:50.395443    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-06c978-d2dpr"
Jul 29 01:28:50.397685 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:50.397662    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 01:28:50.397810 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:50.397708    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4nzwm\""
Jul 29 01:28:50.402735 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:50.402707    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-06c978-d2dpr"]
Jul 29 01:28:50.432449 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:50.432413    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01f17b85-174e-456f-8036-b03f618c3194-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-06c978-d2dpr\" (UID: \"01f17b85-174e-456f-8036-b03f618c3194\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-06c978-d2dpr"
Jul 29 01:28:50.533970 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:50.533934    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01f17b85-174e-456f-8036-b03f618c3194-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-06c978-d2dpr\" (UID: \"01f17b85-174e-456f-8036-b03f618c3194\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-06c978-d2dpr"
Jul 29 01:28:50.534629 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:50.534577    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01f17b85-174e-456f-8036-b03f618c3194-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-06c978-d2dpr\" (UID: \"01f17b85-174e-456f-8036-b03f618c3194\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-06c978-d2dpr"
Jul 29 01:28:50.708272 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:50.708184    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-06c978-d2dpr"
Jul 29 01:28:50.843463 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:50.843332    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-06c978-d2dpr"]
Jul 29 01:28:50.845814 ip-10-0-138-146 kubenswrapper[2577]: W0729 01:28:50.845783    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01f17b85_174e_456f_8036_b03f618c3194.slice/crio-c3497af46265f5436629048923264fafbc543918e593f19040ffc0e4124677d0 WatchSource:0}: Error finding container c3497af46265f5436629048923264fafbc543918e593f19040ffc0e4124677d0: Status 404 returned error can't find the container with id c3497af46265f5436629048923264fafbc543918e593f19040ffc0e4124677d0
Jul 29 01:28:50.946420 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:50.946387    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-06c978-d2dpr" event={"ID":"01f17b85-174e-456f-8036-b03f618c3194","Type":"ContainerStarted","Data":"c3497af46265f5436629048923264fafbc543918e593f19040ffc0e4124677d0"}
Jul 29 01:28:51.952695 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:51.952658    2577 generic.go:356] "Generic (PLEG): container finished" podID="01f17b85-174e-456f-8036-b03f618c3194" containerID="15d539d8bb2e62a8c56997f2e27fcf924da6dc9af8bfbd338ffd1fa9a39bb5a5" exitCode=0
Jul 29 01:28:51.953086 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:51.952706    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-06c978-d2dpr" event={"ID":"01f17b85-174e-456f-8036-b03f618c3194","Type":"ContainerDied","Data":"15d539d8bb2e62a8c56997f2e27fcf924da6dc9af8bfbd338ffd1fa9a39bb5a5"}
Jul 29 01:28:53.091744 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:53.091716    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-06c978-d2dpr"
Jul 29 01:28:53.160135 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:53.160104    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01f17b85-174e-456f-8036-b03f618c3194-maas-api-service-ca\") pod \"01f17b85-174e-456f-8036-b03f618c3194\" (UID: \"01f17b85-174e-456f-8036-b03f618c3194\") "
Jul 29 01:28:53.160477 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:53.160453    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01f17b85-174e-456f-8036-b03f618c3194-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "01f17b85-174e-456f-8036-b03f618c3194" (UID: "01f17b85-174e-456f-8036-b03f618c3194"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:28:53.261778 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:53.261682    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01f17b85-174e-456f-8036-b03f618c3194-maas-api-service-ca\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:28:53.963934 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:53.963898    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-06c978-d2dpr"
Jul 29 01:28:53.963934 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:53.963908    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-06c978-d2dpr" event={"ID":"01f17b85-174e-456f-8036-b03f618c3194","Type":"ContainerDied","Data":"c3497af46265f5436629048923264fafbc543918e593f19040ffc0e4124677d0"}
Jul 29 01:28:53.964185 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:53.963950    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c3497af46265f5436629048923264fafbc543918e593f19040ffc0e4124677d0"
Jul 29 01:28:55.781027 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:55.780991    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-06c978-d2dpr"]
Jul 29 01:28:55.784297 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:55.784272    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-06c978-d2dpr"]
Jul 29 01:28:56.304175 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:28:56.304140    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01f17b85-174e-456f-8036-b03f618c3194" path="/var/lib/kubelet/pods/01f17b85-174e-456f-8036-b03f618c3194/volumes"
Jul 29 01:29:00.516066 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:00.516032    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:29:02.064128 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:02.064089    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"]
Jul 29 01:29:02.064711 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:02.064370    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57" podUID="9b359f67-66bf-4453-b260-0b25b26f14d8" containerName="istio-proxy" containerID="cri-o://549fb38e78916981cdf71783a08b98f0dabb3b064c3d3f4c351157d638b0a986" gracePeriod=30
Jul 29 01:29:05.658470 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:05.658436    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e81b9d-2pzxg"]
Jul 29 01:29:05.659049 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:05.659029    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01f17b85-174e-456f-8036-b03f618c3194" containerName="revoke-keys"
Jul 29 01:29:05.659130 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:05.659053    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="01f17b85-174e-456f-8036-b03f618c3194" containerName="revoke-keys"
Jul 29 01:29:05.659185 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:05.659137    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="01f17b85-174e-456f-8036-b03f618c3194" containerName="revoke-keys"
Jul 29 01:29:05.662348 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:05.662327    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e81b9d-2pzxg"
Jul 29 01:29:05.664439 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:05.664417    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 01:29:05.664535 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:05.664448    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4nzwm\""
Jul 29 01:29:05.667878 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:05.667851    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e81b9d-2pzxg"]
Jul 29 01:29:05.786976 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:05.786941    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4305521c-9446-4bf2-ab67-275ef35731fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-e81b9d-2pzxg\" (UID: \"4305521c-9446-4bf2-ab67-275ef35731fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e81b9d-2pzxg"
Jul 29 01:29:05.888312 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:05.888270    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4305521c-9446-4bf2-ab67-275ef35731fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-e81b9d-2pzxg\" (UID: \"4305521c-9446-4bf2-ab67-275ef35731fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e81b9d-2pzxg"
Jul 29 01:29:05.888963 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:05.888943    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4305521c-9446-4bf2-ab67-275ef35731fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-e81b9d-2pzxg\" (UID: \"4305521c-9446-4bf2-ab67-275ef35731fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e81b9d-2pzxg"
Jul 29 01:29:05.975253 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:05.975167    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e81b9d-2pzxg"
Jul 29 01:29:06.112444 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:06.112349    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e81b9d-2pzxg"]
Jul 29 01:29:06.114792 ip-10-0-138-146 kubenswrapper[2577]: W0729 01:29:06.114764    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4305521c_9446_4bf2_ab67_275ef35731fc.slice/crio-2ce3bd365c53e0f7fa62c0022026a2d6552d80c1a3ce9991d806fbf0435bc619 WatchSource:0}: Error finding container 2ce3bd365c53e0f7fa62c0022026a2d6552d80c1a3ce9991d806fbf0435bc619: Status 404 returned error can't find the container with id 2ce3bd365c53e0f7fa62c0022026a2d6552d80c1a3ce9991d806fbf0435bc619
Jul 29 01:29:07.037738 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:07.037654    2577 generic.go:356] "Generic (PLEG): container finished" podID="4305521c-9446-4bf2-ab67-275ef35731fc" containerID="b2f640612bcad9d64ec98299989d120cbc8de579e20ae9bfcb1c85fec8ab8531" exitCode=0
Jul 29 01:29:07.038073 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:07.037738    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e81b9d-2pzxg" event={"ID":"4305521c-9446-4bf2-ab67-275ef35731fc","Type":"ContainerDied","Data":"b2f640612bcad9d64ec98299989d120cbc8de579e20ae9bfcb1c85fec8ab8531"}
Jul 29 01:29:07.038073 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:07.037805    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e81b9d-2pzxg" event={"ID":"4305521c-9446-4bf2-ab67-275ef35731fc","Type":"ContainerStarted","Data":"2ce3bd365c53e0f7fa62c0022026a2d6552d80c1a3ce9991d806fbf0435bc619"}
Jul 29 01:29:07.329441 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:07.329413    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"
Jul 29 01:29:07.403750 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:07.403713    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b359f67-66bf-4453-b260-0b25b26f14d8-istio-token\") pod \"9b359f67-66bf-4453-b260-0b25b26f14d8\" (UID: \"9b359f67-66bf-4453-b260-0b25b26f14d8\") "
Jul 29 01:29:07.403750 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:07.403758    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b359f67-66bf-4453-b260-0b25b26f14d8-istio-podinfo\") pod \"9b359f67-66bf-4453-b260-0b25b26f14d8\" (UID: \"9b359f67-66bf-4453-b260-0b25b26f14d8\") "
Jul 29 01:29:07.404019 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:07.403791    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b359f67-66bf-4453-b260-0b25b26f14d8-credential-socket\") pod \"9b359f67-66bf-4453-b260-0b25b26f14d8\" (UID: \"9b359f67-66bf-4453-b260-0b25b26f14d8\") "
Jul 29 01:29:07.404019 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:07.403811    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b359f67-66bf-4453-b260-0b25b26f14d8-istiod-ca-cert\") pod \"9b359f67-66bf-4453-b260-0b25b26f14d8\" (UID: \"9b359f67-66bf-4453-b260-0b25b26f14d8\") "
Jul 29 01:29:07.404019 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:07.403840    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5kvc\" (UniqueName: \"kubernetes.io/projected/9b359f67-66bf-4453-b260-0b25b26f14d8-kube-api-access-z5kvc\") pod \"9b359f67-66bf-4453-b260-0b25b26f14d8\" (UID: \"9b359f67-66bf-4453-b260-0b25b26f14d8\") "
Jul 29 01:29:07.404019 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:07.403881    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b359f67-66bf-4453-b260-0b25b26f14d8-workload-certs\") pod \"9b359f67-66bf-4453-b260-0b25b26f14d8\" (UID: \"9b359f67-66bf-4453-b260-0b25b26f14d8\") "
Jul 29 01:29:07.404019 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:07.403913    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b359f67-66bf-4453-b260-0b25b26f14d8-workload-socket\") pod \"9b359f67-66bf-4453-b260-0b25b26f14d8\" (UID: \"9b359f67-66bf-4453-b260-0b25b26f14d8\") "
Jul 29 01:29:07.404019 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:07.403952    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b359f67-66bf-4453-b260-0b25b26f14d8-istio-envoy\") pod \"9b359f67-66bf-4453-b260-0b25b26f14d8\" (UID: \"9b359f67-66bf-4453-b260-0b25b26f14d8\") "
Jul 29 01:29:07.404309 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:07.404131    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b359f67-66bf-4453-b260-0b25b26f14d8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9b359f67-66bf-4453-b260-0b25b26f14d8" (UID: "9b359f67-66bf-4453-b260-0b25b26f14d8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:29:07.404309 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:07.404157    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b359f67-66bf-4453-b260-0b25b26f14d8-istio-data\") pod \"9b359f67-66bf-4453-b260-0b25b26f14d8\" (UID: \"9b359f67-66bf-4453-b260-0b25b26f14d8\") "
Jul 29 01:29:07.404410 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:07.404354    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b359f67-66bf-4453-b260-0b25b26f14d8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9b359f67-66bf-4453-b260-0b25b26f14d8" (UID: "9b359f67-66bf-4453-b260-0b25b26f14d8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:29:07.404410 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:07.404374    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b359f67-66bf-4453-b260-0b25b26f14d8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9b359f67-66bf-4453-b260-0b25b26f14d8" (UID: "9b359f67-66bf-4453-b260-0b25b26f14d8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:29:07.404621 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:07.404576    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b359f67-66bf-4453-b260-0b25b26f14d8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9b359f67-66bf-4453-b260-0b25b26f14d8" (UID: "9b359f67-66bf-4453-b260-0b25b26f14d8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:29:07.404723 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:07.404653    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b359f67-66bf-4453-b260-0b25b26f14d8-credential-socket\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:29:07.404723 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:07.404676    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b359f67-66bf-4453-b260-0b25b26f14d8-istiod-ca-cert\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:29:07.404723 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:07.404689    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b359f67-66bf-4453-b260-0b25b26f14d8-workload-socket\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:29:07.405266 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:07.405241    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b359f67-66bf-4453-b260-0b25b26f14d8-istio-data" (OuterVolumeSpecName: "istio-data") pod "9b359f67-66bf-4453-b260-0b25b26f14d8" (UID: "9b359f67-66bf-4453-b260-0b25b26f14d8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:29:07.406239 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:07.406215    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9b359f67-66bf-4453-b260-0b25b26f14d8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9b359f67-66bf-4453-b260-0b25b26f14d8" (UID: "9b359f67-66bf-4453-b260-0b25b26f14d8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 01:29:07.406342 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:07.406218    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b359f67-66bf-4453-b260-0b25b26f14d8-kube-api-access-z5kvc" (OuterVolumeSpecName: "kube-api-access-z5kvc") pod "9b359f67-66bf-4453-b260-0b25b26f14d8" (UID: "9b359f67-66bf-4453-b260-0b25b26f14d8"). InnerVolumeSpecName "kube-api-access-z5kvc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:29:07.406435 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:07.406412    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b359f67-66bf-4453-b260-0b25b26f14d8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9b359f67-66bf-4453-b260-0b25b26f14d8" (UID: "9b359f67-66bf-4453-b260-0b25b26f14d8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:29:07.406616 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:07.406598    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b359f67-66bf-4453-b260-0b25b26f14d8-istio-token" (OuterVolumeSpecName: "istio-token") pod "9b359f67-66bf-4453-b260-0b25b26f14d8" (UID: "9b359f67-66bf-4453-b260-0b25b26f14d8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:29:07.505864 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:07.505829    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b359f67-66bf-4453-b260-0b25b26f14d8-istio-podinfo\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:29:07.505864 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:07.505857    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5kvc\" (UniqueName: \"kubernetes.io/projected/9b359f67-66bf-4453-b260-0b25b26f14d8-kube-api-access-z5kvc\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:29:07.505864 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:07.505867    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b359f67-66bf-4453-b260-0b25b26f14d8-workload-certs\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:29:07.505864 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:07.505876    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b359f67-66bf-4453-b260-0b25b26f14d8-istio-envoy\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:29:07.506123 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:07.505883    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b359f67-66bf-4453-b260-0b25b26f14d8-istio-data\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:29:07.506123 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:07.505891    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b359f67-66bf-4453-b260-0b25b26f14d8-istio-token\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:29:08.044061 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:08.044025    2577 generic.go:356] "Generic (PLEG): container finished" podID="9b359f67-66bf-4453-b260-0b25b26f14d8" containerID="549fb38e78916981cdf71783a08b98f0dabb3b064c3d3f4c351157d638b0a986" exitCode=0
Jul 29 01:29:08.044486 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:08.044076    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"
Jul 29 01:29:08.044486 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:08.044103    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57" event={"ID":"9b359f67-66bf-4453-b260-0b25b26f14d8","Type":"ContainerDied","Data":"549fb38e78916981cdf71783a08b98f0dabb3b064c3d3f4c351157d638b0a986"}
Jul 29 01:29:08.044486 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:08.044152    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57" event={"ID":"9b359f67-66bf-4453-b260-0b25b26f14d8","Type":"ContainerDied","Data":"3c0ac4e8386faee25bab2cdeafaa2b462305e34f0996a353e02148b2c32dc570"}
Jul 29 01:29:08.044486 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:08.044175    2577 scope.go:117] "RemoveContainer" containerID="549fb38e78916981cdf71783a08b98f0dabb3b064c3d3f4c351157d638b0a986"
Jul 29 01:29:08.053981 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:08.053961    2577 scope.go:117] "RemoveContainer" containerID="f7fe1951509db123432f5520efb1ec8bc77a2fe70bde783725c4ca676e2a84e7"
Jul 29 01:29:08.063306 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:08.063278    2577 scope.go:117] "RemoveContainer" containerID="549fb38e78916981cdf71783a08b98f0dabb3b064c3d3f4c351157d638b0a986"
Jul 29 01:29:08.063629 ip-10-0-138-146 kubenswrapper[2577]: E0729 01:29:08.063573    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"549fb38e78916981cdf71783a08b98f0dabb3b064c3d3f4c351157d638b0a986\": container with ID starting with 549fb38e78916981cdf71783a08b98f0dabb3b064c3d3f4c351157d638b0a986 not found: ID does not exist" containerID="549fb38e78916981cdf71783a08b98f0dabb3b064c3d3f4c351157d638b0a986"
Jul 29 01:29:08.063629 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:08.063620    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"549fb38e78916981cdf71783a08b98f0dabb3b064c3d3f4c351157d638b0a986"} err="failed to get container status \"549fb38e78916981cdf71783a08b98f0dabb3b064c3d3f4c351157d638b0a986\": rpc error: code = NotFound desc = could not find container \"549fb38e78916981cdf71783a08b98f0dabb3b064c3d3f4c351157d638b0a986\": container with ID starting with 549fb38e78916981cdf71783a08b98f0dabb3b064c3d3f4c351157d638b0a986 not found: ID does not exist"
Jul 29 01:29:08.063629 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:08.063639    2577 scope.go:117] "RemoveContainer" containerID="f7fe1951509db123432f5520efb1ec8bc77a2fe70bde783725c4ca676e2a84e7"
Jul 29 01:29:08.064005 ip-10-0-138-146 kubenswrapper[2577]: E0729 01:29:08.063897    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7fe1951509db123432f5520efb1ec8bc77a2fe70bde783725c4ca676e2a84e7\": container with ID starting with f7fe1951509db123432f5520efb1ec8bc77a2fe70bde783725c4ca676e2a84e7 not found: ID does not exist" containerID="f7fe1951509db123432f5520efb1ec8bc77a2fe70bde783725c4ca676e2a84e7"
Jul 29 01:29:08.064005 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:08.063926    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7fe1951509db123432f5520efb1ec8bc77a2fe70bde783725c4ca676e2a84e7"} err="failed to get container status \"f7fe1951509db123432f5520efb1ec8bc77a2fe70bde783725c4ca676e2a84e7\": rpc error: code = NotFound desc = could not find container \"f7fe1951509db123432f5520efb1ec8bc77a2fe70bde783725c4ca676e2a84e7\": container with ID starting with f7fe1951509db123432f5520efb1ec8bc77a2fe70bde783725c4ca676e2a84e7 not found: ID does not exist"
Jul 29 01:29:08.066872 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:08.066849    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"]
Jul 29 01:29:08.070399 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:08.070373    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-06c978-openshift-default-59c89dc846-v8j57"]
Jul 29 01:29:08.172645 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:08.172613    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e81b9d-2pzxg"
Jul 29 01:29:08.303799 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:08.303722    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b359f67-66bf-4453-b260-0b25b26f14d8" path="/var/lib/kubelet/pods/9b359f67-66bf-4453-b260-0b25b26f14d8/volumes"
Jul 29 01:29:08.312950 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:08.312928    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4305521c-9446-4bf2-ab67-275ef35731fc-maas-api-service-ca\") pod \"4305521c-9446-4bf2-ab67-275ef35731fc\" (UID: \"4305521c-9446-4bf2-ab67-275ef35731fc\") "
Jul 29 01:29:08.313261 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:08.313241    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4305521c-9446-4bf2-ab67-275ef35731fc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4305521c-9446-4bf2-ab67-275ef35731fc" (UID: "4305521c-9446-4bf2-ab67-275ef35731fc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:29:08.414224 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:08.414187    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4305521c-9446-4bf2-ab67-275ef35731fc-maas-api-service-ca\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:29:09.050575 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:09.050537    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e81b9d-2pzxg" event={"ID":"4305521c-9446-4bf2-ab67-275ef35731fc","Type":"ContainerDied","Data":"2ce3bd365c53e0f7fa62c0022026a2d6552d80c1a3ce9991d806fbf0435bc619"}
Jul 29 01:29:09.050979 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:09.050607    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2ce3bd365c53e0f7fa62c0022026a2d6552d80c1a3ce9991d806fbf0435bc619"
Jul 29 01:29:09.050979 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:09.050547    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e81b9d-2pzxg"
Jul 29 01:29:21.272154 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:21.272116    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e81b9d-2pzxg"]
Jul 29 01:29:21.276506 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:21.276480    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e81b9d-2pzxg"]
Jul 29 01:29:22.303399 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:22.303365    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4305521c-9446-4bf2-ab67-275ef35731fc" path="/var/lib/kubelet/pods/4305521c-9446-4bf2-ab67-275ef35731fc/volumes"
Jul 29 01:29:25.216977 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:25.216942    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:29:26.643326 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:26.643289    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-e81b9d/ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf"]
Jul 29 01:29:41.662541 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:41.662483    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-e81b9d/ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf" podUID="a6030f0f-668a-4b24-a26d-637f5732a3f2" containerName="main" containerID="cri-o://4ae16fa09cb7d130f1be235ae5aab80466ec63a812c504dc1e7d7bfaf463feee" gracePeriod=45
Jul 29 01:29:41.913911 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:41.913849    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-e81b9d/ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf"
Jul 29 01:29:42.030345 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:42.030313    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6030f0f-668a-4b24-a26d-637f5732a3f2-model-cache\") pod \"a6030f0f-668a-4b24-a26d-637f5732a3f2\" (UID: \"a6030f0f-668a-4b24-a26d-637f5732a3f2\") "
Jul 29 01:29:42.030520 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:42.030386    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6030f0f-668a-4b24-a26d-637f5732a3f2-tmp-dir\") pod \"a6030f0f-668a-4b24-a26d-637f5732a3f2\" (UID: \"a6030f0f-668a-4b24-a26d-637f5732a3f2\") "
Jul 29 01:29:42.030520 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:42.030432    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7zst\" (UniqueName: \"kubernetes.io/projected/a6030f0f-668a-4b24-a26d-637f5732a3f2-kube-api-access-g7zst\") pod \"a6030f0f-668a-4b24-a26d-637f5732a3f2\" (UID: \"a6030f0f-668a-4b24-a26d-637f5732a3f2\") "
Jul 29 01:29:42.030520 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:42.030450    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6030f0f-668a-4b24-a26d-637f5732a3f2-dshm\") pod \"a6030f0f-668a-4b24-a26d-637f5732a3f2\" (UID: \"a6030f0f-668a-4b24-a26d-637f5732a3f2\") "
Jul 29 01:29:42.030520 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:42.030469    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6030f0f-668a-4b24-a26d-637f5732a3f2-home\") pod \"a6030f0f-668a-4b24-a26d-637f5732a3f2\" (UID: \"a6030f0f-668a-4b24-a26d-637f5732a3f2\") "
Jul 29 01:29:42.030520 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:42.030499    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6030f0f-668a-4b24-a26d-637f5732a3f2-tls-certs\") pod \"a6030f0f-668a-4b24-a26d-637f5732a3f2\" (UID: \"a6030f0f-668a-4b24-a26d-637f5732a3f2\") "
Jul 29 01:29:42.030804 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:42.030660    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6030f0f-668a-4b24-a26d-637f5732a3f2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a6030f0f-668a-4b24-a26d-637f5732a3f2" (UID: "a6030f0f-668a-4b24-a26d-637f5732a3f2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:29:42.030804 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:42.030667    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6030f0f-668a-4b24-a26d-637f5732a3f2-model-cache" (OuterVolumeSpecName: "model-cache") pod "a6030f0f-668a-4b24-a26d-637f5732a3f2" (UID: "a6030f0f-668a-4b24-a26d-637f5732a3f2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:29:42.030902 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:42.030837    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6030f0f-668a-4b24-a26d-637f5732a3f2-home" (OuterVolumeSpecName: "home") pod "a6030f0f-668a-4b24-a26d-637f5732a3f2" (UID: "a6030f0f-668a-4b24-a26d-637f5732a3f2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:29:42.030951 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:42.030905    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6030f0f-668a-4b24-a26d-637f5732a3f2-tmp-dir\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:29:42.030951 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:42.030928    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6030f0f-668a-4b24-a26d-637f5732a3f2-model-cache\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:29:42.035473 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:42.033116    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6030f0f-668a-4b24-a26d-637f5732a3f2-dshm" (OuterVolumeSpecName: "dshm") pod "a6030f0f-668a-4b24-a26d-637f5732a3f2" (UID: "a6030f0f-668a-4b24-a26d-637f5732a3f2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:29:42.035473 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:42.033743    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6030f0f-668a-4b24-a26d-637f5732a3f2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a6030f0f-668a-4b24-a26d-637f5732a3f2" (UID: "a6030f0f-668a-4b24-a26d-637f5732a3f2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:29:42.035760 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:42.035739    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6030f0f-668a-4b24-a26d-637f5732a3f2-kube-api-access-g7zst" (OuterVolumeSpecName: "kube-api-access-g7zst") pod "a6030f0f-668a-4b24-a26d-637f5732a3f2" (UID: "a6030f0f-668a-4b24-a26d-637f5732a3f2"). InnerVolumeSpecName "kube-api-access-g7zst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:29:42.131519 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:42.131480    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7zst\" (UniqueName: \"kubernetes.io/projected/a6030f0f-668a-4b24-a26d-637f5732a3f2-kube-api-access-g7zst\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:29:42.131519 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:42.131514    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6030f0f-668a-4b24-a26d-637f5732a3f2-dshm\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:29:42.131519 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:42.131527    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6030f0f-668a-4b24-a26d-637f5732a3f2-home\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:29:42.131784 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:42.131535    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6030f0f-668a-4b24-a26d-637f5732a3f2-tls-certs\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:29:42.218537 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:42.218448    2577 generic.go:356] "Generic (PLEG): container finished" podID="a6030f0f-668a-4b24-a26d-637f5732a3f2" containerID="4ae16fa09cb7d130f1be235ae5aab80466ec63a812c504dc1e7d7bfaf463feee" exitCode=0
Jul 29 01:29:42.218537 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:42.218492    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-e81b9d/ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf"
Jul 29 01:29:42.218537 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:42.218498    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-e81b9d/ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf" event={"ID":"a6030f0f-668a-4b24-a26d-637f5732a3f2","Type":"ContainerDied","Data":"4ae16fa09cb7d130f1be235ae5aab80466ec63a812c504dc1e7d7bfaf463feee"}
Jul 29 01:29:42.218537 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:42.218538    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-e81b9d/ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf" event={"ID":"a6030f0f-668a-4b24-a26d-637f5732a3f2","Type":"ContainerDied","Data":"79c65bb360eea796c60b31fd5eea5eff115c9013df2327c161e4deae437398cc"}
Jul 29 01:29:42.218831 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:42.218556    2577 scope.go:117] "RemoveContainer" containerID="4ae16fa09cb7d130f1be235ae5aab80466ec63a812c504dc1e7d7bfaf463feee"
Jul 29 01:29:42.229596 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:42.229562    2577 scope.go:117] "RemoveContainer" containerID="4ae16fa09cb7d130f1be235ae5aab80466ec63a812c504dc1e7d7bfaf463feee"
Jul 29 01:29:42.229902 ip-10-0-138-146 kubenswrapper[2577]: E0729 01:29:42.229886    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ae16fa09cb7d130f1be235ae5aab80466ec63a812c504dc1e7d7bfaf463feee\": container with ID starting with 4ae16fa09cb7d130f1be235ae5aab80466ec63a812c504dc1e7d7bfaf463feee not found: ID does not exist" containerID="4ae16fa09cb7d130f1be235ae5aab80466ec63a812c504dc1e7d7bfaf463feee"
Jul 29 01:29:42.229947 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:42.229912    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ae16fa09cb7d130f1be235ae5aab80466ec63a812c504dc1e7d7bfaf463feee"} err="failed to get container status \"4ae16fa09cb7d130f1be235ae5aab80466ec63a812c504dc1e7d7bfaf463feee\": rpc error: code = NotFound desc = could not find container \"4ae16fa09cb7d130f1be235ae5aab80466ec63a812c504dc1e7d7bfaf463feee\": container with ID starting with 4ae16fa09cb7d130f1be235ae5aab80466ec63a812c504dc1e7d7bfaf463feee not found: ID does not exist"
Jul 29 01:29:42.241425 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:42.241398    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-e81b9d/ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf"]
Jul 29 01:29:42.244597 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:42.244556    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-e81b9d/ipp-route-e81b9d-kserve-5c9d98b89f-nxvgf"]
Jul 29 01:29:42.305014 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:29:42.304982    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6030f0f-668a-4b24-a26d-637f5732a3f2" path="/var/lib/kubelet/pods/a6030f0f-668a-4b24-a26d-637f5732a3f2/volumes"
Jul 29 01:30:00.140630 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:00.140578    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-7c9ee4-29754810-rzzgm"]
Jul 29 01:30:00.141065 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:00.140962    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b359f67-66bf-4453-b260-0b25b26f14d8" containerName="istio-proxy"
Jul 29 01:30:00.141065 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:00.140973    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b359f67-66bf-4453-b260-0b25b26f14d8" containerName="istio-proxy"
Jul 29 01:30:00.141065 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:00.140983    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b359f67-66bf-4453-b260-0b25b26f14d8" containerName="istio-proxy"
Jul 29 01:30:00.141065 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:00.140989    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b359f67-66bf-4453-b260-0b25b26f14d8" containerName="istio-proxy"
Jul 29 01:30:00.141065 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:00.141001    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4305521c-9446-4bf2-ab67-275ef35731fc" containerName="revoke-keys"
Jul 29 01:30:00.141065 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:00.141008    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4305521c-9446-4bf2-ab67-275ef35731fc" containerName="revoke-keys"
Jul 29 01:30:00.141065 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:00.141019    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6030f0f-668a-4b24-a26d-637f5732a3f2" containerName="main"
Jul 29 01:30:00.141065 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:00.141024    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6030f0f-668a-4b24-a26d-637f5732a3f2" containerName="main"
Jul 29 01:30:00.141347 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:00.141086    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b359f67-66bf-4453-b260-0b25b26f14d8" containerName="istio-proxy"
Jul 29 01:30:00.141347 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:00.141096    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4305521c-9446-4bf2-ab67-275ef35731fc" containerName="revoke-keys"
Jul 29 01:30:00.141347 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:00.141104    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6030f0f-668a-4b24-a26d-637f5732a3f2" containerName="main"
Jul 29 01:30:00.144024 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:00.144000    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754810-qhqfc"]
Jul 29 01:30:00.144194 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:00.144120    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-7c9ee4-29754810-rzzgm"
Jul 29 01:30:00.144383 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:00.144370    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b359f67-66bf-4453-b260-0b25b26f14d8" containerName="istio-proxy"
Jul 29 01:30:00.146089 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:00.146064    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4nzwm\""
Jul 29 01:30:00.147407 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:00.147386    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754810-qhqfc"
Jul 29 01:30:00.153117 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:00.153088    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-7c9ee4-29754810-rzzgm"]
Jul 29 01:30:00.155424 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:00.155395    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754810-qhqfc"]
Jul 29 01:30:00.160158 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:00.159935    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-7c9ee4-29754810-rzzgm"
Jul 29 01:30:00.166355 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:00.166332    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754810-qhqfc"
Jul 29 01:30:00.307559 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:00.307532    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-7c9ee4-29754810-rzzgm"]
Jul 29 01:30:00.310075 ip-10-0-138-146 kubenswrapper[2577]: W0729 01:30:00.310032    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1488dc33_33bc_401e_a7f6_17fd3075d1e2.slice/crio-07f830b5968a2ad3b174c5654f0ca340c07373bdaedb4dc765421e0ec45f1e5b WatchSource:0}: Error finding container 07f830b5968a2ad3b174c5654f0ca340c07373bdaedb4dc765421e0ec45f1e5b: Status 404 returned error can't find the container with id 07f830b5968a2ad3b174c5654f0ca340c07373bdaedb4dc765421e0ec45f1e5b
Jul 29 01:30:00.341422 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:00.341396    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754810-qhqfc"]
Jul 29 01:30:00.345736 ip-10-0-138-146 kubenswrapper[2577]: W0729 01:30:00.345711    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79e03c89_e249_45b4_9b03_eb1edc8658aa.slice/crio-28153d87ac42768ac5bfd2ce4650a5f274916346442fda5d2281a878876fb032 WatchSource:0}: Error finding container 28153d87ac42768ac5bfd2ce4650a5f274916346442fda5d2281a878876fb032: Status 404 returned error can't find the container with id 28153d87ac42768ac5bfd2ce4650a5f274916346442fda5d2281a878876fb032
Jul 29 01:30:01.315034 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:01.314996    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754810-qhqfc" event={"ID":"79e03c89-e249-45b4-9b03-eb1edc8658aa","Type":"ContainerStarted","Data":"a451c79be0fb80aa04e9b900c9ec31afd00a6c306e621c56205a95a491d7ca73"}
Jul 29 01:30:01.315493 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:01.315059    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754810-qhqfc" event={"ID":"79e03c89-e249-45b4-9b03-eb1edc8658aa","Type":"ContainerStarted","Data":"28153d87ac42768ac5bfd2ce4650a5f274916346442fda5d2281a878876fb032"}
Jul 29 01:30:01.316732 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:01.316702    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-7c9ee4-29754810-rzzgm" event={"ID":"1488dc33-33bc-401e-a7f6-17fd3075d1e2","Type":"ContainerStarted","Data":"4f93e5149fcdfd4a6cf828d6a4f2731f5485ee59b42db3f0831392e43df03f0d"}
Jul 29 01:30:01.316858 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:01.316746    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-7c9ee4-29754810-rzzgm" event={"ID":"1488dc33-33bc-401e-a7f6-17fd3075d1e2","Type":"ContainerStarted","Data":"07f830b5968a2ad3b174c5654f0ca340c07373bdaedb4dc765421e0ec45f1e5b"}
Jul 29 01:30:01.330785 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:01.330733    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754810-qhqfc" podStartSLOduration=1.330713104 podStartE2EDuration="1.330713104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:30:01.328074144 +0000 UTC m=+3227.472531713" watchObservedRunningTime="2026-07-29 01:30:01.330713104 +0000 UTC m=+3227.475170713"
Jul 29 01:30:01.344217 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:01.344157    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-7c9ee4-29754810-rzzgm" podStartSLOduration=1.344124245 podStartE2EDuration="1.344124245s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:30:01.343781146 +0000 UTC m=+3227.488238717" watchObservedRunningTime="2026-07-29 01:30:01.344124245 +0000 UTC m=+3227.488581815"
Jul 29 01:30:02.324220 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:02.324186    2577 generic.go:356] "Generic (PLEG): container finished" podID="79e03c89-e249-45b4-9b03-eb1edc8658aa" containerID="a451c79be0fb80aa04e9b900c9ec31afd00a6c306e621c56205a95a491d7ca73" exitCode=0
Jul 29 01:30:02.324724 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:02.324276    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754810-qhqfc" event={"ID":"79e03c89-e249-45b4-9b03-eb1edc8658aa","Type":"ContainerDied","Data":"a451c79be0fb80aa04e9b900c9ec31afd00a6c306e621c56205a95a491d7ca73"}
Jul 29 01:30:02.326033 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:02.326007    2577 generic.go:356] "Generic (PLEG): container finished" podID="1488dc33-33bc-401e-a7f6-17fd3075d1e2" containerID="4f93e5149fcdfd4a6cf828d6a4f2731f5485ee59b42db3f0831392e43df03f0d" exitCode=0
Jul 29 01:30:02.326155 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:02.326086    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-7c9ee4-29754810-rzzgm" event={"ID":"1488dc33-33bc-401e-a7f6-17fd3075d1e2","Type":"ContainerDied","Data":"4f93e5149fcdfd4a6cf828d6a4f2731f5485ee59b42db3f0831392e43df03f0d"}
Jul 29 01:30:03.486816 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:03.486786    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754810-qhqfc"
Jul 29 01:30:03.489827 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:03.489801    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-7c9ee4-29754810-rzzgm"
Jul 29 01:30:04.337902 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:04.337875    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-7c9ee4-29754810-rzzgm"
Jul 29 01:30:04.338097 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:04.337908    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-7c9ee4-29754810-rzzgm" event={"ID":"1488dc33-33bc-401e-a7f6-17fd3075d1e2","Type":"ContainerDied","Data":"07f830b5968a2ad3b174c5654f0ca340c07373bdaedb4dc765421e0ec45f1e5b"}
Jul 29 01:30:04.338097 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:04.337957    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="07f830b5968a2ad3b174c5654f0ca340c07373bdaedb4dc765421e0ec45f1e5b"
Jul 29 01:30:04.339245 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:04.339222    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754810-qhqfc" event={"ID":"79e03c89-e249-45b4-9b03-eb1edc8658aa","Type":"ContainerDied","Data":"28153d87ac42768ac5bfd2ce4650a5f274916346442fda5d2281a878876fb032"}
Jul 29 01:30:04.339245 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:04.339243    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754810-qhqfc"
Jul 29 01:30:04.339385 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:04.339264    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="28153d87ac42768ac5bfd2ce4650a5f274916346442fda5d2281a878876fb032"
Jul 29 01:30:10.180140 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:10.180063    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"]
Jul 29 01:30:10.180540 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:10.180297    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2" podUID="087e9740-bd95-4095-ab53-8548296895a7" containerName="istio-proxy" containerID="cri-o://018e81088a64152cf055515a053d320c77eedd20b324f1b52e98f7f92f5283e3" gracePeriod=30
Jul 29 01:30:15.394284 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:15.394247    2577 generic.go:356] "Generic (PLEG): container finished" podID="087e9740-bd95-4095-ab53-8548296895a7" containerID="018e81088a64152cf055515a053d320c77eedd20b324f1b52e98f7f92f5283e3" exitCode=0
Jul 29 01:30:15.394729 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:15.394319    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2" event={"ID":"087e9740-bd95-4095-ab53-8548296895a7","Type":"ContainerDied","Data":"018e81088a64152cf055515a053d320c77eedd20b324f1b52e98f7f92f5283e3"}
Jul 29 01:30:15.394729 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:15.394381    2577 scope.go:117] "RemoveContainer" containerID="8bec86391792b749ee807c7846ff4ea7ecf2583d500bae0f0215f9e9ffa4264d"
Jul 29 01:30:15.441874 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:15.441849    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"
Jul 29 01:30:15.550188 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:15.550098    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/087e9740-bd95-4095-ab53-8548296895a7-workload-socket\") pod \"087e9740-bd95-4095-ab53-8548296895a7\" (UID: \"087e9740-bd95-4095-ab53-8548296895a7\") "
Jul 29 01:30:15.550188 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:15.550146    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/087e9740-bd95-4095-ab53-8548296895a7-istio-envoy\") pod \"087e9740-bd95-4095-ab53-8548296895a7\" (UID: \"087e9740-bd95-4095-ab53-8548296895a7\") "
Jul 29 01:30:15.550188 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:15.550168    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4xfh\" (UniqueName: \"kubernetes.io/projected/087e9740-bd95-4095-ab53-8548296895a7-kube-api-access-q4xfh\") pod \"087e9740-bd95-4095-ab53-8548296895a7\" (UID: \"087e9740-bd95-4095-ab53-8548296895a7\") "
Jul 29 01:30:15.550464 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:15.550197    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/087e9740-bd95-4095-ab53-8548296895a7-credential-socket\") pod \"087e9740-bd95-4095-ab53-8548296895a7\" (UID: \"087e9740-bd95-4095-ab53-8548296895a7\") "
Jul 29 01:30:15.550464 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:15.550222    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/087e9740-bd95-4095-ab53-8548296895a7-istio-data\") pod \"087e9740-bd95-4095-ab53-8548296895a7\" (UID: \"087e9740-bd95-4095-ab53-8548296895a7\") "
Jul 29 01:30:15.550464 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:15.550238    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/087e9740-bd95-4095-ab53-8548296895a7-istio-podinfo\") pod \"087e9740-bd95-4095-ab53-8548296895a7\" (UID: \"087e9740-bd95-4095-ab53-8548296895a7\") "
Jul 29 01:30:15.550464 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:15.550255    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/087e9740-bd95-4095-ab53-8548296895a7-istio-token\") pod \"087e9740-bd95-4095-ab53-8548296895a7\" (UID: \"087e9740-bd95-4095-ab53-8548296895a7\") "
Jul 29 01:30:15.550464 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:15.550342    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/087e9740-bd95-4095-ab53-8548296895a7-workload-certs\") pod \"087e9740-bd95-4095-ab53-8548296895a7\" (UID: \"087e9740-bd95-4095-ab53-8548296895a7\") "
Jul 29 01:30:15.550464 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:15.550386    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/087e9740-bd95-4095-ab53-8548296895a7-istiod-ca-cert\") pod \"087e9740-bd95-4095-ab53-8548296895a7\" (UID: \"087e9740-bd95-4095-ab53-8548296895a7\") "
Jul 29 01:30:15.550999 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:15.550469    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/087e9740-bd95-4095-ab53-8548296895a7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "087e9740-bd95-4095-ab53-8548296895a7" (UID: "087e9740-bd95-4095-ab53-8548296895a7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:30:15.550999 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:15.550612    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/087e9740-bd95-4095-ab53-8548296895a7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "087e9740-bd95-4095-ab53-8548296895a7" (UID: "087e9740-bd95-4095-ab53-8548296895a7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:30:15.550999 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:15.550784    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/087e9740-bd95-4095-ab53-8548296895a7-workload-socket\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:30:15.550999 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:15.550804    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/087e9740-bd95-4095-ab53-8548296895a7-credential-socket\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:30:15.550999 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:15.550839    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/087e9740-bd95-4095-ab53-8548296895a7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "087e9740-bd95-4095-ab53-8548296895a7" (UID: "087e9740-bd95-4095-ab53-8548296895a7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:30:15.550999 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:15.550843    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/087e9740-bd95-4095-ab53-8548296895a7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "087e9740-bd95-4095-ab53-8548296895a7" (UID: "087e9740-bd95-4095-ab53-8548296895a7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:30:15.551319 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:15.551234    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/087e9740-bd95-4095-ab53-8548296895a7-istio-data" (OuterVolumeSpecName: "istio-data") pod "087e9740-bd95-4095-ab53-8548296895a7" (UID: "087e9740-bd95-4095-ab53-8548296895a7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:30:15.552501 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:15.552469    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/087e9740-bd95-4095-ab53-8548296895a7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "087e9740-bd95-4095-ab53-8548296895a7" (UID: "087e9740-bd95-4095-ab53-8548296895a7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 01:30:15.552706 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:15.552687    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/087e9740-bd95-4095-ab53-8548296895a7-kube-api-access-q4xfh" (OuterVolumeSpecName: "kube-api-access-q4xfh") pod "087e9740-bd95-4095-ab53-8548296895a7" (UID: "087e9740-bd95-4095-ab53-8548296895a7"). InnerVolumeSpecName "kube-api-access-q4xfh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:30:15.552826 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:15.552785    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/087e9740-bd95-4095-ab53-8548296895a7-istio-token" (OuterVolumeSpecName: "istio-token") pod "087e9740-bd95-4095-ab53-8548296895a7" (UID: "087e9740-bd95-4095-ab53-8548296895a7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:30:15.552910 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:15.552845    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/087e9740-bd95-4095-ab53-8548296895a7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "087e9740-bd95-4095-ab53-8548296895a7" (UID: "087e9740-bd95-4095-ab53-8548296895a7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:30:15.651960 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:15.651927    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/087e9740-bd95-4095-ab53-8548296895a7-istiod-ca-cert\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:30:15.651960 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:15.651956    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/087e9740-bd95-4095-ab53-8548296895a7-istio-envoy\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:30:15.651960 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:15.651965    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4xfh\" (UniqueName: \"kubernetes.io/projected/087e9740-bd95-4095-ab53-8548296895a7-kube-api-access-q4xfh\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:30:15.652196 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:15.651975    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/087e9740-bd95-4095-ab53-8548296895a7-istio-data\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:30:15.652196 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:15.651984    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/087e9740-bd95-4095-ab53-8548296895a7-istio-podinfo\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:30:15.652196 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:15.651992    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/087e9740-bd95-4095-ab53-8548296895a7-istio-token\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:30:15.652196 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:15.652000    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/087e9740-bd95-4095-ab53-8548296895a7-workload-certs\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:30:16.400659 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:16.400624    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2" event={"ID":"087e9740-bd95-4095-ab53-8548296895a7","Type":"ContainerDied","Data":"f5874843014989bd717521f9282de06e6bd1ccf93afbc5cb693d4bb1b91cc8d2"}
Jul 29 01:30:16.401065 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:16.400689    2577 scope.go:117] "RemoveContainer" containerID="018e81088a64152cf055515a053d320c77eedd20b324f1b52e98f7f92f5283e3"
Jul 29 01:30:16.401065 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:16.400643    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"
Jul 29 01:30:16.418638 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:16.418612    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"]
Jul 29 01:30:16.421106 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:16.421082    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-e81b9d-openshift-default-859f47bd4d-8c7f2"]
Jul 29 01:30:18.304349 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:18.304319    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="087e9740-bd95-4095-ab53-8548296895a7" path="/var/lib/kubelet/pods/087e9740-bd95-4095-ab53-8548296895a7/volumes"
Jul 29 01:30:21.078442 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:21.078403    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-7c9ee4-29754810-rzzgm"]
Jul 29 01:30:21.081941 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:21.081912    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-7c9ee4-29754810-rzzgm"]
Jul 29 01:30:22.303993 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:22.303949    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1488dc33-33bc-401e-a7f6-17fd3075d1e2" path="/var/lib/kubelet/pods/1488dc33-33bc-401e-a7f6-17fd3075d1e2/volumes"
Jul 29 01:30:24.214339 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:24.214296    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:30:28.100366 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:28.100332    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ebcf3a-lmtcc"]
Jul 29 01:30:28.100780 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:28.100739    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79e03c89-e249-45b4-9b03-eb1edc8658aa" containerName="cleanup"
Jul 29 01:30:28.100780 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:28.100751    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="79e03c89-e249-45b4-9b03-eb1edc8658aa" containerName="cleanup"
Jul 29 01:30:28.100780 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:28.100768    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="087e9740-bd95-4095-ab53-8548296895a7" containerName="istio-proxy"
Jul 29 01:30:28.100780 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:28.100774    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="087e9740-bd95-4095-ab53-8548296895a7" containerName="istio-proxy"
Jul 29 01:30:28.100780 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:28.100782    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="087e9740-bd95-4095-ab53-8548296895a7" containerName="istio-proxy"
Jul 29 01:30:28.100947 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:28.100788    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="087e9740-bd95-4095-ab53-8548296895a7" containerName="istio-proxy"
Jul 29 01:30:28.100947 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:28.100810    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1488dc33-33bc-401e-a7f6-17fd3075d1e2" containerName="cleanup"
Jul 29 01:30:28.100947 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:28.100816    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1488dc33-33bc-401e-a7f6-17fd3075d1e2" containerName="cleanup"
Jul 29 01:30:28.100947 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:28.100875    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="087e9740-bd95-4095-ab53-8548296895a7" containerName="istio-proxy"
Jul 29 01:30:28.100947 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:28.100888    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1488dc33-33bc-401e-a7f6-17fd3075d1e2" containerName="cleanup"
Jul 29 01:30:28.100947 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:28.100897    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="79e03c89-e249-45b4-9b03-eb1edc8658aa" containerName="cleanup"
Jul 29 01:30:28.103896 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:28.103878    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ebcf3a-lmtcc"
Jul 29 01:30:28.105998 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:28.105976    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 01:30:28.106115 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:28.106043    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4nzwm\""
Jul 29 01:30:28.110035 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:28.109997    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ebcf3a-lmtcc"]
Jul 29 01:30:28.171997 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:28.171961    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b013d96-2713-4112-8f7a-c81657e5899c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-ebcf3a-lmtcc\" (UID: \"6b013d96-2713-4112-8f7a-c81657e5899c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ebcf3a-lmtcc"
Jul 29 01:30:28.272876 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:28.272834    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b013d96-2713-4112-8f7a-c81657e5899c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-ebcf3a-lmtcc\" (UID: \"6b013d96-2713-4112-8f7a-c81657e5899c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ebcf3a-lmtcc"
Jul 29 01:30:28.273530 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:28.273508    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b013d96-2713-4112-8f7a-c81657e5899c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-ebcf3a-lmtcc\" (UID: \"6b013d96-2713-4112-8f7a-c81657e5899c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ebcf3a-lmtcc"
Jul 29 01:30:28.415051 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:28.414956    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ebcf3a-lmtcc"
Jul 29 01:30:28.547117 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:28.547088    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ebcf3a-lmtcc"]
Jul 29 01:30:28.549778 ip-10-0-138-146 kubenswrapper[2577]: W0729 01:30:28.549754    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b013d96_2713_4112_8f7a_c81657e5899c.slice/crio-6316f8804d3e3d673382b244408f923b7d1ebde876f2b1b58398eedfa03c975d WatchSource:0}: Error finding container 6316f8804d3e3d673382b244408f923b7d1ebde876f2b1b58398eedfa03c975d: Status 404 returned error can't find the container with id 6316f8804d3e3d673382b244408f923b7d1ebde876f2b1b58398eedfa03c975d
Jul 29 01:30:29.471267 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:29.471227    2577 generic.go:356] "Generic (PLEG): container finished" podID="6b013d96-2713-4112-8f7a-c81657e5899c" containerID="9f661213ef653decca5286d20269ed6a82a58681c8f6c3c6dcf3b2c358afc874" exitCode=0
Jul 29 01:30:29.471689 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:29.471321    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ebcf3a-lmtcc" event={"ID":"6b013d96-2713-4112-8f7a-c81657e5899c","Type":"ContainerDied","Data":"9f661213ef653decca5286d20269ed6a82a58681c8f6c3c6dcf3b2c358afc874"}
Jul 29 01:30:29.471689 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:29.471374    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ebcf3a-lmtcc" event={"ID":"6b013d96-2713-4112-8f7a-c81657e5899c","Type":"ContainerStarted","Data":"6316f8804d3e3d673382b244408f923b7d1ebde876f2b1b58398eedfa03c975d"}
Jul 29 01:30:30.608525 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:30.608501    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ebcf3a-lmtcc"
Jul 29 01:30:30.695332 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:30.695300    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b013d96-2713-4112-8f7a-c81657e5899c-maas-api-service-ca\") pod \"6b013d96-2713-4112-8f7a-c81657e5899c\" (UID: \"6b013d96-2713-4112-8f7a-c81657e5899c\") "
Jul 29 01:30:30.695739 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:30.695720    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b013d96-2713-4112-8f7a-c81657e5899c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6b013d96-2713-4112-8f7a-c81657e5899c" (UID: "6b013d96-2713-4112-8f7a-c81657e5899c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:30:30.797136 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:30.797055    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b013d96-2713-4112-8f7a-c81657e5899c-maas-api-service-ca\") on node \"ip-10-0-138-146.ec2.internal\" DevicePath \"\""
Jul 29 01:30:31.483426 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:31.483398    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ebcf3a-lmtcc"
Jul 29 01:30:31.483633 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:31.483395    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ebcf3a-lmtcc" event={"ID":"6b013d96-2713-4112-8f7a-c81657e5899c","Type":"ContainerDied","Data":"6316f8804d3e3d673382b244408f923b7d1ebde876f2b1b58398eedfa03c975d"}
Jul 29 01:30:31.483633 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:31.483520    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6316f8804d3e3d673382b244408f923b7d1ebde876f2b1b58398eedfa03c975d"
Jul 29 01:30:38.644806 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:38.644771    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ebcf3a-lmtcc"]
Jul 29 01:30:38.651189 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:38.651161    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ebcf3a-lmtcc"]
Jul 29 01:30:40.303834 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:40.303787    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b013d96-2713-4112-8f7a-c81657e5899c" path="/var/lib/kubelet/pods/6b013d96-2713-4112-8f7a-c81657e5899c/volumes"
Jul 29 01:30:41.610669 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:41.610634    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:30:59.216934 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:30:59.216897    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hw2xr"]
Jul 29 01:31:03.506497 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:03.506454    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-b9f6bb998-rxg65_bfdb191d-a481-4300-bdd2-fefdee160b67/authorino/0.log"
Jul 29 01:31:09.606651 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:09.606620    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8_43dc1497-b349-42f0-9571-9ad4e2e12b75/copy-manifests/0.log"
Jul 29 01:31:09.622228 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:09.622198    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8_43dc1497-b349-42f0-9571-9ad4e2e12b75/manager/0.log"
Jul 29 01:31:10.468792 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:10.468761    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29754810-qhqfc_79e03c89-e249-45b4-9b03-eb1edc8658aa/cleanup/0.log"
Jul 29 01:31:11.903458 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:11.903433    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-b9f6bb998-rxg65_bfdb191d-a481-4300-bdd2-fefdee160b67/authorino/0.log"
Jul 29 01:31:12.262119 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:12.262039    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-vgb6g_bfe92e94-9165-46c0-b80e-0a6e88a3b493/kuadrant-console-plugin/0.log"
Jul 29 01:31:12.623902 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:12.623870    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-hw2xr_bdd22a18-a108-4e14-ac35-7dc2a03107cc/limitador/0.log"
Jul 29 01:31:13.114916 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:13.114890    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8_e518a241-e1d6-4dcd-94cd-8fa60ae3e311/istio-proxy/0.log"
Jul 29 01:31:13.336005 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:13.335974    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75d55f5564-8xsr5_de7d69f3-462e-4662-9b91-fb826c4d16b3/kube-auth-proxy/0.log"
Jul 29 01:31:14.514967 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:14.514937    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tfr5v_ac322954-06d1-4807-8a8b-59e62befe6bc/ovn-acl-logging/0.log"
Jul 29 01:31:14.522462 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:14.522440    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tfr5v_ac322954-06d1-4807-8a8b-59e62befe6bc/ovn-acl-logging/0.log"
Jul 29 01:31:14.694299 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:14.694266    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-nkvlk_d4c2d705-3b1e-4b05-8792-7afc8364ab61/main/0.log"
Jul 29 01:31:14.812432 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:14.812357    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-ztg42_2d08ab07-cb1e-4980-a2a0-f37ec60fc2f0/main/0.log"
Jul 29 01:31:23.208389 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:23.208359    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jswzt_5133632e-a2ef-4d96-a84e-296378c156bc/global-pull-secret-syncer/0.log"
Jul 29 01:31:23.325854 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:23.325824    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-khbnj_3d340227-bc79-4097-9f96-1c6e28099b20/konnectivity-agent/0.log"
Jul 29 01:31:23.417254 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:23.417225    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-146.ec2.internal_7de2163f97d96577b1944d1e86114197/haproxy/0.log"
Jul 29 01:31:28.568077 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:28.568042    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-b9f6bb998-rxg65_bfdb191d-a481-4300-bdd2-fefdee160b67/authorino/0.log"
Jul 29 01:31:28.650743 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:28.650662    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-vgb6g_bfe92e94-9165-46c0-b80e-0a6e88a3b493/kuadrant-console-plugin/0.log"
Jul 29 01:31:28.916147 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:28.916067    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-hw2xr_bdd22a18-a108-4e14-ac35-7dc2a03107cc/limitador/0.log"
Jul 29 01:31:31.075219 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:31.075181    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-c6clq_62bcf3a9-3e52-4311-95d4-00ab9b46bd7a/kube-state-metrics/0.log"
Jul 29 01:31:31.095317 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:31.095292    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-c6clq_62bcf3a9-3e52-4311-95d4-00ab9b46bd7a/kube-rbac-proxy-main/0.log"
Jul 29 01:31:31.125049 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:31.124961    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-c6clq_62bcf3a9-3e52-4311-95d4-00ab9b46bd7a/kube-rbac-proxy-self/0.log"
Jul 29 01:31:31.153901 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:31.153859    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-777f6d779c-fb68s_3990fbdb-f010-4c3f-ab69-6652117b1a0b/metrics-server/0.log"
Jul 29 01:31:31.209383 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:31.209357    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8sgwr_8f058002-0a06-4a4b-8aa7-07ab94de01fe/node-exporter/0.log"
Jul 29 01:31:31.229920 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:31.229892    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8sgwr_8f058002-0a06-4a4b-8aa7-07ab94de01fe/kube-rbac-proxy/0.log"
Jul 29 01:31:31.252363 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:31.252337    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8sgwr_8f058002-0a06-4a4b-8aa7-07ab94de01fe/init-textfile/0.log"
Jul 29 01:31:31.453358 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:31.453271    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-w84pc_520b4f0a-2788-4913-93a6-72d7a4c0cc1f/kube-rbac-proxy-main/0.log"
Jul 29 01:31:31.477534 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:31.477475    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-w84pc_520b4f0a-2788-4913-93a6-72d7a4c0cc1f/kube-rbac-proxy-self/0.log"
Jul 29 01:31:31.498100 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:31.498074    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-w84pc_520b4f0a-2788-4913-93a6-72d7a4c0cc1f/openshift-state-metrics/0.log"
Jul 29 01:31:31.531735 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:31.531709    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_282ce192-1408-4581-b4f6-30f8395e0380/prometheus/0.log"
Jul 29 01:31:31.552335 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:31.552310    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_282ce192-1408-4581-b4f6-30f8395e0380/config-reloader/0.log"
Jul 29 01:31:31.576788 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:31.576763    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_282ce192-1408-4581-b4f6-30f8395e0380/thanos-sidecar/0.log"
Jul 29 01:31:31.598150 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:31.598127    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_282ce192-1408-4581-b4f6-30f8395e0380/kube-rbac-proxy-web/0.log"
Jul 29 01:31:31.624728 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:31.624705    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_282ce192-1408-4581-b4f6-30f8395e0380/kube-rbac-proxy/0.log"
Jul 29 01:31:31.647355 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:31.647327    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_282ce192-1408-4581-b4f6-30f8395e0380/kube-rbac-proxy-thanos/0.log"
Jul 29 01:31:31.671724 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:31.671697    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_282ce192-1408-4581-b4f6-30f8395e0380/init-config-reloader/0.log"
Jul 29 01:31:31.782852 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:31.782779    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6cfc47b79f-p9lpp_a194f138-170d-4c72-8129-186c5c8945ef/telemeter-client/0.log"
Jul 29 01:31:31.813486 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:31.813458    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6cfc47b79f-p9lpp_a194f138-170d-4c72-8129-186c5c8945ef/reload/0.log"
Jul 29 01:31:31.835970 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:31.835941    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6cfc47b79f-p9lpp_a194f138-170d-4c72-8129-186c5c8945ef/kube-rbac-proxy/0.log"
Jul 29 01:31:31.867145 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:31.867115    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5455cb9c97-tflgb_aec01d64-fe91-47d0-b4d6-acfb46d51202/thanos-query/0.log"
Jul 29 01:31:31.886653 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:31.886604    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5455cb9c97-tflgb_aec01d64-fe91-47d0-b4d6-acfb46d51202/kube-rbac-proxy-web/0.log"
Jul 29 01:31:31.906375 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:31.906350    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5455cb9c97-tflgb_aec01d64-fe91-47d0-b4d6-acfb46d51202/kube-rbac-proxy/0.log"
Jul 29 01:31:31.925910 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:31.925886    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5455cb9c97-tflgb_aec01d64-fe91-47d0-b4d6-acfb46d51202/prom-label-proxy/0.log"
Jul 29 01:31:31.949746 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:31.949722    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5455cb9c97-tflgb_aec01d64-fe91-47d0-b4d6-acfb46d51202/kube-rbac-proxy-rules/0.log"
Jul 29 01:31:31.970421 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:31.970398    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5455cb9c97-tflgb_aec01d64-fe91-47d0-b4d6-acfb46d51202/kube-rbac-proxy-metrics/0.log"
Jul 29 01:31:33.589842 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:33.589810    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-99rkt/perf-node-gather-daemonset-xgk2n"]
Jul 29 01:31:33.590205 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:33.590149    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b013d96-2713-4112-8f7a-c81657e5899c" containerName="revoke-keys"
Jul 29 01:31:33.590205 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:33.590160    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b013d96-2713-4112-8f7a-c81657e5899c" containerName="revoke-keys"
Jul 29 01:31:33.590294 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:33.590218    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b013d96-2713-4112-8f7a-c81657e5899c" containerName="revoke-keys"
Jul 29 01:31:33.590294 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:33.590228    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="087e9740-bd95-4095-ab53-8548296895a7" containerName="istio-proxy"
Jul 29 01:31:33.593461 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:33.593444    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-99rkt/perf-node-gather-daemonset-xgk2n"
Jul 29 01:31:33.595850 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:33.595833    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-99rkt\"/\"kube-root-ca.crt\""
Jul 29 01:31:33.595984 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:33.595939    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-99rkt\"/\"openshift-service-ca.crt\""
Jul 29 01:31:33.596499 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:33.596486    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-99rkt\"/\"default-dockercfg-fls7h\""
Jul 29 01:31:33.603641 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:33.603617    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-99rkt/perf-node-gather-daemonset-xgk2n"]
Jul 29 01:31:33.681448 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:33.681414    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/413f63ef-284a-4723-9362-c0c3ac65cb5b-lib-modules\") pod \"perf-node-gather-daemonset-xgk2n\" (UID: \"413f63ef-284a-4723-9362-c0c3ac65cb5b\") " pod="openshift-must-gather-99rkt/perf-node-gather-daemonset-xgk2n"
Jul 29 01:31:33.681448 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:33.681448    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/413f63ef-284a-4723-9362-c0c3ac65cb5b-podres\") pod \"perf-node-gather-daemonset-xgk2n\" (UID: \"413f63ef-284a-4723-9362-c0c3ac65cb5b\") " pod="openshift-must-gather-99rkt/perf-node-gather-daemonset-xgk2n"
Jul 29 01:31:33.681678 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:33.681491    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl6nt\" (UniqueName: \"kubernetes.io/projected/413f63ef-284a-4723-9362-c0c3ac65cb5b-kube-api-access-dl6nt\") pod \"perf-node-gather-daemonset-xgk2n\" (UID: \"413f63ef-284a-4723-9362-c0c3ac65cb5b\") " pod="openshift-must-gather-99rkt/perf-node-gather-daemonset-xgk2n"
Jul 29 01:31:33.681678 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:33.681549    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/413f63ef-284a-4723-9362-c0c3ac65cb5b-sys\") pod \"perf-node-gather-daemonset-xgk2n\" (UID: \"413f63ef-284a-4723-9362-c0c3ac65cb5b\") " pod="openshift-must-gather-99rkt/perf-node-gather-daemonset-xgk2n"
Jul 29 01:31:33.681678 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:33.681616    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/413f63ef-284a-4723-9362-c0c3ac65cb5b-proc\") pod \"perf-node-gather-daemonset-xgk2n\" (UID: \"413f63ef-284a-4723-9362-c0c3ac65cb5b\") " pod="openshift-must-gather-99rkt/perf-node-gather-daemonset-xgk2n"
Jul 29 01:31:33.782520 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:33.782485    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/413f63ef-284a-4723-9362-c0c3ac65cb5b-lib-modules\") pod \"perf-node-gather-daemonset-xgk2n\" (UID: \"413f63ef-284a-4723-9362-c0c3ac65cb5b\") " pod="openshift-must-gather-99rkt/perf-node-gather-daemonset-xgk2n"
Jul 29 01:31:33.782520 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:33.782524    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/413f63ef-284a-4723-9362-c0c3ac65cb5b-podres\") pod \"perf-node-gather-daemonset-xgk2n\" (UID: \"413f63ef-284a-4723-9362-c0c3ac65cb5b\") " pod="openshift-must-gather-99rkt/perf-node-gather-daemonset-xgk2n"
Jul 29 01:31:33.782784 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:33.782622    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl6nt\" (UniqueName: \"kubernetes.io/projected/413f63ef-284a-4723-9362-c0c3ac65cb5b-kube-api-access-dl6nt\") pod \"perf-node-gather-daemonset-xgk2n\" (UID: \"413f63ef-284a-4723-9362-c0c3ac65cb5b\") " pod="openshift-must-gather-99rkt/perf-node-gather-daemonset-xgk2n"
Jul 29 01:31:33.782784 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:33.782655    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/413f63ef-284a-4723-9362-c0c3ac65cb5b-sys\") pod \"perf-node-gather-daemonset-xgk2n\" (UID: \"413f63ef-284a-4723-9362-c0c3ac65cb5b\") " pod="openshift-must-gather-99rkt/perf-node-gather-daemonset-xgk2n"
Jul 29 01:31:33.782784 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:33.782687    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/413f63ef-284a-4723-9362-c0c3ac65cb5b-proc\") pod \"perf-node-gather-daemonset-xgk2n\" (UID: \"413f63ef-284a-4723-9362-c0c3ac65cb5b\") " pod="openshift-must-gather-99rkt/perf-node-gather-daemonset-xgk2n"
Jul 29 01:31:33.782784 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:33.782712    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/413f63ef-284a-4723-9362-c0c3ac65cb5b-lib-modules\") pod \"perf-node-gather-daemonset-xgk2n\" (UID: \"413f63ef-284a-4723-9362-c0c3ac65cb5b\") " pod="openshift-must-gather-99rkt/perf-node-gather-daemonset-xgk2n"
Jul 29 01:31:33.782784 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:33.782721    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/413f63ef-284a-4723-9362-c0c3ac65cb5b-podres\") pod \"perf-node-gather-daemonset-xgk2n\" (UID: \"413f63ef-284a-4723-9362-c0c3ac65cb5b\") " pod="openshift-must-gather-99rkt/perf-node-gather-daemonset-xgk2n"
Jul 29 01:31:33.782963 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:33.782787    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/413f63ef-284a-4723-9362-c0c3ac65cb5b-proc\") pod \"perf-node-gather-daemonset-xgk2n\" (UID: \"413f63ef-284a-4723-9362-c0c3ac65cb5b\") " pod="openshift-must-gather-99rkt/perf-node-gather-daemonset-xgk2n"
Jul 29 01:31:33.782963 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:33.782832    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/413f63ef-284a-4723-9362-c0c3ac65cb5b-sys\") pod \"perf-node-gather-daemonset-xgk2n\" (UID: \"413f63ef-284a-4723-9362-c0c3ac65cb5b\") " pod="openshift-must-gather-99rkt/perf-node-gather-daemonset-xgk2n"
Jul 29 01:31:33.791568 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:33.791533    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl6nt\" (UniqueName: \"kubernetes.io/projected/413f63ef-284a-4723-9362-c0c3ac65cb5b-kube-api-access-dl6nt\") pod \"perf-node-gather-daemonset-xgk2n\" (UID: \"413f63ef-284a-4723-9362-c0c3ac65cb5b\") " pod="openshift-must-gather-99rkt/perf-node-gather-daemonset-xgk2n"
Jul 29 01:31:33.904599 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:33.904491    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-99rkt/perf-node-gather-daemonset-xgk2n"
Jul 29 01:31:34.037521 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:34.037495    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-99rkt/perf-node-gather-daemonset-xgk2n"]
Jul 29 01:31:34.795495 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:34.795458    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-99rkt/perf-node-gather-daemonset-xgk2n" event={"ID":"413f63ef-284a-4723-9362-c0c3ac65cb5b","Type":"ContainerStarted","Data":"c7a39b9828412d9a8a02f187424e091ceb720fe933f568a87f90bd7a925e546e"}
Jul 29 01:31:34.795945 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:34.795509    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-99rkt/perf-node-gather-daemonset-xgk2n" event={"ID":"413f63ef-284a-4723-9362-c0c3ac65cb5b","Type":"ContainerStarted","Data":"83b493acd07917f5eee2093632a34324768e3025e8d71da3dba6107cab9cbaaf"}
Jul 29 01:31:34.795945 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:34.795652    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-99rkt/perf-node-gather-daemonset-xgk2n"
Jul 29 01:31:34.813418 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:34.813370    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-99rkt/perf-node-gather-daemonset-xgk2n" podStartSLOduration=1.8133547669999999 podStartE2EDuration="1.813354767s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:31:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:31:34.812558642 +0000 UTC m=+3320.957016213" watchObservedRunningTime="2026-07-29 01:31:34.813354767 +0000 UTC m=+3320.957812336"
Jul 29 01:31:35.988542 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:35.988517    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gc7sl_24dc581c-bc96-46b8-961d-580e65035181/dns/0.log"
Jul 29 01:31:36.013309 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:36.013280    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gc7sl_24dc581c-bc96-46b8-961d-580e65035181/kube-rbac-proxy/0.log"
Jul 29 01:31:36.138630 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:36.138533    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4hcbn_f89cf1a4-a323-4d76-b082-cb93514324fc/dns-node-resolver/0.log"
Jul 29 01:31:36.831260 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:36.831229    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5b664c4c7d-wvn9t_12c07414-162b-46c5-83e4-5964ab05819c/registry/0.log"
Jul 29 01:31:36.875128 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:36.875092    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7w5v9_7f95557b-6c39-4b63-9d6c-2cdbd68e8eb2/node-ca/0.log"
Jul 29 01:31:37.776104 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:37.776069    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8_e518a241-e1d6-4dcd-94cd-8fa60ae3e311/istio-proxy/0.log"
Jul 29 01:31:37.986236 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:37.986208    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75d55f5564-8xsr5_de7d69f3-462e-4662-9b91-fb826c4d16b3/kube-auth-proxy/0.log"
Jul 29 01:31:39.025372 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:39.025349    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-88lcv_23dd62d1-ab12-4d69-8e45-183f23fb5ff1/serve-healthcheck-canary/0.log"
Jul 29 01:31:39.572937 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:39.572911    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-knqll_0cc6fd7f-032b-4ab6-a8ca-b329395a8db5/kube-rbac-proxy/0.log"
Jul 29 01:31:39.590778 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:39.590757    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-knqll_0cc6fd7f-032b-4ab6-a8ca-b329395a8db5/exporter/0.log"
Jul 29 01:31:39.611627 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:39.611596    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-knqll_0cc6fd7f-032b-4ab6-a8ca-b329395a8db5/extractor/0.log"
Jul 29 01:31:40.810223 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:40.810197    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-99rkt/perf-node-gather-daemonset-xgk2n"
Jul 29 01:31:42.431719 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:42.431686    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8_43dc1497-b349-42f0-9571-9ad4e2e12b75/manager/0.log"
Jul 29 01:31:42.449658 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:42.449635    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cf6bc8b6f-td8m8_43dc1497-b349-42f0-9571-9ad4e2e12b75/copy-manifests/0.log"
Jul 29 01:31:43.912383 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:43.912352    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-896f4944f-bk8hf_d27609d6-83a3-4c8b-8980-8b7a7795550f/manager/0.log"
Jul 29 01:31:43.936765 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:43.936714    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-d22wz_f3f16949-db6c-42d5-b104-867a758170d4/openshift-lws-operator/0.log"
Jul 29 01:31:44.225702 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:44.225606    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8_e518a241-e1d6-4dcd-94cd-8fa60ae3e311/istio-proxy/0.log"
Jul 29 01:31:44.415697 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:44.415665    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75d55f5564-8xsr5_de7d69f3-462e-4662-9b91-fb826c4d16b3/kube-auth-proxy/0.log"
Jul 29 01:31:45.939377 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:45.939346    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cgg7p8_e518a241-e1d6-4dcd-94cd-8fa60ae3e311/istio-proxy/0.log"
Jul 29 01:31:46.146502 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:46.146474    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75d55f5564-8xsr5_de7d69f3-462e-4662-9b91-fb826c4d16b3/kube-auth-proxy/0.log"
Jul 29 01:31:50.290273 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:50.290243    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5762b_aacee544-c9e9-49a4-be77-072f82640155/kube-multus/0.log"
Jul 29 01:31:50.660275 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:50.660246    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mqkpn_d82ff890-8510-4c13-bf38-a9674ceb80b6/kube-multus-additional-cni-plugins/0.log"
Jul 29 01:31:50.687245 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:50.687220    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mqkpn_d82ff890-8510-4c13-bf38-a9674ceb80b6/egress-router-binary-copy/0.log"
Jul 29 01:31:50.709965 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:50.709940    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mqkpn_d82ff890-8510-4c13-bf38-a9674ceb80b6/cni-plugins/0.log"
Jul 29 01:31:50.729212 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:50.729188    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mqkpn_d82ff890-8510-4c13-bf38-a9674ceb80b6/bond-cni-plugin/0.log"
Jul 29 01:31:50.747758 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:50.747733    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mqkpn_d82ff890-8510-4c13-bf38-a9674ceb80b6/routeoverride-cni/0.log"
Jul 29 01:31:50.766849 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:50.766825    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mqkpn_d82ff890-8510-4c13-bf38-a9674ceb80b6/whereabouts-cni-bincopy/0.log"
Jul 29 01:31:50.785890 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:50.785861    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mqkpn_d82ff890-8510-4c13-bf38-a9674ceb80b6/whereabouts-cni/0.log"
Jul 29 01:31:50.920301 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:50.920212    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tzrn2_068d3131-bf24-4e3f-b450-e518d95238db/network-metrics-daemon/0.log"
Jul 29 01:31:50.942698 ip-10-0-138-146 kubenswrapper[2577]: I0729 01:31:50.942676    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tzrn2_068d3131-bf24-4e3f-b450-e518d95238db/kube-rbac-proxy/0.log"